undefined | Better HN

0 pointsxkgt7y ago0 comments

Quite a few out there but the problem is that of fragmentation. There have been too many API changes making following online resources tricky. Having said that, I got great value out of these resources. Make sure you are working on the right version of Spark.

https://jaceklaskowski.gitbooks.io/mastering-apache-spark/ https://pages.databricks.com/definitive-guide-spark.html

Databricks cloud workspace (community edition) offers free interactive spark clusters where you can practice or develop your skills https://community.cloud.databricks.com/

If you want a bit of flexibility, you can launch your own cluster using flinktrock and a pair of free tier t2.micro EC2 instances https://github.com/nchammas/flintrock

0 comments

1 comments · 1 top-level

mywrathacademia7y ago

Had a quick look, its really useful and both of the tutorials seem thorough. Hopefully it can get someone with zero Machine Learning experience up to speed. I noticed Scala but not Java. I read that Spark was written in Java, can I use Java instead of Scala? Since you seem quite far along, can you quickly explain how Spark is used in DeepLearning/Machine Learning? Is it just a virtual machine?

j / k navigate · click thread line to collapse