Spark 101 - Integration with data sources

In the previous post I showed you how to build basic Spark programs. Building a basic Spark application is the hello world scenario of Spark. Normally you'd use something like a database to feed your algorithm in Spark and output the results of the algorithm somewhere else.

But what can you connect to Spark and where do you leave the outputs of your program?

Spark 101 - Writing your first spark app

Recently I've started exploring Apache Spark as a way to process large amounts of data coming from things like sensors. The kind of things that happen in a typical IoT solution.

One of the things I noticed is that the hello world scenario for Spark looks cool on the website, but in practice there are quite a few things you need to be aware of if you want to use Spark in a real world scenario.