I set up this project to demonstrate how to dockerize a Spring Boot app and deploy, configure and scale it on Kubernetes.

I evaluated ways to deploy an Kubernetes cluster on AWS and settled on kops, since it is well supported by the Kubernetes community and can set up HA clusters.

Dirg is an orchestration tool for docker. It reads a yaml file describing services made of docker container definitions and allows to apply a number of commands to these groups of containers.

I wrote a blog post for Smaato on how to approach stabilizing and tuning a Spark Streaming application:

Spark’s accumulators can be used for much more than just adding up numbers. Spark only ships with int/double accumulators, but you can always create your own by implementing AccumulatorParam. Let’s say we’re processing log files with Spark Streaming and we would like to create a running tally of the most used browsers.