«Those 10000 classes I never wrote – the power of recursion schemes applied to data engineering», Valentin Kasas

When validating data with Spark, or read/writing it to Kafka topics, the go-to solution is to write a Scala case class and let the compiler generate the code that would coerce incoming data to your business types. But what if you had only 5 developers, 10000+ data structures and only a few months to ship your project?
Let me show you how the power of recursion schemes combined with expressive schemas allowed us to write the code that validates and transforms data from dozens of tables from hundreds of data sources, and ship our project in time and on budget.

Watch Speakers speeches at ScalaUA2018

Leave a Reply

Your email address will not be published. Required fields are marked *