|
You are here |
lucapette.me | ||
| | | | |
www.madewithtea.com
|
|
| | | | | This article is about aggregates in stateful stream processing in general. I write about the differences between Apache Spark and Apache Kafka Streams along concrete code examples. Further, I list the requirements which we might like to see covered by a stream processing framework. | |
| | | | |
www.michael-noll.com
|
|
| | | | | In this article, perhaps the first in a mini-series, I want to explain the concepts of streams and tables in stream processing and, specifically, in Apache K... | |
| | | | |
gist.github.com
|
|
| | | | | The introduction to Reactive Programming you've been missing - introrx.md | |
| | | | |
tech.scribd.com
|
|
| | | Streaming data from Apache Kafka into Delta Lake is an integral part of Scribd's data platform, but has been challenging to manage and scale. We use Spark Structured Streaming jobs to read data from Kafka topics and write that data into Delta Lake tables. This approach gets the job done but in production our experience has convinced us that a different approach is necessary to efficiently bring data from Kafka to Delta Lake. To serve this need, we created kafka-delta-ingest. | ||