/explore

Click through on any links that interest you or select the planets on the right to continue exploring the Outer Web.
You are here

www.altexsoft.com
| | www.madewithtea.com

This article is about aggregates in stateful stream processing in general. I write about the differences between Apache Spark and Apache Kafka Streams along concrete code examples. Further, I list the requirements which we might like to see covered by a stream processing framework.
1.9 parsecs

Travel
| |
| | aneesh.mataroa.blog

[AI summary] The article discusses the evolution of big data processing technologies from supercomputing to Hadoop MapReduce and finally to Apache Spark, emphasizing the importance of understanding the 'why' behind tools and how they address scalability and efficiency challenges.
1.9 parsecs

Travel
| |
| | timilearning.com

In the first lecture of this series, I wrote about MapReduce as a distributed computation framework. MapReduce partitions the input data across worker nodes, which process data in two stages: map and reduce. While MapReduce was innovative, it was inefficient for iterative and more complex computations. Researchers at UC Berkeley invented Spark to deal with these limitations.
1.9 parsecs

Travel
|