/explore

Click through on any links that interest you or select the planets on the right to continue exploring the Outer Web.
You are here

www.altexsoft.com
| | www.madewithtea.com
1.9 parsecs away

Travel
| | This article is about aggregates in stateful stream processing in general. I write about the differences between Apache Spark and Apache Kafka Streams along concrete code examples. Further, I list the requirements which we might like to see covered by a stream processing framework.
| | timilearning.com
1.9 parsecs away

Travel
| | In the first lecture of this series, I wrote about MapReduce as a distributed computation framework. MapReduce partitions the input data across worker nodes, which process data in two stages: map and reduce. While MapReduce was innovative, it was inefficient for iterative and more complex computations. Researchers at UC Berkeley invented Spark to deal with these limitations.
| | aneesh.mataroa.blog
1.9 parsecs away

Travel
| | [AI summary] The article discusses the evolution of big data processing technologies from supercomputing to Hadoop MapReduce and finally to Apache Spark, emphasizing the importance of understanding the 'why' behind tools and how they address scalability and efficiency challenges.
| | delta.io
19.5 parsecs away

Travel
| This post describes the exiting features in the Delta Lake 3.0.0 release