/explore

Click through on any links that interest you or select the planets on the right to continue exploring the Outer Web.
You are here

www.madewithtea.com
| | tech.scribd.com
3.0 parsecs away

Travel
| | Streaming data from Apache Kafka into Delta Lake is an integral part of Scribd's data platform, but has been challenging to manage and scale. We use Spark Structured Streaming jobs to read data from Kafka topics and write that data into Delta Lake tables. This approach gets the job done but in production our experience has convinced us that a different approach is necessary to efficiently bring data from Kafka to Delta Lake. To serve this need, we created kafka-delta-ingest.
| | jensrantil.github.io
4.1 parsecs away

Travel
| | High-level Apache Kafka architecture.
| | risingwave.com
1.1 parsecs away

Travel
| | A simpler and more efficient approach to streaming.
| | mathscholar.org
16.8 parsecs away

Travel
| [AI summary] The article details how DeepMind's AlphaDev program used AI to discover new sorting algorithms that outperform existing human-derived methods, while discussing broader implications of AI in mathematics and computing.