Explore >> Select a destination
|
You are here 
|
highscalability.com | ||
| | | | |
arpitonline.com
|
|
| | | | | I was recently looking to scaling up an API currently hosted on Heroku.com. While adding dynos to Heroku was an option, I also thought it was a good excuse to get more familiar with Google Cloud Platform (GCP), which I have been curious about for a while and have had some really good conversations on... | |
| | | | |
aneesh.mataroa.blog
|
|
| | | | | [AI summary] The article discusses the evolution of big data processing technologies from supercomputing to Hadoop MapReduce and finally to Apache Spark, emphasizing the importance of understanding the 'why' behind tools and how they address scalability and efficiency challenges. | |
| | | | |
github.com
|
|
| | | | | A curated list of software and architecture related design patterns. - DovAmir/awesome-design-patterns | |
| | | | |
tech.scribd.com
|
|
| | | Streaming data from Apache Kafka into Delta Lake is an integral part of Scribd's data platform, but has been challenging to manage and scale. We use Spark Structured Streaming jobs to read data from Kafka topics and write that data into Delta Lake tables. This approach gets the job done but in production our experience has convinced us that a different approach is necessary to efficiently bring data from Kafka to Delta Lake. To serve this need, we created kafka-delta-ingest. | ||
