/explore
|
You are here 
|
blog.cleverelephant.ca | ||
| | | | |
aneesh.mataroa.blog
[AI summary] The article discusses the evolution of big data processing technologies from supercomputing to Hadoop MapReduce and finally to Apache Spark, emphasizing the importance of understanding the 'why' behind tools and how they address scalability and efficiency challenges. |
|
| | | | | ||
| | | | |
rmoff.net
[AI summary] This article discusses the evolution of data engineering in 2022, focusing on storage and access methods for analytical data, including the transition from traditional data warehouses to modern data lakehouses and open formats. |
|
| | | | | ||
| | | | |
lakefs.io
A comparison between data lake table formats: Hudi Iceberg and Delta Lake. With advice on how to pick the best one for a particular workload |
|
| | | | | ||
| | | | |
jack-vanlightly.com
In the world of open table formats (Apache Iceberg, Delta Lake, Apache Hudi, Apache Paimon, etc), an emerging trend is to provide interoperability between table formats by cross-publishing metadata. It allows a table to be written in table format X but read in format Y or Z. Cross-publishing is the idea of a table having: * A primary table format that you write to. * Equivalent metadata files of one or more secondary formats that allow the table to be read as if it were of that secondary format. |
|
| | | |||
