/explore

Click through on any links that interest you or select the planets on the right to continue exploring the Outer Web.
You are here

 delta.io
Unifying the open table formats with Delta Lake Universal Format (UniForm) and Apache XTable | Delta Lake
| | www.dquach.com
State of Data Engineering 2025 Q1 - Dan Quach Blog
1.6 parsecs away

Travel
| | [AI summary] An analysis of 2025 agentic AI frameworks and deep-configures on Open Table Format wars, AWS SageMaker Unified Studio, and updates to Apache Iceberg, Hudi, Redshift, and Glue for data engineering.
| | jack-vanlightly.com
Table format interoperability, future or fantasy? - Jack Vanlightly
1.2 parsecs away

Travel
| | In the world of open table formats (Apache Iceberg, Delta Lake, Apache Hudi, Apache Paimon, etc), an emerging trend is to provide interoperability between table formats by cross-publishing metadata. It allows a table to be written in table format X but read in format Y or Z. Cross-publishing is the idea of a table having: * A primary table format that you write to. * Equivalent metadata files of one or more secondary formats that allow the table to be read as if it were of that secondary format.
| | rmoff.net
Data Engineering in 2022: Storage and Access
0.8 parsecs away

Travel
| | [AI summary] This article discusses the evolution of data engineering in 2022, focusing on storage and access methods for analytical data, including the transition from traditional data warehouses to modern data lakehouses and open formats.
| | ministryofjustice.github.io
Building a transaction data lake using Amazon Athena, Apache Iceberg and dbt - Data and Analytics Engineering - Ministry of Justice
7.5 parsecs away

Travel
| How we leveraged Amazon Athena, along with the Apache Iceberg table format and the dbt SQL management framework, to build robust, scalable and maintainable ELT (extract, load, transform) pipelines.