|
You are here |
delta.io | ||
| | | | |
www.dquach.com
|
|
| | | | | [AI summary] An analysis of 2025 agentic AI frameworks and deep-configures on Open Table Format wars, AWS SageMaker Unified Studio, and updates to Apache Iceberg, Hudi, Redshift, and Glue for data engineering. | |
| | | | |
jack-vanlightly.com
|
|
| | | | | In the world of open table formats (Apache Iceberg, Delta Lake, Apache Hudi, Apache Paimon, etc), an emerging trend is to provide interoperability between table formats by cross-publishing metadata. It allows a table to be written in table format X but read in format Y or Z. Cross-publishing is the idea of a table having: * A primary table format that you write to. * Equivalent metadata files of one or more secondary formats that allow the table to be read as if it were of that secondary format. | |
| | | | |
rmoff.net
|
|
| | | | | [AI summary] This article discusses the evolution of data engineering in 2022, focusing on storage and access methods for analytical data, including the transition from traditional data warehouses to modern data lakehouses and open formats. | |
| | | | |
ministryofjustice.github.io
|
|
| | | How we leveraged Amazon Athena, along with the Apache Iceberg table format and the dbt SQL management framework, to build robust, scalable and maintainable ELT (extract, load, transform) pipelines. | ||