You are here |
dennyglee.com | ||
| | | |
www.getorchestra.io
|
|
| | | | Discover how Data Engineers are using Apache Iceberg in Snowflake to replace External Tables, thereby truly deocupling compute and storage. Find out more. | |
| | | |
mertkavi.com
|
|
| | | | The article discusses the challenges faced by scalable data teams in managing and processing large amounts of data and proposes a system that includes separating storage, compute, and metadata, using distributed file systems and columnar data formats, real-time data ingestion with CDC tools, and efficient querying through composable components and a joint query/compute engine. | |
| | | |
jack-vanlightly.com
|
|
| | | | In the previous post, I covered append-only tables, a common table type in analytics used often for ingesting data into a data lake or modeling streams between stream processor jobs. I had promised to cover native support for changelog streams, aka change data capture (CDC), but before I do so, I think we should first look at how the table formats support the ingestion of data with row-level operations (insert, update, delete) rather than query-level operations that are commonly used in SQL batch commands. | |
| | | |
www.kai-waehner.de
|
|
| | Blog about architectures, best practices and use cases for data streaming, analytics, hybrid cloud infrastructure, internet of things, crypto, and more |