Explore >> Select a destination


You are here

blog.panoply.io
| | www.zuar.com
5.5 parsecs away

Travel
| | Learn about data ingestion tools and methods, and how it all fits into the modern data stack through ETL/ELT pipelines.
| | www.talend.com
5.2 parsecs away

Travel
| | Data modeling is the process of creating a diagram that represents your data system & defines the structure, attributes, and relationships of your entities.
| | www.starburst.io
3.4 parsecs away

Travel
| | Building data lakes using AWS S3 object storage and deploy Starburst to query and analyze your big data directly where it lives.
| | jack-vanlightly.com
15.0 parsecs away

Travel
| In today's post I want to walk through a fascinating indexing technique for data lakehouses which flips the role of the index in open table formats like Apache Iceberg and Delta Lake. We are going to turn the tables on two key points: 1. Indexes are primarily for reads. Indexes are usually framed as read optimizations paid for by write overhead: they make read queries fast, but inserts and updates slower. That isn't the full story as indexes also support writes such as with faster uniqueness enforcement and reducing lock contention (for example, by avoiding range locks during table scans) but the dominant mental model is that indexing serves reads while writes pay the bill. 2. OTFs don't use tree-based indexes. Open-table format indexes are data-skipping ind...