|
You are here |
cnr.sh | ||
| | | | |
www.morling.dev
|
|
| | | | | Do you remember Angus "Mac" MacGyver? The always creative protagonist of the popular 80ies/90ies TV show, who could solve about any problem with nothing more than a Swiss Army knife, duct tape, shoe strings and a paper clip? The single message transformations (SMTs) of Kafka Connect are almost as versatile as MacGyver's Swiss Army knife: How to change the timezone or format of date/time message fields? How to change the topic a specific message gets sent to? How to filter out specific records? SMTs can b... | |
| | | | |
neovintage.org
|
|
| | | | | ||
| | | | |
jeff.klukas.net
|
|
| | | | | Originally posted on the Simple engineering blog; also presented at PGConf US 2017 and Ohio LinuxFest 2017 We previously wrote about a pipeline for replicating data from multiple siloed PostgreSQL databases to a data warehouse in Building Analytics at Simple, but we knew that pipeline was only the first step. This post details a rebuilt pipeline that captures a complete history of data-changing operations in near real-time by hooking into PostgreSQL's logical decoding feature. The new pipeline powers not only a higher-fidelity warehouse, but also user-facing features. | |
| | | | |
www.morling.dev
|
|
| | | If you are following the news around Debezium-?an open-source platform for Change Data Capture (CDC) for a variety of databases-?you may have seen the announcement that the project is in the process of moving to the Commonhaus Foundation. I think this is excellent news for the Debezium project, its community, and open-source CDC at large. In this post I'd like to share some more context on why I am so excited about this development. | ||