/explore

Click through on any links that interest you or select the planets on the right to continue exploring the Outer Web.
You are here

 cnr.sh
So, you want to build a Kafka Connector? Source edition. | cnr.sh
| | neovintage.org
rimas silkaitis : From Postgres to Cassandra
5.0 parsecs away

Travel
| |
| | jeff.klukas.net
A Change Data Capture Pipeline From PostgreSQL to Kafka - Jeff Klukas
4.8 parsecs away

Travel
| | Originally posted on the Simple engineering blog; also presented at PGConf US 2017 and Ohio LinuxFest 2017 We previously wrote about a pipeline for replicating data from multiple siloed PostgreSQL databases to a data warehouse in Building Analytics at Simple, but we knew that pipeline was only the first step. This post details a rebuilt pipeline that captures a complete history of data-changing operations in near real-time by hooking into PostgreSQL's logical decoding feature. The new pipeline powers not only a higher-fidelity warehouse, but also user-facing features.
| | www.morling.dev
Single Message Transformations - The Swiss Army Knife of Kafka Connect - Gunnar Morling
4.2 parsecs away

Travel
| | Do you remember Angus "Mac" MacGyver? The always creative protagonist of the popular 80ies/90ies TV show, who could solve about any problem with nothing more than a Swiss Army knife, duct tape, shoe strings and a paper clip? The single message transformations (SMTs) of Kafka Connect are almost as versatile as MacGyver's Swiss Army knife: How to change the timezone or format of date/time message fields? How to change the topic a specific message gets sent to? How to filter out specific records? SMTs can b...
| | justinjaffray.com
What Does Write Skew Look Like?
28.4 parsecs away

Travel
| [AI summary] This technical blog post explains write skew anomalies and how they occur within Snapshot Isolation in databases, providing mathematical proofs and examples to help developers gain intuition about database concurrency control guarantees.