Category: Kafka Connect

15 Things Every Apache Kafka Engineer Should Know About Confluent Replicator

Posted on March 17, 2020 by Tom Scott

Single-cluster deployments of Apache Kafka® are rare. Most medium to large deployments employ more than one Kafka cluster, and even

Sharpening your Stream Processing Skills with Kafka Tutorials

Posted on March 11, 2020 by Rick Spurgeon

In the Apache Kafka® ecosystem, ksqlDB and Kafka Streams are two popular tools for building event streaming applications that are

Using secrets in Kafka Connect configuration

Posted on February 14, 2020 by Jakub Scholz

Kafka Connect is an integration framework that is part of the Apache Kafka project. On Kubernetes and Red Hat OpenShift,

Integrating Elasticsearch and ksqlDB for Powerful Data Enrichment and Analytics

Posted on February 12, 2020 by Sarwar Bhuiyan

Apache Kafka® is often deployed alongside Elasticsearch to perform log exploration, metrics monitoring and alerting, data visualisation, and analytics. It

Seamless SIEM – Part 1: Osquery Event Log Aggregation and Confluent Platform

Posted on February 11, 2020 by Hubert Dulay

Osquery (developed by Facebook) is an open source tool used to gather audit log events from an operating system (OS).

Pipeline to the Cloud – Streaming On-Premises Data for Cloud Analytics

Posted on January 8, 2020 by Robin Moffatt

This article show how you can offload data from on-premises transactional (OLTP) databases to cloud-based datastores, including Snowflake and Amazon

What’s New in Apache Kafka 2.4

Posted on December 16, 2019 by Manikumar Reddy

On behalf of the Apache Kafka® community, it is my pleasure to announce the release of Apache Kafka 2.4.0. This

Transferring Avro Schemas Across Schema Registries with Kafka Connect

Posted on December 9, 2019 by Jordan Moore

Although starting out with one Confluent Schema Registry deployment per development environment is straightforward, over time, a company may scale

4 Steps to Creating Apache Kafka Connectors with the Kafka Connect API

Posted on October 23, 2019 by Tiffany Chang

If you’ve worked with the Apache Kafka® and Confluent ecosystem before, chances are you’ve used a Kafka Connect connector to

🚂 On Track with Apache Kafka – Building a Streaming ETL Solution with Rail Data

Posted on October 16, 2019 by Robin Moffatt

Trains are an excellent source of streaming data—their movements around the network are an unbounded series of events. Using this