Category: Kafka Connect

Using secrets in Kafka Connect configuration

Posted on February 14, 2020 by Jakub Scholz

Kafka Connect is an integration framework that is part of the Apache Kafka project. On Kubernetes and Red Hat OpenShift,

Integrating Elasticsearch and ksqlDB for Powerful Data Enrichment and Analytics

Posted on February 12, 2020 by Sarwar Bhuiyan

Apache Kafka® is often deployed alongside Elasticsearch to perform log exploration, metrics monitoring and alerting, data visualisation, and analytics. It

Seamless SIEM – Part 1: Osquery Event Log Aggregation and Confluent Platform

Posted on February 11, 2020 by Hubert Dulay

Osquery (developed by Facebook) is an open source tool used to gather audit log events from an operating system (OS).

Pipeline to the Cloud – Streaming On-Premises Data for Cloud Analytics

Posted on January 8, 2020 by Robin Moffatt

This article show how you can offload data from on-premises transactional (OLTP) databases to cloud-based datastores, including Snowflake and Amazon

What’s New in Apache Kafka 2.4

Posted on December 16, 2019 by Manikumar Reddy

On behalf of the Apache Kafka® community, it is my pleasure to announce the release of Apache Kafka 2.4.0. This

Transferring Avro Schemas Across Schema Registries with Kafka Connect

Posted on December 9, 2019 by Jordan Moore

Although starting out with one Confluent Schema Registry deployment per development environment is straightforward, over time, a company may scale

4 Steps to Creating Apache Kafka Connectors with the Kafka Connect API

Posted on October 23, 2019 by Tiffany Chang

If you’ve worked with the Apache Kafka® and Confluent ecosystem before, chances are you’ve used a Kafka Connect connector to

🚂 On Track with Apache Kafka – Building a Streaming ETL Solution with Rail Data

Posted on October 16, 2019 by Robin Moffatt

Trains are an excellent source of streaming data—their movements around the network are an unbounded series of events. Using this

Internet of Things (IoT) and Event Streaming at Scale with Apache Kafka and MQTT

Posted on October 10, 2019 by Kai Waehner

The Internet of Things (IoT) is getting more and more traction as valuable use cases come to light. A key

Real-Time Analytics and Monitoring Dashboards with Apache Kafka and Rockset

Posted on September 26, 2019 by Shruti Bhat

In the early days, many companies simply used Apache Kafka® for data ingestion into Hadoop or another data lake. However,