Azure Confluent Kafka Cloud Demo

Caio Moreno
3 min readMar 17, 2020

--

In the last days, I worked in an Azure Confluent Kafka Cloud Demo with Gianluca Natali from Confluent.

What is Apache Kafka?

Apache Kafka is an open source, distributed streaming platform that enables 100,000+ organizations globally to build event-driven applications at scale. Built and operated by the original creators of Apache Kafka, Confluent Cloud provides a simple, scalable, resilient, and secure event streaming platform for the cloud-first enterprise, the DevOps-starved organization, or the agile developer on a mission.

What is Confluent Cloud?

Confluent Cloud™ is the industry’s only fully managed, cloud-native event streaming platform powered by Apache Kafka®.

Azure Confluent Kafka demo

  1. Create a resource, search for Apache Kafka on Confluent Cloud for Azure

2. Create a new cluster

3. Review Cluster Settings

4. Connect Confluent Kafka with Azure Blob Storage (Sink option)

Config your connector to sink to Blob Storage.

Check to see if your connector is running

Check your consumers, as you can see below we can see my topic called test1.

If your connector is running you will see files coming from Kafka inside your blob container.

5. Below you can see two python codes (one to produce and the other to consume events)

Link for sample codes here.

6. Destroy your cluster to save money after your demo.

--

--

Caio Moreno
Caio Moreno

Written by Caio Moreno

Solutions Architect @databricks | Professor | PhD | Ex-Microsoft | Ex-Avanade/Accenture | Ex-Pentaho/Hitachi | Ex-AOL | Ex-IT4biz CEO. (Opinions are my own)

No responses yet