Posts

Showing posts with the label kafka stream api

Kafka Stream API: MySQL CDC to apache Kafka with debezium

Image
I was learning kafka. Then started learning kafka stream and was learning how to capture database change-event  and source them to kafka topic. Here we are going to learn capturing mysql database change event and source them to kafka topic and consume them from kafka-console-consumer. What you need to start with[Note: I have done all this for my ubuntu-18.04 machine]: apache Kafka + Zookeepr[ kafka tar file:v2.12-2.4.0 ] Debezium 0.9.2  Debezium_v0.9.2 MySQL 5.7 installed on your pc or any mysql db with mentioned version Now, are all set to have a headstart. Steps we will follow: unzip/untar all downloaded resources Configure MySQL Configure Apache Kafka Connector setup test how data-streaming happens Step 1 .   untar your your Kafka tar file in suitable location-like in a dedicated folder in any drive with this command: tar xvzf your filename.tar.gz inside your kafka untar file, untar the debezium tar file you downloaded from ...