Kafka-sidecar supports Kafka Streams Applications with drop-in support. You just need to drop your streams application jar file into the folder mapped to /streamsjar in Docker volume. Start Kafka Before running any demo applications, we need to get the Confluent Platform started. If you have Docker installed, you can start it from the kafka-sidecar repository. cd ~/networknt git clone https://github.com/networknt/kafka-sidecar.git cd kafka-sidecar docker-compose down docker-compose up Test Topics Once the Confluent Platform is up and running, create two topics from the control center or with the following command line. Read More »

This tutorial gives users a reference implementation of the reactive consumer service. It receives a batch, transforms the value and then produces the new value to another topic on the same Kafka cluster. We should do the transformation with Kafka streams as it is designed for this kind of task. In real business scenarios, the consumer might populate the transformed result to a database or invoke another API. Confluent Platform Start Confluent platform with by following the Confluent Docker if you have docker installed. Read More »

If you have Docker installed on your desktop, you can use the local Kafka docker image to start the confluent platform. https://docs.confluent.io/platform/current/quickstart/ce-docker-quickstart.html A docker-compose.yml is created in the root directory to start the confluent platform. cd ~/networknt/kafka-sidecar docker-compose up -d If you are using Linux desktop, you can start confluent local from the command line. Read More »

Check Out Check out the following repositories to your local working directory. I am using networknt in my home directory. cd ~/networknt git clone https://github.com/networknt/light-kafka.git git clone https://github.com/networknt/light-example-4j.git Confluent Local Before running the tutorial, we need to have confluent platform started locally. If you are using Linux, you can install confluent locally and start it from the command line. cd ~/tool/confluent-6.1.0/bin confluent local services start You can also start the confluent locally with a docker-compose. Read More »

We are using the confluent local on Ubuntu 20.10 for the Kafka server to speed up the development. Here is the link to get it installed. https://www.confluent.io/product/confluent-platform Or use the confluent docker-compose Read More »

This tutorial will run the sidecar and backend API with local default configuration for producer and reactive consumer. Confluent Local As we plan to run everything locally, we need to install and start the Confluent local. I am using confluent 6.1 on Ubuntu Linux 20.10 desktop. confluent local services start Create Test Topics To test with different schemas for validation and serialization/deserialization, we will create three topics (test1, test2, test3). If you are using the Confluent Platform, it can be done from the control center interface. Read More »