Pyspark Kafka Structured Streaming Data Pipeline
Author(s): Vivek Chaudhary Originally published on Towards AI. Programming The objective of this article is to build an understanding to create a data pipeline to process data using Apache Structured Streaming and Apache Kafka. Source: Kafka-Spark streaming Business Case Explanation: Let us …
Getting Started with Apache Kafka β Beginners Tutorial
Author(s): Vivek Chaudhary Originally published on Towards AI. Programming The objective of this article is to build an understanding of What is Kafka, Why Kafka, Kafka architecture, producer, consumer, broker, and different components of the Kafka ecosystem. And a small coding exercise …