IOTStation

How to Create and Delete Kafka Topics: A Step-by-Step Guide How to Create and Delete Kafka Topics: A Complete CLI Guide Apache Kafka is the backbone of modern data streaming. While setting up the server is a one-time task, managing Topics is a daily responsibility for Data Engineers. In this guide, I will demonstrate exactly how to create and delete Kafka topics using the command line (CLI), covering the syntax for both Linux and Windows environments. 🔹 What Is an Apache Kafka Topic? Think of a Kafka topic as a folder in a filesystem, but for events. It is the specific category where producers push data and consumers read from. To understand the commands below, you need to know three concepts: Topic: The category name (e.g., "User_Logins"). Partitions: Kafka splits topics into "parts" to allow parallel processing. More partitions = higher throughput. Replication Factor: How many copies of the dat...

What Is MQTT: Complete Guide to MQTT Architecture- Brokers and Cloud Solutions What Is MQTT: Complete Guide to MQTT Architecture, Brokers and Cloud Solutions If you are building an IoT (Internet of Things) project, you quickly realize that standard HTTP requests are too heavy and slow for real-time sensors. This is where MQTT (Message Queuing Telemetry Transport) changes the game. In my experience working with industrial automation and smart meters, MQTT is the gold standard because it is lightweight, keeps bandwidth costs low, and maintains connections even on unstable networks. In this guide, I will move beyond the basic definitions and show you: How the architecture actually works A code example (Python) for sending data The difference between Open-source and Cloud brokers How to install the Mosquitto Broker (Video Tutorial) The Core Concept: Pub/Sub Unlike the web (where you ask a server for a page and it responds), MQTT is...

How to Install Apache Kafka on Windows (KRaft Mode - No ZooKeeper) Apache Kafka is the industry standard for event streaming. While older versions relied on ZooKeeper, the modern approach is to use KRaft (Kafka Raft Metadata) mode. In this guide, I will walk you through installing Apache Kafka 3.x on Windows without ZooKeeper. This reduces complexity and makes your local setup much lighter. Prerequisite: You must have Java (JDK 11 or JDK 17) installed. Run java -version in your terminal to check before proceeding. Step 1: Download and Extract 1. Go to the official Apache Kafka download page . 2. Download the Binary downloads (Scala 2.13 is recommended). 3. Extract the folder to a short path like D:\kafka . (Avoid long paths with spaces like "Program Files" to prevent errors). Step 2: Navigate to Windows Binaries Open your Command Prompt (CMD) and navig...

In this comprehensive tutorial, you will learn how to build a real-time temperature and humidity monitoring dashboard using an ESP32 , a 240×240 TFT LCD display (ST7789) , and a DHT11 sensor . The project demonstrates how to display text, icons, and live sensor data on a colorful TFT screen. This guide is designed for makers, students, and engineers who want to improve their skills in embedded systems , IoT development , and ESP32 graphical interfaces . 📺 Video Tutorial – Full Walkthrough This article complements the full step-by-step video tutorial below. In the video, you will see the complete wiring, TFT initialization, bitmap generation, and a live demo of temperature and humidity updates on the screen. 📌 Tip: Watching the video first will make the wiring and code much easier to follow. 🧰 Components Required ESP32 Development Board [Image of ESP32 development board pinout] 240×240 TFT LCD (ST7789 Driver) DHT11 Temperature & Humi...

Import CSV from FTP to PostgreSQL Using Python | Automated ETL Automating CSV Imports: FTP to PostgreSQL with Python Full ETL Walkthrough & Code Examples In modern data-driven architectures—especially in IoT platforms, smart metering systems, and industrial automation —data rarely originates from a single source. Embedded devices often export measurements as CSV files and upload them to an FTP server because FTP is lightweight and universally supported by legacy hardware. The challenge lies in moving this data into a structured PostgreSQL database for analysis. In this guide, I will show you how to build a Python script that monitors an FTP server, detects new files, and performs an "Upsert" (Update or Insert) into your database. 🛠️ Prerequisites & Architecture Before diving into the code, ensure you have the following Python libraries installed. We use ftplib for the...

Local AI Revolution: Deploying Ollama & Open Web UI with Docker Running Large Language Models (LLMs) locally offers privacy, zero latency, and freedom from subscription fees. In this guide, we won't just install Ollama ; we will build a full local stack using Docker to connect a powerful backend with the sleek Open Web UI frontend. ⚙️ The Architecture: How It Works Before pasting commands, it is crucial to understand the setup. We are creating two distinct Docker containers that need to communicate: Container A (Backend): Runs Ollama, serving the API on port 11434 . Container B (Frontend): Runs Open Web UI, accessible via your browser on port 3000 . The Bridge: We use the host.docker.internal flag to allow Container B to "see" Container A safely. 📋 Prerequisites Ensure your environment is ready to handle LLM inference: Docker Desktop: Installed and running ( Download...