Real-time Streaming — Mega Prompt
AI interviews you, builds complete Kafka/streaming data pipeline.
KafkaStreamingReal-time
Mega Prompt — Copy & Paste into AI
You are a world-class streaming systems engineer expert in Apache Kafka and real-time data processing with 20+ years of production experience. You have built systems used by millions of users. You write clean, scalable, production-ready code. Your job is to build a COMPLETE complete real-time streaming data pipeline for me. But first, you need to understand exactly what I want. STEP 1 — ASK ME ALL THESE QUESTIONS (ask all at once, wait for my answers): 1. What is the PROJECT NAME? 2. Describe it in 2-3 sentences — what does it do and who is it for? 3. List the MAIN FEATURES you want. 4. USE CASE? (Event processing, Log aggregation, Real-time analytics, CDC, IoT data?) 5. STREAMING PLATFORM: Kafka / Kinesis / Pulsar / RabbitMQ? 6. PROCESSING: Kafka Streams / Flink / Spark Streaming / Custom consumer? 7. PRODUCERS? (Application events, Database CDC, IoT devices, Logs?) 8. CONSUMERS/SINKS? (Database, Data warehouse, Dashboard, Alerts?) 9. Need SCHEMA REGISTRY? 10. Need EXACTLY-ONCE semantics? 11. Expected THROUGHPUT? (Messages per second?) STEP 2 — After I answer, you will: A. Present a detailed PROJECT PLAN with: - Project summary - Complete list of screens/pages/endpoints you will build - Tech stack and architecture - Data models / database schema - Key features confirmed B. Ask me: "Does this look correct? Should I add or change anything?" STEP 3 — After I confirm, you will BUILD the COMPLETE project: - Generate the full folder structure first - Then provide COMPLETE code for EVERY file - No placeholders, no "// TODO", no shortcuts - Include all imports, dependencies, and config files - Every file must be COMPLETE and RUNNABLE - Include realistic dummy data where needed - Add error handling, loading states, and edge cases - Code must compile/run without errors on first try - Follow best practices for the framework - Add brief comments only for complex logic
How to use this prompt
Copy the prompt above → open ChatGPT, Claude, Gemini, Copilot or DeepSeek → paste → the AI will interview you about your project, then build complete production-ready code.
Works with:
ChatGPT-5
Claude 4.5
Gemini 2.5 Pro
Copilot
DeepSeek V3
Mistral
About this Data Engineering Prompt
The Real-time Streaming — Mega Prompt is a battle-tested mega prompt designed for the Streaming Pipeline stack. Instead of dumping a vague request into ChatGPT or Claude, this prompt turns the AI into a senior engineer that interviews you first, confirms an architecture plan, and only then writes the full project — files, folders, configs and all. The result is production-ready code you can drop straight into a real build, not a half-finished snippet you still have to glue together.
You can paste this prompt into ChatGPT, Claude, Gemini, Copilot, DeepSeek, Mistral Le Chat or any modern reasoning model. It is written to be model-agnostic and stack-aware, so the AI adapts its output to your specific requirements rather than forcing a one-size-fits-all template on your project.
What you'll get
- Kafka
- Streaming
- Real-time
How to Use the Real-time Streaming — Mega Prompt
- Copy the full prompt from the box above using the "Copy Prompt" button. The clipboard copy includes every instruction the AI needs — do not trim it.
- Open your AI assistant — ChatGPT, Claude, Gemini, Copilot or any LLM with a large context window. Start a new conversation so previous chat memory does not pollute the build.
- Paste the prompt and hit send. The AI will ask you a structured set of discovery questions about your Streaming Pipeline project — features, screens, auth, payments, design style and target users.
- Answer in plain English. You do not need to know technical jargon. The AI translates your answers into the right architecture, libraries and folder structure.
- Confirm the plan. The AI will reply with a detailed project plan: file tree, data models, key flows. Approve it or ask for changes before code generation starts.
- Receive complete code. Every file is written out in full — no TODOs, no placeholders, no "implement this later" comments. Drop it into your IDE and run.
Why this Prompt Outperforms a Plain Request
Most developers write prompts like "build me a data engineering app" and get back generic, half-broken boilerplate. The Real-time Streaming — Mega Prompt works better for three concrete reasons:
- Role priming — the AI is told to act as a senior engineer with 20+ years of production experience in Streaming Pipeline, raising its quality baseline.
- Mandatory interview step — the AI must ask requirements before writing code, so you get a tailored project instead of a generic template.
- Plan-then-build flow — architecture is approved before code is generated. This eliminates the most common failure mode of LLM coding: building the wrong thing beautifully.
- Completeness contract — the prompt explicitly forbids placeholders, TODOs and stubbed functions. Every file you receive is meant to compile and run.
Frequently Asked Questions
Is the Real-time Streaming — Mega Prompt free to use?
Yes. Every prompt on AI Prompts Lib is 100% free, no signup or paywall. Copy it, paste into your AI of choice, and start building. We do not log your inputs or your generated code.
Which AI models work best with this prompt?
This prompt is tuned for any modern large-context model: Claude 4 / 4.5 Sonnet, ChatGPT-5 / GPT-4 Turbo, Gemini 2.5 Pro, DeepSeek V3 and Copilot Chat. For very large projects we recommend Claude or Gemini because of their larger output windows.
Can I modify the prompt for my own use case?
Absolutely. Treat the prompt as a starting template — add your brand voice, swap the tech stack hints, or pin specific libraries you already use. The interview + plan + build structure is the magic, not the exact wording.
What if the AI's output has bugs?
Paste the error message back into the same chat and say "fix this and re-emit the affected files in full". Because the prompt forces complete file output, the fix slots straight back into your project without manual stitching.