Build an AI-powered content intelligence system
Upgrade from “data crawler” thinking to an AI Data Agent stack that turns public media metadata into a knowledge base and operator insights — the same pattern behind short-drama intelligence products.
What You Will Build
AI Collection Agent
Content knowledge base
Insights dashboard
What you open after purchase
Repository layout you unpack, plus the go-live checklist inside the playbook docs.
Repository structure
data-intelligence/
├── agent/ # AI Collection Agent
├── pipeline/
│ ├── clean/
│ └── classify/
├── knowledge/ # Normalized store + search
├── dashboard/ # Operator insights UI
├── docker-compose.yml
└── docs/
├── pipeline.md
├── agent-contracts.md
└── go-live-checklist.mdLaunch checklist
- Collection agent runs against one public metadata source
- Retry / budget / source contract configured
- Cleaning stage writes raw + normalized partitions
- AI classification tags land in the knowledge base
- Operator dashboard shows at least one insight view
- Docker Compose boots agent + DB locally
- R2 (or object store) wired for collected assets
- Alert on failed agent runs documented
Live cases on this path
Real builds that map to this playbook — not generic screenshots.
Data Automation System
Data Automation ≈ AI Data Intelligence — collection agent, Docker jobs, R2 assets, operator pipeline.
Case studyArchitecture
Production stack used across all playbooks in this track.
Ingest
Public Data
Agent
AI Collection
Intelligence
AI Classification
Product
Dashboard + Insights
Included
Engineering system
- AI Collection Agent playbook
- Cleaning + normalization stages
- AI classification prompts & jobs
- Knowledge base + search patterns
Ship assets
- Operator dashboard layouts
- Scheduling & retry notes
- Cloudflare / container deploy path
- Business insights report templates
Ready to ship?
See the file-level download list first, then unlock zips with Pro or Founder.
Pipeline
From public data to business insights
Sell the intelligence system — not “how to scrape short dramas.”
- Public Data
- AI Collection Agent
- Data Cleaning
- AI Classification
- Knowledge Base
- Dashboard
- Business Insights
- Production monitoring