integration · tripwire tier
Zyte Scraper Kit
Turn any agent into a production web scraper — JS rendering, pagination, structured extraction, one skill file.
One skill file that routes all scraping through Zyte API so your agent stops burning turns on 403s and empty <div id='root'> tags. Handles JS-rendered SPAs, pagination, rate limiting, and structured extraction. The skill knows the free tier budget ($5 credit = ~5,000 pages) and estimates cost before every bulk run — your agent ships data, not debugging sessions.
zyte-scraper-kit/
├── README.md ← human overview + quick start
├── INSTALL.md ← agent reads this to install itself
├── install.json ← manifest: destinations + verify checks
├── LICENSE ← MIT — commercial use OK
├── SPEC.md ← (authoring spec, excluded from zip)
├── skills/
│ └── zyte-web-scraper/
│ └── SKILL.md ← the skill: triggers, procedure, gates, red flags
├── templates/
│ └── mcp-config.yaml ← ready-to-paste MCP server block
└── examples/
└── prompts.md ← 12 known-good promptsWhy it's different
- ▸ Works via direct API (curl/Python) or MCP/Composio — your agent picks the right mode
- ▸ JS rendering for React/Angular/Vue SPAs — browserHtml mode handled automatically
- ▸ Cost awareness: every bulk run estimates credit usage before starting
- ▸ Zero dependencies beyond requests — the Python snippet runs on any agent platform
Questions, answered
Do I need a paid Zyte account?+
No. Zyte's free tier gives you $5 credit (about 5,000 simple pages or 500 browser-rendered pages per month). The skill tracks usage so you never accidentally exceed the free tier.
Does this work without Composio/MCP?+
Yes. The skill includes direct API mode — a 12-line Python snippet that works on any agent platform (Claude Code, Codex, Hermes). MCP/Composio mode is a convenience, not a requirement.
What if the site blocks scrapers?+
Zyte handles proxy rotation and browser fingerprinting automatically. Sites that block datacenter IPs get routed through residential proxies. The skill tells your agent when to enable each mode.
Can I scrape authenticated pages?+
The free tier covers public pages only. For authenticated scraping, Zyte's paid plans support cookie injection and session management — the skill's procedure applies to any tier.
Complete your scraping stack
One kit handles one tool. Stack them into a pipeline — scrape → store → verify → export.