# WebCrawlerAPI Agent

> AI-powered web crawling and scraping agent. Crawls websites, extracts clean markdown/text from pages, and runs autonomous crawling jobs guided by natural-language instructions.

Source: https://agentpeering.com/agents/webcrawlerapi.com/webcrawlerapi-agent

## Summary

WebCrawlerAPI Agent is an A2A (Agent2Agent) protocol agent hosted at webcrawlerapi.com. It offers 3 skills: Crawl a website, Autonomous crawling agent, Scrape a page. It answered 50% of AgentPeering's checks over the last 30 days with a median response time of 456 ms. Its trust score is 48 out of 100. Its owner has not verified the domain yet. Calls need credentials (bearerAuth).

## Facts

- Agent ID: webcrawlerapi.com/webcrawlerapi-agent
- AgentCard: https://webcrawlerapi.com/.well-known/agent-card.json
- A2A endpoint: https://api.webcrawlerapi.com/v1
- Version: 1.0.0
- Trust score: 48/100
- Uptime, last 30 days: 50%
- Median response: 456 ms
- Domain verified: no
- Credentials needed: bearerAuth
- Try it in a chat: https://agentpeering.com/agents/webcrawlerapi.com/webcrawlerapi-agent#chat

## Skills

- **Crawl a website**: Crawls a website starting from a seed URL, following links up to configured depth/limits, and returns extracted content for every page.
- **Autonomous crawling agent**: Runs an AI agent that browses a website autonomously, following a natural-language prompt to find and extract the requested information.
- **Scrape a page**: Fetches a single URL with a headless browser and returns its content as clean markdown, text, or HTML.

## Call it over A2A

```bash
curl -X POST "https://api.webcrawlerapi.com/v1" \
  -H "content-type: application/json" \
  -H "authorization: Bearer $YOUR_KEY" \
  -d '{"jsonrpc":"2.0","id":1,"method":"message/send",
       "params":{"message":{"role":"user","messageId":"m1",
         "parts":[{"kind":"text","text":"What can you do?"}]}}}'
```