AI Assistants (MCP Server)

PageCrawl includes a built-in MCP (Model Context Protocol) server that lets AI assistants manage your page monitors. You can add monitors, check history, trigger checks, and more, all through natural conversation with tools like Claude or ChatGPT.

MCP is an open protocol that standardizes how AI tools connect to external services. Once connected, your AI assistant can directly interact with your PageCrawl account without you needing to use the web interface or API manually.

Available on Enterprise and Ultimate plans.

What You Can Do

The MCP server provides six tools that your AI assistant can use:

Tool What It Does
List workspaces View all your teams and workspaces with their IDs
List monitors Search and view monitors across all workspaces by URL, domain, or name
Get monitor details See full configuration of a specific monitor including tracked elements and latest values
Get monitor history Retrieve historical checks and detected changes with AI summaries
Add page monitor Create a new monitor with URL, selectors, frequency, and element tracking
Trigger check Trigger a one-off check on a monitor. Rate limited, not for programmatic use

Supported Element Types

When creating monitors through MCP, you can track the following element types:

  • Full Page - Entire page text content (no selector needed)
  • Text - Text content of a specific element (CSS selector required)
  • Number - Numeric values with change thresholds
  • Price - Price values with currency detection
  • HTML - Raw HTML structure of an element
  • JavaScript - Execute JavaScript and track the result
  • File Hash - Monitor file changes by checksum (no selector needed)
  • PDF - Track changes in PDF documents (no selector needed)

Setting Up with Claude.ai

  1. Go to claude.ai Settings
  2. Navigate to the Integrations section
  3. Click Add Integration and search for PageCrawl, or enter the MCP server URL: https://pagecrawl.io/mcp
  4. You will be redirected to PageCrawl to authorize access
  5. Log in (if not already) and click Approve
  6. PageCrawl tools are now available in your Claude conversations

Setting Up with Claude Code

Add the following to your .mcp.json file (in your project root or ~/.claude/):

{
  "mcpServers": {
    "pagecrawl": {
      "url": "https://pagecrawl.io/mcp"
    }
  }
}

When Claude Code first tries to use PageCrawl tools, it will open a browser window for you to authorize the connection via OAuth.

Setting Up with Claude Desktop

Add the following to your claude_desktop_config.json:

{
  "mcpServers": {
    "pagecrawl": {
      "url": "https://pagecrawl.io/mcp"
    }
  }
}

Restart Claude Desktop. On first use, it will prompt you to authorize the connection through your browser.

Setting Up with ChatGPT

Works with ChatGPT on web, desktop, and mobile. Requires a ChatGPT Plus, Pro, Team, Enterprise, or Edu plan.

  1. Go to chatgpt.com (or open the ChatGPT desktop app)
  2. Navigate to Settings > Connectors > Create
  3. Enter a name (e.g. "PageCrawl"), a short description, and set the URL to: https://pagecrawl.io/mcp
  4. Click Create. You will be redirected to PageCrawl to authorize access
  5. Log in and click Approve
  6. To use in a conversation, click the + button near the message input, select More, and enable PageCrawl

Setting Up with Other MCP Clients

Any MCP-compatible client can connect to PageCrawl. The server details:

  • URL: https://pagecrawl.io/mcp
  • Authentication: OAuth 2.0 (automatic via MCP protocol)
  • Protocol: MCP over HTTP with JSON-RPC 2.0
  • OAuth Discovery: https://pagecrawl.io/.well-known/oauth-authorization-server

The client will handle the OAuth flow automatically. No manual token setup is required.

Example Conversations

Once connected, you can interact with PageCrawl naturally:

Adding a monitor:

"Monitor example.com/pricing every hour and track the full page text"

Checking status:

"Show me all my monitors that have changed recently"

Getting details:

"What changes were detected on the pricing page in the last week?"

Triggering a check:

"Run a check on my competitor's product page now"

Searching monitors:

"Find all monitors tracking example.com"

Working with Workspaces

All tools automatically search across every workspace you have access to. You do not need to know which workspace a monitor is in to find or interact with it.

  • Use List monitors with the search parameter to find monitors by URL, domain, or name
  • Use List monitors with workspace_id to filter results to a specific workspace
  • Use List workspaces to see all your teams and workspaces with their IDs
  • Only Add page monitor requires a workspace_id to specify where to create the new monitor

Limits and Quotas

MCP operations respect your plan's limits:

  • Monitor creation counts toward your page monitor quota
  • Triggered checks are rate limited and placed in a deprioritized queue, so checks may take a while to complete. This is designed for occasional, manual use only (one or two checks at a time). It does not support programmatic or automated triggering - requests that exceed rate limits will be rejected with an error. Instead, configure the check frequency on each monitor and use scheduling settings to run checks at specific times.
  • If you exceed your monitor limit, new monitors are created in a disabled state
  • If you exceed your check limit, manual check triggers will be rejected

See Check Limits and Website Limits for details on plan quotas.

Ready to Track Changes?

Set up monitoring in under 60 seconds and never miss important updates again.

Track a New Page