# PageCrawl.io

> AI-powered website change monitoring and change detection platform

PageCrawl.io monitors web pages for changes and sends instant notifications when content updates. Track prices, availability, text, documents, and more using real browser rendering with AI-powered change summaries.

## What PageCrawl Does

PageCrawl.io is a cloud-based website monitoring service that detects changes on any web page and notifies you through your preferred channels. It uses real browsers (with full JavaScript support) to render pages exactly as a human would see them, then compares snapshots to detect what changed. AI analyzes every change to provide plain-language summaries and importance scoring, so you only get notified when it matters.

## Core Capabilities

- **Website Change Monitoring**: Detect text, visual, and structural changes on any webpage
- **Real Browser Rendering**: JavaScript-enabled monitoring for dynamic sites and SPAs
- **AI-Powered Change Summaries**: Get plain-language summaries of what changed, included on all plans
- **AI Importance Scoring**: Every change scored 0-100 by importance, set thresholds to filter noise
- **AI Pattern Learning**: Dismiss changes and AI learns, similar low-value changes are auto-filtered
- **Multi-Channel Alerts**: Email, Slack, Discord, Microsoft Teams, Telegram, webhooks, web push notifications
- **Element-Level Tracking**: Track specific elements with CSS/XPath selectors or monitor full pages
- **File Monitoring**: Track changes in PDFs, Word (.docx), Excel (.xlsx), PowerPoint (.pptx), CSV files
- **Cloud Document Monitoring**: Google Sheets, Google Drive, Microsoft SharePoint documents
- **Visual Comparison**: Side-by-side screenshot diffs and historical screenshot archives
- **Automatic Page Discovery**: Find new pages on any website via sitemap scanning, deep crawl, or URL scanning
- **Check Frequencies**: From every 2 minutes (Ultimate) to monthly schedules
- **Smart False-Positive Reduction**: Filter dates, ads, popups, dynamic content, combined with AI noise filtering
- **Cloudflare and Bot Detection Bypass**: Automatic bypass of anti-bot systems
- **Password-Protected Pages**: Monitor pages behind login forms
- **Browser Actions**: Click buttons, type text, remove overlays, scroll, wait for elements before capture
- **Team Collaboration**: Workspaces, user roles (owner, admin, standard, viewer), shared monitors
- **Review Boards**: Kanban-like board for compliance teams to review and flag changes
- **Bulk Management**: Import multiple URLs, bulk edit configurations, reusable page templates
- **Web Archiving**: Save complete web archives in WACZ format (Ultimate plan)
- **Monitoring Reports**: Daily, weekly, or monthly digest reports with AI summaries
- **Data Exports**: Export change history to Excel spreadsheets

## Tracking Modes

- **Full Page**: Monitor the entire visible text content of a page
- **Content Only**: Ignores navigation, headers, footers, focuses on main content
- **Reader Mode**: Uses Readability algorithm for clean article extraction
- **Price**: Auto-detects prices and tracks availability for e-commerce pages
- **Specific Text**: Track a specific element using CSS or XPath selector
- **Specific Number**: Track a numeric value on a page using CSS or XPath selector
- **Visual/Screenshot**: Detect visual layout changes via screenshot comparison
- **Links**: Track all links on a page for changes
- **HTML**: Monitor raw HTML source changes
- **File Hash**: Track binary file changes via SHA-256 hash

## Integrations

- Slack, Microsoft Teams, Discord, Telegram
- Email with Cc support and digest reports
- Web push notifications (Chrome, Firefox, Edge, Safari 16+)
- Webhooks for custom integrations
- Zapier (2000+ apps)
- n8n (community node with full API support)
- Google Sheets sync (auto-sync monitored data)
- Dropbox sync (auto-save screenshots)
- RSS feeds
- Home Assistant (via webhooks and REST API)
- RESTful API for programmatic access
- Browser extension for Chrome and Firefox
- iOS Safari bookmarklet
- MCP Server for AI assistants

## MCP Server (AI Assistant Integration)

PageCrawl.io provides an MCP (Model Context Protocol) server that lets AI assistants manage website monitors through natural conversation. Free plan users have read-only access. Paid plans (Standard and above) have full access.

- **MCP Server URL**: https://pagecrawl.io/mcp
- **Authentication**: OAuth 2.0
- **Compatible with**: Claude.ai, ChatGPT, Claude Code, Claude Desktop, Cursor, Windsurf, and any MCP-compatible client

### MCP Setup

**Claude (Web/Desktop):** Settings > Connectors > Add custom connector > Name: "PageCrawl", URL: `https://pagecrawl.io/mcp` > Authorize

**Claude Code:** Add to `.mcp.json`:
```json
{ "mcpServers": { "pagecrawl": { "url": "https://pagecrawl.io/mcp" } } }
```

**ChatGPT:** Settings > Connected apps > Add > URL: `https://pagecrawl.io/mcp`

### MCP Tools

| Tool | Description |
|------|-------------|
| list-workspaces | List all accessible workspaces |
| add-page-monitor | Create a new monitor with URL, tracking mode, frequency, notifications |
| list-monitors | Search and list monitors across all workspaces by URL, domain, or name |
| get-monitor-details | Get full configuration for a monitor (supports batch via monitor_ids) |
| get-monitor-history | Retrieve historical checks and detected changes (supports batch, since filter) |
| get-latest-values | Get current tracked values for monitors (supports batch, lightest-weight) |
| get-check-diff | View formatted text diffs showing additions and removals for a check |
| get-changes-since | Get all changes across all monitors since a given date |
| trigger-check | Force an immediate check on a monitor |
| manage-tags | List workspace tags, add or remove tags from monitors |
| mark-changes-seen | Mark detected changes as reviewed on one or all monitors |
| list-templates | List templates available in a workspace |
| update-monitor-defaults | View or update default settings for new monitors per workspace |

### MCP Usage Guide

- "What is the current price?" -> use get-latest-values
- "What changed in the last check?" -> use get-check-diff
- "Show me the change history" -> use get-monitor-history
- "What changed today/this week?" -> use get-changes-since
- "Find monitors for example.com" -> use list-monitors
- "Monitor this URL" -> use add-page-monitor
- frequency is in minutes: 60 = hourly, 1440 = daily, 10080 = weekly
- get-monitor-details, get-monitor-history, and get-latest-values support batch requests via monitor_ids array (max 50)

## Common Use Cases

- **E-commerce & Price Monitoring**: Track competitor prices, product availability, inventory restocks
- **Compliance & Legal**: Monitor terms of service, privacy policies, regulatory filings, legal documents
- **Competitive Intelligence**: Track competitor websites for pricing, product, hiring, and content changes
- **Stock and Restock Alerts**: GPU stock (NVIDIA RTX), gaming consoles (PS5), networking equipment (UniFi), Tesla inventory, Raspberry Pi
- **Job Hunting**: Get alerts for new job postings on career pages and job boards
- **SEC Filing Monitoring**: Track EDGAR filings (10-K, 10-Q, 8-K, S-1, Form 4, 13-F)
- **Software Release Tracking**: Monitor release notes, changelogs, and version updates
- **Academic Research**: Track research papers, news, and competitor publications
- **Real Estate**: Monitor new property listings and price changes
- **Content Monitoring**: Track news sites, blogs, government pages for updates
- **Smart Home Automation**: Integrate with Home Assistant for automated responses to web changes

## Key Differentiators

- **Real browser rendering**: Unlike simple HTTP scrapers, PageCrawl uses real browsers that execute JavaScript, handle SPAs, and render pages exactly as humans see them
- **AI included on all plans**: Every plan includes AI credits for change summaries and smart filtering, no separate AI add-on needed
- **BYOK (Bring Your Own Key)**: Connect your own API key from OpenAI, Gemini, Anthropic, or OpenRouter for unlimited AI usage. OpenRouter gives access to any AI model available on the market, so you can choose the model that best fits your needs and budget
- **No data selling**: PageCrawl does not sell user data, offer data packs, or use customer data for AI training. Your data stays private.
- **File monitoring built-in**: Track PDFs, Excel, Word, PowerPoint, CSV, Google Sheets, and SharePoint documents natively
- **Automatic page discovery**: Find and start monitoring new pages automatically as they appear on any website
- **MCP Server for AI assistants**: Manage monitors through AI tools like Claude and ChatGPT
- **Browser extension**: One-click monitoring from Chrome or Firefox
- **Cloud-based, no installation**: Entirely browser-based, nothing to install
- **Since 2018**: Serving thousands of organizations including Microsoft, New York Times, Deloitte, Goldman Sachs, HubSpot, Yahoo, EY, and Stanford

## Pricing

- **Free Forever**: $0/month, 6 pages, 220 checks/mo, 60-min frequency, 90-day history, 10 AI credits, all integrations
- **Standard**: $8/month (or $80/year), 100 pages, 15,000 checks/mo, 15-min frequency, 12-month history, 100 AI credits, API access
- **Enterprise** (Most Popular): $30/month (or $300/year), 500 pages, 100,000 checks/mo, 5-min frequency, unlimited history, 1,000 AI credits, SSO, premium proxy pool, MCP server
- **Ultimate**: $99/month (or $990/year), 1,000 pages, 100,000 checks/mo, 2-min frequency, unlimited history, 5,000 AI credits with Pro-tier models, web archiving (WACZ), dedicated account manager, MCP server
- **Custom plans**: Available for higher volumes, 1-minute checks, and enterprise needs. Contact hey@pagecrawl.io
- All paid plans scale with quantity multipliers for more pages and checks

## Enterprise Features

- SAML 2.0 Single Sign-On (Azure AD, Google Workspace, Okta, OneLogin)
- User access roles and permissions (owner, admin, standard, viewer)
- Premium proxy pool for difficult-to-access sites
- CAPTCHA bypass service (additional cost)
- Higher quality screenshots
- MCP Server for AI assistant integration
- Invoice and PO billing (Ultimate, annual)
- Dedicated account manager (Ultimate)

## API

PageCrawl.io offers a RESTful API for programmatic access to:
- Create and manage monitored pages
- Retrieve change history and diffs (PNG, HTML, Markdown, Patch formats)
- Get screenshots and visual comparisons
- Configure webhooks for real-time change notifications
- Trigger manual checks
- Manage folders, tags, and workspaces

- **Interactive API Reference**: https://pagecrawl.io/developers
- **OpenAPI 3.0 Spec**: https://pagecrawl.io/api/openapi.yaml
- **Authentication**: Bearer token via `Authorization: Bearer <token>`
- **Quick Track Endpoint**: `POST /api/track-simple` - create a monitor with just a URL
- **Webhook Payload Fields**: 25+ customizable fields including AI summary, priority score, markdown diff, screenshot URL
- **Rate Limit**: 600 requests/minute
- **API access**: Standard plan and above ($8/month)

## Support

- Free plan: Community support only
- Standard: Email support within 72 hours
- Enterprise: Premium email support within 24 hours
- Ultimate: Priority support within 24 hours with dedicated account manager
- Contact: hey@pagecrawl.io (sales), help_me@pagecrawl.io (support)

## Resources

- Website: https://pagecrawl.io
- Help Center: https://pagecrawl.io/help
- Blog: https://pagecrawl.io/blog
- Pricing: https://pagecrawl.io/pricing
- API Documentation: https://pagecrawl.io/help/features/article/does-pagecrawl-support-api
- Contact: https://pagecrawl.io/contact-us
- About: https://pagecrawl.io/about
- Privacy Policy: https://pagecrawl.io/privacy-policy
- Security: https://pagecrawl.io/security-statement
- GDPR: https://pagecrawl.io/gdpr
- Roadmap: https://pagecrawl.io/roadmap
- Full LLM reference: https://pagecrawl.io/llms-full.txt