If a monitor shows an access-denied message or a security challenge instead of the page you expect, start with Location: Auto and the default browser settings. PageCrawl automatically retries some loading and access errors. If the problem persists, the options below can help, but no configuration guarantees access to every website.
Is the page blocked, or does it need a login?
Open the exact URL in a private or incognito browser window and compare it with the monitor's latest result. A 401 or 403 error can indicate a sign-in requirement or another access restriction, so it does not always mean bot protection. A blank page or timeout can also have a different cause.
- If the page requires a login, follow Monitoring Password-Protected Websites.
- If it shows a CAPTCHA, see Monitoring Pages That Show CAPTCHA.
- If the site reports too many requests, reduce the check frequency and allow time before checking again.
What should I try first?
Use Auto unless the page needs a specific connection. Open the monitor and click Edit. In the simple editor, expand Page adjustments to find Location and Engine. Start with Engine: Default if you previously changed it. In the advanced editor, enable Power User Settings to reveal Engine; Location is available without that switch.
Change one setting at a time, click Save Changes, and wait for any queued or running check to finish. If another check is needed, use Run now or Check Now when available. Review the captured content, not just the success status, before applying the same configuration to other monitors.
When is Relay a good fit?
Relay mainly suits personal monitoring on a budget when a public page works through your connection and you can keep a computer online. PageCrawl Relay has no PageCrawl fee on any plan, including Free and Standard. Your own bandwidth costs and normal plan limits still apply.
For business monitoring, we recommend Enterprise or Ultimate and their included managed Residential connection options, so checks do not depend on your computer staying online. Relay remains available on every plan if you need your own connection.
Open Settings → More → Relays, follow the setup guide, then select the machine under the monitor's Location. Relay does not provide access to private intranets or local-network pages.
Keep the machine running and choose what should happen when it is offline in the Relays settings. A relay does not reuse your browser's signed-in session; pages that require authentication still need a login configured in PageCrawl.
Which options are included, and which cost extra?
For business monitoring, we recommend Enterprise or Ultimate and their included Residential options. For personal monitoring, Relay can keep costs down by using your own computer and bandwidth. It is available on every plan with no PageCrawl relay fee. Web Unblocker is separate and uses a purchased bandwidth balance.
| Option | When it helps | Cost |
|---|---|---|
| Auto | A starting point for most monitors | Included in your plan |
| PageCrawl Relay | Personal monitoring when a public page accepts your connection and you can keep a computer online | No PageCrawl fee on any plan; uses your own bandwidth |
| Included Residential options | Recommended for business monitoring when a page still fails with Auto | Included on Enterprise and Ultimate |
| Web Unblocker | You want to try an additional managed option for a persistently blocked page | Metered bandwidth on Enterprise and Ultimate |
| Custom Proxy Pools | You already have proxies you want to use | Any charges from your provider |
How do I use Web Unblocker?
On Enterprise or Ultimate, open Settings → More → Proxies to review the current bandwidth price, balance and purchase options. Then edit the monitor, select Web Unblocker under Location, choose a country, and save. Check the result before setting up more monitors.
Note: Web Unblocker needs a positive bandwidth balance. Larger pages and more frequent checks use more traffic. The included Residential options do not spend this balance.
How do I use proxies I already have?
Go to Settings → More → Proxies, find Custom Proxy Pools, and click Add New. Name the pool and add the proxy details supplied by your provider. Then edit the monitor and select that pool under Location. See Custom Proxies for configuration details.
What if the page is still blocked?
Email support@pagecrawl.io with the monitor URL, the error or challenge you see, and whether the same page opens in a private browser window. Include the options you have tried so we can suggest the next step. Do not include passwords, relay tokens or proxy credentials.
For failures without an access-denied message or challenge, see Page Loading Issues.