Site Crawl
Automatically discover and audit multiple pages across your entire website.
What is Site Crawl?
Site Crawl automatically discovers pages on your website by following internal links, then runs accessibility audits on each discovered page. Instead of auditing one page at a time, you can audit your entire site in a single operation.
How Site Crawl works
- 1
Start from a seed URL
ConformPilot begins at your specified starting URL (usually your homepage or a section root).
- 2
Discover internal links
All internal links on each page are collected and added to the crawl queue.
- 3
Audit each page
Each discovered page is audited with your selected engines and compliance standard.
- 4
Aggregate results
All violations are collected into a single report, organized by page URL and severity.
How to run a Site Crawl
- 1
Open the audit form
Click New Audit from the dashboard.
- 2
Enter the starting URL
Enter the URL where the crawl should begin, e.g.
https://example.com - 3
Enable "Site Crawl"
Toggle on the Site Crawl option. Additional crawl settings will appear.
- 4
Set crawl depth and page limit
Set the maximum crawl depth (how many link levels deep) and the maximum number of pages to audit.
- 5
Choose engines and standard
Select your audit engines and compliance standard. These apply to all pages in the crawl.
- 6
Click Run Crawl
ConformPilot will begin crawling and auditing. Progress is shown in real time.
Crawl settings
Max pages
Limit the total number of pages audited. Recommended: 10–50 pages for initial audits, up to 500 for full site audits.
Crawl depth
How many link levels deep to crawl. Depth 1 = only the starting page. Depth 2 = starting page + all pages linked from it. Depth 3 = one more level, etc.
URL include/exclude patterns
Use regex patterns to include or exclude specific URL paths. For example, exclude /admin or only include /blog.
Stay on same domain
Enabled by default. Prevents the crawler from following links to external websites.
Crawl reports
After a site crawl, you can export:
- →VPAT DOCX — covering all pages in the crawl
- →Error Report DOCX — all violations organized by page URL
- →HTML Report — interactive report with page-by-page breakdown
- →JSON — raw data for integration with CI/CD pipelines
⚠️ Performance tip
Large crawls (100+ pages) can take significant time and resources. Start with a smaller page limit to verify your configuration, then increase for full audits. Use URL patterns to focus on specific sections of your site.