OnCrawl

OnCrawl is a cloud-based technical SEO platform created and published by Cogniteev SAS. It helps SEO and digital teams crawl websites, analyze page and link data, inspect server logs, connect analytics and search data, and build dashboards for technical and organic-search decisions. Current terms describe its Crawler as collecting page responses, content structure, internal links, JavaScript-rendering results, and performance signals; its Log Analyzer can monitor how search engines, AI bots, and organic visitors interact with a site on eligible plans. The platform supports technical SEO audits and search observability.

✨ Key Features

• Technical SEO crawler — Crawl website pages and analyze response data, content structure, internal links, JavaScript rendering, and performance signals.
• JavaScript crawling and audits — Render JavaScript pages and run configured audits, with higher crawl-token consumption than standard crawling.
• Log Analyzer — Analyze server-log activity from search engines, AI bots, and organic visitors; current terms list this on Core and Scale plans.
• AI-bot monitoring — Track and report how AI crawlers interact with the website where the Log Analyzer and relevant reporting features are enabled.
• Crawl comparisons — Compare two crawls to identify changes and understand the impact of site updates.
• Data Explorer — Filter datasets with Oncrawl Query Language, customize columns, calculate aggregates, save views, and export reports.
• Dashboards and reports — Use built-in or custom dashboards to visualize crawl and SEO data, with configurable metrics and page groups.
• Chart Builder — Create scorecards, donut charts, and bar charts with selected metrics, dimensions, filters, colors, legends, and trend lines.
• Segmentation — Group pages using crawl fields and imported data to analyze sections, templates, and content types.
• Search and analytics enrichment — Join crawl information with Google Search Console, Google Analytics/GA4, Adobe, ranking, revenue, and other configured data sources.
• Data ingestion and reporting — Import CSV or third-party datasets, join fields to crawled URLs, export to Looker Studio where included, and use the API for downstream reporting.
• Alerts, usage, and support — Create recurring alerts from Data Explorer filters; standard crawling consumes one token per URL, JavaScript crawling three, and audits five. Terms describe customer success support and optional SEO Workshops.

💳 Pricing

Oncrawl offers paid Basic, Core, and Scale subscriptions. Basic includes its crawler and core platform; Core and Scale include Log Analyzer. Rates and crawl-token allowances are specified in the Order Form.

The REST API is available on all plans. Premium Lenses, including Content Lens, additional annual crawl capacity, and SEO workshops may cost extra. Customer-success support is included according to the subscribed plan. Monthly crawl quotas renew during an active subscription; URL count and configuration determine token consumption. Ask sales for current prices, quotas, and optional-module terms.

⚖️ Alternatives Compared

🎯 Use Cases

• Technical SEO audits: Crawl a site and identify response, content, linking, rendering, and performance issues.
• Migration and release monitoring: Compare pre- and post-release crawls to detect regressions, redirects, broken links, and structural changes.
• Crawl-budget analysis: Combine crawl data and server logs to understand how search engines and AI bots access important pages.
• AI crawler observability: Monitor AI-bot activity and compare it with organic visitors and search-engine behavior where enabled.
• SEO performance correlation: Blend crawl findings with Search Console, analytics, ranking, revenue, or conversion data.
• Large-site segmentation: Analyze page groups, templates, content types, and country or business sections at scale.
• Agency reporting: Build dashboards, schedule exports, and connect multiple projects or data sources for client reporting.
• Custom SEO data pipelines: Import CSV or other third-party data and use the API or Looker Studio connector for downstream analysis.
• Recurring technical alerts: Turn Data Explorer filters into alerts for conditions that require ongoing attention.

Crawler and log findings depend on crawl configuration, JavaScript rendering, log completeness, product matching, connected data sources, and quotas. Validate sampling and date ranges before making SEO or business decisions. AI-bot labels and behavior can change as crawlers evolve; treat the platform as an observability aid, not a guarantee of search or AI visibility.