Skip to main content

Pages without AI Bot Hits

Priority: High

Impact: Negative

What issues it may cause​

If important pages are consistently missed by AI crawlers, they are invisible to a growing channel of user engagement, representing a missed opportunity.

How do you fix it​

Improve internal linking to these pages from important site hubs. Ensure they are included in sitemaps. For high-priority content, build high-quality links to signal their importance.

What is the positive impact​

Pages not being crawled by AI bots will not be included in generative AI experiences. This could be due to crawl budget issues, poor internal linking, or newness.

How to fetch the data for this report template​

You will need to run a crawl for report template to generate report. When report has been generated and you have crawl id you can fetch data for the report using the following query:

query GetReportStatForCrawl(
    $crawlId: ObjectID!
    $reportTemplateCode: String!
    $after: String
   ) {
      getReportStat(
        input: {crawlId: $crawlId, reportTemplateCode: $reportTemplateCode}
      ) {
        crawlUrls(after: $after, reportType: Basic) {
          nodes {
            pageTitle
            url
            description
            foundAtUrl
            deeprank
            level
            logRequestsAiBot
            httpStatusCode
            indexable
            foundInGoogleAnalytics
            foundInGoogleSearchConsole
            foundInBacklinks
            foundInList
            foundInLogSummary
            foundInWebCrawl
            foundInSitemap
          }
          totalCount
          pageInfo {
            endCursor
            hasNextPage
          }
        }
     }
   }

Try in explorer