Pages with AI Bot Hits

Priority: None

Impact: Positive

What issues it may cause

Successful crawling by AI bots is the first step toward gaining visibility in new generative search features, confirming your technical setup allows access.

How do you fix it

This is a positive report. Monitor this list to understand which content themes are of interest to AI crawlers and ensure these pages are high-quality.

What is the positive impact

Pages receiving hits from AI bots are being considered for inclusion in generative AI models and search experiences, indicating your content is accessible.

How to fetch the data for this report template

You will need to run a crawl for report template to generate report. When report has been generated and you have crawl id you can fetch data for the report using the following query:

Query

query GetReportStatForCrawl(
    $crawlId: ObjectID!
    $reportTemplateCode: String!
    $after: String
   ) {
      getReportStat(
        input: {crawlId: $crawlId, reportTemplateCode: $reportTemplateCode}
      ) {
        crawlUrls(after: $after, reportType: Basic) {
          nodes {
            pageTitle
            url
            description
            foundAtUrl
            logRequestsAiBot
            deeprank
            level
            httpStatusCode
            indexable
            foundInGoogleAnalytics
            foundInGoogleSearchConsole
            foundInBacklinks
            foundInList
            foundInLogSummary
            foundInWebCrawl
            foundInSitemap
          }
          totalCount
          pageInfo {
            endCursor
            hasNextPage
          }
        }
     }
   }

Variables

{"crawlId":"TjAwNUNyYXdsNDAwMA","reportTemplateCode":"pages_with_ai_bot_hits"}

cURL

curl -X POST -H "Content-Type: application/json" -H "apollographql-client-name: docs-example-client" -H "apollographql-client-version: 1.0.0" -H "x-auth-token: YOUR_API_SESSION_TOKEN" --data '{"query":"query GetReportStatForCrawl( $crawlId: ObjectID! $reportTemplateCode: String! $after: String ) { getReportStat( input: {crawlId: $crawlId, reportTemplateCode: $reportTemplateCode} ) { crawlUrls(after: $after, reportType: Basic) { nodes { pageTitle url description foundAtUrl logRequestsAiBot deeprank level httpStatusCode indexable foundInGoogleAnalytics foundInGoogleSearchConsole foundInBacklinks foundInList foundInLogSummary foundInWebCrawl foundInSitemap } totalCount pageInfo { endCursor hasNextPage } } } }","variables":{"crawlId":"TjAwNUNyYXdsNDAwMA","reportTemplateCode":"pages_with_ai_bot_hits"}}' https://api.lumar.io/graphql

Try in explorer