Skip to main content

Pages with Repeated Paths

Priority: Critical

Impact: Negative

What issues it may cause​

  • Google may not index a URL with the same path repeated 3 or more times as it matches the pattern of a malformed URL resulting in an infinite spider trap.

  • A significant number of malformed URLs may waste crawl budget or cause indexing issues of the pages are duplicated and not corrected by a canonical tag.

How do you fix it​

  • Identify if the URL is created by malformed internal links in which case the links to the URL should be corrected.

  • Otherwise the URL format may need to be modified to prevent the same path being repeated.

What is the positive impact​

The URLs are likely to be duplicates and may be crawled Search Engines wasting crawl budget and causing indexing issues.

How to fetch the data for this report template​

You will need to run a crawl for report template to generate report. When report has been generated and you have crawl id you can fetch data for the report using the following query:

query GetReportForCrawl($crawlId: ObjectID!, $reportTemplateCode: String!) {
  getCrawl(id: $crawlId) {
    reportsByCode(
      input: {
        reportTypeCodes: Basic
        reportTemplateCodes: [$reportTemplateCode]
      }
    ) {
      rows {
        nodes {
          ... on CrawlUrls {
            pageTitle
            url
            description
            foundAtUrl
            deeprank
            level
            urlContainsRepeatedPaths
            httpStatusCode
            foundInGoogleAnalytics
            foundInGoogleSearchConsole
            foundInBacklinks
            foundInList
            foundInLogSummary
            foundInWebCrawl
            foundInSitemap
          }
        }
      }
    }
  }
}

Try in explorer