Non-Indexable Pages
Pages that return a 200 status but are prevented from being indexed via a noindex or canonical.
Priority: Low
Impact: Negative
What issues it may cause
Any pages that have the potential to be drive traffic from search engine results pages can't be indexed and won't generate any organic search traffic.
How do you fix it
The pages should be reviewed to ensure they not include any pages which have the potential to drive traffic.
If the pages have potential search value, the noindex can be removed or the canonical URL updated to match the URL of the page.
What is the positive impact
Pages with potential search value can be indexed and potentially generate additional search traffic and conversions.
How to fetch the data for this report template
You will need to run a crawl for report template to generate report. When report has been generated and you have crawl id you can fetch data for the report using the following query:
- Query
- Variables
- cURL
query GetReportStatForCrawl(
$crawlId: ObjectID!
$reportTemplateCode: String!
$after: String
) {
getReportStat(
input: {crawlId: $crawlId, reportTemplateCode: $reportTemplateCode}
) {
crawlUrls(after: $after, reportType: Basic) {
nodes {
pageTitle
url
canonicalUrl
foundAtUrl
deeprank
level
indexable
httpStatusCode
noindex
canonicalizedPage
nofollowedPage
disallowedPage
unavailableAfter
foundInGoogleAnalytics
foundInGoogleSearchConsole
foundInBacklinks
foundInList
foundInLogSummary
foundInWebCrawl
foundInSitemap
}
totalCount
pageInfo {
endCursor
hasNextPage
}
}
}
}
{"crawlId":"TjAwNUNyYXdsNDAwMA","reportTemplateCode":"non_indexable_pages"}
curl -X POST -H "Content-Type: application/json" -H "apollographql-client-name: docs-example-client" -H "apollographql-client-version: 1.0.0" -H "x-auth-token: YOUR_API_SESSION_TOKEN" --data '{"query":"query GetReportStatForCrawl( $crawlId: ObjectID! $reportTemplateCode: String! $after: String ) { getReportStat( input: {crawlId: $crawlId, reportTemplateCode: $reportTemplateCode} ) { crawlUrls(after: $after, reportType: Basic) { nodes { pageTitle url canonicalUrl foundAtUrl deeprank level indexable httpStatusCode noindex canonicalizedPage nofollowedPage disallowedPage unavailableAfter foundInGoogleAnalytics foundInGoogleSearchConsole foundInBacklinks foundInList foundInLogSummary foundInWebCrawl foundInSitemap } totalCount pageInfo { endCursor hasNextPage } } } }","variables":{"crawlId":"TjAwNUNyYXdsNDAwMA","reportTemplateCode":"non_indexable_pages"}}' https://api.lumar.io/graphql