Error Pages with Visits
Pages that have generated clicks from Google's search results pages but return a broken page status code such as 404 or 501
Priority: Critical
Impact: Negative
What issues it may cause
These pages are very likely to be removed from the search engine's indexes and lose any existing traffic.
If a user clicks on the page in a search engine's results page then it's likely to result in a poor user experience
How do you fix it
The pages should be checked in a web analytics tool to confirm they are still generating organic search visits.
If the pages were removed deliberately then they will be removed from the search engine's indexes automatically in time.
If there is an appropriate alternative working page, then the URL could be 301 redirected to the alternative URL.
If a 404 status is being used, consider switching to a 410 status which is a stronger indication that the page has been permanently removed and it should be removed from the index more quickly.
What is the positive impact
If the URL is redirected then there is a chance that the rankings will be inherited by the redirect target and the search traffic can be maintained.
Crawl budget can be saved so other pages may be crawled more frequently, or save on server costs.
How to fetch the data for this report template
You will need to run a crawl for report template to generate report. When report has been generated and you have crawl id you can fetch data for the report using the following query:
- Query
- Variables
- cURL
query GetReportForCrawl($crawlId: ObjectID!, $reportTemplateCode: String!) {
getCrawl(id: $crawlId) {
reportsByCode(
input: {
reportTypeCodes: Basic
reportTemplateCodes: [$reportTemplateCode]
}
) {
rows {
nodes {
... on CrawlUrls {
pageTitle
url
foundAtUrl
deeprank
level
httpStatusCode
indexable
duplicatePage
gaVisits
gaAvgPageLoadTime
gaVisitBounceRate
gaAvgTimeOnPage
gaPageviewsPerVisits
foundInGoogleAnalytics
foundInGoogleSearchConsole
foundInBacklinks
foundInList
foundInLogSummary
foundInWebCrawl
foundInSitemap
}
}
}
}
}
}
{"crawlId":"TjAwNUNyYXdsNDAwMA","reportTemplateCode":"error_pages_with_visits"}
curl -X POST -H "Content-Type: application/json" -H "apollographql-client-name: docs-example-client" -H "apollographql-client-version: 1.0.0" -H "x-auth-token: YOUR_API_SESSION_TOKEN" --data '{"query":"query GetReportForCrawl($crawlId: ObjectID!, $reportTemplateCode: String!) { getCrawl(id: $crawlId) { reportsByCode( input: { reportTypeCodes: Basic reportTemplateCodes: [$reportTemplateCode] } ) { rows { nodes { ... on CrawlUrls { pageTitle url foundAtUrl deeprank level httpStatusCode indexable duplicatePage gaVisits gaAvgPageLoadTime gaVisitBounceRate gaAvgTimeOnPage gaPageviewsPerVisits foundInGoogleAnalytics foundInGoogleSearchConsole foundInBacklinks foundInList foundInLogSummary foundInWebCrawl foundInSitemap } } } } } }","variables":{"crawlId":"TjAwNUNyYXdsNDAwMA","reportTemplateCode":"error_pages_with_visits"}}' https://api.lumar.io/graphql