Skip to main content

Crawl archiving

Crawl archiving is a fully automated process. It runs in the background, performing data checks every 30 minutes. Crawls are archived based on multiple policies described below:

Data retention policy

After crawl becomes older than 60 days, it is archived automatically.

Large projects policy

Crawls older than the 7 most recent crawls are archived automatically, with the exception of unarchived crawls (see below).

Unarchived crawls policy

Unarchived crawls remain available for 7 days. Afterwards, they are archived automatically.