Crawl log
What the crawler saw and when
SharePoint's crawl log for a site, a library or a single address: when the crawler visited, whether it succeeded, and the error code and message when it did not. Filter by level, content source and dates, look at every value SharePoint recorded for an entry, and export to Excel.
What it tells you
- Has the crawler visited this site since the migration?
- Which items failed to crawl, and with what error?
- When was a particular file last crawled?
How it runs
- Sign in. One sign-in when you click the tile. A SharePoint admin centre browser session is recommended; it needs no app consent.
- Choose what to read. An address (the tenant root to start), Starts with for everything below it, a level, Sites or User profiles, the dates and a row limit.
- Read crawl log. Entries come back newest first. Click one to see every value SharePoint recorded for it.
- Export. Excel, with the filters you used on the Summary sheet.
How it works
Each read is one request to SharePoint's crawl log for the address you give, either that exact address or every address that starts with it, filtered by level, by content source (your sites, or user profiles) and by dates, up to the row limit. When the read stops at the row limit, the page says there may be more entries than shown.
An entry SharePoint records as a success but that carries an error code or a status message is shown as a warning, so it is not lost among the successes. Every value SharePoint returned for an entry is kept and shown in its details.
If the account is neither a SharePoint administrator nor granted crawl log access, SharePoint refuses the read, and the page says so in one sentence with a button that opens the admin centre page where an administrator can grant it. ShareMaster never grants that access itself, and nothing on this page changes SharePoint.
What you need
- SharePoint administrator, or an account granted crawl log access on the admin centre's Crawl log permissions page. Without either, the page says so and opens that page for an administrator.
What it will not do
- Reads only. Granting crawl log access is a tenant setting an administrator makes on the admin centre page.
- Large row limits can take minutes, and SharePoint ends one request after 90 seconds. Narrow the dates or the address if a read stops.
- The count says when the row limit was reached: there may be more entries than shown.
- Whether an app-only certificate may read the crawl log has not been confirmed yet.
Read next
- Item search properties: The crawl log's last entries for one item, with the rest of the story.