Crawl import

Upload a crawl from Screaming Frog or Sitebulb so the Action plan can show technical problems next to the search data.

Copilot SEO does not crawl your site. If you already crawl it with a tool such as Screaming Frog or Sitebulb, you can import the results. This is optional: everything else works without it.

Which export

Any CSV with one row per URL works, as long as it has an Address or URL column. In Screaming Frog, the Internal tab's "All" export has every column we read.

Upload it

  1. Open Crawl import.
  2. Choose the site and the CSV file (up to 25 MB).
  3. Press Import crawl.

The import runs in the background. Refresh the page after a short while. Recent imports shows each file's status, how many rows were imported and how many were skipped, and the error if one failed.

Make the addresses match

We match crawl rows to your Search Console pages by their exact address. https://example.com/shoes/ and https://example.com/shoes are different pages to us, and so are http and https.

Crawl the same version of the site that Search Console reports, and check that the addresses in your export look like the ones on Pages.

Rows without a valid URL are skipped.

What it adds

The import flags common technical problems on each page, such as status codes, indexability and on-page basics, as clues for a diagnosis rather than automatic fixes. A redirect or a canonical elsewhere can be exactly what you want.

Where it shows

On an action's diagnosis page in the Action plan, under Technical evidence, when your crawl has a row for that page. See Working an action.

The Crawl import page also lists the latest evidence for the site.

Importing again

A new import updates every URL it contains. URLs that are not in the new file keep their evidence from the previous import, so a partial crawl does not wipe the rest.

Sign in or join the early access list to see exactly how this is worked out.