Specifies the crawl and indexing directives of a page type
For each page type whether it is indexable, its sitemap, its canonical rule and its robots rule
Can AI do this?
Not tested yet
No AI benchmark covers this knobit yet. New results are announced in the Can AI Do the Job? newsletter.
What it looks like in practice
Expected result: For each page type whether it is indexable, its sitemap, its canonical rule and its robots rule
How it is assessed: Indexable pages are in a per-type sitemap with a self-referencing canonical, and excluded pages are kept out by one stated mechanism, not two that conflict
Related knobits
Builds on
- E-251 Explains canonicalisation of duplicate URLs
- E-252 Explains crawl control with robots rules and sitemaps
All 7 knobits of Enhance website visibility.
Source: ESCO skill 'enhance website visibility' (ESCO v1.2.1); DO process activities P2.6, P2.13, P3.2; Google Search Central documentation; the assessment criterion is this register's own and is in no reference text