Site check
Whether AI crawlers may read the key pages of ridgewell.example/ch/, and whether the pages show their text without scripts.
Site readiness
68%82 of 120 key pages ready for the wanted crawlers+4 ptsvs. the 28 days beforeRead on 2 November · 120 key pagesWanted crawlers
5 of 7You keep out CCBot and Google-ExtendedOur list is checked every monthProblems
3Each one linked to its website fixFound on 38 key pagesProblems
The most pages first
- Blocked by the serverPerplexityBot gets a challenge pageThe server answers PerplexityBot with a bot challenge on every key page, although robots.txt allows it. 120 pages.See the website fix
- Text without scriptsProduct text needs scriptsOn 22 product pages only 41 % of the main text is in the page as the server sends it; the rest appears after scripts run. 22 pages.See the website fix
- Structured dataPrice missing in structured dataThe Product markup has no offers.price on 14 product pages, for example Cirrus Pro. 14 pages.See the website fix
AI crawlers
| Crawler | Wanted | robots.txt | Pages readable |
|---|---|---|---|
| GPTBot | Yes | Allowed | 118 of 120 |
| OAI-SearchBot | Yes | Allowed | 118 of 120 |
| ClaudeBot | Yes | Allowed | 118 of 120 |
| PerplexityBot | Yes | Allowed | 0 of 120 |
| Bingbot | Yes | Allowed | 120 of 120 |
| Google-Extended | No | Blocked, as you chose | — |
| CCBot | No | Blocked, as you chose | — |
Key pages
120 pages · Editors can add or remove
| Page | Kind | Crawlers | Text | Data |
|---|---|---|---|---|
| /ch/ | Home | OK | 96% | OK |
| /ch/jacken/hardshell/ | Category | OK | 91% | OK |
| /ch/cirrus-pro/ | Product | 1 blocked | 41% | No price |
| /ch/cirrus-lite/ | Product | 1 blocked | 44% | No price |
| /ch/nimbus-down/ | Product | 1 blocked | 88% | OK |