Technical SEO: the foundations AI and Google both reward

Technical SEO is the layer that decides whether search engines and AI systems can find, read and trust your site in the first place. You can write brilliant content, but if a page can't be crawled, loads slowly, or confuses the machine trying to parse it, none of it counts. These foundations matter more in the AI era, not less — AI can't cite what it can't read.

1. Crawlability and indexing

If Google can't crawl a page, it can't rank it — and AI can't quote it.

• robots.txt should allow the pages you want found, and increasingly, the AI crawlers too (GPTBot, PerplexityBot, Google-Extended and friends) if you want to be cited in AI answers.
• XML sitemap — keep it current so crawlers find new and updated pages.
• No accidental noindex on pages you want ranked (a shockingly common self-inflicted wound).

2. Site speed and Core Web Vitals

Speed is both a ranking factor and a conversion factor. Google measures it through Core Web Vitals — loading, interactivity and visual stability.

• Optimise images, defer non-critical scripts, and lean on modern hosting/CDN.
• Test on mobile, where most searches happen and most sites are slowest.
• Every second of load costs you rankings and conversions — the same fix helps both.

3. Structure a machine can follow

Both Google and AI parse your page by its structure:

• One clear H1, then a logical heading hierarchy that mirrors the content.
• Descriptive URLs, titles and meta descriptions.
• Internal linking that connects related pages into a coherent topic cluster — it spreads authority and helps crawlers understand what you're an authority on.

4. Structured data (schema)

Schema markup tells search and AI systems exactly what your content is — a business, an article, an FAQ, a product, a location. It's one of the clearest signals you can give a machine, and it powers rich results and easier AI citation. Full explainer: Schema markup: how structured data helps AI understand your business.

5. Mobile and HTTPS basics

• Mobile-first — Google indexes the mobile version of your site; it must be fully functional, not a stripped-down afterthought.
• HTTPS — non-negotiable table stakes for trust and ranking.

Why this matters more with AI

Content and backlinks get the attention, but they sit on top of the technical layer. AI answer engines are, if anything, less forgiving than classic search: they favour sources they can crawl cleanly and parse confidently. A messy, slow, poorly-structured site simply won't make it into the answer. (This is a big part of why SEO still matters in the AI era.)

The order to fix things

1. Crawlability — can they reach and index it (including AI bots)?
2. Speed — Core Web Vitals, especially on mobile.
3. Structure — headings, URLs, internal links.
4. Schema — tell machines exactly what everything is.

Get the foundation right and everything you build on top — content, authority, AI citations — actually counts. It's the first thing we fix in Search & AI Visibility. Not sure what's holding your site back? Get an AI Growth Audit.