Crawling & indexing
Search engines must be able to fetch a page and decide to store it before it can rank. Robots rules, canonicals, sitemaps and status codes control this.
A structured path through search engine optimisation — from how Google crawls and ranks pages to technical fixes, audits and measurement.
Short answer
Search engine optimisation (SEO) is the practice of making a website easy for search engines to crawl, understand and trust, so its pages rank for the searches your customers make. It combines technical health (crawling, indexing, speed), relevant content that satisfies search intent, and authority signals such as links and brand mentions.
Key concepts
Understand these and most SEO advice — and most vendor pitches — becomes much easier to evaluate.
Search engines must be able to fetch a page and decide to store it before it can rank. Robots rules, canonicals, sitemaps and status codes control this.
Every query has a job behind it — learn, compare, buy or find a place. Pages rank when their format and depth match that job.
Titles, headings, body copy and internal anchor text tell search engines which topic a page covers and which query it deserves.
Clear topic clusters and internal links spread authority to important pages and help crawlers discover new ones quickly.
Core Web Vitals (LCP, INP, CLS), mobile usability and HTTPS affect how users experience a page and are part of Google’s ranking systems.
Experience, expertise, authoritativeness and trust come from real authorship, cited sources, reviews and links from relevant sites.
Learning path
Each step builds on the one before. Work through them in sequence, or jump to the step that matches where you are.
Understand how crawling, indexing and ranking fit together before changing anything.
Browse SEO articlesLearn the infrastructure layer: status codes, canonicals, rendering, sitemaps and Core Web Vitals.
Browse SEO articlesApply what you learnt with our 26-point checklist, grouped by priority.
Open the Technical SEO ChecklistTurn the checklist into a prioritised list of issues for your own site.
Browse SEO articlesSee how we run technical, content and authority work as one programme.
Search Engine Optimization servicesHave a strategist review your site and send prioritised fixes — free.
Get a free SEO auditFrom the blog
In-depth guides from our strategists on SEO for Indian and global brands.
A practical technical SEO checklist for Indian business websites — covering indexing, mobile performance, Core Web Vitals, site structure, structured...
Read articleGo further
Technical, on-page and off-page SEO that makes your website fast, relevant and trusted — so it earns visibility for the searches that bring...
How to make your content the answer — in featured snippets, People Also Ask, voice assistants and conversational search.
How brands get mentioned and cited in ChatGPT, Gemini, Perplexity, Copilot and Google AI Overviews — and how to measure it.
26 checks across crawling, indexing, architecture, on-page, performance and measurement — each with the reason it matters.
A cross-platform check of how ready your brand is for Google AI Overviews, ChatGPT search, Perplexity, Gemini and Copilot.
FAQ
Free · No obligation
Find out what is holding your website back across Google, answer engines and AI search — with a prioritised list of fixes.
We value your privacy
We use analytics cookies to understand which pages help visitors and to improve our site. They load only if you accept.