Search engines
Crawlability
Crawlability is whether a search engine or AI crawler can reach and read a page at all. It is decided before ranking and before any judgment of quality: a page that cannot be fetched, that is blocked in robots.txt, or that returns its content only after JavaScript runs may be treated as empty. Crawlability is the precondition every other kind of optimization depends on.
Real estate sites fail here more often than most, because the content with the most value, the listings, usually arrives through a third-party widget that builds itself in the browser. A crawler that does not run JavaScript sees the page frame and nothing inside it.
The quickest check is to view the page's raw source, or fetch it with a tool that does not execute scripts, and search for a sentence that appears on the screen. If the sentence is not in the source, a text-only crawler cannot read it.
Other common causes are a stray noindex tag left over from a staging site, a robots.txt rule that blocks a whole directory, and pages reachable only through a search box, with no link pointing at them from anywhere on the site.
Why it matters
Every hour spent on content is wasted if the page cannot be fetched and read in the first place.
Related terms
Related reading
Last reviewed 2026-09-04. All Saige glossary terms.