User-agent: *
Disallow: /widgets/embed
Disallow: /widgets?

# The embed is the iframe body behind the widget builder and behind every widget
# a customer has installed. It already carries noindex,nofollow, so Google gains
# nothing by fetching it. Measured 2026-08-29: 7,696 of 8,177 embed requests in
# one day were Googlebot, across 3,171 different towns.
#
# /widgets? is the same builder with a town in its own URL, which is a
# near-infinite crawl space: 14,775 towns times a dozen widget types. Every
# variant already carries a canonical back to /widgets, but a canonical does not
# stop crawling. Measured 2026-09-08: /widgets? was the single most crawled path
# on the site, 36 of 708 Googlebot requests that day, while 12,826 real pages sat
# in "discovered, currently not indexed". Google also logged 1,394 of these URLs
# as 5xx around 2026-09-01, which is what put a server-error block in Search
# Console. The plain /widgets page stays crawlable.

Sitemap: https://www.weatherengland.com/sitemap.xml