Robots.txt Isn’t a Noindex: The Quiet SEO Failure That’s Letting Spam Pages Get Indexed (And How To Fix It)
A small robots.txt “quirk” can make Googlebot ignore the rules you thought protected you—especially during search box spam attacks. Here’s what changed, why it matters, and a practical playbook for SMEs, ecommerce teams, and agencies to prevent unwanted indexing and protect organic visibility.