User-agent: * # Allow crawling so page-level and header-level “noindex” directives are picked up. # Once URLs are de-indexed (verify in Search Console), you can re-add Disallow rules.