# robots.txt — hedimanai.vercel.app # Change the Sitemap line if the domain moves; nothing else here is host-bound. User-agent: * Allow: / Disallow: /Hedi%20Manai%20-%20Website%20Redesign.html Disallow: /.claude/ Disallow: /CLAUDE.md Disallow: /DESIGN.md Disallow: /PLAN.md Sitemap: https://hedimanai.vercel.app/sitemap.xml # --- AI crawlers, explicitly allowed -------------------------------------- # Not decoration. These agents are the retrieval layer behind ChatGPT Search, # Claude, Perplexity and Google's AI Overviews. A site that stays silent here # is at the mercy of each crawler's default, and a site that blocks them is # invisible to the search surface that is growing fastest. This is a technical # curriculum whose whole value is being cited as a source — so it opts in. # # One group, every agent. A crawler that matches a named group ignores the * # group completely, so the exclusions below have to be repeated here or the # 1 MB design mockup gets crawled by exactly the agents this site cares about. User-agent: GPTBot User-agent: ChatGPT-User User-agent: OAI-SearchBot User-agent: ClaudeBot User-agent: Claude-User User-agent: Claude-SearchBot User-agent: PerplexityBot User-agent: Google-Extended User-agent: Applebot-Extended User-agent: CCBot Allow: / Disallow: /Hedi%20Manai%20-%20Website%20Redesign.html Disallow: /.claude/ Disallow: /CLAUDE.md Disallow: /DESIGN.md Disallow: /PLAN.md