# Open the entire subdomain to all search and AI discovery engines User-agent: * Allow: / Disallow: # Ensure OpenAI's semantic summary crawler has priority clearance User-agent: OAI-SearchBot Allow: / # Ensure Google's semantic crawler has priority clearance User-agent: Googlebot Allow: /