User-agent: * Allow: / # ProcessWire core and internal asset directories Disallow: /processwire/ Disallow: /wire/ Disallow: /site/assets/ Disallow: /site-*/assets/