User-agent: * Disallow: /assets/* Disallow: /common/assets/* Disallow: /cgibin/