User-agent: Python-urllib Disallow: / User-agent: * Disallow: /fonts/ Disallow: /scan_management/ Disallow: /nucleo/ Disallow: /viewer/ Disallow: /js/ Disallow: /css/ Allow: /