# Gigbuilder marketing site — strict crawler allowlist. # Only the marketing pages may be indexed. Customer-area pages # (under /index.nsf/current-customers.html and the directory # aggregators below it) are off-limits. User-agent: * Disallow: / Allow: /$ Allow: /index.nsf/index.html Allow: /index.nsf/privacy.html Allow: /index.nsf/terms.html Allow: /index.nsf/faq.html Allow: /index.nsf/compare.html Allow: /index.nsf/api.html Allow: /robots.txt Allow: /sitemap.xml Allow: /favicon.ico