Main categories: - ai-only/ - private/ - public/ - search-only/
Of course, do not forget to check out robots.txt!