User-Agent: * Allow: /directory/subdirectory/file.asp Allow: /directory/file.htm Allow: /directory/subdirectory/ Allow: /directory/subdirectory/file.htm Allow: /directory/file.asp Allow: /directory/file.html Allow: /directory/subdirectory/file.html Allow: /