# # Access control file for robot web mappers # # For more information, refer to: # # http://web.nexor.co.uk/mak/doc/robots/norobots.html # # Robots may access //www.haystack.edu with the following restrictions # # Updated by AMG on 3 June 1997 # Updated to add everything beyond logs on 10/04/2001 # 9/2/03 - added /madrigal/tempReports/, /midas/display_acfspec_plots, and /sopac/ # 9/22/03 - added /NSFreview/ # 5/05/06 - total rewrite for launching the new web site # 5/08/06 - root directory cleaned and old stuff moved to /old/ # 7/11/08 - added /mwatelescope/ # 2/20/09 - added /ast/arrays/mwa/, /ozone/, /errors/, /mediaplayer/ # User-agent: * Disallow: /old/ Disallow: /isr/ Disallow: /cgi-bin/ Disallow: /logs/ Disallow: /icons/ Disallow: /save/ Disallow: /private/ Disallow: /madrigal/experiments/ Disallow: /madrigal/tempReports/ Disallow: /AMG/ Disallow: /BRIDEOUT/ Disallow: /DPS/ Disallow: /FLIND/ Disallow: /JCF/ Disallow: /JMH/ Disallow: /PJE/ Disallow: /tmp/ Disallow: /testsite/ Disallow: /scripts/ Disallow: /templates/ Disallow: /mwatelescope/ Disallow: /ast/arrays/mwa/ Disallow: /ozone/ Disallow: /errors/ Disallow: /mediaplayer/