robotparser | index /System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/robotparser.py Module Docs |
robotparser.py
Copyright (C) 2000 Bastian Kleineidam
You can choose between two licenses when using this package:
1) GNU GPLv2
2) PSF license for Python 2.2
The robots.txt Exclusion Protocol is implemented as specified in
http://www.robotstxt.org/norobots-rfc.txt
Modules | ||||||
|
Classes | ||||||||||
|
Data | ||
__all__ = ['RobotFileParser'] |