This basically is a wrapper around the HTTP client, and tries to ensure that *all* requests meet the request limits to avoid getting blocked. |
||
---|---|---|
.. | ||
crawler | ||
db | ||
hadapi | ||
__init__.py | ||
__main__.py | ||
htmlstrip.py | ||
index.html | ||
main.js | ||
pool.py | ||
resizer.py | ||
server.py | ||
util.py | ||
wordstat.py |