stuartl/hackaday.io-spambot-hunter
Archived
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity

crawler: Loosen up restrictions on Google+ links.

Browse Source
This commit is contained in:
Stuart Longland 2018-06-03 20:05:29 +10:00
parent 462422998d
commit 1d87af9896
Signed by: stuartl
GPG Key ID: 6AA32EFB18079BAA
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
hadsh/crawler/crawler.py
View File

@ -37,7 +37,7 @@ CHECK_PATTERNS = (
# URI whitelist
URI_WHITELIST = (
# Google Plus
re.compile(r'^https?://plus.google.com/[^/]+$'),
re.compile(r'^https?://plus.google.com/'),
# Github
re.compile(r'^https?://github.com/[^/]+$'),
# Twitter