stuartl/hackaday.io-spambot-hunter
Archived
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity

crawler: Fix return when no new user data exists.

Browse Source
This commit is contained in:
Stuart Longland 2018-07-01 14:27:04 +10:00
parent 9e2f145cbc
commit caf7fd18c0
Signed by: stuartl
GPG Key ID: 6AA32EFB18079BAA
1 changed files with 3 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
hadsh/crawler/crawler.py
View File

@ -865,6 +865,9 @@ class Crawler(object):
users.append((user, new)) users.append((user, new))
else: else:
users.append(user) users.append(user)
else:
# No new user data
new_user_data = {}
page += 1 page += 1
raise Return((users, page, new_user_data.get('last_page'))) raise Return((users, page, new_user_data.get('last_page')))