Commit Graph

123 Commits

Author SHA1 Message Date
870e47500a
server: Use previously tokenised words.
Since we've pretty much dealt with all users that were not previously
tokenised; we can drop that bit of backward-compatible code that
tokenises on classification.

We should be able to just commit once too, which should speed things up.
2018-03-02 21:12:46 +10:00
0de910395d
server: Handle user without detail. 2018-03-02 19:42:50 +10:00
8646c09ee1
server: Make number of users returned configurable.
Limit to 10 by default.
2018-03-02 19:41:48 +10:00
748192875a
server: Wrap ClassifyHandler in semaphore.
This has the potential to deadlock if multiple instances run together,
so wrap it in a semaphore to reduce the probability of this.
2018-03-02 19:11:36 +10:00
fa6635ba9d
server: Generate JSON response in worker thread.
Passing back the User object is not a good idea as it becomes detached
from the session.
2018-03-02 19:06:40 +10:00
d3779e0509
server: Re-locate log message output. 2018-03-02 18:47:55 +10:00
6b69f93861
server: Pass through user_id to classify handler. 2018-03-02 18:46:43 +10:00
aa0334abbc
server: Add missed thread_count argument 2018-03-02 18:40:22 +10:00
89c737687a
server: Defer classifying to worker thread.
Updating the database scores can take a while, let's not block the main
thread.
2018-03-02 18:39:18 +10:00
374e441466
server: Add a worker pool 2018-03-02 18:34:07 +10:00
dd0fbd51e5
server: Fix user classify handler 2018-03-01 22:15:15 +10:00
d98ac5e85d
server: Use separate DB instance per request.
Otherwise, if a SQL error occurs, it trips up the whole server.
2018-03-01 22:07:50 +10:00
7d0d686418
server: Retry word adjacency addition. 2018-03-01 22:02:37 +10:00
47ac3dcd64
server: Commit word adjacencies on create. 2018-03-01 21:57:04 +10:00
04b997a8e8
server: Fix typo in ClassifyHandler 2018-03-01 21:51:47 +10:00
25c9375703
server: Use previously obtained tokens if possible. 2018-02-25 20:30:51 +10:00
2bcc8191bf
server: Drop user links and detail if legit.
If we mark a user as legitimate, drop the links and user detail
associated with the user account.
2018-02-13 08:19:49 +10:00
056e469e03
server: Handle null last_update in user detail. 2018-02-03 21:49:49 +10:00
75153d2d2d
server: Switch sort order of users.
Since we're no longer getting reliable user creation times, use the user
ID instead.
2018-02-03 14:43:33 +10:00
1c1dd25cca
server: Use dedicated database instance for crawler. 2018-02-03 12:23:49 +10:00
e8531a6731
server: Report user word usage and tokens. 2018-02-03 10:46:02 +10:00
c335a24e63
server: Try to create objects in bulk lots. 2018-02-03 00:46:31 +10:00
c00a236ae2
server: Fix retrieval of words 2018-02-03 00:20:44 +10:00
6a93a997d5
server: Fix creation of WordAdjacent objects. 2018-02-03 00:14:51 +10:00
5962f3c965
server: Lowercase query not Query 2018-02-03 00:12:54 +10:00
11d2c70a33
server: Tally up word stats on classify. 2018-02-02 23:32:50 +10:00
8d7985d3ae
server: Expose number of projects 2018-02-02 11:56:29 +10:00
67df0a1bb6
server: Check session expiry, update if needed. 2018-01-19 19:40:35 +10:00
6dd86fd4b5
server: Set expiry date on session. 2018-01-17 19:35:51 +10:00
5a33a120d5
server: Return users in auto_suspect or auto_legit groups. 2018-01-11 20:59:48 +10:00
2f4997f02b
server: Order by users by creation date, then user ID. 2018-01-11 20:53:43 +10:00
6acf55a530
server: Tweak logging 2018-01-11 20:26:50 +10:00
30a8d2e219
server: Handle non-successful OAuth response. 2018-01-10 08:32:53 +10:00
8361834292
server: Fix proxying of error message. 2018-01-10 08:28:57 +10:00
8593196462
server: Handle 403 in authentication. 2018-01-10 08:21:07 +10:00
b4c54a624f
server: Wait up to a minute for the crawler. 2018-01-09 19:39:35 +10:00
fe23ad0a99
server: Expose what_i_would_like_to_do field 2018-01-08 22:43:01 +10:00
6eeaeb0206
server: Don't store token. 2018-01-08 22:32:15 +10:00
0e7bfe57e5
server: Implement page semantics 2018-01-08 08:34:42 +10:00
9282b4c24b
server: Fix user filter for new users. 2018-01-08 08:13:27 +10:00
1efe32b0d8
server: Fix wait for new users 2018-01-08 08:09:35 +10:00
1a0c91e13a
server: Retrieve new users from database.
No need to go out and fetch them ourselves anymore.
2018-01-08 08:05:15 +10:00
8a9a1608f5
server: Implement classification endpoint. 2018-01-07 17:30:51 +10:00
db39ddbbcb
server: Pass through project ID from command line. 2018-01-07 16:17:15 +10:00
906aaa97be
server: Expose user groups and tags 2018-01-07 15:34:08 +10:00
3de3d25b8d
server: Drop unused classes 2018-01-07 14:58:12 +10:00
a462f39358
server: Convert date/time to ISO format 2018-01-07 14:39:47 +10:00
1369a6089f
server: Show user creation date. 2018-01-07 14:38:23 +10:00
6be5e9a297
server: Retrieve page from fetch_new_users. 2018-01-07 11:36:00 +10:00
96f2e1c63f
server: Fix reference to crawler in avatar retrieval. 2018-01-07 10:08:20 +10:00
c02a5509cb
server: Fetch avatar if needed 2018-01-07 09:55:50 +10:00
4ec5e4f63d
server: Pass avatar to resizer 2018-01-07 09:19:12 +10:00
2cd07eee3e
server: Call image resizer if given a bounding box. 2018-01-07 09:08:00 +10:00
bfb9d3c322
server: Actually return data to be dumped. 2018-01-06 23:27:33 +10:00
24abb2162c
server: Add missed json import 2018-01-06 23:25:44 +10:00
5a01a9ddbe
server: Require user authentication to see JSON data. 2018-01-06 21:26:47 +10:00
0a0eb66704
server: Add endpoint for retrieving user data. 2018-01-06 21:12:45 +10:00
cc06bd8a9c
server: Re-implement OAuth2 callback using crawler 2018-01-06 20:51:41 +10:00
21ac26b685
server: Add avatar retrieval endpoint 2018-01-06 19:48:55 +10:00
415ee415ae
server: Make subclass for enforcing log-in. 2018-01-06 19:47:42 +10:00
8d5e52b5b0
server: Record current time, user details on login. 2018-01-06 19:38:15 +10:00
8d2c7bdb92
server: Pass user info to template 2018-01-06 19:27:01 +10:00
55beb123d9
server: Redirect user if not logged in. 2018-01-06 19:20:02 +10:00
624b4899b2
server: Store UUID in cookie as string 2018-01-06 19:03:33 +10:00
8adabca637
server: Fix commit of user 2018-01-06 18:57:55 +10:00
5654396ffc
server: Fix reference to database 2018-01-06 18:56:51 +10:00
f2a48694e9
server: Fix reference to HTTP client 2018-01-06 18:55:40 +10:00
f23da7844e
server: Retrieve first avatar from result set. 2018-01-06 18:53:51 +10:00
43904297d6
server: Fix avatar URL look-up 2018-01-06 18:47:02 +10:00
b592e9182c
server: Add logging 2018-01-06 18:37:35 +10:00
b1164caa90
server: Add --db-uri 2018-01-06 18:32:53 +10:00
ca800e3015
server: Drop unused parameters 2018-01-06 18:27:38 +10:00
7eed4704f1
server: Initial server implementation 2018-01-06 18:19:43 +10:00