Commit Graph

86 Commits

Author SHA1 Message Date
d7147b2d8e
server: Expose user hostname scores. 2018-06-03 18:30:00 +10:00
a4d7a0ca7a
server: Tally up the hostnames linked to by users. 2018-06-03 18:00:56 +10:00
f55795675d
server: API to use own HTTP client instance, don't pass to crawler. 2018-06-02 16:52:20 +10:00
40ad79dd3d
server: Report back error 400 on failed OAuth callback. 2018-06-02 12:47:02 +10:00
738794f0d5
server, crawler: Add ability to make non-members admins
This is done by specifying the user's UID on the command line.
2018-06-02 11:02:07 +10:00
abf0820a9a
server: Set cache control on newcomers feed.
Otherwise the browser caches the response.
2018-05-02 21:46:05 +10:00
a4d5836016
server: Set User Agent on HTTP client. 2018-05-02 20:35:00 +10:00
6d554920fe
server: Expose inspection count and next inspection time. 2018-03-03 13:24:29 +10:00
55b9c71d88
server: Report whether inspection is pending 2018-03-03 13:04:17 +10:00
bf0060e2be
server: Remove user from DeferredUsers on classification. 2018-03-03 12:59:44 +10:00
9f2402a2c8
server: Use dedicated database connection for session. 2018-03-02 22:05:13 +10:00
349c597394
server: Wrap database calls in try-finally
Close database in finally block.
2018-03-02 22:00:03 +10:00
af58e9006c
server: Connect to and close off database in worker.
Don't pass connection across threads, as it seems to leave the link
hanging.
2018-03-02 21:42:25 +10:00
870e47500a
server: Use previously tokenised words.
Since we've pretty much dealt with all users that were not previously
tokenised; we can drop that bit of backward-compatible code that
tokenises on classification.

We should be able to just commit once too, which should speed things up.
2018-03-02 21:12:46 +10:00
0de910395d
server: Handle user without detail. 2018-03-02 19:42:50 +10:00
8646c09ee1
server: Make number of users returned configurable.
Limit to 10 by default.
2018-03-02 19:41:48 +10:00
748192875a
server: Wrap ClassifyHandler in semaphore.
This has the potential to deadlock if multiple instances run together,
so wrap it in a semaphore to reduce the probability of this.
2018-03-02 19:11:36 +10:00
fa6635ba9d
server: Generate JSON response in worker thread.
Passing back the User object is not a good idea as it becomes detached
from the session.
2018-03-02 19:06:40 +10:00
d3779e0509
server: Re-locate log message output. 2018-03-02 18:47:55 +10:00
6b69f93861
server: Pass through user_id to classify handler. 2018-03-02 18:46:43 +10:00
aa0334abbc
server: Add missed thread_count argument 2018-03-02 18:40:22 +10:00
89c737687a
server: Defer classifying to worker thread.
Updating the database scores can take a while, let's not block the main
thread.
2018-03-02 18:39:18 +10:00
374e441466
server: Add a worker pool 2018-03-02 18:34:07 +10:00
dd0fbd51e5
server: Fix user classify handler 2018-03-01 22:15:15 +10:00
d98ac5e85d
server: Use separate DB instance per request.
Otherwise, if a SQL error occurs, it trips up the whole server.
2018-03-01 22:07:50 +10:00
7d0d686418
server: Retry word adjacency addition. 2018-03-01 22:02:37 +10:00
47ac3dcd64
server: Commit word adjacencies on create. 2018-03-01 21:57:04 +10:00
04b997a8e8
server: Fix typo in ClassifyHandler 2018-03-01 21:51:47 +10:00
25c9375703
server: Use previously obtained tokens if possible. 2018-02-25 20:30:51 +10:00
2bcc8191bf
server: Drop user links and detail if legit.
If we mark a user as legitimate, drop the links and user detail
associated with the user account.
2018-02-13 08:19:49 +10:00
056e469e03
server: Handle null last_update in user detail. 2018-02-03 21:49:49 +10:00
75153d2d2d
server: Switch sort order of users.
Since we're no longer getting reliable user creation times, use the user
ID instead.
2018-02-03 14:43:33 +10:00
1c1dd25cca
server: Use dedicated database instance for crawler. 2018-02-03 12:23:49 +10:00
e8531a6731
server: Report user word usage and tokens. 2018-02-03 10:46:02 +10:00
c335a24e63
server: Try to create objects in bulk lots. 2018-02-03 00:46:31 +10:00
c00a236ae2
server: Fix retrieval of words 2018-02-03 00:20:44 +10:00
6a93a997d5
server: Fix creation of WordAdjacent objects. 2018-02-03 00:14:51 +10:00
5962f3c965
server: Lowercase query not Query 2018-02-03 00:12:54 +10:00
11d2c70a33
server: Tally up word stats on classify. 2018-02-02 23:32:50 +10:00
8d7985d3ae
server: Expose number of projects 2018-02-02 11:56:29 +10:00
67df0a1bb6
server: Check session expiry, update if needed. 2018-01-19 19:40:35 +10:00
6dd86fd4b5
server: Set expiry date on session. 2018-01-17 19:35:51 +10:00
5a33a120d5
server: Return users in auto_suspect or auto_legit groups. 2018-01-11 20:59:48 +10:00
2f4997f02b
server: Order by users by creation date, then user ID. 2018-01-11 20:53:43 +10:00
6acf55a530
server: Tweak logging 2018-01-11 20:26:50 +10:00
30a8d2e219
server: Handle non-successful OAuth response. 2018-01-10 08:32:53 +10:00
8361834292
server: Fix proxying of error message. 2018-01-10 08:28:57 +10:00
8593196462
server: Handle 403 in authentication. 2018-01-10 08:21:07 +10:00
b4c54a624f
server: Wait up to a minute for the crawler. 2018-01-09 19:39:35 +10:00
fe23ad0a99
server: Expose what_i_would_like_to_do field 2018-01-08 22:43:01 +10:00