|
|
1a20d5afe0
|
update: schedule archive snapshots to next Saturday midnight
fix: no expire when acquiring lock for classifyVideos
ref: format
|
2025-05-31 12:13:56 +08:00 |
|
|
|
2b0497c83a
|
fix: incorrect timezone when adding to bilibili metadata
|
2025-05-27 22:40:53 +08:00 |
|
|
|
3bc72720d1
|
fix: remove bull-board from all scripts to prevent crashing
|
2025-05-27 22:35:44 +08:00 |
|
|
|
1ff71ab241
|
improve: code quality
|
2025-05-19 00:13:01 +08:00 |
|
|
|
cf7a285f57
|
fix: incorrect import for psql.d.ts, remove unnecessary benchmark files
|
2025-05-19 00:11:53 +08:00 |
|
|
|
79a37d927a
|
fix: forget to specify type when collecting videos without active schedules;
missing return when eta too long for milestone snapshot
|
2025-05-19 00:10:33 +08:00 |
|
|
|
fa5ccce83f
|
fix: incorrect import of type Psql
|
2025-05-18 00:36:39 +08:00 |
|
|
|
7786d66dbb
|
add: complete guarding under uCaptcha
|
2025-05-18 00:33:43 +08:00 |
|
|
|
b18b45078f
|
add: tokenID added to JWT in endpoint GET /captcha/:id/result
|
2025-05-17 02:15:05 +08:00 |
|
|
|
44f4ee5b01
|
fix: incorrect path in build.ts in crawler
|
2025-05-06 03:42:42 +08:00 |
|
|
|
95681dcbf3
|
add: Dockerfile for crawler
|
2025-05-06 03:10:20 +08:00 |
|
|
|
59f09ca5eb
|
ref: switch to bun
|
2025-05-05 01:53:33 +08:00 |
|
|
|
94dd662c40
|
fix: module not found "net/getVideoInfo.ts"
|
2025-04-29 04:00:15 +08:00 |
|
|
|
e72b3008d1
|
ref: switch to bun & postgres.js for backend
|
2025-04-29 00:07:12 +08:00 |
|
|
|
1a86831e90
|
fix: handle ALICLOUD_PROXY_ERR error in snapshotVideoWorker
|
2025-04-24 03:42:25 +08:00 |
|
|
|
244298913a
|
fix: comparison condition error in scheduleSnapshot
|
2025-04-18 22:38:02 +08:00 |
|
|
|
2c47105913
|
fix: incorrectly delayed milestone schedule due to UPDATE
|
2025-04-17 02:18:25 +08:00 |
|
|
|
6eaaf921d6
|
fix: ignored the case of inserting schedule when type = 'milestone' in scheduleSnapshot
|
2025-04-15 22:06:14 +08:00 |
|
|
|
288e4f9571
|
fix: incorrect SQL in scheduleSnapshot
|
2025-04-15 22:00:02 +08:00 |
|
|
|
907c0a6976
|
fix: update started_at instead of returning for milestone snapshots in scheduleSnapshot
|
2025-04-15 21:42:02 +08:00 |
|
|
|
7689e687ff
|
ref: extract scheduleCleanup into individual file
improve: logic of scheduleCleanup
|
2025-04-15 03:50:03 +08:00 |
|
|
|
651eef0b9e
|
fix: incorrectly set snapshot status to 'completed' when bilibili returned other status code
|
2025-04-15 03:34:45 +08:00 |
|
|
|
68bd46fd8a
|
improve: logging text in snapshotVideo.ts
|
2025-04-14 05:39:27 +08:00 |
|
|
|
13ea8fec8b
|
improve: remove unused import in snapshotTick.ts
|
2025-04-14 05:37:06 +08:00 |
|
|
|
3d9e98c949
|
ref: extract snapshotVideoWorker into individual file
|
2025-04-14 05:36:07 +08:00 |
|
|
|
c7dd1cfc2e
|
improve: unused imports in snapshotTick.ts
|
2025-04-14 05:21:06 +08:00 |
|
|
|
e0a19499e1
|
ref: move some worker functions into individual files
|
2025-04-14 05:20:35 +08:00 |
|
|
|
0930bbe6f4
|
improve: remove unused import
|
2025-04-14 05:11:35 +08:00 |
|
|
|
054d28e796
|
merge: branch 'main' into ref/structure
|
2025-04-14 05:10:44 +08:00 |
|
|
|
0614067278
|
update: handler for SIGINT & SIGTERM
|
2025-04-14 00:49:57 +08:00 |
|
|
|
6df6345ec1
|
update: status of schedule when no proxy available
|
2025-04-14 00:46:43 +08:00 |
|
|
|
bae1f84bea
|
add: logging for releasing locks
|
2025-04-14 00:39:17 +08:00 |
|
|
|
21c918f1fa
|
fix: BitInt serialization in bulkSnapshotTickWorker
|
2025-04-14 00:32:06 +08:00 |
|
|
|
f1651fee30
|
fix: did not release lock for dispatchArchiveSnapshots when quitting
|
2025-04-14 00:28:45 +08:00 |
|
|
|
d0b7d93e5b
|
fix: incorrect logging text in archiveSnapshotsWorker
|
2025-04-14 00:26:59 +08:00 |
|
|
|
7a7c5cada9
|
feat: full snapshot archiving for all videos
|
2025-04-14 00:25:39 +08:00 |
|
|
|
10b761e3db
|
improve: query for getVideosNearMilestone
|
2025-04-14 00:07:50 +08:00 |
|
|
|
1f6411b512
|
fix: added lower limit in collecting videos near 100k milestone
|
2025-04-14 00:02:00 +08:00 |
|
|
|
9ef513eed7
|
update: add randomness in interval of re-scheduling when no proxy available
|
2025-04-13 23:55:43 +08:00 |
|
|
|
d80a6bfcd9
|
add: restarting when process quit
|
2025-04-13 23:15:09 +08:00 |
|
|
|
b080c51c3e
|
merge: branch 'main' into ref/structure
|
2025-04-13 18:38:34 +08:00 |
|
|
|
f4d08e944a
|
fix: expand the candidate range of milestone snapshot
|
2025-04-13 16:50:19 +08:00 |
|
|
|
a9582722f4
|
ref: wrap some worker functions with withDbConnection
|
2025-04-13 05:06:52 +08:00 |
|
|
|
4ee4d2ede9
|
ref: move some functions into separate files
|
2025-04-12 02:08:04 +08:00 |
|
|
|
f21ff45dd3
|
version: crawler/1.0.26
|
2025-04-08 02:12:04 +08:00 |
|
|
|
fc90dad185
|
ref: move some common files to @core
|
2025-04-08 02:05:44 +08:00 |
|
|
|
0b36f52c6c
|
merge: branch 'feat/backend' into ref/structure
|
2025-04-08 01:43:46 +08:00 |
|
|
|
71ed0bd66b
|
feat: videoInfo API in backend
|
2025-04-07 21:29:53 +08:00 |
|
|
|
b76d8e589c
|
merge: branch 'main' into ref/structure
|
2025-04-07 02:44:21 +08:00 |
|
|
|
69fb3604b1
|
fix: missing setSnapshotStatus in takeSnapshotForVideoWorker
|
2025-04-07 00:41:27 +08:00 |
|
