|
|
485d455ea7
|
add: song inclusion
|
2025-11-10 04:29:10 +08:00 |
|
|
|
7314e43b2d
|
fix: using toISOString() instead of toUTCString()
|
2025-11-08 14:03:31 +08:00 |
|
|
|
cb6b70faf4
|
improve: more accurate snapshot timestamp
|
2025-11-08 13:59:17 +08:00 |
|
|
|
3390df291d
|
update: use gauge metric for all kinds of job duration info
|
2025-10-31 20:06:23 +08:00 |
|
|
|
3f8f47895c
|
update: push the job duration of dispatchMilestoneSnapshots to raw
|
2025-10-31 00:29:12 +08:00 |
|
|
|
9ba1a0c6f0
|
update: collection of metrics of queues
|
2025-10-30 02:34:01 +08:00 |
|
|
|
125a30f0df
|
add: metrics for queue
|
2025-10-30 01:46:34 +08:00 |
|
|
|
154c075aaf
|
add: metrics monitoring
|
2025-10-29 23:56:23 +08:00 |
|
|
|
093bc3697c
|
update: limit the range of schedule candidates for a tick
|
2025-10-29 22:01:17 +08:00 |
|
|
|
e71c2f140b
|
fix: unexpectly commented MQ init code
|
2025-10-29 21:46:23 +08:00 |
|
|
|
937482e50b
|
fix: currentSnapshot may be null in takeBulkSnapshotForVideosWorker
|
2025-10-26 23:39:53 +08:00 |
|
|
|
92dccbab9d
|
ref: full deployment config for crawler based on PM2
|
2025-10-26 22:38:22 +08:00 |
|
|
|
1a79e679bb
|
ref: use bun's redis in crawler, deployment via PM2
|
2025-10-26 17:26:11 +08:00 |
|
|
|
57992069ec
|
update: better logging
|
2025-10-21 22:50:38 +08:00 |
|
|
|
9770a487bc
|
add: logging for debugging
|
2025-10-21 22:25:57 +08:00 |
|
|
|
b25a2992e1
|
update: missing service & codePath info in some logging
|
2025-10-20 05:36:38 +08:00 |
|
|
|
c7b0174742
|
fix: the SQL to write producer column into songs table
|
2025-10-14 01:55:46 +08:00 |
|
|
|
2b04092f0a
|
update: the SQL to insert cover_url into songs table as well
|
2025-10-14 01:51:26 +08:00 |
|
|
|
9266cfb331
|
fix: incorrect math for calculating eta
|
2025-10-08 04:53:54 +08:00 |
|
|
|
39ae323269
|
fix: incorrect target for calculating eta
|
2025-10-08 04:43:53 +08:00 |
|
|
|
14be6d51b2
|
add: insert eta info into database
|
2025-10-08 04:35:47 +08:00 |
|
|
|
87d9066fa1
|
add: the server timing & prettifier plugin, update the archiveSnapshots logic
|
2025-10-08 04:03:00 +08:00 |
|
|
|
02a2a845da
|
ref: cleanup code
|
2025-10-06 17:04:16 +08:00 |
|
|
|
b40d24721c
|
add: milestone monitoring for videos close to N million views
|
2025-06-06 21:37:55 +08:00 |
|
|
|
8cf9395354
|
fix: don't adjust start time for schedule when no proxy is available
|
2025-06-06 17:11:44 +08:00 |
|
|
|
1e8d28e194
|
fix: incorrectly ignored type when collecting videos for archive snapshots
|
2025-06-06 16:52:27 +08:00 |
|
|
|
2c83b79881
|
update: termination condition to time-based in classifyVideosWorker
|
2025-05-31 12:23:01 +08:00 |
|
|
|
1a20d5afe0
|
update: schedule archive snapshots to next Saturday midnight
fix: no expire when acquiring lock for classifyVideos
ref: format
|
2025-05-31 12:13:56 +08:00 |
|
|
|
1ff71ab241
|
improve: code quality
|
2025-05-19 00:13:01 +08:00 |
|
|
|
cf7a285f57
|
fix: incorrect import for psql.d.ts, remove unnecessary benchmark files
|
2025-05-19 00:11:53 +08:00 |
|
|
|
79a37d927a
|
fix: forget to specify type when collecting videos without active schedules;
missing return when eta too long for milestone snapshot
|
2025-05-19 00:10:33 +08:00 |
|
|
|
fa5ccce83f
|
fix: incorrect import of type Psql
|
2025-05-18 00:36:39 +08:00 |
|
|
|
7786d66dbb
|
add: complete guarding under uCaptcha
|
2025-05-18 00:33:43 +08:00 |
|
|
|
b18b45078f
|
add: tokenID added to JWT in endpoint GET /captcha/:id/result
|
2025-05-17 02:15:05 +08:00 |
|
|
|
95681dcbf3
|
add: Dockerfile for crawler
|
2025-05-06 03:10:20 +08:00 |
|
|
|
59f09ca5eb
|
ref: switch to bun
|
2025-05-05 01:53:33 +08:00 |
|
|
|
94dd662c40
|
fix: module not found "net/getVideoInfo.ts"
|
2025-04-29 04:00:15 +08:00 |
|
|
|
1a86831e90
|
fix: handle ALICLOUD_PROXY_ERR error in snapshotVideoWorker
|
2025-04-24 03:42:25 +08:00 |
|
|
|
2c47105913
|
fix: incorrectly delayed milestone schedule due to UPDATE
|
2025-04-17 02:18:25 +08:00 |
|
|
|
288e4f9571
|
fix: incorrect SQL in scheduleSnapshot
|
2025-04-15 22:00:02 +08:00 |
|
|
|
7689e687ff
|
ref: extract scheduleCleanup into individual file
improve: logic of scheduleCleanup
|
2025-04-15 03:50:03 +08:00 |
|
|
|
651eef0b9e
|
fix: incorrectly set snapshot status to 'completed' when bilibili returned other status code
|
2025-04-15 03:34:45 +08:00 |
|
|
|
68bd46fd8a
|
improve: logging text in snapshotVideo.ts
|
2025-04-14 05:39:27 +08:00 |
|
|
|
13ea8fec8b
|
improve: remove unused import in snapshotTick.ts
|
2025-04-14 05:37:06 +08:00 |
|
|
|
3d9e98c949
|
ref: extract snapshotVideoWorker into individual file
|
2025-04-14 05:36:07 +08:00 |
|
|
|
c7dd1cfc2e
|
improve: unused imports in snapshotTick.ts
|
2025-04-14 05:21:06 +08:00 |
|
|
|
e0a19499e1
|
ref: move some worker functions into individual files
|
2025-04-14 05:20:35 +08:00 |
|
|
|
0930bbe6f4
|
improve: remove unused import
|
2025-04-14 05:11:35 +08:00 |
|
|
|
054d28e796
|
merge: branch 'main' into ref/structure
|
2025-04-14 05:10:44 +08:00 |
|
|
|
6df6345ec1
|
update: status of schedule when no proxy available
|
2025-04-14 00:46:43 +08:00 |
|
