1
0
Commit Graph

122 Commits

Author SHA1 Message Date
92db443e6b
update: include old data in history table 2025-11-23 13:12:55 +08:00
558658feea
fix: some bugs in snapshotSchedule 2025-11-19 03:11:21 +08:00
871a0f1f65
fix: regular snapshot interval will set to 24 hrs if recent two snapshots are too close, this may cause problems 2025-11-19 02:39:54 +08:00
4851a69b91
add: more new snapshots for new songs, script for fullSnapshot 2025-11-19 02:28:05 +08:00
2d71ed7a60
fix: incorrect published_at for new songs 2025-11-19 00:24:55 +08:00
05de9dda5b
fix: drizzle generating malformed SQL causing getVideosNearMilestone() crash 2025-11-18 20:34:33 +08:00
a95b9f76be
update: version number
fix: version number in frontend
2025-11-17 05:21:07 +08:00
9f84003544
fix: some bugs in crawler package 2025-11-17 02:54:35 +08:00
30f8a2ffe8
ref: switch to drizzle, add history 2025-11-17 01:34:14 +08:00
50d6e0f498
improve: frontend & backend 2025-11-10 07:30:22 +08:00
b9b3dc5aae
fix: some bugs, ready for deployment 2025-11-10 05:04:00 +08:00
485d455ea7
add: song inclusion 2025-11-10 04:29:10 +08:00
7314e43b2d fix: using toISOString() instead of toUTCString() 2025-11-08 14:03:31 +08:00
cb6b70faf4
improve: more accurate snapshot timestamp 2025-11-08 13:59:17 +08:00
3390df291d update: use gauge metric for all kinds of job duration info 2025-10-31 20:06:23 +08:00
3f8f47895c update: push the job duration of dispatchMilestoneSnapshots to raw 2025-10-31 00:29:12 +08:00
9ba1a0c6f0 update: collection of metrics of queues 2025-10-30 02:34:01 +08:00
125a30f0df add: metrics for queue 2025-10-30 01:46:34 +08:00
0f22f19572 update: increase frequency of exporting data 2025-10-30 00:52:04 +08:00
154c075aaf add: metrics monitoring 2025-10-29 23:56:23 +08:00
55535a16ce update: the rate limit config 2025-10-29 22:49:21 +08:00
093bc3697c update: limit the range of schedule candidates for a tick 2025-10-29 22:01:17 +08:00
e71c2f140b fix: unexpectly commented MQ init code 2025-10-29 21:46:23 +08:00
937482e50b fix: currentSnapshot may be null in takeBulkSnapshotForVideosWorker 2025-10-26 23:39:53 +08:00
92dccbab9d ref: full deployment config for crawler based on PM2 2025-10-26 22:38:22 +08:00
1a79e679bb ref: use bun's redis in crawler, deployment via PM2 2025-10-26 17:26:11 +08:00
57992069ec update: better logging 2025-10-21 22:50:38 +08:00
9770a487bc add: logging for debugging 2025-10-21 22:25:57 +08:00
b25a2992e1 update: missing service & codePath info in some logging 2025-10-20 05:36:38 +08:00
f8192d5241 fix: missing check for latestActiveSchedule 2025-10-20 05:24:25 +08:00
c7b0174742 fix: the SQL to write producer column into songs table 2025-10-14 01:55:46 +08:00
2b04092f0a update: the SQL to insert cover_url into songs table as well 2025-10-14 01:51:26 +08:00
efa1a71512 fix: forgot to set updated_at column of the eta table 2025-10-13 23:07:13 +08:00
82022231d1 improve: range of the milestone candidates 2025-10-08 05:33:11 +08:00
9266cfb331 fix: incorrect math for calculating eta 2025-10-08 04:53:54 +08:00
39ae323269 fix: incorrect target for calculating eta 2025-10-08 04:43:53 +08:00
14be6d51b2 add: insert eta info into database 2025-10-08 04:35:47 +08:00
87d9066fa1 add: the server timing & prettifier plugin, update the archiveSnapshots logic 2025-10-08 04:03:00 +08:00
02a2a845da ref: cleanup code 2025-10-06 17:04:16 +08:00
4e08168ef4 merge: ref/solid into main branch 2025-10-04 23:42:59 +08:00
394b73505e add: the drizzle stuff into @core and a todo for new bilibili API, update the .gitignore. 2025-09-22 02:23:48 +08:00
21be7883c4 update: metadata archive script 2025-09-06 03:12:24 +08:00
b40d24721c
add: milestone monitoring for videos close to N million views 2025-06-06 21:37:55 +08:00
b4a0320e3e
version: cvsa/3.15.34 2025-06-06 17:40:32 +08:00
8cf9395354
fix: don't adjust start time for schedule when no proxy is available 2025-06-06 17:11:44 +08:00
1e8d28e194
fix: incorrectly ignored type when collecting videos for archive snapshots 2025-06-06 16:52:27 +08:00
54a2de0a11
Merge branch 'main' into ref/next 2025-06-05 22:30:19 +08:00
507f2c331e
add: several pages, synced with old frontend 2025-06-02 04:04:17 +08:00
a1a4abff46
fix: missing import in @cvsa/core 2025-06-01 21:31:37 +08:00
2c83b79881
update: termination condition to time-based in classifyVideosWorker 2025-05-31 12:23:01 +08:00