|
|
48b1130cba
|
feat: continuous monitoring of new songs
|
2025-03-24 04:53:43 +08:00 |
|
|
|
42db333d1a
|
temp: schedule for new songs
|
2025-03-24 04:40:10 +08:00 |
|
|
|
0a73d28623
|
fix: incorrect time base when adjusting snapshot time
|
2025-03-24 04:15:51 +08:00 |
|
|
|
584a1be9f9
|
test: debug for adjusting snapshot time
|
2025-03-24 04:08:34 +08:00 |
|
|
|
20731c0530
|
test: debug for init window
|
2025-03-24 04:05:22 +08:00 |
|
|
|
cb573e55d9
|
fix: incorrect offset when initializing
|
2025-03-24 04:01:44 +08:00 |
|
|
|
3028dc13c7
|
improve: performance when dispatching jobs
|
2025-03-24 02:35:55 +08:00 |
|
|
|
0be961e709
|
improve: target time finding
|
2025-03-23 23:31:16 +08:00 |
|
|
|
35d58be8fd
|
fix: may accessing a non-existent schedule
|
2025-03-23 21:42:05 +08:00 |
|
|
|
3a0dd26c68
|
fix: only 1 pending task at a time
|
2025-03-23 21:36:40 +08:00 |
|
|
|
9e764746fb
|
update: better task retrieval for snapshotTick
add: logging when snapshot the video
|
2025-03-23 20:49:41 +08:00 |
|
|
|
33c63fc29f
|
fix: NaN caused by not converting date string to timestamp
|
2025-03-23 20:41:13 +08:00 |
|
|
|
7768a202b2
|
fix: failed to serialize bigint correctly
|
2025-03-23 20:23:00 +08:00 |
|
|
|
8652ac8fb7
|
fix: bugs of snapshot scheduling
|
2025-03-23 19:45:52 +08:00 |
|
|
|
18fc9752bb
|
fix: several bugs of snapshot scheduling
|
2025-03-23 18:46:25 +08:00 |
|
|
|
2c12310e8c
|
feat: snapshot based on persistent schedule
|
2025-03-23 17:44:59 +08:00 |
|
|
|
e38dc96275
|
update: insertion of snapshot schedule
|
2025-03-22 20:51:28 +08:00 |
|
|
|
9f9ef800d1
|
merge: hotfix into ref/snapshot
|
2025-03-22 01:48:03 +08:00 |
|
|
|
fabb77d98d
|
fix: inefficient SQL query for getting songs close to milestone
|
2025-03-22 00:28:47 +08:00 |
|
|
|
2e8ed7ce70
|
add: ETA estimation for short-term snapshot
|
2025-03-20 01:57:33 +08:00 |
|
|
|
cd8aa826e1
|
fix: prevent videos from being crawled for too long
|
2025-03-17 00:33:28 +08:00 |
|
|
|
b07d0c18f9
|
update: preparation for snapshotSchedule
|
2025-03-17 00:25:31 +08:00 |
|
|
|
a6c8fd7f3f
|
ref: code structure related to AI
|
2025-03-16 01:23:10 +08:00 |
|
|
|
7104a95af9
|
ref: rename table all_data, bili_user to bilibili_metadata, bilibili_user
|
2025-03-15 21:27:19 +08:00 |
|
|
|
5af2236109
|
temp: remove the scheduleSnapshotTick job
|
2025-03-15 21:25:26 +08:00 |
|
|
|
e12275dbd4
|
fix: zero division error
|
2025-03-11 23:50:21 +08:00 |
|
|
|
bce4161501
|
improve: better eta prediction
|
2025-03-11 23:40:15 +08:00 |
|
|
|
7ac2d2c217
|
update: completed snapshot for videos close to milestone
|
2025-03-09 19:36:19 +08:00 |
|
|
|
5cc2afeb0e
|
add: snapshot feat for new videos and songs near milestone
|
2025-03-09 05:35:20 +08:00 |
|
|
|
fa414e89ce
|
add: insert labelled songs into songs table
|
2025-03-08 00:55:29 +08:00 |
|
|
|
47e47f2b12
|
add: func:getUnArchivedBiliUsers
|
2025-03-02 18:48:01 +08:00 |
|
|
|
1720ff332e
|
fix: undefined reference of userRow
|
2025-03-02 18:39:36 +08:00 |
|
|
|
012887d1d9
|
fix: missing uid in bili_user causes undefined reference
|
2025-03-02 18:17:43 +08:00 |
|
|
|
5b0e27465b
|
update: author_info in classification
|
2025-03-02 02:54:30 +08:00 |
|
|
|
1838219f04
|
ref: separate fetching of aid list and video metadata
|
2025-03-02 02:38:50 +08:00 |
|
|
|
95fa08b517
|
update: increase db pool limit
|
2025-02-22 22:21:09 +08:00 |
|
|
|
d2f9f28608
|
update: limited db pool size to save memory
|
2025-02-22 22:06:51 +08:00 |
|
|
|
f70401846a
|
add: more logging for filter's workers
|
2025-02-22 21:43:09 +08:00 |
|
|
|
cecc1c1d2c
|
add: classifyVideo & classifyVideos implementation
|
2025-02-22 19:57:52 +08:00 |
|
|
|
4b48357ab6
|
update: insert duration as metadata
|
2025-02-14 03:06:39 +08:00 |
|
|
|
d870627220
|
update: added tags fetching
|
2025-02-12 00:18:56 +08:00 |
|
|
|
471a522d05
|
update: getVideoTags with NetScheduler
improve: extracted PostgreSQL config
|
2025-02-11 00:37:40 +08:00 |
|
|
|
248978a3e8
|
improve: error handling for NetScheduler
fix: incorrect test code
|
2025-02-10 22:48:37 +08:00 |
|
|
|
1b714f1a84
|
fix: unhandled insertion conflict in db/allData.ts
|
2025-02-09 23:28:52 +08:00 |
|
|
|
63874eef20
|
ref: use custom logger
|
2025-02-09 22:38:45 +08:00 |
|
|
|
b4421a3b18
|
fix: job won't actually execute
|
2025-02-09 02:26:52 +08:00 |
|
|
|
0c589b5d20
|
update: the video list fetching workflow
|
2025-02-08 23:15:47 +08:00 |
|
|
|
b21e6da07a
|
update: structurize video insertion code, use js-compatible filter model arch
|
2025-02-08 00:36:40 +08:00 |
|
