Commit Graph

39 Commits

Author SHA1 Message Date
9a85da0532
update: handling for deleted videos 2025-03-09 22:57:26 +08:00
81b95c9569
update: minimum interval for snapshotMilestoneVideo 2025-03-09 22:52:12 +08:00
a138f6d572
add: auto-removal of jobs, aliyun-fc auto retry 2025-03-09 22:34:23 +08:00
d5a317ea34
update: save both stdout and stderr for aliyunfc error handling 2025-03-09 22:16:54 +08:00
2c503df172
add: raw output dump in aliyun-fc error handling 2025-03-09 22:11:46 +08:00
8721089e7c
update: proxies that can be used to snapshot 2025-03-09 22:02:16 +08:00
7ac2d2c217
update: completed snapshot for videos close to milestone 2025-03-09 19:36:19 +08:00
5cc2afeb0e
add: snapshot feat for new videos and songs near milestone 2025-03-09 05:35:20 +08:00
fa414e89ce
add: insert labelled songs into songs table 2025-03-08 00:55:29 +08:00
2a2e65804f
merge: branch 'feat/user-info' to main 2025-03-05 00:24:18 +08:00
da47c0ab66
update: alicloud-fc support in NetScheduler 2025-03-05 00:23:16 +08:00
3842c63ad1
add: filter model V3.17 with deployment 2025-03-03 02:09:45 +08:00
47e47f2b12
add: func:getUnArchivedBiliUsers 2025-03-02 18:48:01 +08:00
f7e71c22f6
fix: empty author_info passed in that causes filter model to crash 2025-03-02 03:02:27 +08:00
5a22564526
fix: incorrect limiter key in triggerLimiter 2025-03-02 03:00:28 +08:00
5b0e27465b
update: author_info in classification 2025-03-02 02:54:30 +08:00
ecb44b9cba
update: interval between 2 getVideoInfo, rate limit for this task 2025-03-02 02:45:48 +08:00
1838219f04
ref: separate fetching of aid list and video metadata 2025-03-02 02:38:50 +08:00
c67e3d8e36
fix: incorrect key in setProviderLimiter of Scheduler 2025-02-26 01:48:18 +08:00
7566722d04
update: support for provider-level limiter in NetScheduler
add: fn:getLatestVideoAids()
2025-02-26 01:40:01 +08:00
232585594a
add: provider in NetScheduler, missing await 2025-02-26 00:55:48 +08:00
73b96e869d
fix: move filter model init to an earlier stage 2025-02-22 22:29:30 +08:00
c23753aceb
update: add lock for classifyVideo 2025-02-22 22:00:34 +08:00
f70401846a
add: more logging for filter's workers 2025-02-22 21:43:09 +08:00
b14a43f63f
fix: feeding empty data to the filter model 2025-02-22 20:56:57 +08:00
cecc1c1d2c
add: classifyVideo & classifyVideos implementation 2025-02-22 19:57:52 +08:00
f78f7fabdd
ref: remove data/ from git
update: inference code for filter model
2025-02-14 02:04:07 +08:00
7797fef685
fix: didn't release after connected to database
add: gracefully shutdown
2025-02-12 01:47:34 +08:00
d870627220
update: added tags fetching 2025-02-12 00:18:56 +08:00
471a522d05
update: getVideoTags with NetScheduler
improve: extracted PostgreSQL config
2025-02-11 00:37:40 +08:00
248978a3e8
improve: error handling for NetScheduler
fix: incorrect test code
2025-02-10 22:48:37 +08:00
e570e3bbff
add: task specified request for NetScheduler 2025-02-10 21:42:32 +08:00
0a34c9a444
add: the net scheduler 2025-02-10 21:32:03 +08:00
e72e817152
fix: did not release DB connection after using it 2025-02-09 23:29:33 +08:00
63874eef20
ref: use custom logger 2025-02-09 22:38:45 +08:00
2585025f69
ref: use jobscheduler for getLatestVideos 2025-02-09 21:06:14 +08:00
b4421a3b18
fix: job won't actually execute 2025-02-09 02:26:52 +08:00
0c589b5d20
update: the video list fetching workflow 2025-02-08 23:15:47 +08:00
b21e6da07a
update: structurize video insertion code, use js-compatible filter model arch 2025-02-08 00:36:40 +08:00