Commit Graph

255 Commits

Author SHA1 Message Date
a138f6d572
add: auto-removal of jobs, aliyun-fc auto retry 2025-03-09 22:34:23 +08:00
d5a317ea34
update: save both stdout and stderr for aliyunfc error handling 2025-03-09 22:16:54 +08:00
2c503df172
add: raw output dump in aliyun-fc error handling 2025-03-09 22:11:46 +08:00
8721089e7c
update: proxies that can be used to snapshot 2025-03-09 22:02:16 +08:00
7ac2d2c217
update: completed snapshot for videos close to milestone 2025-03-09 19:36:19 +08:00
5cc2afeb0e
add: snapshot feat for new videos and songs near milestone 2025-03-09 05:35:20 +08:00
fa414e89ce
add: insert labelled songs into songs table 2025-03-08 00:55:29 +08:00
98e063e86c
add: a simple tdd spider 2025-03-06 23:37:13 +08:00
2a2e65804f
merge: branch 'feat/user-info' to main 2025-03-05 00:24:18 +08:00
da47c0ab66
update: alicloud-fc support in NetScheduler 2025-03-05 00:23:16 +08:00
3842c63ad1
add: filter model V3.17 with deployment 2025-03-03 02:09:45 +08:00
748e2e2aaa
add: support for inference of filter model V3.13 2025-03-03 01:06:55 +08:00
b84f8a1f3e
ref: return to cascade classifier 2025-03-03 00:57:25 +08:00
f08a863ac6
update: seperate two classifiers 2025-03-03 00:56:02 +08:00
f488c3ceda
add: filter model based on cascade classifier (V3.12) 2025-03-02 23:45:32 +08:00
3aa3bc8596
add: filter model based on CNN(V6.0) 2025-03-02 23:06:19 +08:00
47e47f2b12
add: func:getUnArchivedBiliUsers 2025-03-02 18:48:01 +08:00
1720ff332e
fix: undefined reference of userRow 2025-03-02 18:39:36 +08:00
012887d1d9
fix: missing uid in bili_user causes undefined reference 2025-03-02 18:17:43 +08:00
f7e71c22f6
fix: empty author_info passed in that causes filter model to crash 2025-03-02 03:02:27 +08:00
5a22564526
fix: incorrect limiter key in triggerLimiter 2025-03-02 03:00:28 +08:00
5b0e27465b
update: author_info in classification 2025-03-02 02:54:30 +08:00
ecb44b9cba
update: interval between 2 getVideoInfo, rate limit for this task 2025-03-02 02:45:48 +08:00
1838219f04
ref: separate fetching of aid list and video metadata 2025-03-02 02:38:50 +08:00
c67e3d8e36
fix: incorrect key in setProviderLimiter of Scheduler 2025-02-26 01:48:18 +08:00
7566722d04
update: support for provider-level limiter in NetScheduler
add: fn:getLatestVideoAids()
2025-02-26 01:40:01 +08:00
232585594a
add: provider in NetScheduler, missing await 2025-02-26 00:55:48 +08:00
15312f4078
update: filter model benchmark 2025-02-22 22:53:40 +08:00
73b96e869d
fix: move filter model init to an earlier stage 2025-02-22 22:29:30 +08:00
95fa08b517
update: increase db pool limit 2025-02-22 22:21:09 +08:00
d2f9f28608
update: limited db pool size to save memory 2025-02-22 22:06:51 +08:00
9da623e731
fix: unsupported version of onnxruntime in linux 2025-02-22 22:01:45 +08:00
c23753aceb
update: add lock for classifyVideo 2025-02-22 22:00:34 +08:00
46191cfd56
fix: unintended local_files_only in loading the tokenizer 2025-02-22 21:48:17 +08:00
f70401846a
add: more logging for filter's workers 2025-02-22 21:43:09 +08:00
bdbd2ac748
fix: unspecified onnxruntime version 2025-02-22 21:17:18 +08:00
b14a43f63f
fix: feeding empty data to the filter model 2025-02-22 20:56:57 +08:00
cecc1c1d2c
add: classifyVideo & classifyVideos implementation 2025-02-22 19:57:52 +08:00
7946cb6e96
fix: try to remove timezone offseet in bisect 2025-02-14 03:13:32 +08:00
4b48357ab6
update: insert duration as metadata 2025-02-14 03:06:39 +08:00
bfc622bfda
update: gitignore settings about data/ 2025-02-14 02:28:12 +08:00
f78f7fabdd
ref: remove data/ from git
update: inference code for filter model
2025-02-14 02:04:07 +08:00
fd090a25c2
add: quantized filter model inference 2025-02-13 07:42:16 +08:00
7e6854db00
merge: from branch 'gitbook' 2025-02-12 02:45:05 +08:00
4dc4dfcc5d
Merge branch 'gitbook' of https://github.com/alikia2x/cvsa into gitbook 2025-02-12 02:44:38 +08:00
bb222a882b
doc: GitBook - No subject 2025-02-11 18:43:57 +00:00
33062a7693
Merge branch 'gitbook' 2025-02-12 02:24:25 +08:00
dd7cdc4db5
update: auto-removal of completed jobs 2025-02-12 02:13:42 +08:00
7797fef685
fix: didn't release after connected to database
add: gracefully shutdown
2025-02-12 01:47:34 +08:00
b2a7cb1adf
merge: branch 'main' into gitbook 2025-02-12 00:19:27 +08:00