|
|
cd160c486e
|
update: logging in bulk
|
2025-03-27 03:51:35 +08:00 |
|
|
|
c12379134c
|
update: error handling in bulk fetch
|
2025-03-27 03:44:41 +08:00 |
|
|
|
189bb294cb
|
improve: logging
|
2025-03-27 03:31:48 +08:00 |
|
|
|
7ad4255fa7
|
update: remove lastAvailableWindow
|
2025-03-27 03:26:13 +08:00 |
|
|
|
de061eeb0f
|
update: rate limit config and number of schedules obtained by tick
|
2025-03-27 03:21:01 +08:00 |
|
|
|
767e19b425
|
fix: bigint serialization failed
|
2025-03-27 03:15:35 +08:00 |
|
|
|
d8201c7f8e
|
update: shallow copy instead of re-asignment when creating copy of rate limitor config
|
2025-03-27 03:13:05 +08:00 |
|
|
|
d229e49ff2
|
feat: bulk fetch
|
2025-03-27 02:58:42 +08:00 |
|
|
|
aea9e10d1a
|
update: bulk fetch
|
2025-03-27 02:33:54 +08:00 |
|
|
|
d44ba8a0ae
|
fix: incorrect offset calculation in adjustSnapshotTime
|
2025-03-27 02:13:33 +08:00 |
|
|
|
d6dd4d9334
|
fix: potential shifting for obtained window offset in last commit
|
2025-03-27 02:09:48 +08:00 |
|
|
|
d5c278ae06
|
improve: cache result for adjustSnapshotTime
|
2025-03-27 01:48:10 +08:00 |
|
|
|
c80b047e0c
|
fix: did not release db client before quiting
|
2025-03-27 01:31:54 +08:00 |
|
|
|
92678066a7
|
update: forgot to plus one for iteration count
|
2025-03-26 23:37:12 +08:00 |
|
|
|
afee7f58bf
|
update: return when meeting non-0 video status code in snapshotVideo job
|
2025-03-26 23:25:07 +08:00 |
|
|
|
5450c17e13
|
update: reduce rate limit, no longer collect deleted videos for milestone monitoring
|
2025-03-26 23:13:53 +08:00 |
|
|
|
2c51c3c09c
|
add: log for getRegularSnapshotInterval
|
2025-03-26 23:04:08 +08:00 |
|
|
|
7adc370ba2
|
update: increase concurrency of snapshot worker
|
2025-03-26 23:00:45 +08:00 |
|
|
|
b286a9d7b1
|
update: use findSnapshotBefore instead of findClosetSnapshot in regular snapshot scheduling
|
2025-03-26 22:59:52 +08:00 |
|
|
|
cabb360a16
|
fix: missing entrance for schedule type 'new'
update: perf log text
|
2025-03-25 22:58:56 +08:00 |
|
|
|
17ded63758
|
update: perf monitor for adjustSnapshotTime
|
2025-03-25 22:38:57 +08:00 |
|
|
|
2d8e990bc9
|
fix: prevent duplicate jobs added to queue
|
2025-03-25 21:33:58 +08:00 |
|
|
|
b33fd790d1
|
fix: snapshot process early returned incorrectly
|
2025-03-25 21:29:47 +08:00 |
|
|
|
86337e3802
|
add: set scheduled job status to 'processing' before adding to bullmq
|
2025-03-25 05:05:33 +08:00 |
|
|
|
76c9256662
|
test: looser rate limits for snapshot
|
2025-03-25 04:57:24 +08:00 |
|
|
|
a178b7fc16
|
update: force schedule for new songs
|
2025-03-25 04:52:19 +08:00 |
|
|
|
6b7142a6d5
|
fix: new jobs may be scheduled before the current time
|
2025-03-24 23:43:54 +08:00 |
|
|
|
314beb54b5
|
add: upsertJob for scheduleCleanup
|
2025-03-24 23:39:29 +08:00 |
|
|
|
d8b47f8fc8
|
add: log for scheduleCleanupWorker
|
2025-03-24 23:37:46 +08:00 |
|
|
|
fa058b22fe
|
fix: job consumption rate too low, add outdated job cleanup
|
2025-03-24 23:36:01 +08:00 |
|
|
|
48b1130cba
|
feat: continuous monitoring of new songs
|
2025-03-24 04:53:43 +08:00 |
|
|
|
42db333d1a
|
temp: schedule for new songs
|
2025-03-24 04:40:10 +08:00 |
|
|
|
0a73d28623
|
fix: incorrect time base when adjusting snapshot time
|
2025-03-24 04:15:51 +08:00 |
|
|
|
584a1be9f9
|
test: debug for adjusting snapshot time
|
2025-03-24 04:08:34 +08:00 |
|
|
|
20731c0530
|
test: debug for init window
|
2025-03-24 04:05:22 +08:00 |
|
|
|
cb573e55d9
|
fix: incorrect offset when initializing
|
2025-03-24 04:01:44 +08:00 |
|
|
|
8be68248df
|
fix: ignored the case where snapshots are actually the same
|
2025-03-24 03:49:06 +08:00 |
|
|
|
6f4a26e8b3
|
test: dynamic interval for reglar snapshots
|
2025-03-24 03:43:26 +08:00 |
|
|
|
c99318e2d3
|
update: missing env in deno job
|
2025-03-24 02:39:57 +08:00 |
|
|
|
3028dc13c7
|
improve: performance when dispatching jobs
|
2025-03-24 02:35:55 +08:00 |
|
|
|
0455abce2e
|
fix: did not quit when job is already workingx
|
2025-03-24 01:10:27 +08:00 |
|
|
|
723b6090c4
|
fix: 1 dispatchRegularSnapshots working at a time
|
2025-03-24 01:06:48 +08:00 |
|
|
|
9060d28823
|
fix: prevent dispatchRegularSnapshots from running for too long
|
2025-03-24 00:57:48 +08:00 |
|
|
|
0be961e709
|
improve: target time finding
|
2025-03-23 23:31:16 +08:00 |
|
|
|
f9dd53c250
|
update: remove old jobScheduler
|
2025-03-23 21:48:42 +08:00 |
|
|
|
35d58be8fd
|
fix: may accessing a non-existent schedule
|
2025-03-23 21:42:05 +08:00 |
|
|
|
3a0dd26c68
|
fix: only 1 pending task at a time
|
2025-03-23 21:36:40 +08:00 |
|
|
|
9e764746fb
|
update: better task retrieval for snapshotTick
add: logging when snapshot the video
|
2025-03-23 20:49:41 +08:00 |
|
|
|
33c63fc29f
|
fix: NaN caused by not converting date string to timestamp
|
2025-03-23 20:41:13 +08:00 |
|
|
|
b654eb3643
|
fix: potential NaN as delay time when scheduling
|
2025-03-23 20:30:06 +08:00 |
|
