Commit Graph

5 Commits

Author SHA1 Message Date
932cbd4336
add: dataset 2024-09-16 17:29:12 +08:00
a9a7430a58
update: fetching with cooldown
fix: post-process unmatch
improve: LLM-translate now request with temprature
2024-09-16 04:08:33 +08:00
6f25183654
update: fetcher and post-process
move the max threads and fetch limit in fetcher into env
update the postprocess flow to remove duplicates
2024-09-16 00:59:58 +08:00
9eeb3de828
update: fetcher, translator
increase threshold of split in fetcher
improve prompt for LLM-translator
2024-09-16 00:48:07 +08:00
4c9f411f67
add: content fetcher for translate 2024-09-15 23:43:01 +08:00