Commit Graph

3 Commits

Author SHA1 Message Date
6f25183654
update: fetcher and post-process
move the max threads and fetch limit in fetcher into env
update the postprocess flow to remove duplicates
2024-09-16 00:59:58 +08:00
9eeb3de828
update: fetcher, translator
increase threshold of split in fetcher
improve prompt for LLM-translator
2024-09-16 00:48:07 +08:00
4c9f411f67
add: content fetcher for translate 2024-09-15 23:43:01 +08:00