4 Commits

Author	SHA1	Message	Date
alikia2x	37d2507f10	update: latest synthetic data script	2024-10-07 23:15:25 +08:00
alikia2x	a9a7430a58	update: fetching with cooldown ... fix: post-process unmatch improve: LLM-translate now request with temprature	2024-09-16 04:08:33 +08:00
alikia2x	6f25183654	update: fetcher and post-process ... move the max threads and fetch limit in fetcher into env update the postprocess flow to remove duplicates	2024-09-16 00:59:58 +08:00
alikia2x	7021687e10	add: postprocess	2024-09-15 23:54:37 +08:00