#Large-scale-data-processing

Showing 2 of 2 repositories tagged #large-scale-data-processing, ranked by stars

Scalable data pre processing and curation toolkit for LLMs

★ 1.7k ⑂ 296 +1/day

Open source project for data preparation for GenAI applications

★ 948 ⑂ 251 +2/day

Related Topics

#data #data-prep #data-preparation #datacuration #datarecipes #deduplication #large-language-models #llm #llmapps #python #data-curation #data-processing