#Dataset-generation

Showing 21 of 21 repositories tagged #dataset-generation, ranked by stars

Kiln-AI
Kiln-AI
Kiln

Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.

Score
100
β˜… 5.0k β‘‚ 377 +2/day
Python
nfstream
nfstream
nfstream

NFStream: a Flexible Network Data Analysis Framework.

Score
100
β˜… 1.2k β‘‚ 143 β€”
Python
DIYer22
DIYer22
bpycv

Computer vision utils for Blender (generate instance annoatation, depth and 6D pose by one line code)

Score
100
β˜… 504 β‘‚ 61 β€”
Python
radi-cho
radi-cho
datasetGPT

A command-line interface to generate textual and conversational datasets with LLMs.

Score
67
β˜… 298 β‘‚ 19 β€”
Python
Erfaniaa
Erfaniaa
crypto-trading-strategy-backtester

Easy-to-use cryptocurrency trading strategy simulator and backtester

Score
0
β˜… 99 β‘‚ 18 β€”
Python
qforge-dev
qforge-dev
torque

Torque is a Declarative, typesafe DSL for building synthetic LLM datasets β€” compose conversations like React components

Score
67
β˜… 93 β‘‚ 5 β€”
TypeScript
QuentinWach
QuentinWach
image-ranker

Rank images using TrueSkill by comparing them against each other in the browser. πŸ–ΌπŸ“Š

Score
75
β˜… 89 β‘‚ 14 β€”
Python
codingo
codingo
Ransomware-Json-Dataset

Compiles a json dataset using public sources that contains properties to aid in the detection and mitigation of over 1000 variants of ransomware.

Score
0
β˜… 73 β‘‚ 18 β€”
Python
miendinh
miendinh
VietnameseOCR

Vietnamese Optical Character Recognition. It works with Vietnamese and Latin characters as well.

Score
33
β˜… 72 β‘‚ 39 β€”
Python
HowieHwong
HowieHwong
DataGen

[ICLR'25] DataGen: Unified Synthetic Dataset Generation via Large Language Models

Score
33
β˜… 68 β‘‚ 4 β€”
Python
packing-box
packing-box
docker-packing-box

Docker image gathering packers and tools for making datasets of packed executables and training machine learning models for packing detection

Score
100
β˜… 65 β‘‚ 18 +1/day
Python
kostyaev
kostyaev
smart_categorizer

Trainable categorization tool

Score
33
β˜… 61 β‘‚ 11 β€”
Python
MMehdiMousavi
MMehdiMousavi
SuperCaustics

Real-time, open-source simulation of transparent objects for deep learning applications

Score
67
β˜… 59 β‘‚ 13 β€”
Python
3DCF-Labs
3DCF-Labs
doc2dataset

3DCF / doc2dataset: token-efficient document layer with NumGuard numeric integrity and multi-framework exports for RAG & fine-tuning.

Score
100
β˜… 57 β‘‚ 4 β€”
Rust
SilentFlame
SilentFlame
Named-Entity-Recognition

Corpus and a baseline neural network system for Named Entity Recognition in Hindi-English Code-Mixed social media text.

Score
0
β˜… 46 β‘‚ 16 β€”
Python
anlp-team
anlp-team
LTI_Neural_Navigator

"Enhancing LLM Factual Accuracy with RAG to Counter Hallucinations: A Case Study on Domain-Specific Queries in Private Knowledge-Bases" by Jiarui Li and Ye Yuan and Zehua Zhang

Score
0
β˜… 45 β‘‚ 4 β€”
HTML
dmgutierrez
dmgutierrez
spotify-musixmatch-data-collector

A Python module to generate large scale Music datasets using both Spotify and MusixMatch API's.

Score
0
β˜… 43 β‘‚ 1 β€”
Python
SOM-Research
SOM-Research
DescribeML

DescribeML is a Visual Studio Code language plug-in to describe machine-learning datasets in a structured format. Build better data describing the composition, provenance and social concerns of your dataset.

Score
0
β˜… 30 β‘‚ 4 β€”
TypeScript
stefanDeveloper
stefanDeveloper
heiFIP

heiFIP: A tool to convert network traffic into images for ML use cases

Score
50
β˜… 29 β‘‚ 4 β€”
C++
atfortes
atfortes
LLMSymbolicReasoningBench

Synthetic data generation for evaluating LLM symbolic and logic reasoning

Score
25
β˜… 23 β‘‚ 1 β€”
Python
HZYAI
HZYAI
RagScore

⚑️ The "1-Minute RAG Audit" β€” Generate QA datasets & evaluate RAG systems in Colab, Jupyter, or CLI. Privacy-first, async, visual reports.

Score
50
β˜… 22 β‘‚ 3 β€”
Python
Related Topics
#machine-learning#python#data-science#dataset#llm#synthetic-data#deep-learning#large-language-models#evaluation#fine-tuning#computer-vision#rag

Β© 2026 GitRepoTrend Β· GitHub repositories by topic Β· Updated weekly