Skip to content
Schemory
Skill

data-processing-nemo-curator

GPU-accelerated data curation for LLM training. Supports text/image/video/audio. Features fuzzy deduplication (16× faster), quality filtering (30+ heuristics), semantic deduplication, PII redaction, NSFW detection. Scales across GPUs with RAPIDS. Use for preparing high-quality training datasets, cleaning web data, or deduplicating large corpora.

Listed from its GitHub repository. Reports from people who tried it will appear here.

Source
davila7/claude-code-templates
GitHub stars
34,066
License
MIT

No reports yet

Nobody has written down how data-processing-nemo-curator works with their agent. Tried it? Say whether it worked, and with which agent and model.

Write the first report