data · Found in 5 repositories
nemo-curator
GPU-accelerated data curation for LLM training. Supports text/image/video/audio. Features fuzzy deduplication (16× faster), quality filtering (30+ heuristics), semantic deduplication, PII redaction, N
View source: zechenzhangAGI/AI-research-SKILLs ↗Install from source
Install using Skill Manager:
sk install https://github.com/zechenzhangAGI/AI-research-SKILLs/tree/main/05-data-processing/nemo-curator/SKILL.mdSource-path status is inferred from metadata; it does not verify a live download. Scan and quality scores describe registry checks and are not a guarantee of safety.
Attribution and permissions
Check the original repository for permission and license terms before reuse. Registry metadata does not grant a license.
This guide links to the author’s instructions and includes metadata only.
Request removal or correct attributionCopies with matching content
Exact Markdown body copies across 5 repositories. This count does not identify the original author.
- local/development/nemo-curator
- MesferAli/XCircle/.claude/skills/nemo-curator/SKILL.md
- Orchestra-Research/AI-Research-SKILLs/05-data-processing/nemo-curator/SKILL.md
- Orchestra-Research/AI-research-SKILLs/05-data-processing/nemo-curator/SKILL.md
- ihatesea69/HieuNghi-AI-Skills/airesearch_skills/05-data-processing/nemo-curator/SKILL.md
- zechenzhangAGI/AI-research-SKILLs/05-data-processing/nemo-curator/SKILL.md