◈ Skill RegistryExplore skills
← Back to search
ai-ml · Found in 5 repositories

bitsandbytes

Quantizes LLMs to 8-bit or 4-bit for 50-75% memory reduction with minimal accuracy loss. Use when GPU memory is limited, need to fit larger models, or want faster inference. Supports INT8, NF4, FP4 fo

View source: zechenzhangAGI/AI-research-SKILLs ↗

Install from source

Install using Skill Manager:

sk install https://github.com/zechenzhangAGI/AI-research-SKILLs/tree/main/10-optimization/bitsandbytes/SKILL.md

Source-path status is inferred from metadata; it does not verify a live download. Scan and quality scores describe registry checks and are not a guarantee of safety.

Attribution and permissions

Check the original repository for permission and license terms before reuse. Registry metadata does not grant a license.

This guide links to the author’s instructions and includes metadata only.

Request removal or correct attribution

Copies with matching content

Exact Markdown body copies across 5 repositories. This count does not identify the original author.

More in ai-ml

agentdb-learningCreate and train AI learning plugins with AgentDB's 9 reinforcement learning algorithms. Includes Decision Transformer, Q-Learning, SARSA, Actor-Critic, anopenai-whisperYour own personal AI assistant. Any OS. Any Platform. The lobster way. 🦞reasoningbank-agentdbImplement ReasoningBank adaptive learning with AgentDB's 150x faster vector database. Includes trajectory tracking, verdict judgment, memory distillation, mlops-engineerBuild comprehensive ML pipelines, experiment tracking, and model registries with MLflow, Kubeflow, and modern MLOps tools. Implements automated training, deploy