huggingface import_error ai_generated true

ImportError: bitsandbytes not found or CUDA not available

ID: huggingface/bitsandbytes-not-found

Also available as: JSON · Markdown
85%Fix Rate
88%Confidence
3Evidence
2023-01-01First Seen

Version Compatibility

VersionStatusIntroducedDeprecatedNotes
4 active — — —

Root Cause

bitsandbytes quantization library not installed or CUDA missing.

generic

Workarounds

  1. 90% success Install with CUDA: pip install bitsandbytes
  2. 88% success Verify CUDA toolkit installed: nvcc --version

Dead Ends

Common approaches that don't work:

  1. Install bitsandbytes without CUDA 78% fail

    CPU quantization very limited

  2. Skip quantization 72% fail

    Model too large for GPU