Skip to main content

VRAM Overcommit

VRAM Overcommit is a feature that allows you to overcommit the VRAM of the GPU. This is useful for reducing memory usage and improving performance.

How to use vram overcommit​

  1. Set the WOOLYAI_VRAM_OVERCOMMIT environment variable to true in the WoolyAI Client configuration file.
WOOLYAI_VRAM_OVERCOMMIT = 1