Skip to main content

Weight Dedup

Weight dedup is a feature that allows you to deduplicate weights between clients on the same GPU. This is useful for reducing memory usage and improving performance.

How to use weight dedup​

  1. Set the WOOLYAI_WEIGHTS_DEDUP environment variable to true in the WoolyAI Client configuration file.