Microsoft recently issued a press release, introducing the new Microsoft Olive tool, which can improve the performance of AMD’s GPU graphics cards by up to 9.9 times.
Microsoft Olive is a Python tool that dramatically optimizes the performance of AMD GPUs running large language models.
The press release states that the Radeon RX 7900 XTX GPU, when enabled with the Microsoft Olive tool, shows a significant increase in performance for text-based image generation, for example, when running a Stable Diffusion model.
Microsoft Olive transforms, optimizes, quantizes, and auto-tunes models to maximize performance output, and AMD said in official tests that running on the default PyTorch path, the AMD Radeon RX 7900 XTX delivers 1.87 iterations per second; however, with the Microsoft Olive tool turned on to optimize the model, the GPU is able to perform 1.87 iterations per second. However, with the Microsoft Olive tool turned on to optimize the model, the GPU can iterate 18.59 times per second.
