Unsloth Desktop Now Supports Using The AMD Ryzen AI NPU - Including On Linux

AMD and Unsloth announced today that local NPU inference is now available for Unsloth Desktop, starting with the AMD Ryzen AI NPUs of XDNA 2 and later. Unsloth Desktop now supports making use of the modern AMD NPUs on Ryzen AI laptops and desktops for faster inference. There are already more than 100 compatible agentic AI applications and workflows reported to be working with Unsloth running on the Ryzen AI NPUs. This NPU support is leveraging AMD's open-source Lemonade and FastFlowLM code for model serving and inference. Those curious can learn more about this AMD and Unsloth collaboration via the AMD blog. AMD did confirm in advance to me that this Ryzen AI NPU support with Unsloth Desktop will work fine with the Linux builds and is not limited to just Microsoft Windows.

Original Source

Read the full article at Phoronix →

KhanList aggregates and links to publicly available news content. We do not host full articles from third-party sources. Always verify important information with original sources.