Performance - NPU

The evolution of the NPU has transformed how we approach computing. Traditionally, the CPU was responsible for executing AI algorithms. As the demands for processing performance skyrocketed, dedicated NPUs emerged as a specialized solution for handling software and applications leveraging AI. These processors are designed to efficiently handle the complex mathematical computations required for AI tasks, offering unparalleled efficiency, performance and power savings.

With the addition of INT8, the Image Generation Benchmark now supports NPUs found in power efficient devices. This makes Procyon the first available benchmark that has been standardized for measuring and comparing the AI image generation performance of NPUs, iGPUs, and discrete GPUs. While the higher-precision FP16 image contains more detail, it requires more powerful hardware and takes longer to generate. Using INT8 allows for faster execution times, a smaller memory footprint, and support for a wider range of hardware, such as modern NPUs.