Huawei claims new software can 'create an analogue AI chip 1000 times faster than Nvidia’s chips' — open source Flex:ai software designed to boost AI-chip utilization

Huawei has unveiled Flex:ai, an open-source tool that aims to enhance the efficiency of AI chips in large compute clusters, potentially outperforming Nvidia chips by 1000 times. The platform, based on Kubernetes, is set to be released through Huawei’s ModelEngine developer community. Flex:ai is designed to increase average utilization by approximately 30% by dividing GPU or NPU cards into multiple virtual compute instances and managing workloads across different hardware types. The tool includes a smart scheduler, Hi Scheduler, that reallocates idle resources in real-time to optimize AI workloads. While the open-source code is not yet available, Flex:ai's development involved contributions from researchers at various universities in China.