Multi-Core Architecture Optimized For Time-Predictable Neural Network Inference (FZI, KIT)

Researchers from FZI Research Center for Information Technology and Karlsruhe Institute for Information Technology (KIT) have published a technical paper on a new architecture called "MultiVic" optimized for neural network inference. The architecture features a multi-core vector processor with predictable cores and local scratchpad memories, managed by a central core for shared memory access. Different design variants were evaluated, showing that configurations with more smaller cores outperformed a baseline single-core vector processor in terms of performance and time predictability. This architecture aims to address the need for high-performance hardware with predictable timing behavior in real-time systems utilizing neural networks.