Neural Network Inference on Mobile SoCs

Editor’s notes: Mobile devices are increasingly being used to run machine-learning-based applications. This article provides a quantitative evaluation of machine learning inference capabilities of the different components on mobile SoCs and explores their performance limits. —Sudeep Pasricha, Colorado State University