Delivers Significant Expansion of Edge Computing Capabilities, Performance and Functionality
SANTA CLARA, Calif., March 17, 2020 ---Socionext Inc. has developed a prototype chip that incorporates newly-developed quantized Deep Neural Network (DNN) technology, enabling highly-advanced AI processing for small and low-power edge computing devices.
The prototype is a part of a research project on “Updatable and Low Power AI-Edge LSI Technology Development” commissioned by the New Energy and Industrial Technology Development Organization (NEDO) of Japan. The chip features a "quantized DNN engine" optimized for deep learning inference processing at high speeds with low power consumption.
Today’s edge computing devices are based on conventional, general-purpose GPUs. These processors are not generally capable of supporting the growing demand for AI-based processing requirements, such as image recognition and analysis, which need larger devices at higher cost due to increases in power consumption and heat generation. Such devices and their limited performance are not desirable for state-of-the art AI processing.
Quantized DNN Engine
In their place, Socionext has developed a proprietary architecture based on "quantized DNN technology" for reducing the parameter and activation bits required for deep learning. The result is improved performance of AI processing along with lower power consumption. The architecture incorporates bit reduction including 1-bit (binary) and 2-bit (ternary) in addition to the conventional 8-bit, as well as the company’s original parameter compression technology, enabling a large amount of computation with fewer resources and significantly less amounts of data.
In addition, Socionext has developed a novel on-chip memory technology that provides highly efficient data delivery, reducing the need for extensive large capacity on-chip or external memory typically required for deep learning.
Integrating these new technologies, Socionext has prototyped an AI chip with its “DNN engine” and has confirmed its functionality and performance. The prototype chip achieved object detection by “YOLO v3” at 30fps, while consuming less than 5W of power. This is 10 times more efficient than conventional, general-purpose GPUs. The chip is also equipped with a high-performance, low-power Arm Cortex-A53 quad-core CPU. Unlike other “accelerator” chips, it can perform the entire AI processing without external processors.
Deep Learning Software Development Environment
Socionext has also built a deep learning software development environment. Incorporating TensorFlow as the base framework, it allows developers to perform original, low-bit "quantization-aware training" or "post-training quantization". When used in combination with the new chip, users can choose and apply the optimal quantization technology to various neural networks and execute highly accurate processing. The new chip will add the most advanced computer vision functionality to small form factor, low-power edge devices. Target applications include advanced driver assistance system (ADAS), security camera, and factory automation among others.
Socionext is currently conducting circuitry fine-tuning and performance optimization through the evaluation of this prototype chip. The company will continue working on research and development with the partner companies towards the completion of the NEDO-commissioned project, to deliver the AI Edge LSI as the final product.
NEDO Project title:
Project for Innovative AI Chips and Next-Generation Computing Technology Development
Development of innovative AI edge computing technologies
Updatable and Low Power AI-Edge LSI Technology Development
About Socionext America Inc.
Socionext America Inc. (SNA) is the US branch of Socionext Inc., one of the world’s leading fabless SoC suppliers. Headquartered in Milpitas, California, the company provides leading-edge technologies and offers a wide range of standard and customizable SoC solutions. Socionext America meets customers' requirements with quality semiconductor products based on extensive and differentiated IPs, proven design methodologies, and state-of-the-art implementation expertise, with full support.
About Socionext Inc.
Socionext Inc. is a global SoC (System-on-Chip) supplier and a pioneer of a unique “Solution SoC” business model through decades of industry experience and expertise. Socionext contributes to global innovation in advanced technologies including automotive, data center, networking, and smart devices. As a trusted silicon partner, Socionext delivers superior features, performance, and quality that differentiate its customers’ products and services from their competition.
Socionext Inc. is headquartered in Yokohama, and has offices in Japan, Asia, United States and Europe to lead its development and sales activities. For more information, visit https://www.socionext.com/en/.
All company or product names mentioned herein are trademarks or registered trademarks of their respective owners. Information provided in this press release is accurate at time of publication and is subject to change without advance notice.