The Socionext SC1810, our robust 2D/3D graphics SoC processor featuring the world’s first OpenVX-compliant hardware accelerator, just keeps getting better. The SoC, with its multi-display output and powerful image processing capabilities, is an ideal HMI solution for automotive, industrial and home applications needing multiple Full HD outputs, multi-camera image stitching, and other advanced computer vision features. Read on to learn more.
The introduction of the Socionext SC1810 (nicknamed “Miranda”), a highly-integrated and scalable 2D/3D graphics SoC processor featuring the world’s first OpenVX-compliant hardware accelerator, turned heads when we announced it in March of 2017. This fourth-generation SoC in our high-performance graphics display controller lineup is a significant step up from its predecessors, offering five times better 3D performance while integrating sophisticated video processing functionality.
With six Full HD video inputs and three Full HD display outputs, the SC1810 can easily power multiple instrument clusters, head-up displays (HUDs) and in-vehicle infotainment (IVI) systems. This combination of multi-display support and OpenVX makes the SC1810 an ideal foundation for automotive, industrial and home HMI applications needing advanced computer vision and image recognition capabilities.
(Click to enlarge)
Miranda Key Features
- Four ARM® Cortex™-A9 processors
- Image Power VR S8XE 3D Engine
- Memory DDR3-1866/DDR3L-1600
- 6 Full HD video inputs
- 3 Full HD display outputs
- Integrated Vision Processor Unit with OpenVX for expanded image recognition
- H.264 codec support for simultaneously processing / recording images from multiple cameras
- Multiple peripheral interfaces (I2C, I2S, UART, USART, ADC, HS-SPI, SPI、USB2.0, SD/eMMC, FPD-Link, MIPI D-PHY, CAN, EthernetAVB, and MediaLB)
Our colleague, Anthony Wong, wrote a blog article shortly after the release of the SC1810 highlighting the exciting advanced computer vision solutions that the new SoC would enable. Anthony described how the SC1810 could help computer systems “see” and understand the world around them by processing visual and sensor information. He gave examples such as factory automation systems that could recognize and safely operate alongside human workers as well as advanced driver assistance systems (ADAS) capable of detecting, and if necessary reacting to, nearby vehicles, pedestrians and other hazards.
Today we would like to update you on the progress we have made to realize the vision for the SC1810 that Anthony outlined last year. We have been hard at work with our customers and partners to apply the potential of the SC1810 to develop smart machines and vehicles that improve human productivity, comfort and safety. Here’s a peek at a few of the latest innovations.
Improved 360-degree Wrap-around View & Moving Object Detection
Socionext has long been a leader in innovative imaging solutions, such as our 360-degree wrap-around video imaging technology that seamlessly stitches together input from multiple cameras to create a three-dimensional view from any perspective. When deployed as part of an auto safety system, for example, this technology creates a virtual “bird’s-eye view” helping the driver see all around the vehicle while backing up or turning. You can see a video of it in action here.
As you would expect, stitching together video input from multiple cameras to create a 3D view in real-time is no small task – especially ensuring that the resulting wrap-around view is accurate and clear. But to be truly useful, any 360-degree view system deployed in a vehicle or factory must also be able to recognize objects, account for motion, and proactively identify and react to potential hazards. Stitching multi-camera input while also performing this level of detailed object recognition and tracking is extremely processing intensive. And this is where the SC1810 shines.
The SC1810, with its integrated Vision Processor Unit (VPU) featuring an OpenVX-compliant hardware accelerator as well as a programmable data parallel accelerator, takes our 360-degree wrap-around view technology to a whole new level of accuracy and responsiveness. The VPU enables the SC1810 to perform high-speed processing for image recognition and other advanced features with low power consumption.
The SC1810 can intelligent recognize and clearly present
objects and pedestrians. (Click to enlarge)
The results are remarkable. The SC1810 fuses information from multiple cameras and sensors to create a “dynamic bowl” view around a vehicle while also enabling intelligent image processing. This is important because a view created solely by stitching together multiple cameras can sometimes obscure hazards. For example, a camera-only image might not clearly show a pedestrian or object off to the side or further away from the vehicle. But thanks to the powerful image processing capabilities of the SC1810, the SoC can intelligently recognize and enhance the clarity of objects to improve the driver’s view and alert them to potential hazards. The SC1810 also enables sophisticated moving object detection features, allowing the system to warn the driver of any approaching potential hazards such as other vehicles, bicycles and pedestrians.
The robust processing capabilities of the SC1810 allow for other enhancements to our 360-degree Wrap-around View system. First, the SoC presents a more realistic rendering of the car model, showing tire rotation, open and closed doors, and even recreating reflections to present the driver with an extremely true-to-life virtual representation of the vehicle and its surroundings. Second, if desired, the system can remove the car model entirely to show what is beneath the vehicle. Finally, a common limitation of a stitched images is bending or warping of lines. The SC1810 compensates for this by automatically recognizing and straightening lines, thereby accurately showing lane markings.
ADAS Example: Wrap-around View, Mirror Replacement & Drive Recorder Solution
Putting all the above together, our system engineers have designed a demo configuration of a next-gen ADAS system powered by the SC1810. This "Integrated HMI system" manages visual and sensor information from inside and outside the vehicle and controls multiple high-definition displays. The system features four cameras (front, back, left and right) to generate a 360-degree wrap-around view as well as two cameras functioning as enhanced side-mirror replacements.
The SC180-powered ADAS incorporates all the safety functions discussed above, including improved image recognition, enhanced wrap-around visualization, moving object detection, parking assistance and intelligent driver alerts. An integrated drive recorder captures 360-degree video around the vehicle.
Learn More About the SC1810
Our engineering team at Socionext has decades of experience designing and delivering industry-leading graphics and imaging solutions for use in vehicles, industrial equipment and consumer devices. The SC1810 builds on that know-how to deliver best-in-class advanced image processing with multiple inputs and displays. Find out how the SC1810 can take your HMI or ADAS system design to the next level.
Samples and software development kits for the SC1810 are now available. Fill out the form below to get more information.
Rick Fiorenzi, field applications engineer at Socionext America, also contributed to this blog post.
