First image sensor with built-in AI
Sony Corp touted on 14 May 2020 the world’s first image sensors with built-in artificial intelligence, promising to make data-gathering tasks much faster and more secure. Calling it the first of its kind, Sony said the technology would give “intelligent vision” to cameras for retail and industrial applications. The new sensors are akin to tiny self-contained computers, incorporating a logic processor and memory. They’re capable of image recognition without generating any images, allowing them to do AI tasks like identifying, analyzing or counting objects without offloading any information to a separate chip. The method provides increased privacy while also making it possible to do near-instant analysis and object tracking.
- The new AI-augmented sensors are capable of capturing a regular 12-megapixel image, 4K video at up to 60 frames per second or neither, providing only metadata about what the sensor has seen.
- Among the applications suggested by Sony are the counting and tracking of visitors to public spaces, heat and congestion mapping and measuring shopper behaviour in retail locations.
- Though intended for commercial customers in its present iteration, the technology has promise for consumer applications as well.
- Without generating any actual images, it can help a personal device such as a smartphone identify objects and users securely. The accelerated object detection would also be an advantage for maintaining sharp focus when filming fast-moving subjects such as sports players or pets.
- Sony is the world leader in providing image sensors for smartphones such as Apple Inc’s iPhone and dedicated photo and video cameras from the likes of Nikon Corp Its sensor division has been its most reliable growth driver over the past few years, boosted by the proliferation of multi-camera phones.
- The new products are in line with the company’s long-term goal, as articulated by Chief Executive Officer Kenichiro Yoshida, of expanding the variety of sensing solutions it offers and pursuing more forms of recurring revenue.
- Sony said it has already shipped samples of its new sensors to potential customers, who are mostly in the business-to-business segment, including factory automation.
- Artificial intelligence (AI) is wide-ranging branch of computer science concerned with building smart machines capable of performing tasks that typically require human intelligence.
- AI is an interdisciplinary science with multiple approaches, but advancements in machine learning and deep learning are creating a paradigm shift in virtually every sector of the tech industry.