Replicating human vision in robots
February 2011
News
Synthetic vision system for recognising objects in real-time.
With the advances in robotics, a robotic vision system that performs the operations of a human eye can complement the artificial intelligence that can be one of the vital cogs in the internal architecture of a robot. However, replicating the human vision system is a difficult task. There is a need for a vision system that is capable of performing the same task as that of a human vision system such as spotting and identifying objects in real-time motion.
A research team headed by Dr. Eugenio Culurciello has developed a field programmable gate array (FPGA) processor that has been specifically designed for artificial vision. It is a specialised device, and effectively brings supercomputing power to synthetic vision. It operates about 100 times faster than a laptop computer.
This system can be trained to recognise any object in real-time, either from scratch or in an unsupervised manner. Vision is taught with the help of convolutional neural networks or ConvNets – multistage neural networks that can model the way the brains visual processing area creates invariance to size and position to identify the objects.
The researchers have developed a general-purpose system that can be programmed like a standard PC, based on a runtime reconfigurable 2D grid of computing elements with reconfiguration capabilities, somewhat similar to those of an FPGA. The major difference is that the reconfiguration can be done at runtime, allowing very diverse computations to be performed on the grid. The FPGAs are custom-made for this system and are superior to any CPU (central processing unit) or GPU (graphics processing unit). The FPGA that is used in this system is substantially more efficient. According to Dr. Eugenio Culurciello, custom designed FPGAs will always outperform general purpose ICs for specific tasks since custom-made FPGAs require only about 10 watts, and within a few years will have the capability to dissipate just 1 watt.
The heart of the system is the FPGA. Due to the power of the hardware, it is capable of analysing full-motion video in real-time. A robot equipped with this system could recognise streets, vehicles, animals, trees, and people. This technology can directly benefit any robot, be it a drone, a UAV (unmanned aerial vehicle), a driverless car, or even a humanoid robot. This system can complement a human operator, thereby reducing the need for human monitoring. This system could simultaneously monitor multiple video streams, looking for certain objects or behaviours.
The ultimate aim is to create a cognitive system that can take actions based on what the system sees. However, that would require some form of thought or intelligence. According to Dr. Culurciello, driverless cars and the first general purpose domestic robots may become available in the next decade. Synthetic vision will be standard on robots, and will be able to process text, speech, or vision in real-time. Frost & Sullivan believes a system like this will form the backbone of robotic systems in the future.
For more information contact Christie Cronje, Frost & Sullivan, +27 (0)21 680 3296, [email protected], www.frost.com
Further reading:
New Würth Elektronik location in South Africa
News
A new Würth Elektronik branch has opened in Brackenfell, Western Cape. The location operates under the name Wurth Electronics South Africa and will serve local customers, as well as being responsible for markets in Botswana, Mauritius, Namibia, Tanzania and Zambia.
Read more...
John Thompson and BECS partner to deliver biomass energy solutions
News
John Thompson, a division of ACTOM and South Africa’s leading provider of industrial energy solutions, has announced a strategic partnership with Berkeley Energy Corporate Solutions, a specialist developer and supplier of biomass energy projects. Together, the companies aim to accelerate the deployment of reliable, renewable steam solutions to industrial customers across Africa.
Read more...
Academy pumps out the next generation of experts
News
KSB Pumps and Valves has invested in a specialised training centre designed to equip internal and branch staff and certified partners with in-depth knowledge of KSB products and systems.
Read more...
Celebrating the power of diversity in the engineering sector
News
The engineering sector has historically been a male-dominated field, and to a large extent it still is. However, this is changing, and the shift is gaining significant momentum as more women begin to take up leadership roles, spearheading innovation and driving inclusive growth.
Read more...
Fifteen years of promoting innovation and supporting engineering excellence
RS South Africa
News
RS South Africa is celebrating 15 years of promoting innovation and supporting engineering excellence through DesignSpark, its pioneering online engineering platform.
Read more...
From the Editor's desk: What happened to the metaverse?
Technews Publishing (SA Instrumentation & Control)
News
One of the most interesting technical crashes in recent years is the metaverse. As recently as 2022, it was white hot, with massive hype led by Meta. Even Bill Gates was saying that in two to three years
...
Read more...
Omniflex celebrates 60th anniversary
Omniflex Remote Monitoring Specialists
News
Remote monitoring specialist Omniflex is celebrating its 60th anniversary.
Read more...
Nidec adopts Siemens Teamcenter for electric motor development
Siemens South Africa
News
Siemens Digital Industries Software has announced that Nidec Corporation, a Japanese manufacturer and distributor of electric motors, has adopted Teamcenter X software from the Siemens Xcelerator portfolio of industry software to achieve innovative motor development and supply to set new industry standards, including automotive.
Read more...
Yaskawa Southern Africa and Sol-Tech advance industrial robotics training
Yaskawa Southern Africa
News
Yaskawa Southern Africa has announced a strategic collaboration with Sol-Tech, a private vocational training institution based in Pretoria, to strengthen technical education in industrial robotics and support the development of future-focused talent for South Africa’s evolving manufacturing sector.
Read more...
Building skills and sharing knowledge for growth in Africa
SEW-EURODRIVE
News
As a leading provider of drive and automation solutions across the continent, SEW-EURODRIVE recognises that local insight and on-the-ground capability are critical to delivering effective sustainable results. The company continues to invest in people development and technical training within its network of African subsidiaries and partners, supporting the long-term growth of its customers and the broader industrial ecosystem.
Read more...
printer friendly version