Their work was recently published in Nature Machine Intelligence and it is attracting significant attention from across the world.
They designed a framework that could make it easier for robots to find things in their environment that could be used as tools and then use those things to manually perform tasks, even if they had never seen those things before.
Past studies in the field of robotics have shown that the systems which can use tools to complete physical tasks have a lot of potential. However, all of the methods discussed in those researches so far require prior training with tools.
Tee and Gowrishankar, therefore, focused on instilling human tool usage, ’embodiment’, and human tool characterization with their past work. This enabled the researchers to develop a new cognition framework that allowed robots to identify useful objects from their surroundings and use them to perform tasks as we do.
One of the fundamental ways we use to ascertain if an object can be useful as a tool is by using our own hands as a reference. We often depend on the shape and size of our hands and the corresponding features of the object to analyze if it were useful in achieving our objective. This newly developed cognitive framework utilizes this thought process as its basis.
Thus, robots will be able to intuitively identify tools and validate their potential by isolating the functionalities of their limbs. Next, they generate the necessary skills using the existing controllers and cameras.
As a result, the robots’ ability to utilize this framework will be largely dependent on the visual apparatus i.e. cameras and sensors. However, this can be a limitation in many cases since the shape and size of an object aren’t the only important things that are to be considered when using them. For instance, weight and surface hardness are equally important as shape and size when we want to use an item as a hammer.
The researchers are aiming to add more layers of perception to help robots make better and quicker dynamic tool use decisions. Their framework is intended to suit both existing and new robots.
