Liwaiwai Liwaiwai
  • /
  • Artificial Intelligence
  • Machine Learning
  • Robotics
  • Engineering
    • Architecture
    • Design
    • Software
    • Hybrid Cloud
    • Data
  • About
  • /
  • Artificial Intelligence
  • Machine Learning
  • Robotics
  • Engineering
    • Architecture
    • Design
    • Software
    • Hybrid Cloud
    • Data
  • About
Liwaiwai Liwaiwai
  • /
  • Artificial Intelligence
  • Machine Learning
  • Robotics
  • Engineering
    • Architecture
    • Design
    • Software
    • Hybrid Cloud
    • Data
  • About
  • Robotics

Dexterous Robotic Hands Manipulate Thousands Of Objects With Ease

  • November 10, 2021
  • liwaiwai.com

At just one year old, a baby is more dexterous than a robot. Sure, machines can do more than just pick up and put down objects, but we’re not quite there as far as replicating a natural pull towards exploratory or sophisticated dexterous manipulation goes.

OpenAI gave it a try with “Dactyl” (meaning “finger” from the Greek word daktylos), using their humanoid robot hand to solve a Rubik’s cube with software that’s a step towards more general AI, and a step away from the common single-task mentality. DeepMind created “RGB-Stacking,” a vision-based system that challenges a robot to learn how to grab items and stack them.


Partner with liwaiwai.com
for your next big idea.
Let us know here.


cyberpogo

Scientists from MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL), in the ever-present quest to get machines to replicate human abilities, created a framework that’s more scaled up: a system that can reorient over two thousand different objects, with the robotic hand facing both upwards and downwards. This ability to manipulate anything from a cup to a tuna can, and a Cheez-It box, could help the hand quickly pick-and-place objects in specific ways and locations — and even generalize to unseen objects.

This deft “handiwork” – which is usually limited by single tasks and upright positions – could be an asset in speeding up logistics and manufacturing, helping with common demands such as packing objects into slots for kitting, or dexterously manipulating a wider range of tools. The team used a simulated, anthropomorphic hand with 24 degrees of freedom, and showed evidence that the system could be transferred to a real robotic system in the future.

“In industry, a parallel-jaw gripper is most commonly used, partially due to its simplicity in control, but it’s physically unable to handle many tools we see in daily life,” says MIT CSAIL PhD student Tao Chen, member of the Improbable AI Lab and the lead researcher on the project. “Even using a plier is difficult because it can’t dexterously move one handle back and forth. Our system will allow a multi-fingered hand to dexterously manipulate such tools, which opens up a new area for robotics applications.”

Read More  Artificial Neural Networks Model Face Processing In Autism

Give me a hand

This type of “in-hand” object reorientation has been a challenging problem in robotics, due to the large number of motors to be controlled and the frequent change in contact state between the fingers and the objects. And with over two thousand objects, the model had a lot to learn.

The problem becomes even more tricky when the hand is facing downwards. Not only does the robot need to manipulate the object, but also circumvent gravity so it doesn’t fall down.

The team found that a simple approach could solve complex problems. They used a model-free reinforcement learning algorithm (meaning the system has to figure out value functions from interactions with the environment) with deep learning, and something called a “teacher-student” training method.

For this to work, the “teacher” network is trained on information about the object and robot that’s easily available in simulation, but not in the real world, such as the location of fingertips or object velocity. To ensure that the robots can work outside of the simulation, the knowledge of the “teacher” is distilled into observations that can be acquired in the real world, such as depth images captured by cameras, object pose, and the robot’s joint positions. They also used a “gravity curriculum”, where the robot first learns the skill in a zero-gravity environment, and then slowly adapts the controller to the normal gravity condition, which, when taking things at this pace — really improved the overall performance.

While seemingly counterintuitive, a single controller (known as brain of the robot) could reorient a large number of objects it had never seen before, and with no knowledge of shape.

Read More  OLA To Deploy ABB Robotics And Automation Solutions At Its Mega-Factory For Electric Scooters

“We initially thought that visual perception algorithms for inferring shape while the robot manipulates the object was going to be the primary challenge,” says MIT professor Pulkit Agrawal, an author on the paper about the research. “To the contrary, our results show that one can learn robust control strategies that are shape agnostic. This suggests that visual perception may be far less important for manipulation than what we are used to thinking, and simpler perceptual processing strategies might suffice.”

Many small, circular shaped objects (apples, tennis balls, marbles), had close to one hundred percent success rates when reoriented with the hand facing up and down, with the lowest success rates, unsurprisingly, for more complex objects, like a spoon, a screwdriver, or scissors, being closer to thirty.

Beyond bringing the system out into the wild, since success rates varied with object shape, in the future, the team notes that training the model based on object shapes could improve performance.

Chen wrote a paper about the research alongside MIT CSAIL PhD student Jie Xu, and MIT professor Pulkit Agrawal. The research is funded by Toyota Research Institute, Amazon Research Award, and DARPA Machine Common Sense Program. It will be presented at the 2021 The Conference on Robot Learning (CoRL).

 

By Rachel Gordon
Source MIT CSAIL


Our humans need coffee too! Your support is highly appreciated, thank you!

liwaiwai.com

Related Topics
  • CSAIL
  • Dactyl
  • MIT
  • OpenAI
You May Also Like
View Post
  • Artificial Intelligence
  • Automation
  • Data
  • Research
  • Robotics
  • Technology

The Geography Of Artificial Intelligence

  • June 8, 2023
View Post
  • Robotics

Open-Source Platform Simulates Wildlife For Soft Robotics Designers

  • May 5, 2023
View Post
  • Artificial Intelligence
  • Data Science
  • Robotics
  • Technology

Humanity VS Intelligence VS Artificial Intelligence, And Areas Of Study

  • May 4, 2023
View Post
  • Research
  • Robotics

Biohybrid Robots: Recent Progress, Challenges, And Perspectives

  • April 24, 2023
View Post
  • Robotics

Battling Bots

  • April 12, 2023
View Post
  • Artificial Intelligence
  • Robotics

A Four-Legged Robotic System For Playing Soccer On Various Terrains

  • April 5, 2023
View Post
  • Robotics

Robotic Hand Can Identify Objects With Just One Grasp

  • April 5, 2023
View Post
  • Artificial Intelligence
  • Machine Learning
  • Robotics

Gods In The Machine? The Rise Of Artificial Intelligence May Result In New Religions

  • March 23, 2023

Leave a Reply

Your email address will not be published. Required fields are marked *

Stay Connected!
LATEST
  • Data | Points | Binary 1
    Microsoft Offers Azure ML Data Import CLI, SDK For Snowflake, Other Databases
    • June 9, 2023
  • Classification | Binder 2
    Build An Image Data Classification Model With BigQuery ML
    • June 9, 2023
  • 3
    H.I. To Gaia. Connecting Hyperintelligence With The Earth.
    • June 8, 2023
  • 4
    Why Are Humans Afraid Of AI?
    • June 8, 2023
  • 5
    The Geography Of Artificial Intelligence
    • June 8, 2023
  • 6
    Nature Already Inspired A.I. Than Most Realise
    • June 8, 2023
  • 7
    “A Field Guide To AI: For Business, Institutions, Society & Political Economy” — Your Essential Companion In Navigating the World of Artificial Intelligence.
    • June 7, 2023
  • 8
    Predictions: Top 25 Careers Likely In High Demand In The Future
    • June 6, 2023
  • 9
    A S.W.O.T. Analysis Of Current A.I. Systems
    • June 6, 2023
  • Apple-WWCD23-Vision-Pro-glass-230605 10
    Introducing Apple Vision Pro: Apple’s first spatial computer
    • June 6, 2023

about
About
Hello World!

We are liwaiwai.com. Created by programmers for programmers.

Our site aims to provide materials, guides, programming how-tos, and resources relating to artificial intelligence, machine learning and the likes.

We would like to hear from you.

If you have any questions, enquiries or would like to sponsor content, kindly reach out to us at:

[email protected]

Live long & prosper!
Most Popular
  • 1
    Apple Unveils New Mac Studio And Brings Apple Silicon To Mac Pro
    • June 5, 2023
  • 2
    Apple Introduces M2 Ultra
    • June 5, 2023
  • 3
    tvOS 17 Brings FaceTime And Video Conferencing To The Biggest Screen In The Home
    • June 5, 2023
  • 4
    Apple Introduces The 15‑Inch MacBook Air
    • June 5, 2023
  • 5
    CrowdStrike Introduces Charlotte AI To Deliver Generative AI-Powered Cybersecurity
    • May 30, 2023
  • /
  • Artificial Intelligence
  • Explore
  • About
  • Contact Us

Input your search keywords and press Enter.