Combining next-token prediction and video diffusion in ... - MIT …
Oct 16, 2024 · The result: a flexible, reliable sequence model that resulted in higher-quality artificial videos and more precise decision-making for robots and AI agents. By sorting through noisy data and reliably predicting the next steps in a task, Diffusion Forcing can aid a robot in ignoring visual distractions to complete manipulation tasks.
Robotics | MIT News | Massachusetts Institute of Technology
Oct 28, 2024 · Combining next-token prediction and video diffusion in computer vision and robotics. A new method can train a neural network to sort corrupted data while anticipating next steps. It can make flexible plans for robots, generate high-quality video, and help AI agents navigate digital environments. October 16, 2024.
AI helps robots manipulate objects with their whole bodies
Aug 24, 2023 · Caption: MIT researchers developed an AI technique that enables a robot to develop complex plans for manipulating an object using its entire hand, not just the fingertips. This model can generate effective plans in about a minute using a standard laptop. Here, a robot attempts to rotate a bucket 180 degrees.
The new wave of robotic automation - MIT News
Jun 16, 2021 · Realtime Robotics has developed a combination of proprietary software and hardware that reduces system deployment time by 70 percent or more, reduces deployment costs by 30 percent or more, and reduces the programming component of building a robotic system in the industrial robot space by upwards of 90 percent. Image courtesy of Realtime Robotics.
A technique for more effective multipurpose robots | MIT News ...
Jun 3, 2024 · The MIT researchers developed a technique that can take a series of smaller datasets, like those gathered from many robotic warehouses, learn separate policies from each one, and combine the policies in a way that enables a robot to generalize to many tasks. They represent each policy using a type of generative AI model known as a diffusion model.
A better way to control shape-shifting soft robots - MIT News
May 10, 2024 · A new machine-learning technique can train and control a reconfigurable soft robot that can dynamically change its shape to complete a task. The researchers, from MIT and elsewhere, also built a simulator that can evaluate control algorithms for …
A system for designing and training intelligent soft robots
Dec 7, 2021 · The climber robot evolved two arms and two leg-like structures (kind of like a monkey) to help it climb. The lifter robot resembled a two-fingered gripper. One avenue for future research is so-called “morphological development,” where a robot incrementally becomes more intelligent as it gains experience solving more complex tasks.
Computer-aided creativity in robot design - MIT News
Nov 30, 2020 · You start by telling the system, called RoboGrammar, which robot parts are lying around your shop — wheels, joints, etc. You also tell it what terrain your robot will need to navigate. And RoboGrammar does the rest, generating an optimized structure and control program for your robot. The advance could inject a dose of computer-aided ...
Artificial intelligence | MIT News | Massachusetts Institute of …
2 days ago · Combining next-token prediction and video diffusion in computer vision and robotics. A new method can train a neural network to sort corrupted data while anticipating next steps. It can make flexible plans for robots, generate high-quality video, and help AI agents navigate digital environments. October 16, 2024.
MIT engineers devise a recipe for improving any autonomous
Jun 21, 2022 · The first system comprised a wheeled robot tasked with planning a path between two obstacles, based on signals that it received from two beacons placed at separate locations. The team sought to find the optimal placement of the beacons that would yield a clear path between the obstacles.