Today, Boston Dynamics and the Toyota Research Institute (TRI) announced a new partnership “to accelerate the development of general-purpose humanoid robots utilizing TRI’s Large Behavior Models and Boston Dynamics’ Atlas robot.” Committing to working towards a general purpose robot may make this partnership sound like a every other commercial humanoid company right now, but that’s not at all that’s going on here: BD and TRI are talking about fundamental robotics research, focusing on hard problems, and (most importantly) sharing the results.

The broader context here is that Boston Dynamics has an exceptionally capable humanoid platform capable of advanced and occasionally painful-looking whole-body motion behaviors along with some relatively basic and brute force-y manipulation. Meanwhile, TRI has been working for quite a while on developing AI-based learning techniques to tackle a variety of complicated manipulation challenges. TRI is working toward what they’re calling large behavior models (LBMs), which you can think of as analogous to large language models (LLMs), except for robots doing useful stuff in the physical world. The appeal of this partnership is pretty clear: Boston Dynamics gets new useful capabilities for Atlas, while TRI gets Atlas to explore new useful capabilities on.

Here’s a bit more from the press release:

The project is designed to leverage the strengths and expertise of each partner equally. The physical capabilities of the new electric Atlas robot, coupled with the ability to programmatically command and teleoperate a broad range of whole-body bimanual manipulation behaviors, will allow research teams to deploy the robot across a range of tasks and collect data on its performance. This data will, in turn, be used to support the training of advanced LBMs, utilizing rigorous hardware and simulation evaluation to demonstrate that large, pre-trained models can enable the rapid acquisition of new robust, dexterous, whole-body skills.

The joint team will also conduct research to answer fundamental training questions for humanoid robots, the ability of research models to leverage whole-body sensing, and understanding human-robot interaction and safety/assurance cases to support these new capabilities.

For more details, we spoke with Scott Kuindersma (Senior Director of Robotics Research at Boston Dynamics) and Russ Tedrake (VP of Robotics Research at TRI).

How did this partnership happen?

Russ Tedrake: We have a ton of respect for the Boston Dynamics team and what they’ve done, not only in terms of the hardware, but also the controller on Atlas. They’ve been growing their machine learning effort as we’ve been working more and more on the machine learning side. On TRI’s side, we’re seeing the limits of what you can do in tabletop manipulation, and we want to explore beyond that.

Scott Kuindersma: The combination skills and tools that TRI brings the table with the existing platform capabilities we have at Boston Dynamics, in addition to the machine learning teams we’ve been building up for the last couple years, put us in a really great position to hit the ground running together and do some pretty amazing stuff with Atlas.

What will your approach be to communicating your work, especially in the context of all the craziness around humanoids right now?

Tedrake: There’s a ton of pressure right now to do something new and incredible every six months or so. In some ways, it’s healthy for the field to have that much energy and enthusiasm and ambition. But I also think that there are people in the field that are coming around to appreciate the slightly longer and deeper view of understanding what works and what doesn’t, so we do have to balance that.

The other thing that I’d say is that there’s so much hype out there. I am incredibly excited about the promise of all this new capability; I just want to make sure that as we’re pushing the science forward, we’re being also honest and transparent about how well it’s working.

Kuindersma: It’s not lost on either of our organizations that this is maybe one of the most exciting points in the history of robotics, but there’s still a tremendous amount of work to do.

What are some of the challenges that your partnership will be uniquely capable of solving?

Kuindersma: One of the things that we’re both really excited about is the scope of behaviors that are possible with humanoids—a humanoid robot is much more than a pair of grippers on a mobile base. I think the opportunity to explore the full behavioral capability space of humanoids is probably something that we’re uniquely positioned to do right now because of the historical work that we’ve done at Boston Dynamics. Atlas is a very physically capable robot—the most capable humanoid we’ve ever built. And the platform software that we have allows for things like data collection for whole body manipulation to be about as easy as it is anywhere in the world.

Tedrake: In my mind, we really have opened up a brand new science—there’s a new set of basic questions that need answering. Robotics has come into this era of big science where it takes a big team and a big budget and strong collaborators to basically build the massive data sets and train the models to be in a position to ask these fundamental questions.

Fundamental questions like what?

Tedrake: Nobody has the beginnings of an idea of what the right training mixture is for humanoids. Like, we want to do pre-training with language, that’s way better, but how early do we introduce vision? How early do we introduce actions? Nobody knows. What’s the right curriculum of tasks? Do we want some easy tasks where we get greater than zero performance right out of the box? Probably. Do we also want some really complicated tasks? Probably. We want to be just in the home? Just in the factory? What’s the right mixture? Do we want backflips? I don’t know. We have to figure it out.

There are more questions too, like whether we have enough data on the Internet to train robots, and how we could mix and transfer capabilities from Internet data sets into robotics. Is robot data fundamentally different than other data? Should we expect the same scaling laws? Should we expect the same long-term capabilities?

The other big one that you’ll hear the experts talk about is evaluation, which is a major bottleneck. If you look at some of these papers that show incredible results, the statistical strength of their results section is very weak and consequently we’re making a lot of claims about things that we don’t really have a lot of basis for. It will take a lot of engineering work to carefully build up empirical strength in our results. I think evaluation doesn’t get enough attention.

What has changed in robotics research in the last year or so that you think has enabled the kind of progress that you’re hoping to achieve?

Kuindersma: From my perspective, there are two high-level things that have changed how I’ve thought about work in this space. One is the convergence of the field around repeatable processes for training manipulation skills through demonstrations. The pioneering work of diffusion policy (which TRI was a big part of) is a really powerful thing—it takes the process of generating manipulation skills that previously were basically unfathomable, and turned it into something where you just collect a bunch of data, you train it on an architecture that’s more or less stable at this point, and you get a result.

The second thing is everything that’s happened in robotics-adjacent areas of AI showing that data scale and diversity are really the keys to generalizable behavior. We expect that to also be true for robotics. And so taking these two things together, it makes the path really clear, but I still think there are a ton of open research challenges and questions that we need to answer.

Do you think that simulation is an effective way of scaling data for robotics?

Tedrake: I think generally people underestimate simulation. The work we’ve been doing has made me very optimistic about the capabilities of simulation as long as you use it wisely. Focusing on a specific robot doing a specific task is asking the wrong question; you need to get the distribution of tasks and performance in simulation to be predictive of the distribution of tasks and performance in the real world. There are some things that are still hard to simulate well, but even when it comes to frictional contact and stuff like that, I think we’re getting pretty good at this point.

Is there a commercial future for this partnership that you’re able to talk about?

Kuindersma: For Boston Dynamics, clearly we think there’s long-term commercial value in this work, and that’s one of the main reasons why we want to invest in it. But the purpose of this collaboration is really about fundamental research—making sure that we do the work, advance the science, and do it in a rigorous enough way so that we actually understand and trust the results and we can communicate that out to the world. So yes, we see tremendous value in this commercially. Yes, we are commercializing Atlas, but this project is really about fundamental research.

What happens next?

Tedrake: There are questions at the intersection of things that BD has done and things that TRI has done that we need to do together to start, and that’ll get things going. And then we have big ambitions—getting a generalist capability that we’re calling LBM (large behavior models) running on Atlas is the goal. In the first year we’re trying to focus on these fundamental questions, push boundaries, and write and publish papers.

I want people to be excited about watching for our results, and I want people to trust our results when they see them. For me, that’s the most important message for the robotics community: Through this partnership we’re trying to take a longer view that balances our extreme optimism with being critical in our approach.

EA FC 25 players have a whole new Team of the Week to grind for, and there are some fantastic cards among them, including Sporting CP's hotshot striker Viktor Gyokeres.

EA FC 25 players can snag some big freebies this week, with EA Sports celebrating the Ballon d'Or in style for all Ultimate Team players with some of the best players around.

They must have played. They must ….

Just like Eli Manning in 2004, Deion Sanders said he would tell NFL teams his son, Shedeur Sanders, won't play for them if it's not the right fit.

Senator-elect Jim Justice's office has clarified reports that his famous pooch Babydog was banned from the Senate floor, saying Justice never intended to bring the dog onto the floor.

Team at Kolkata institute engineers bacteria to solve maths problems  The Hindu

The new text is timed to a new California law against false advertising.

Nobody loses games they already bought, but the clock is ticking.

Tentatively called D55, the film is produced by Sushmita Anbuchezian under the Gopuram Films banner

The film will mark Geetu’s third directorial after ‘Liar’s Dice’ and ‘Moothon’

Hello gentle readers, and welcome to the SwitchArcade Round-Up for August 19th, 2024. It’s the beginning of a new week, …

Continue reading "SwitchArcade Round-Up: Reviews Featuring ‘SteamWorld Heist II’, Plus the Latest Releases and Sales"

One of the biggest advantages to PC gaming is having access to multiple generations of game releases. We’ve seen entire …

Continue reading "Musou Games on Steam Deck – Samurai Warriors, Dynasty Warriors, Warriors Orochi, Empires, and Much More Tested on Steam Deck OLED"

When thinking about the classics or games I’d recommend people play on mobile, Mini Metro is one of the best …

Continue reading "Exclusive: Dinosaur Polo Club Interview – CEO Amie Wolken on Mini Metro, Mini Motorways, the Team, Free DLC, Working With Apple, Ports, and More"

Welcome to this week’s edition of the Steam Deck Weekly. I delayed publishing this because Gamescom 2024 is on right …

Continue reading "Steam Deck Weekly: Gamescom 2024 Steam Deck News, Reviews Including Bakeru and SCHiM, New Verified Games, Discounts, and More"

Back in early 2016 when I was looking for import-friendly games on PS Vita, I used to often see Gundam …

Continue reading "Gundam Breaker 4 Review – Steam Deck, Switch, and PS5 Tested"

When Square Enix released the monster collecting RPG Dragon Quest Monsters: The Dark Prince on Switch last year, I loved …

Continue reading "‘Dragon Quest Monsters: The Dark Prince’ Is Coming to iOS, Android, and Steam on September 11th With All DLC Included From the Switch Release"

Yesterday during the Nintendo Indie World Partner Direct whatever it is called for the double feature, Red Nexus Games’ pachinko …

Continue reading "The Huge ‘Peglin’ 1.0 Update Is Now Live on iOS, Android, and Steam Following Switch Launch Yesterday"

Welcome to this week’s edition of the Steam Deck Weekly. If you missed my Gundam Breaker 4 Steam Deck review, …

Continue reading "Steam Deck Weekly: Visions of Mana and More Reviews, Reynatis Preview, Age of Mythology Retold Steam Deck Impressions, News, and More"

Following developer TRAGsoft bringing monster collecting game Coromon to mobile after it debuted on PC and Switch, we are getting …

Continue reading "Roguelite ‘Coromon: Rogue Planet’ in Development for Release on iOS, Android, Switch, and Steam in 2025"

While most fans have been looking forward to Warhammer 40,000: Space Marine 2 or basically a sequel to Warhammer 40,000: …

Continue reading "Warhammer 40,000: Space Marine 2 Steam Deck Review (in Progress) – GOTY Contender, but Play It Elsewhere for Now"

Welcome to this week’s edition of the Steam Deck Weekly. If you missed my Warhammer 40000: Space Marine 2 Steam …

Continue reading "Steam Deck Weekly: NBA 2K25, ARCO, ODDADA, DATE a LIVE Ren Dystopia, Star Trucker, Skull and Bones, & More Reviews With New Verified Games"

For a lot of folks who have been following Capcom’s fighting games over the years, the Marvel vs Capcom Fighting …

Continue reading "Marvel vs Capcom Fighting Collection: Arcade Classics Review – Switch, Steam Deck, and PS5 Covered"

A lot of folks got into the SaGa series a long time ago through its many releases on prior console …

Continue reading "Romancing SaGa 2: Revenge of the Seven Interview With Game Producer Shinichi Tatsuke and Steam Deck Hands-On Preview"

A voyage in this kind of spacecraft — while still conceptual — would take multiple lifetimes, crossing unimaginable gulfs of interstellar space. The theoretical exercise puts aside technical problems, including the propulsion system, and focusses on the design of the habitat and society.

After briefly offering a transparent Steam Deck OLED last year, Valve has announced its next limited edition variant featuring a bold new color: "white." It'll cost you $679 when it's available on November 18, and it features the exact same hardware as the 1TB Steam Deck OLED. (Most importantly, it sports that gorgeous 7.4-inch display with HDR and a 90Hz refresh rate). There's also a white carrying case, naturally. While the perils of white console hardware are hard to ignore (especially for a hefty portable that'll surely trap plenty of hand grease), this new variant may convince early Steam Deck owners to make the jump. 

As we covered in our review, the Steam Deck OLED's display looks significantly bolder than the original LCD models, especially with the addition of HDR support. This time around, Valve says it's also shipping the limited edition white model worldwide where Steam Decks are already available (including Australia).

"We're curious to see what the response is, and will use what we learn to inform future decisions about any potential new color variants down the line," Valve said in an e-mail. "We've always said our intent is to continually work on improving Steam Deck, and that's true from both a software perspective (continuing to ship improvements) and a hardware one (Steam Deck OLED, as well as ongoing work toward the future of Steam Deck and other hardware plans)."

Team17, the developer of the Worms and publisher of Dredge, Blasphemous and more, is working on Rogue Point, a new rogue-lite tactical FPS game. The studio has enlisted the help of Crowbar Collective, the team behind Black Mesa, the fan-made and Valve-approved Half-Life remake that needs no further introduction. Rogue Point is currently in development and slated to enter early access soon.

Rogue Point is set in a dystopian future where a single CEO had controlled everything. After his death, competing companies work to carve up his empire. To achieve this, they hire mercenaries using the MERX app, and it’s as simple as getting food using Uber Eats. Currently, only Rogue Point, a team of vigilantes, is fighting back against this dystopian state of affairs.

The game pits teams of four against computer-controlled enemies of different classes, each offering unique challenges. Players must strategize and play with the right loadouts or risk losing. There’s plenty of gear to acquire, too, with some weapons only available in the mission field.

Maps are procedurally generated to ensure no two playthroughs are the same. Unlocked equipment may also be used in future runs. Besides the standard campaign missions where “high-octane tactical combat meets strategic planning,” there’s an endgame mission with maxed-out difficulty, promising a challenge for those craving it.

The developers have a rather extensive wishlist of features they hope to add to the game down the road. Those include new weapons (who doesn’t like new gear?), improved AI and new maps. There are currently four maps announced, but the procedural generation should make things less repetitive.

Rogue Point isn’t in early access yet, but you can wishlist it on Steam. The game is set to come out in 2025, but the developers have yet to announce a final release date.

A team at Columbia University School of Engineering and Applied Science has developed a technique to enhance chimeric antigen receptor (CAR) T cell therapy in solid tumors. The technique involves engineering E. coli bacteria, that naturally tend to accumulate in the immune privileged core of solid tumors. The bacteria have been engineered to interact with […]

National Dog Bite Prevention Week is May 18-24. Any dog can bite, regardless of breed. Be a responsible pet owner.

Hotel Transylvania 2 Shop Goodwill Ad

Broll

ESPN College Basketball Analyst and LG Color Commentator Jay Bilas shares his tips on how to do game day right.

MAKE UP FOR EVER TEAMS UP WITH CHARLI XCX FOR ITS NEW AQUA XL CAMPAIGN

Viva� and Monica Potter Unleash Clean Event Video

Video One

IBM Watson is bringing cognitive computing to education to bring personalized learning to kids around the world - transforming early childhood education to help kids grow smarter, stronger and kinder.

Aly Raisman Making a PB&J

#5MoreNow

NBA All-Star Paul George was only 6-years-old when his mother suffered a stroke. They share their story to teach others the stroke warning signs.

When Christen Press puts her game face on, she makes sure she helps protect it with Coppertone� Sport. Use and reapply as directed.

Prostate Cancer Foundation, Evander Holyfield and Brian Custer encourage African-American men to �man up and get checked� for prostate cancer.

Pollination: Busy as a Bee

Video 1 Preview Image Caption