As the space industry evolves, we need a new set of international regulations to decide who is responsible for safety, the number of satellites in space, and more

See the world's best space images from the Astronomy Photographer of the Year 2024 award

Astronomers have detected an exoplanet around Barnard’s star, one of the sun’s closest neighbours, but it is too hot for liquid water or life

A computer simulation suggests that some collisions between exotic, hypothetical stars would make space-time ripple with detectable waves

Complex carbon-based molecules crucial to life on Earth originated somewhere in space, but we didn't know where. Now, huge amounts of them have been spotted in a huge, cold cloud of gas

In order to figure out how something came from nothing, we first need to explore the different types of nothing

Samantha Harvey has won the UK's top fiction prize for a novel that takes place over 24 hours on the International Space Station

A Spot robot equipped with a blowtorch can locate weeds on farms and precisely heat them up to stop them growing, offering a possible alternative to herbicides

A robot can hold a squash, pumpkin or melon in one hand, while it is peeled by the other

Many people enjoy the experience of using AIs like ChatGPT or voice assistants like Alexa to find out information, but it turns out doing so makes it less likely you will spot inaccurate information

To address the problem of AIs generating inaccurate information, a team of ethicists says there should be legal obligations for companies to reduce the risk of errors, but there are doubts about whether it would work

It can be difficult to spot AI generated videos known as deepfakes, but there are ways to spot one if you know what to look for

Are humanoid robots the future of space exploration? New Scientist reporter James Woodford took NASA's Valkyrie for a spin to find out

NASA’s Valkyrie is undergoing tests to understand what it would take to get a humanoid robot onto offshore facilities or into space. New Scientist's James Woodford took the controls to see what it is capable of

Smart TVs from Samsung and LG monitor what you are watching even when you are using the screens to display a feed from a connected laptop or video game console

It has become trivially easy to use artificial intelligence to edit images or generate video to remove unwanted objects or beautify scenes, but doing so leads to people misremembering what they have seen

AI chatbots from Google and Microsoft sometimes parrot disinformation when answering questions about Russia’s invasion of Ukraine – but their performance depends on language and changes over time

Smartphones have indeed created an "anxious generation", but it isn't young people, it is their parents, argues neuroscientist Dean Burnett

Our Future Chronicles column explores an imagined history of inventions and developments yet to come. We visit 2032 and meet artificial animals that love their owners, without the carbon footprint of biological pets. Rowan Hooper explains how it happened

Autonomous taxis are already operating on US streets, while Elon Musk has spent years promising a self-driving car and failing to deliver. The newly announced Tesla Cybercab is unlikely to change that

Scientists used AI to transform tourist photos into a 3D digital map of Antarctic penguin colonies – even as researchers debate whether to harness or discourage tourism in this remote region

I have a confession to make. After taking a handful of autonomous taxi rides, I have gone from a hater to a friend of robot cars in just a few weeks, says Annalee Newitz

Four-legged robot dogs learned to perform new tricks by practising in a virtual platform that mimics real-world obstacles – a possible shortcut for training robots faster and more accurately

The controversies surrounding football’s video assistant referee (VAR) system highlight our troubled relationship with uncertainty – and point to potential solutions

An AI-assisted robot can listen to spoken commands and assemble 3D objects such as chairs and tables out of reusable building blocks

Treat yourself to a Becky Lynch book signing, games with the Dropout stars, Kevin Smith’s Dogma, and so much more!

“It’s not funny,” he told her while hosting Saturday Night Live.

Gary is up to his usual schtick with Dani. Will he or the new stews ever learn? (Don’t answer that.)

“It might feel like 2064 on the surface, but in its nostalgic, rechargeable heart, the show parties like it’s 1999.”

Who built this ripped, anatomically graphic snowman? Is there a world of snowmen offscreen waiting to be turned into sex objects for widows?

Krasinski scores the title of People’s Sexiest Man Alive 2024.

Express Sport writers have decided who should replace Gary Lineker

PGMOL chief Howard Webb has responded after referee David Coote was suspended for comments he appeared to make in a video.

Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.

ICRA@40: 23–26 September 2024, ROTTERDAM, NETHERLANDS

IROS 2024: 14–18 October 2024, ABU DHABI, UAE

ICSR 2024: 23–26 October 2024, ODENSE, DENMARK

Cybathlon 2024: 25–27 October 2024, ZURICH

Enjoy today’s videos!

I think it’s time for us all to admit that some of the most interesting bipedal and humanoid research is being done by Disney.

[ Research Paper from ETH Zurich and Disney Research]

Over the past few months, Unitree G1 robot has been upgraded into a mass production version, with stronger performance, ultimate appearance, and being more in line with mass production requirements.

[ Unitree ]

This robot is from Kinisi Robotics, which was founded by Brennand Pierce, who also founded Bear Robotics. You can’t really tell from this video, but check out the website because the reach this robot has is bonkers.

Kinisi Robotics is on a mission to democratize access to advanced robotics with our latest innovation—a low-cost, dual-arm robot designed for warehouses, factories, and supermarkets. What sets our robot apart is its integration of LLM technology, enabling it to learn from demonstrations and perform complex tasks with minimal setup. Leveraging Brennand’s extensive experience in scaling robotic solutions, we’re able to produce this robot for under $20k, making it a game-changer in the industry.

[ Kinisi Robotics ]

Thanks Bren!

Finally, something that Atlas does that I am also physically capable of doing. In theory.

Okay, never mind. I don’t have those hips.

[ Boston Dynamics ]

Researchers in the Department of Mechanical Engineering at Carnegie Mellon University have created the first legged robot of its size to run, turn, push loads, and climb miniature stairs.

They say it can “run,” but I’m skeptical that there’s a flight phase unless someone sneezes nearby.

[ Carnegie Mellon University ]

The lights are cool and all, but it’s the pulsing soft skin that’s squigging me out.

[ Paper, Robotics Reports Vol.2 ]

Roofing is a difficult and dangerous enough job that it would be great if robots could take it over. It’ll be a challenge though.

[ Renovate Robotics ] via [ TechCrunch ]

Kento Kawaharazuka from JSK Robotics Laboratory at the University of Tokyo wrote in to share this paper, just accepted at RA-L, which (among other things) shows a robot using its flexible hands to identify objects through random finger motion.

[ Paper accepted by IEEE Robotics and Automation Letters ]

Thanks Kento!

It’s one thing to make robots that are reliable, and it’s another to make robots that are reliable and repairable by the end user. I don’t think iRobot gets enough credit for this.

[ iRobot ]

I like competitions where they say, “just relax and forget about the competition and show us what you can do.”

[ MBZIRC Maritime Grand Challenge ]

I kid you not, this used to be my job.

[ RoboHike ]

In the 1960s and 1970s, NASA spent a lot of time thinking about whether toroidal (donut-shaped) fuel tanks were the way to go with its spacecraft. Toroidal tanks have a bunch of potential advantages over conventional spherical fuel tanks. For example, you can fit nearly 40% more volume within a toroidal tank than if you were using multiple spherical tanks within the same space. And perhaps most interestingly, you can shove stuff (like the back of an engine) through the middle of a toroidal tank, which could lead to some substantial efficiency gains if the tanks could also handle structural loads.

Because of their relatively complex shape, toroidal tanks are much more difficult to make than spherical tanks. Even though these tanks can perform better, NASA simply doesn’t have the expertise to manufacture them anymore, since each one has to be hand-built by highly skilled humans. But a company called Machina Labs thinks that they can do this with robots instead. And their vision is to completely change how we make things out of metal.

The fundamental problem that Machina Labs is trying to solve is that if you want to build parts out of metal efficiently at scale, it’s a slow process. Large metal parts need their own custom dies, which are very expensive one-offs that are about as inflexible as it’s possible to get, and then entire factories are built around these parts. It’s a huge investment, which means that it doesn’t matter if you find some new geometry or technique or material or market, because you have to justify that enormous up-front cost by making as much of the original thing as you possibly can, stifling the potential for rapid and flexible innovation.

On the other end of the spectrum you have the also very slow and expensive process of making metal parts one at a time by hand. A few hundred years ago, this was the only way of making metal parts: skilled metalworkers using hand tools for months to make things like armor and weapons. The nice thing about an expert metalworker is that they can use their skills and experience to make anything at all, which is where Machina Labs’ vision comes from, explains CEO Edward Mehr who co-founded Machina Labs after spending time at SpaceX followed by leading the 3D printing team at Relativity Space.

“Craftsmen can pick up different tools and apply them creatively to metal to do all kinds of different things. One day they can pick up a hammer and form a shield out of a sheet of metal,” says Mehr. “Next, they pick up the same hammer, and create a sword out of a metal rod. They’re very flexible.”

The technique that a human metalworker uses to shape metal is called forging, which preserves the grain flow of the metal as it’s worked. Casting, stamping, or milling metal (which are all ways of automating metal part production) are simply not as strong or as durable as parts that are forged, which can be an important differentiator for (say) things that have to go into space. But more on that in a bit.

The problem with human metalworkers is that the throughput is bad—humans are slow, and highly skilled humans in particular don’t scale well. For Mehr and Machina Labs, this is where the robots come in.

“We want to automate and scale using a platform called the ‘robotic craftsman.’ Our core enablers are robots that give us the kinematics of a human craftsman, and artificial intelligence that gives us control over the process,” Mehr says. “The concept is that we can do any process that a human craftsman can do, and actually some that humans can’t do because we can apply more force with better accuracy.”

This flexibility that robot metalworkers offer also enables the crafting of bespoke parts that would be impractical to make in any other way. These include toroidal (donut-shaped) fuel tanks that NASA has had its eye on for the last half century or so.

Machina Labs’ CEO Edward Mehr (on right) stands behind a 15 foot toroidal fuel tank.Machina Labs

“The main challenge of these tanks is that the geometry is complex,” Mehr says. “Sixty years ago, NASA was bump-forming them with very skilled craftspeople, but a lot of them aren’t around anymore.” Mehr explains that the only other way to get that geometry is with dies, but for NASA, getting a die made for a fuel tank that’s necessarily been customized for one single spacecraft would be pretty much impossible to justify. “So one of the main reasons we’re not using toroidal tanks is because it’s just hard to make them.”

Machina Labs is now making toroidal tanks for NASA. For the moment, the robots are just doing the shaping, which is the tough part. Humans then weld the pieces together. But there’s no reason why the robots couldn’t do the entire process end-to-end and even more efficiently. Currently, they’re doing it the “human” way based on existing plans from NASA. “In the future,” Mehr tells us, “we can actually form these tanks in one or two pieces. That’s the next area that we’re exploring with NASA—how can we do things differently now that we don’t need to design around human ergonomics?”

Machina Labs’ ‘robotic craftsmen’ work in pairs to shape sheet metal, with one robot on each side of the sheet. The robots align their tools slightly offset from each other with the metal between them such that as the robots move across the sheet, it bends between the tools. Machina Labs

The video above shows Machina’s robots working on a tank that’s 4.572 m (15 feet) in diameter, likely destined for the Moon. “The main application is for lunar landers,” says Mehr. “The toroidal tanks bring the center of gravity of the vehicle lower than what you would have with spherical or pill-shaped tanks.”

Training these robots to work metal like this is done primarily through physics-based simulations that Machina developed in house (existing software being too slow), followed by human-guided iterations based on the resulting real-world data. The way that metal moves under pressure can be simulated pretty well, and although there’s certainly still a sim-to-real gap (simulating how the robot’s tool adheres to the surface of the material is particularly tricky), the robots are collecting so much empirical data that Machina is making substantial progress towards full autonomy, and even finding ways to improve the process.

An example of the kind of complex metal parts that Machina’s robots are able to make.Machina Labs

Ultimately, Machina wants to use robots to produce all kinds of metal parts. On the commercial side, they’re exploring things like car body panels, offering the option to change how your car looks in geometry rather than just color. The requirement for a couple of beefy robots to make this work means that roboforming is unlikely to become as pervasive as 3D printing, but the broader concept is the same: making physical objects a software problem rather than a hardware problem to enable customization at scale.

Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.

ICRA@40: 23–26 September 2024, ROTTERDAM, NETHERLANDS

IROS 2024: 14–18 October 2024, ABU DHABI, UAE

ICSR 2024: 23–26 October 2024, ODENSE, DENMARK

Cybathlon 2024: 25–27 October 2024, ZURICH

Enjoy today’s videos!

Imbuing robots with “human-level performance” in anything is an enormous challenge, but it’s worth it when you see a robot with the skill to interact with a human on a (nearly) human level. Google DeepMind has managed to achieve amateur human-level competence at table tennis, which is much harder than it looks, even for humans. Pannag Sanketi, a tech-lead manager in the robotics team at DeepMind, shared some interesting insights about performing the research. But first, video!

Some behind the scenes detail from Pannag:

• The robot had not seen any participants before. So we knew we had a cool agent, but we had no idea how it was going to fare in a full match with real humans. To witness it outmaneuver even some of the most advanced players was such a delightful moment for team!
• All the participants had a lot of fun playing against the robot, irrespective of who won the match. And all of them wanted to play more. Some of them said it will be great to have the robot as a playing partner. From the videos, you can even see how much fun the user study hosts sitting there (who are not authors on the paper) are having watching the games!
• Barney, who is a professional coach, was an advisor on the project, and our chief evaluator of robot’s skills the way he evaluates his students. He also got surprised by how the robot is always able to learn from the last few weeks’ sessions.
• We invested a lot in remote and automated 24x7 operations. So not the setup in this video, but there are other cells that we can run 24x7 with a ball thrower.
• We even tried robot-vs-robot, i.e. 2 robots playing against each other! :) The line between collaboration and competition becomes very interesting when they try to learn by playing with each other.

[ DeepMind ]

Thanks, Heni!

Yoink.

[ MIT ]

Considering how their stability and recovery is often tested, teaching robot dogs to be shy of humans is an excellent idea.

[ Deep Robotics ]

Yes, quadruped robots need tow truck hooks.

[ Paper ]

Earthworm-inspired robots require novel actuators, and Ayato Kanada at Kyushu University has come up with a neat one.

[ Paper ]

Thanks, Ayato!

Meet the AstroAnt! This miniaturized swarm robot can ride atop a lunar rover and collect data related to its health, including surface temperatures and damage from micrometeoroid impacts. In the summer of 2024, with support from our collaborator Castrol, the Media Lab’s Space Exploration Initiative tested AstroAnt in the Canary Islands, where the volcanic landscape resembles the lunar surface.

[ MIT ]

Kengoro has a new forearm that mimics the human radioulnar joint giving it an even more natural badminton swing.

[ JSK Lab ]

Thanks, Kento!

Gromit’s concern that Wallace is becoming too dependent on his inventions proves justified, when Wallace invents a “smart” gnome that seems to develop a mind of its own. When it emerges that a vengeful figure from the past might be masterminding things, it falls to Gromit to battle sinister forces and save his master… or Wallace may never be able to invent again!

[ Wallace and Gromit ]

ASTORINO is a modern 6-axis robot based on 3D printing technology. Programmable in AS-language, it facilitates the preparation of classes with ready-made teaching materials, is easy both to use and to repair, and gives the opportunity to learn and make mistakes without fear of breaking it.

[ Kawasaki ]

Engineers at NASA’s Jet Propulsion Laboratory are testing a prototype of IceNode, a robot designed to access one of the most difficult-to-reach places on Earth. The team envisions a fleet of these autonomous robots deploying into unmapped underwater cavities beneath Antarctic ice shelves. There, they’d measure how fast the ice is melting — data that’s crucial to helping scientists accurately project how much global sea levels will rise.

[ IceNode ]

Los Alamos National Laboratory, in a consortium with four other National Laboratories, is leading the charge in finding the best practices to find orphaned wells. These abandoned wells can leak methane gas into the atmosphere and possibly leak liquid into the ground water.

[ LANL ]

Looks like Fourier has been working on something new, although this is still at the point of “looks like” rather than something real.

[ Fourier ]

Bio-Inspired Robot Hands: Altus Dexterity is a collaboration between researchers and professionals from Carnegie Mellon University, UPMC, the University of Illinois and the University of Houston.

[ Altus Dexterity ]

PiPER is a lightweight robotic arm with six integrated joint motors for smooth, precise control. Weighing just 4.2kg, it easily handles a 1.5kg payload and is made from durable yet lightweight materials for versatile use across various environments. Available for just $2,499 USD.

[ AgileX ]

At 104 years old, Lilabel has seen over a century of automotive transformation, from sharing a single car with her family in the 1920s to experiencing her first ride in a robotaxi.

[ Zoox ]

Traditionally, blind juggling robots use plates that are slightly concave to help them with ball control, but it’s also possible to make a blind juggler the hard way. Which, honestly, is much more impressive.

[ Jugglebot ]

At ICRA 2024, Spectrum editor Evan Ackerman sat down with Unitree founder and CEO Xingxing Wang and Tony Yang, VP of Business Development, to talk about the company’s newest humanoid, the G1 model.

Smaller, more flexible, and elegant, the G1 robot is designed for general use in service and industry, and is one of the cheapest—if not the cheapest—of a new wave of advanced AI humanoid robots.

Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.

ICRA@40: 23–26 September 2024, ROTTERDAM, NETHERLANDS

IROS 2024: 14–18 October 2024, ABU DHABI, UAE

ICSR 2024: 23–26 October 2024, ODENSE, DENMARK

Cybathlon 2024: 25–27 October 2024, ZURICH

Enjoy today’s videos!

The National Science Foundation Human AugmentatioN via Dexterity Engineering Research Center (HAND ERC) was announced in August 2024. Funded for up to 10 years and $52 million, the HAND ERC is led by Northwestern University, with core members Texas A&M, Florida A&M, Carnegie Mellon, and MIT, and support from Wisconsin-Madison, Syracuse, and an innovation ecosystem consisting of companies, national labs, and civic and advocacy organizations. HAND will develop versatile, easy-to-use dexterous robot end effectors (hands).

[ HAND ]

The Environmental Robotics Lab at ETH Zurich, in partnership with Wilderness International (and some help from DJI and Audi), is using drones to sample DNA from the tops of trees in the Peruvian rainforest. Somehow, the treetops are where 60 to 90 percent of biodiversity is found, and these drones can help researchers determine what the heck is going on up there.

[ ERL ]

Thanks, Steffen!

1X introduces NEO Beta, “the pre-production build of our home humanoid.”

“Our priority is safety,” said Bernt Børnich, CEO at 1X. “Safety is the cornerstone that allows us to confidently introduce NEO Beta into homes, where it will gather essential feedback and demonstrate its capabilities in real-world settings. This year, we are deploying a limited number of NEO units in selected homes for research and development purposes. Doing so means we are taking another step toward achieving our mission.”

[ 1X ]

We love MangDang’s fun and affordable approach to robotics with Mini Pupper. The next generation of the little legged robot has just launched on Kickstarter, featuring new and updated robots that make it easy to explore embodied AI.

The Kickstarter is already fully funded after just a day or two, but there are still plenty of robots up for grabs.

[ Kickstarter ]

Quadrupeds in space can use their legs to reorient themselves. Or, if you throw one off a roof, it can learn to land on its feet.

To be presented at CoRL 2024.

[ ARL ]

HEBI Robotics, which apparently was once headquartered inside a Pittsburgh public bus, has imbued a table with actuators and a mind of its own.

[ HEBI Robotics ]

Carcinization is a concept in evolutionary biology where a crustacean that isn’t a crab eventually becomes a crab. So why not do the same thing with robots? Crab robots solve all problems!

[ KAIST ]

Waymo is smart, but also humans are really, really dumb sometimes.

[ Waymo ]

The Robotics Department of the University of Michigan created an interactive community art project. The group that led the creation believed that while roboticists typically take on critical and impactful problems in transportation, medicine, mobility, logistics, and manufacturing, there are many opportunities to find play and amusement. The final piece is a grid of art boxes, produced by different members of our robotics community, which offer an eight-inch-square view into their own work with robotics.

[ Michigan Robotics ]

I appreciate that UBTECH’s humanoid is doing an actual job, but why would you use a humanoid for this?

[ UBTECH ]

I’m sure most actuators go through some form of life-cycle testing. But if you really want to test an electric motor, put it into a BattleBot and see what happens.

[ Hardcore Robotics ]

Yes, but have you tried fighting a BattleBot?

[ AgileX ]

In this video, we present collaboration aerial grasping and transportation using multiple quadrotors with cable-suspended payloads. Grasping using a suspended gripper requires accurate tracking of the electromagnet to ensure a successful grasp while switching between different slack and taut modes. In this work, we grasp the payload using a hybrid control approach that switches between a quadrotor position control and a payload position control based on cable slackness. Finally, we use two quadrotors with suspended electromagnet systems to collaboratively grasp and pick up a larger payload for transportation.

[ Hybrid Robotics ]

I had not realized that the floretizing of broccoli was so violent.

[ Oxipital ]

While the RoboCup was held over a month ago, we still wanted to make a small summary of our results, the most memorable moments, and of course an homage to everyone who is involved with the B-Human team: the team members, the sponsors, and the fans at home. Thank you so much for making B-Human the team it is!

[ B-Human ]

Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.

ICRA@40: 23–26 September 2024, ROTTERDAM, NETHERLANDS

IROS 2024: 14–18 October 2024, ABU DHABI, UAE

ICSR 2024: 23–26 October 2024, ODENSE, DENMARK

Cybathlon 2024: 25–27 October 2024, ZURICH

Enjoy today’s videos!

Researchers at the Max Planck Institute for Intelligent Systems and ETH Zurich have developed a robotic leg with artificial muscles. Inspired by living creatures, it jumps across different terrains in an agile and energy-efficient manner.

[ Nature ] via [ MPI ]

Thanks, Toshi!

ETH Zurich researchers have now developed a fast robotic printing process for earth-based materials that does not require cement. In what is known as “impact printing,” a robot shoots material from above, gradually building a wall. On impact, the parts bond together, and very minimal additives are required.

[ ETH Zurich ]

How could you not be excited to see this happen for real?

[ arXiv paper ]

Can we all agree that sanding, grinding, deburring, and polishing tasks are really best done by robots, for the most part?

[ Cohesive Robotics ]

Thanks, David!

Using doors is a longstanding challenge in robotics and is of significant practical interest in giving robots greater access to human-centric spaces. The task is challenging due to the need for online adaptation to varying door properties and precise control in manipulating the door panel and navigating through the confined doorway. To address this, we propose a learning-based controller for a legged manipulator to open and traverse through doors.

[ arXiv paper ]

Isaac is the first robot assistant that’s built for the home. And we’re shipping it in fall of 2025.

Fall of 2025 is a long enough time from now that I’m not even going to speculate about it.

[ Weave Robotics ]

By patterning liquid metal paste onto a soft sheet of silicone or acrylic foam tape, we developed stretchable versions of conventional rigid circuits (like Arduinos). Our soft circuits can be stretched to over 300% strain (over 4x their length) and are integrated into active soft robots.

[ Science Robotics ] via [ Yale ]

NASA’s Curiosity rover is exploring a scientifically exciting area on Mars, but communicating with the mission team on Earth has recently been a challenge due to both the current season and the surrounding terrain. In this Mars Report, Curiosity engineer Reidar Larsen takes you inside the uplink room where the team talks to the rover.

[ NASA ]

I love this and want to burn it with fire.

[ Carpentopod ]

Very often, people ask us what Reachy 2 is capable of, which is why we’re showing you the manipulation possibilities (through teleoperation) of our technology. The robot shown in this video is the Beta version of Reachy 2, our new robot coming very soon!

[ Pollen Robotics ]

The Scalable Autonomous Robots (ScalAR) Lab is an interdisciplinary lab focused on fundamental research problems in robotics that lie at the intersection of robotics, nonlinear dynamical systems theory, and uncertainty.

[ ScalAR Lab ]

Astorino is a 6-axis educational robot created for practical and affordable teaching of robotics in schools and beyond. It has been created with 3D printing, so it allows for experimentation and the possible addition of parts. With its design and programming, it replicates the actions of #KawasakiRobotics industrial robots, giving students the necessary skills for future work.

[ Astorino ]

I guess fish-fillet-shaping robots need to exist because otherwise customers will freak out if all their fish fillets are not identical, or something?

[ Flexiv ]

Watch the second episode of the ExoMars Rosalind Franklin rover mission—Europe’s ambitious exploration journey to search for past and present signs of life on Mars. The rover will dig, collect, and investigate the chemical composition of material collected by a drill. Rosalind Franklin will be the first rover to reach a depth of up to two meters below the surface, acquiring samples that have been protected from surface radiation and extreme temperatures.

[ ESA ]

This is a sponsored article brought to you by Khalifa University of Science and Technology.

Abu Dhabi-based Khalifa University of Science and Technology in the United Arab Emirates (UAE) will be hosting the 36th edition of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2024) to highlight the Middle East and North Africa (MENA) region’s rapidly advancing capabilities in the robotics and intelligent transport systems.

aspect_ratio

Themed “Robotics for Sustainable Development,” the IROS 2024 will be held from 14-18 October 2024 at the Abu Dhabi National Exhibition Center (ADNEC) in the UAE’s capital city. It will offer a platform for universities and research institutions to display their research and innovation activities and initiatives in robotics, gathering researchers, academics, leading corporate majors, and industry professionals from around the globe.

A total of 13 forums, nine global-level competitions and challenges covering various aspects of robotics and AI, an IROS Expo, as well as an exclusive Career Fair will also be part of IROS 2024. The challenges and competitions will focus on physical or athletic intelligence of robots, remote robot navigation, robot manipulation, underwater robotics, as well as perception and sensing.

Delegates for the event will represent sectors including manufacturing, healthcare, logistics, agriculture, defense, security, and mining sectors with 60 percent of the talent pool having over six years of experience in robotics. A major component of the conference will be the poster sessions, keynotes, panel discussions by researchers and scientists, and networking events.

Khalifa University will be hosting IROS 2024 to highlight the Middle East and North Africa (MENA) region’s rapidly advancing capabilities in the robotics and intelligent transport systems.Khalifa University

Abu Dhabi ranks first on the world’s safest cities list in 2024, according to online database Numbeo, out of 329 global cities in the 2024 standings, holding the title for eight consecutive years since 2017, reflecting the emirate’s ongoing efforts to ensure a good quality of life for citizens and residents.

With a multicultural community, Abu Dhabi is home to people from more than 200 nationalities and draws a large number of tourists to some of the top art galleries in the city such as Louvre Abu Dhabi and the Guggenheim Abu Dhabi, as well as other destinations such as Ferrari World Abu Dhabi and Warner Bros. World Abu Dhabi.

The UAE and Abu Dhabi have increasingly become a center for creative skillsets, human capital and advanced technologies, attracting several international and regional events such as the global COP28 UAE climate summit, in which more than 160 countries participated.

Abu Dhabi city itself has hosted a number of association conventions such as the 34th International Nursing Research Congress and is set to host the UNCTAD World Investment Forum, the 13th World Trade Organization (WTO) Ministerial Conference (MC13), the 12th World Environment Education Congress in 2024, and the IUCN World Conservation Congress in 2025.

Khalifa University’s Center for Robotics and Autonomous Systems (KU-CARS) includes a vibrant multidisciplinary environment for conducting robotics and autonomous vehicle-related research and innovation.Khalifa University

Dr. Jorge Dias, IROS 2024 General Chair, said: “Khalifa University is delighted to bring the Intelligent Robots and Systems 2024 to Abu Dhabi in the UAE and highlight the innovations in line with the theme Robotics for Sustainable Development. As the region’s rapidly advancing capabilities in robotics and intelligent transport systems gain momentum, this event serves as a platform to incubate ideas, exchange knowledge, foster collaboration, and showcase our research and innovation activities. By hosting IROS 2024, Khalifa University aims to reaffirm the UAE’s status as a global innovation hub and destination for all industry stakeholders to collaborate on cutting-edge research and explore opportunities for growth within the UAE’s innovation ecosystem.”

“This event serves as a platform to incubate ideas, exchange knowledge, foster collaboration, and showcase our research and innovation activities” —Dr. Jorge Dias, IROS 2024 General Chair

Dr. Dias added: “The organizing committee of IROS 2024 has received over 4000 submissions representing 60 countries, with China leading with 1,029 papers, followed by the U.S. (777), Germany (302), and Japan (253), as well as the U.K. and South Korea (173 each). The UAE with a total of 68 papers comes atop the Arab region.”

Driving innovation at Khalifa University is the Center for Robotics and Autonomous Systems (KU-CARS) with around 50 researchers and state-of-the-art laboratory facilities, including a vibrant multidisciplinary environment for conducting robotics and autonomous vehicle-related research and innovation.

IROS 2024 is sponsored by IEEE Robotics and Automation Society, Abu Dhabi Convention and Exhibition Bureau, the Robotics Society of Japan (RSJ), the Society of Instrument and Control Engineers (SICE), the New Technology Foundation, and the IEEE Industrial Electronics Society (IES).

More information at https://iros2024-abudhabi.org/

The software used to control a robot is normally highly adapted to its specific physical set up. But now researchers have created a single general-purpose robotic control policy that can operate robotic arms, wheeled robots, quadrupeds, and even drones.

One of the biggest challenges when it comes to applying machine learning to robotics is the paucity of data. While computer vision and natural language processing can piggyback off the vast quantities of image and text data found on the Internet, collecting robot data is costly and time-consuming.

To get around this, there have been growing efforts to pool data collected by different groups on different kinds of robots, including the Open X-Embodiment and DROID datasets. The hope is that training on diverse robotics data will lead to “positive transfer,” which refers to when skills learned from training on one task help to boost performance on another.

The problem is that robots often have very different embodiments—a term used to describe their physical layout and suite of sensors and actuators—so the data they collect can vary significantly. For instance, a robotic arm might be static, have a complex arrangement of joints and fingers, and collect video from a camera on its wrist. In contrast, a quadruped robot is regularly on the move and relies on force feedback from its legs to maneuver. The kinds of tasks and actions these machines are trained to carry out are also diverse: The arm may pick and place objects, while the quadruped needs keen navigation.

That makes training a single AI model for robots on these large collections of data challenging, says Homer Walke, a Ph.D. student at the University of California, Berkeley. So far, most attempts have either focused on data from a narrower selection of similar robots or researchers have manually tweaked data to make observations from different robots more similar. But in research to be presented at the Conference on Robot Learning (CoRL) in Munich in November, they unveiled a new model called CrossFormer that can train on data from a diverse set of robots and control them just as well as specialized control policies.

“We want to be able to train on all of this data to get the most capable robot,” says Walke. “The main advance in this paper is working out what kind of architecture works the best for accommodating all these varying inputs and outputs.”

How to control diverse robots with the same AI model

The team used the same model architecture that powers large language model, known as a transformer. In many ways, the challenge the researchers were trying to solve is not dissimilar to that facing a chatbot, says Walke. In language modeling, the AI has to to pick out similar patterns in sentences with different lengths and word orders. Robot data can also be arranged in a sequence much like a written sentence, but depending on the particular embodiment, observations and actions vary in length and order too.

“Words might appear in different locations in a sentence, but they still mean the same thing,” says Walke. “In our task, an observation image might appear in different locations in the sequence, but it’s still fundamentally an image and we still want to treat it like an image.”

UC Berkeley/Carnegie Mellon University

Most machine learning approaches work through a sequence one element at a time, but transformers can process the entire stream of data at once. This allows them to analyze the relationship between different elements and makes them better at handling sequences that are not standardized, much like the diverse data found in large robotics datasets.

Walke and his colleagues aren’t the first to train transformers on large-scale robotics data. But previous approaches have either trained solely on data from robotic arms with broadly similar embodiments or manually converted input data to a common format to make it easier to process. In contrast, CrossFormer can process images from cameras positioned above a robot, at head height or on a robotic arms wrist, as well as joint position data from both quadrupeds and robotic arms, without any tweaks.

The result is a single control policy that can operate single robotic arms, pairs of robotic arms, quadrupeds, and wheeled robots on tasks as varied as picking and placing objects, cutting sushi, and obstacle avoidance. Crucially, it matched the performance of specialized models tailored for each robot and outperformed previous approaches trained on diverse robotic data. The team even tested whether the model could control an embodiment not included in the dataset—a small quadcopter. While they simplified things by making the drone fly at a fixed altitude, CrossFormer still outperformed the previous best method.

“That was definitely pretty cool,” says Ria Doshi, an undergraduate student at Berkeley. “I think that as we scale up our policy to be able to train on even larger sets of diverse data, it’ll become easier to see this kind of zero shot transfer onto robots that have been completely unseen in the training.”

The limitations of one AI model for all robots

The team admits there’s still work to do, however. The model is too big for any of the robots’ embedded chips and instead has to be run from a server. Even then, processing times are only just fast enough to support real-time operation, and Walke admits that could break down if they scale up the model. “When you pack so much data into a model it has to be very big and that means running it for real-time control becomes difficult.”

One potential workaround would be to use an approach called distillation, says Oier Mees, a postdoctoral research at Berkley and part of the CrossFormer team. This essentially involves training a smaller model to mimic the larger model, and if successful can result in similar performance for a much smaller computational budget.

But of more importance than the computing resource problem is that the team failed to see any positive transfer in their experiments, as CrossFormer simply matched previous performance rather than exceeding it. Walke thinks progress in computer vision and natural language processing suggests that training on more data could be the key.

Others say it might not be that simple. Jeannette Bohg, a professor of robotics at Stanford University, says the ability to train on such a diverse dataset is a significant contribution. But she wonders whether part of the reason why the researchers didn’t see positive transfer is their insistence on not aligning the input data. Previous research that trained on robots with similar observation and action data has shown evidence of such cross-overs. “By getting rid of this alignment, they may have also gotten rid of this significant positive transfer that we’ve seen in other work,” Bohg says.

It’s also not clear if the approach will boost performance on tasks specific to particular embodiments or robotic applications, says Ram Ramamoorthy, a robotics professor at Edinburgh University. The work is a promising step towards helping robots capture concepts common to most robots, like “avoid this obstacle,” he says. But it may be less useful for tackling control problems specific to a particular robot, such as how to knead dough or navigate a forest, which are often the hardest to solve.

Four decades after the first IEEE International Conference on Robotics and Automation (ICRA) in Atlanta, robotics is bigger than ever. Next week in Rotterdam is the IEEE ICRA@40 conference, “a celebration of 40 years of pioneering research and technological advancements in robotics and automation.” There’s an ICRA every year, of course. Arguably the largest robotics research conference in the world, the 2024 edition was held in Yokohama, Japan back in May.

ICRA@40 is not just a second ICRA conference in 2024. Next week’s conference is a single track that promises “a journey through the evolution of robotics and automation,” through four days of short keynotes from prominent roboticists from across the entire field. You can see for yourself, the speaker list is nuts. There are also debates and panels tackling big ideas, like: “What progress has been made in different areas of robotics and automation over the past decades, and what key challenges remain?” Personally, I’d say “lots” and “most of them,” but that’s probably why I’m not going to be up on stage.

There will also be interactive research presentations, live demos, an expo, and more—the conference schedule is online now, and the abstracts are online as well. I’ll be there to cover it all, but if you can make it in person, it’ll be worth it.

Forty years ago is a long time, but it’s not that long, so just for fun, I had a look at the proceedings of ICRA 1984 which are available on IEEE Xplore, if you’re curious. Here’s an excerpt of the forward from the organizers, which included folks from International Business Machines and Bell Labs:

The proceedings of the first IEEE Computer Society International Conference on Robotics contains papers covering practically all aspects of robotics. The response to our call for papers has been overwhelming, and the number of papers submitted by authors outside the United States indicates the strong international interest in robotics.
The Conference program includes papers on: computer vision; touch and other local sensing; manipulator kinematics, dynamics, control and simulation; robot programming languages, operating systems, representation, planning, man-machine interfaces; multiple and mobile robot systems.
The technical level of the Conference is high with papers being presented by leading researchers in robotics. We believe that this conference, the first of a series to be sponsored by the IEEE, will provide a forum for the dissemination of fundamental research results in this fast developing field.

Technically, this was “ICR,” not “ICRA,” and it was put on by the IEEE Computer Society’s Technical Committee on Robotics, since there was no IEEE Robotics and Automation Society at that time; RAS didn’t get off the ground until 1987.

This is a sponsored article brought to you by Khalifa University of Science and Technology.

A total of eight intense competitions to inspire creativity and innovation along with 13 forums dedicated to diverse segments of robotics and artificial intelligence will be part of the 36th edition of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2024) in Abu Dhabi.

These competitions at the Middle East and North Africa (MENA) region’s first-ever global conference and exhibition from 14-18 October 2024 at the Abu Dhabi National Exhibition Center (ADNEC) will highlight some of the key aspects of robotics. These include physical or athletic intelligence of robots, remote robot navigation, robot manipulation, underwater robotics, perception and sensing as well as challenges for wildlife preservation.

This edition of IROS is one of the largest of its kind globally in this category because of active participation across all levels, with 5,740 authors, 16 keynote speakers, 46 workshops, 11 tutorials, as well as 28 exhibitors and 12 startups. The forums at IROS will explore the rapidly evolving role of robotics in many industry sectors as well as policy-making and regulatory areas. Several leading corporate majors, and industry professionals from across the globe are gathering for IROS 2024 which is themed “Robotics for Sustainable Development.”

“The intense robotics competitions will inspire creativity, while the products on display as well as keynotes will pave the way for more community-relevant solutions.” —Jorge Dias, IROS 2024 General Chair

Dr. Jorge Dias, IROS 2024 General Chair, said: “Such a large gathering of scientists, researchers, industry leaders and government stakeholders in Abu Dhabi for IROS 2024 also demonstrates the role of UAE in pioneering new technologies and in providing an international platform for knowledge exchange and sharing of expertise. The intense robotics competitions will inspire creativity, while the products on display as well as keynotes will pave the way for more community-relevant solutions.”

The competitions are:

• 2nd AI Olympics With RealAIGym: Is AI Ready for Athletic Intelligence in the Real World? focusing on the physical or athletic intelligence of robots

• The Earth Rovers Challenge on remote robot navigation

• Robotic Construction Challenge and the euROBIN Manipulation Skill Versatility Challenge (MSVC) on robot manipulation

• Underwater Robotics Challenges on innovation and problem-solving in underwater robotics and artificial intelligence

• ROAD-IROS: Automatic Data Annotation Challenge for ROAD Dataset on perception and sensing

• 21st F1Tenth Autonomous Racing Competition

• IEEE RAS Quadruped Robot Challenge (QRC), focusing on navigation

In addition to these competitions, the Falcon Monitoring Challenge (FMC) will focus on advancing the field of wildlife tracking and conservation through the development of sophisticated, noninvasive monitoring systems.

Khalifa University

IROS 2024 will also include three keynote talks on ‘Robotic Competitions’ that will be moderated by Professor Lakmal Seneviratne, Director, Center for Autonomous Robotic Systems (KU-CARS), Khalifa University. The keynotes will be delivered by Professor Pedro Lima, Institute for Systems and Robotics, Instituto Superior Técnico, University of. Lisbon, Portugal; Dr. Timothy Chung, General Manager, Autonomy and Robotics, Microsoft, US; and Dr. Ubbo Visser, President of the RoboCup Federation, Director of Graduate Studies, and Associate Professor of Computer Science, University of Miami, US.

The forums at IROS 2024 will include:

• Robotics in Africa Forum

• Marine Robotics in Ocean Decade Initiative for Sustainable Development

• Robots for Sustainability and Sustainable Robots

• Government Forum: Funding for Robotics Research, Human-Avatars Symbiosis: Can you imagine a future society where you can remotely control multiple avatars?

• Moonshot R&D Program Goal 3 Forum. Envisioning a Future of Human-Robot Co-living: Potential for Robotics to Transform Human Lives

Other forums include:

• Sustainable Medical and Surgical Robotics

• Empowering Diverse Voices in Robotics, Robotics & AI in the UAE: Research Innovation and Entrepreneurship

• Europe Regulates Artificial Intelligence: the Challenge for Robotics, Industrial Opportunities and Socio-Economic Impact of Medical Robotics

• The Future of Work: AI-Enhanced Robotics and Human Interaction Research in M3S

• Robots for a Better Tomorrow: Wellbeing Through Advanced Technology.

One of the largest and most important robotics research conferences in the world, IROS 2024 provides a platform for the international robotics community to exchange knowledge and ideas about the latest advances in intelligent robots and smart machines. A total of 3,344 paper submissions representing 60 countries, have been received from researchers and scientists across the world. China tops the list with more than 1,000 papers, the US with 777, Germany with 302, Japan with 253, and the UK and South Korea with 173 each. The UAE remains top in the Arab region with 68 papers.

One of the largest and most important robotics research conferences in the world, IROS 2024 provides a platform for the international robotics community to exchange knowledge and ideas.

For eight consecutive years since 2017, Abu Dhabi has remained first on the world’s safest cities list, according to online database Numbeo, which assessed 329 global cities for the 2024 listing. This reflects the emirate’s ongoing efforts to ensure a good quality of life for citizens and residents. With a multicultural community, Abu Dhabi is home to people from more than 200 nationalities, and draws a large number of tourists to some of the top art galleries in the city such as Louvre Abu Dhabi and the Guggenheim Abu Dhabi, as well as other destinations such as Ferrari World Abu Dhabi and Warner Bros. World™ Abu Dhabi.

Because of its listing as one of the safest cities, Abu Dhabi continues to host several international conferences and exhibitions. Abu Dhabi is set to host the UNCTAD World Investment Forum, the 13th World Trade Organization (WTO) Ministerial Conference (MC13), the 12th World Environment Education Congress in 2024, and the IUCN World Conservation Congress in 2025.

IROS 2024 is sponsored by IEEE Robotics and Automation Society, Abu Dhabi Convention and Exhibition Bureau, the Robotics Society of Japan (RSJ), the Society of Instrument and Control Engineers (SICE), the New Technology Foundation, and the IEEE Industrial Electronics Society (IES).

More information at https://iros2024-abudhabi.org/

When we think of grasping robots, we think of manipulators of some sort on the ends of arms of some sort. Because of course we do—that’s how (most of us) are built, and that’s the mindset with which we have consequently optimized the world around us. But one of the great things about robots is that they don’t have to be constrained by our constraints, and at ICRA@40 in Rotterdam this week, we saw a novel new Thing: a robotic hand that can detach from its arm and then crawl around to grasp objects that would be otherwise out of reach, designed by roboticists from EPFL in Switzerland.

Fundamentally, robot hands and crawling robots share a lot of similarities, including a body along with some wiggly bits that stick out and do stuff. But most robotic hands are designed to grasp rather than crawl, and as far as I’m aware, no robotic hands have been designed to do both of those things at the same time. Since both capabilities are important, you don’t necessarily want to stick with a traditional grasping-focused hand design. The researchers employed a genetic algorithm and simulation to test a bunch of different configurations in order to optimize for the ability to hold things and to move.

You’ll notice that the fingers bend backwards as well as forwards, which effectively doubles the ways in which the hand (or, “Handcrawler”) can grasp objects. And it’s a little bit hard to tell from the video, but the Handcrawler attaches to the wrist using magnets for alignment along with a screw that extends to lock the hand into place.

“Although you see it in scary movies, I think we’re the first to introduce this idea to robotics.” —Xiao Gao, EPFL

The whole system is controlled manually in the video, but lead author Xiao Gao tells us that they already have an autonomous version (with external localization) working in the lab. In fact, they’ve managed to run an entire grasping sequence autonomously, with the Handcrawler detaching from the arm, crawling to a location the arm can’t reach, picking up an object, and then returning and reattaching itself to the arm again.

I’ve been reviewing robot vacuums for more than a decade, and robot mops for just as long. It’s been astonishing how the technology has evolved, from the original iRobot Roomba bouncing off of walls and furniture to robots that use lidar and vision to map your entire house and intelligently keep it clean.

As part of this evolution, cleaning robots have become more and more hands-off, and most of them are now able to empty themselves into occasionally enormous docks with integrated vacuums and debris bags. This means that your robot can vacuum your house, empty itself, recharge, and repeat this process until the dock’s dirt bag fills up.

But this all breaks down when it comes to robots that both vacuum and mop. Mopping, which is a capability that you definitely want if you have hard floors, requires a significant amount of clean water and generates an equally significant amount of dirty water. One approach is to make docks that are even more enormous—large enough to host tanks for clean and dirty water that you have to change out on a weekly basis.

SwitchBot, a company that got its start with a stick-on robotic switch that can make dumb things with switches into smart things, has been doing some clever things in the robotic vacuum space as well, and we’ve been taking a look at the SwitchBot S10, which hooks up to your home plumbing to autonomously manage all of its water needs. And I have to say, it works so well that it feels inevitable: this is the future of home robots.

A Massive Mopping Vacuum

The giant dock can collect debris from the robot for months, and also includes a hot air dryer for the roller mop.Evan Ackerman/IEEE Spectrum

The SwitchBot S10 is a hybrid robotic vacuum and mop that uses a Neato-style lidar system for localization and mapping. It’s also got a camera on the front to help it with obstacle avoidance. The mopping function uses a cloth-covered spinning roller that adds clean water and sucks out dirty water on every rotation. The roller lifts automatically when the robot senses that it’s about to move onto carpet. The S10 comes with a charging dock with an integrated vacuum and dust collection system, and there’s also a heated mop cleaner underneath, which is a nice touch.

I’m not going to spend a lot of time analyzing the S10’s cleaning performance. From what I can tell, it does a totally decent job vacuuming, and the mopping is particularly good thanks to the roller mop that exerts downward pressure on the floor while spinning. Just about any floor cleaning robot is going to do a respectable job with the actual floor cleaning—it’s all the other stuff, like software and interface and ease of use, that have become more important differentiators.

Home Plumbing Integration

The water dock, seen here hooked up to my toilet and sink, exchanges dirty water out of the robot and includes an option to add cleaning fluid.Evan Ackerman/IEEE Spectrum

The S10’s primary differentiator is that it integrates with your home plumbing. It does this through a secondary dock—there’s the big charging dock, which you can put anywhere, and then the much smaller water dock, which is small enough to slide underneath an average toe-kick in a kitchen.

The dock includes a pumping system that accesses clean water through a pressurized water line, and then squirts dirty water out into a drain. The best place to find this combination of fixtures is near a sink with a p-trap, and if this is already beyond the limits of your plumbing knowledge, well, that’s the real challenge with the S10. The S10 is very much not plug-and-play; to install the water dock, you should be comfortable with basic tool use and, more importantly, have some faith in the integrity of your existing plumbing.

My house was built in the early 1960s, which means that a lot of my plumbing consists of old copper with varying degrees of corrosion and mineral infestation, along with slightly younger but somewhat brittle PVC. Installing the clean water line for the dock involves temporarily shutting off the cold water line feeding a sink or a toilet—that is, turning off a valve that may not have been turned for a decade or more. This is risky, and the potential consequences of any uncontrolled water leak are severe, so know where your main water shutoff is before futzing with the dock installation.

To SwitchBot’s credit, the actual water dock installation process was very easy, thanks to a suite of connectors and adapters that come included. I installed my dock in between a toilet and a pedestal sink, with access to the toilet’s water valve for clean water and the sink’s p-trap for dirty water. The water dock is battery powered, and cleverly charges from the robot itself, so it doesn’t need a power outlet. Even so, this one spot was pretty much the only place in my entire house where the water dock could easily go: my other bathrooms have cabinet sinks, which would have meant drilling holes for the water lines, and neither of them had floor space where the dock could live without being kicked all the time. It’s not like the water dock is all that big, but it really needs to be out of the way, and it can be hard to find a compatible space.

Mediocre Mapping

With the dock set up, the next step is mapping. The mapping process with the S10 was a bit finicky. I spent a bunch of time prepping my house—that is, moving as much furniture as possible off of the floor to give the robot the best chance at making a solid map. I know this isn’t something that most people probably do for their robots, but knowing robots like I do, I figure that getting a really good map is worth the hassle in the long run.

The first mapping run completed in about 20 minutes, but the robot got “stuck” on the way back to its dock thanks to a combination of a bit of black carpet and black coffee table legs. I rescued it, but it promptly forgot its map, and I had to start again. The second time, the robot failed to map my kitchen, dining room, laundry room, and one bathroom by not going through a wide open doorway off of the living room. This was confusing, because I could see the unexplored area on the map, and I’m not sure why the robot decided to call it a day rather than investigating that pretty obvious frontier region.

SwitchBot is not terrible at mapping, but it’s definitely sub-par relative to the experiences that I’ve had with older generations of other robots. The S10 also intermittently freaked out on the black patterned carpet that I have: moving very cautiously, spinning in circles, and occasionally stopping completely while complaining about malfunctioning cliff sensors, presumably because my carpet was absorbing all of the infrared from its cliff sensors while it was trying to map.

Black carpet, terror of robots everywhere.Evan Ackerman/IEEE Spectrum

Part of my frustration here is that I feel like I should be able to tell the robot “it’s a black carpet in that spot, you’re fine,” rather than taking such drastic measures as taping over all of the cliff sensors with tin foil, which I’ve had to do on occasion. And let me tell you how overjoyed I was to discover that the S10’s map editor has that exact option. You can also segment rooms by hand, and even position furniture to give the robot a clue on what kind of obstacles to expect. What’s missing is some way of asking the robot to explore a particular area over again, which would have made the initial process a lot easier.

Would a smarter robot be able to figure out all of this stuff on its own? Sure. But robots are dumb, and being able to manually add carpets and furniture and whatnot is an incredibly useful feature, I just wish I could do that during the mapping run somehow instead of having to spend a couple of hours getting that first map to work. Oh well.

How the SwitchBot S10 Cleans

When you ask the S10 to vacuum and mop, it leaves its charging dock and goes to the water dock. Once it docks there, it will extract any dirty water, clean its roller mop, extract the dirty water, wash its filter, and then finally refill itself with clean water before heading off to start mopping. It may do this several times over the course of a cleaning run, depending on how much water you ask it to use, but it’s quite good at managing all of this by itself. If you would like your floor to be extra clean, you can have the robot make two passes over the same area, which it does in a crosshatch pattern. And the app helpfully clues you in to everything that the robot is doing, including real-time position.

The app does and excellent job of showing where the robot has cleaned. You can also add furniture and floor types to help the robot clean better.Evan Ackerman/IEEE Spectrum

I’m pleasantly surprised by my experience with the S10 and the water dock. It was relatively easy to install and works exactly as it should. This is getting very close to the dream for robot vacuums, right? I will never have to worry about clean water tanks or dirty water tanks. The robot can mop every day if I want it to, and I don’t ever have to think about it, short of emptying the charging dock’s dustbin every few months and occasionally doing some basic robot maintenance.

SwitchBot’s Future

Being able to access water on-demand for mopping is pretty great, but the S10’s water dock is about more than that. SwitchBot already has plans for a humidifier and dehumidifier, which can be filled and emptied with the S10 acting as a water shuttle. And the dehumidifier can even pull water out of the air and then the S10 can use that water to mop, which is pretty cool. I can think of two other applications for a water shuttle that are immediately obvious: pets, and plants.

SwitchBot is already planning for more ways of using the S10’s water transporting capability.SwitchBot

What about a water bowl for your pets that you can put anywhere in your house, and it’s always full of fresh water, thanks to a robot that not only tops the water off, but changes it completely? Or a little plant-sized dock that lives on the floor with a tube up to the pot of your leafy friend for some botanical thirst quenching? Heck, I have an entire fleet of robotic gardens that would love to be tended by a mobile water delivery system.

SwitchBot is not the only company to offer plumbing integration for home robots. Narwal and Roborock also have options for plumbing add-on kits to their existing docks, although they seem to be designed more for European or Asian homes where home plumbing tends to be designed a bit differently. And besides the added complication of systems like these, you’ll pay a premium for them: the SwitchBot S10 can cost as much as $1200, although it’s frequently on sale for less. As with all new features for floor care robots, though, you can expect the price to drop precipitously over the next several years as new features become standard, and I hope plumbing integration gets there soon, because I’m sold.

Thirteen years since a massive earthquake and tsunami struck the Fukushima Dai-ichi nuclear power plant in northern Japan, causing a loss of power, meltdowns and a major release of radioactive material, operator Tokyo Electric Power Co. (TEPCO) finally seems to be close to extracting the first bit of melted fuel from the complex—thanks to a special telescopic robotic device.

Despite Japan’s prowess in industrial robotics, TEPCO had no robots to deploy in the immediate aftermath of the disaster. Since then, however, robots have been used to measure radiation levels, clear building debris, and survey the exterior and interior of the plant overlooking the Pacific Ocean.

It will take decades to decommission Fukushima Dai-ichi, and one of the most dangerous, complex tasks is the removal and storage of about 880 tons of highly radioactive molten fuel in three reactor buildings that were operating when the tsunami hit. TEPCO believes mixtures of uranium, zirconium and other metals accumulated around the bottom of the primary containment vessels (PCVs) of the reactors—but the exact composition of the material is unknown. The material is “fuel debris,” which TEPCO defines as overheated fuel that has melted with fuel rods and in-vessel structures, then cooled and re-solidified. The extraction was supposed to begin in 2021 but ran into development delays and obstacles in the extraction route; the coronavirus pandemic also slowed work.

While TEPCO wants a molten fuel sample to analyze for exact composition, getting just a teaspoon of the stuff has proven so tricky that the job is years behind schedule. That may change soon as crews have deployed the telescoping device to target the 237 tons of fuel debris in Unit 2, which suffered less damage than the other reactor buildings and no hydrogen explosion, making it an easier and safer test bed.

“We plan to retrieve a small amount of fuel debris from Unit 2, analyze it to evaluate its properties and the process of its formation, and then move on to large-scale retrieval,” says Tatsuya Matoba, a spokesperson for TEPCO. “We believe that extracting as much information as possible from the retrieved fuel debris will likely contribute greatly to future decommissioning work.”

How TEPCO Plans to Retrieve a Fuel Sample

Getting to the fuel is easier said than done. Shaped like an inverted light bulb, the damaged PCV is a 33-meter-tall steel structure that houses the reactor pressure vessel where nuclear fission took place. A 2-meter-long isolation valve designed to block the release of radioactive material sits at the bottom of the PCV, and that’s where the robot will go in. The fuel debris itself is partly underwater.

The robot arm is being preceded by a smaller telescopic device. The telescopic device, which is trying to retrieve 3 grams of the fuel debris without further contamination to the outside environment, is similar to the larger robot arm, which is better suited for the retrieval of larger bits of debris.

Mitsubishi Heavy Industries, the International Research Institute for Nuclear Decommissioning and UK-based Veolia Nuclear Solutions developed the robot arm to enter small openings in the PCV, where it can survey the interior and grab the fuel. Mostly made of stainless steel and aluminum, the arm measures 22 meters long, weighs 4.6 tons and can move along 18 degrees of freedom. It’s a boom-style arm, not unlike the robotic arms on the International Space Station, that rests in a sealed enclosure box when not extended.

The arm consists of four main elements: a carriage that pushes the assembly through the openings, arm links that can fold up like a ream of dot matrix printer paper, an arm that has three telescopic stages, and a “wand” (an extendable pipe-shaped component) with cameras and a gripper on its tip. Both the arm and the wand can tilt downward toward the target area.

After the assembly is pushed through the PCV’s isolation valve, it angles downward over a 7.2-meter-long rail heading toward the base of the reactor. It continues through existing openings in the pedestal, a concrete structure supporting the reactor, and the platform, which is a flat surface under the reactor.

Then, the tip is lowered on a cable like the grabber in a claw machine toward the debris field at the bottom of the pedestal. The gripper tool at the end of the component has two delicate pincers (only 5 square millimeters), that can pinch a small pebble of debris. The debris is transferred to a container and, if all goes well, is brought back up through the openings and placed in a glovebox: A sealed, negative-pressure container in the reactor building where initial testing can be performed. It will then be moved to a Japan Atomic Energy Agency facility in nearby Ibaraki Prefecture for detailed analysis.

While the gripper on the telescopic device currently being used was able to reach the debris field and grasp a piece of rubble—it’s unknown if it was actually melted fuel—last month, two of the four cameras on the device stopped working a few days later, and the device was eventually reeled back into the enclosure box. Crews confirmed there were no problems with signal wiring from the control panel in the reactor building, and proceeded to perform oscilloscope testing. TEPCO speculates that radiation passing through camera semiconductor elements caused electrical charge to build up, and that the charge will drain if the cameras are left on in a relatively low-dose environment. It was the latest setback in a very long project.

“Retrieving fuel debris from Fukushima Daiichi Nuclear Power Station is an extremely difficult task, and a very important part of decommissioning,” says Matoba. “With the goal of completing the decommissioning in 30 to 40 years, we believe it is important to proceed strategically and systematically with each step of the work at hand.”

This story was updated on 15 October, 2024 to clarify that TEPCO is using two separate tools (a smaller telescopic device and a larger robot arm) in the process of retrieving fuel debris samples.

Today, Boston Dynamics and the Toyota Research Institute (TRI) announced a new partnership “to accelerate the development of general-purpose humanoid robots utilizing TRI’s Large Behavior Models and Boston Dynamics’ Atlas robot.” Committing to working towards a general purpose robot may make this partnership sound like a every other commercial humanoid company right now, but that’s not at all that’s going on here: BD and TRI are talking about fundamental robotics research, focusing on hard problems, and (most importantly) sharing the results.

The broader context here is that Boston Dynamics has an exceptionally capable humanoid platform capable of advanced and occasionally painful-looking whole-body motion behaviors along with some relatively basic and brute force-y manipulation. Meanwhile, TRI has been working for quite a while on developing AI-based learning techniques to tackle a variety of complicated manipulation challenges. TRI is working toward what they’re calling large behavior models (LBMs), which you can think of as analogous to large language models (LLMs), except for robots doing useful stuff in the physical world. The appeal of this partnership is pretty clear: Boston Dynamics gets new useful capabilities for Atlas, while TRI gets Atlas to explore new useful capabilities on.

Here’s a bit more from the press release:

The project is designed to leverage the strengths and expertise of each partner equally. The physical capabilities of the new electric Atlas robot, coupled with the ability to programmatically command and teleoperate a broad range of whole-body bimanual manipulation behaviors, will allow research teams to deploy the robot across a range of tasks and collect data on its performance. This data will, in turn, be used to support the training of advanced LBMs, utilizing rigorous hardware and simulation evaluation to demonstrate that large, pre-trained models can enable the rapid acquisition of new robust, dexterous, whole-body skills.

The joint team will also conduct research to answer fundamental training questions for humanoid robots, the ability of research models to leverage whole-body sensing, and understanding human-robot interaction and safety/assurance cases to support these new capabilities.

For more details, we spoke with Scott Kuindersma (Senior Director of Robotics Research at Boston Dynamics) and Russ Tedrake (VP of Robotics Research at TRI).

How did this partnership happen?

Russ Tedrake: We have a ton of respect for the Boston Dynamics team and what they’ve done, not only in terms of the hardware, but also the controller on Atlas. They’ve been growing their machine learning effort as we’ve been working more and more on the machine learning side. On TRI’s side, we’re seeing the limits of what you can do in tabletop manipulation, and we want to explore beyond that.

Scott Kuindersma: The combination skills and tools that TRI brings the table with the existing platform capabilities we have at Boston Dynamics, in addition to the machine learning teams we’ve been building up for the last couple years, put us in a really great position to hit the ground running together and do some pretty amazing stuff with Atlas.

What will your approach be to communicating your work, especially in the context of all the craziness around humanoids right now?

Tedrake: There’s a ton of pressure right now to do something new and incredible every six months or so. In some ways, it’s healthy for the field to have that much energy and enthusiasm and ambition. But I also think that there are people in the field that are coming around to appreciate the slightly longer and deeper view of understanding what works and what doesn’t, so we do have to balance that.

The other thing that I’d say is that there’s so much hype out there. I am incredibly excited about the promise of all this new capability; I just want to make sure that as we’re pushing the science forward, we’re being also honest and transparent about how well it’s working.

Kuindersma: It’s not lost on either of our organizations that this is maybe one of the most exciting points in the history of robotics, but there’s still a tremendous amount of work to do.

What are some of the challenges that your partnership will be uniquely capable of solving?

Kuindersma: One of the things that we’re both really excited about is the scope of behaviors that are possible with humanoids—a humanoid robot is much more than a pair of grippers on a mobile base. I think the opportunity to explore the full behavioral capability space of humanoids is probably something that we’re uniquely positioned to do right now because of the historical work that we’ve done at Boston Dynamics. Atlas is a very physically capable robot—the most capable humanoid we’ve ever built. And the platform software that we have allows for things like data collection for whole body manipulation to be about as easy as it is anywhere in the world.

Tedrake: In my mind, we really have opened up a brand new science—there’s a new set of basic questions that need answering. Robotics has come into this era of big science where it takes a big team and a big budget and strong collaborators to basically build the massive data sets and train the models to be in a position to ask these fundamental questions.

Fundamental questions like what?

Tedrake: Nobody has the beginnings of an idea of what the right training mixture is for humanoids. Like, we want to do pre-training with language, that’s way better, but how early do we introduce vision? How early do we introduce actions? Nobody knows. What’s the right curriculum of tasks? Do we want some easy tasks where we get greater than zero performance right out of the box? Probably. Do we also want some really complicated tasks? Probably. We want to be just in the home? Just in the factory? What’s the right mixture? Do we want backflips? I don’t know. We have to figure it out.

There are more questions too, like whether we have enough data on the Internet to train robots, and how we could mix and transfer capabilities from Internet data sets into robotics. Is robot data fundamentally different than other data? Should we expect the same scaling laws? Should we expect the same long-term capabilities?

The other big one that you’ll hear the experts talk about is evaluation, which is a major bottleneck. If you look at some of these papers that show incredible results, the statistical strength of their results section is very weak and consequently we’re making a lot of claims about things that we don’t really have a lot of basis for. It will take a lot of engineering work to carefully build up empirical strength in our results. I think evaluation doesn’t get enough attention.

What has changed in robotics research in the last year or so that you think has enabled the kind of progress that you’re hoping to achieve?

Kuindersma: From my perspective, there are two high-level things that have changed how I’ve thought about work in this space. One is the convergence of the field around repeatable processes for training manipulation skills through demonstrations. The pioneering work of diffusion policy (which TRI was a big part of) is a really powerful thing—it takes the process of generating manipulation skills that previously were basically unfathomable, and turned it into something where you just collect a bunch of data, you train it on an architecture that’s more or less stable at this point, and you get a result.

The second thing is everything that’s happened in robotics-adjacent areas of AI showing that data scale and diversity are really the keys to generalizable behavior. We expect that to also be true for robotics. And so taking these two things together, it makes the path really clear, but I still think there are a ton of open research challenges and questions that we need to answer.

Do you think that simulation is an effective way of scaling data for robotics?

Tedrake: I think generally people underestimate simulation. The work we’ve been doing has made me very optimistic about the capabilities of simulation as long as you use it wisely. Focusing on a specific robot doing a specific task is asking the wrong question; you need to get the distribution of tasks and performance in simulation to be predictive of the distribution of tasks and performance in the real world. There are some things that are still hard to simulate well, but even when it comes to frictional contact and stuff like that, I think we’re getting pretty good at this point.

Is there a commercial future for this partnership that you’re able to talk about?

Kuindersma: For Boston Dynamics, clearly we think there’s long-term commercial value in this work, and that’s one of the main reasons why we want to invest in it. But the purpose of this collaboration is really about fundamental research—making sure that we do the work, advance the science, and do it in a rigorous enough way so that we actually understand and trust the results and we can communicate that out to the world. So yes, we see tremendous value in this commercially. Yes, we are commercializing Atlas, but this project is really about fundamental research.

What happens next?

Tedrake: There are questions at the intersection of things that BD has done and things that TRI has done that we need to do together to start, and that’ll get things going. And then we have big ambitions—getting a generalist capability that we’re calling LBM (large behavior models) running on Atlas is the goal. In the first year we’re trying to focus on these fundamental questions, push boundaries, and write and publish papers.

I want people to be excited about watching for our results, and I want people to trust our results when they see them. For me, that’s the most important message for the robotics community: Through this partnership we’re trying to take a longer view that balances our extreme optimism with being critical in our approach.

Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.

ROSCon 2024: 21–23 October 2024, ODENSE, DENMARK

ICSR 2024: 23–26 October 2024, ODENSE, DENMARK

Cybathlon 2024: 25–27 October 2024, ZURICH

Humanoids 2024: 22–24 November 2024, NANCY, FRANCE

Enjoy today’s videos!

One of the most venerable (and recognizable) mobile robots ever made, the Husky, has just gotten a major upgrade.

Shipping early next year.

[ Clearpath Robotics ]

MAB Robotics is developing legged robots for the inspection and maintenance of industrial infrastructure. One of the initial areas for deploying this technology is underground infrastructure, such as water and sewer canals. In these environments, resistance to factors like high humidity and working underwater is essential. To address these challenges, the MAB team has built a walking robot capable of operating fully submerged, based on exceptional self-developed robotics actuators. This innovation overcomes the limitations of current technologies, offering MAB’s first clients a unique service for trenchless inspection and maintenance tasks.

[ MAB Robotics ]

Thanks, Jakub!

The G1 robot can perform a standing long jump of up to 1.4 meters, possibly the longest jump ever achieved by a humanoid robot of its size in the world, standing only 1.32 meters tall.

[ Unitree Robotics ]

Apparently, you can print out a functional four-fingered hand on an inkjet.

[ UC Berkeley ]

We present SDS (``See it. Do it. Sorted’), a novel pipeline for intuitive quadrupedal skill learning from a single demonstration video leveraging the visual capabilities of GPT-4o. We validate our method on the Unitree Go1 robot, demonstrating its ability to execute variable skills such as trotting, bounding, pacing, and hopping, achieving high imitation fidelity and locomotion stability.

[ Robot Perception Lab, University College London ]

You had me at “3D desk octopus.”

[ UIST 2024 ACM Symposium on User Interface Software and Technology ]

Top-notch swag from Dusty Robotics

[ Dusty Robotics ]

I’m not sure how serious this shoes-versus-no-shoes test is, but it’s an interesting result nonetheless.

[ Robot Era ]

Thanks, Ni Tao!

Introducing TRON 1, the first multimodal biped robot! With its innovative “Three-in-One” modular design, TRON 1 can easily switch among Point-Foot, Sole, and Wheeled foot ends.

[ LimX Dynamics ]

Recent works in the robot-learning community have successfully introduced generalist models capable of controlling various robot embodiments across a wide range of tasks, such as navigation and locomotion. However, achieving agile control, which pushes the limits of robotic performance, still relies on specialist models that require extensive parameter tuning. To leverage generalist-model adaptability and flexibility while achieving specialist-level agility, we propose AnyCar, a transformer-based generalist dynamics model designed for agile control of various wheeled robots.

[ AnyCar ]

Discover the future of aerial manipulation with our untethered soft robotic platform with onboard perception stack! Presented at the 2024 Conference on Robot Learning, in Munich, this platform introduces autonomous aerial manipulation that works in both indoor and outdoor environments—without relying on costly off-board tracking systems.

[ Paper ] via [ ETH Zurich Soft Robotics Laboratory ]

Deploying perception modules for human-robot handovers is challenging because they require a high degree of reactivity, generalizability, and robustness to work reliably for diverse cases. Here, we show hardware handover experiments using our efficient and object-agnostic real-time tracking framework, specifically designed for human-to-robot handover tasks with legged manipulators.

[ Paper ] via [ ETH Zurich Robotic Systems Lab ]

Azi and Ameca are killing time, but Azi struggles being the new kid around. Engineered Arts desktop robots feature 32 actuators, 27 for facial control alone, and 5 for the neck. They include AI conversational ability including GPT-4o support, which makes them great robotic companions, even to each other. The robots are following a script for this video, using one of their many voices.

[ Engineered Arts ]

Plato automates carrying and transporting, giving your staff more time to focus on what really matters, improving their quality of life. With a straightforward setup that requires no markers or additional hardware, Plato is incredibly intuitive to use—no programming skills needed.

[ Aldebaran ]

This UPenn GRASP Lab seminar is from Antonio Loquercio, on “Simulation: What made us intelligent will make our robots intelligent.”

Simulation-to-reality transfer is an emerging approach that enables robots to develop skills in simulated environments before applying them in the real world. This method has catalyzed numerous advancements in robotic learning, from locomotion to agile flight. In this talk, I will explore simulation-to-reality transfer through the lens of evolutionary biology, drawing intriguing parallels with the function of the mammalian neocortex. By reframing this technique in the context of biological evolution, we can uncover novel research questions and explore how simulation-to-reality transfer can evolve from an empirically driven process to a scientific discipline.

[ University of Pennsylvania ]

The water column is hazy as an unusual remotely operated vehicle glides over the seafloor in search of a delicate tilt meter deployed three years ago off the west side of Vancouver Island. The sensor measures shaking and shifting in continental plates that will eventually unleash another of the region’s 9.0-scale earthquakes (the last was in 1700). Dwindling charge in the instruments’ loggers threatens the continuity of the data.

The 4-metric-ton, C$8-million (US $5.8-million) remotely operated vehicle (ROV) is 50 meters from its target when one of the seismic science platforms appears on its sonar imaging system, the platform’s hard edges crystallizing from the grainy background like a surgical implant jumping out of an ultrasound image. After easing the ROV to the platform, operators 2,575 meters up at the Pacific’s surface instruct its electromechanical arms and pincer hands to deftly unplug a data logger, then plug in a replacement with a fresh battery.

This mission, executed in early October, marked an exciting moment for Josh Tetarenko, director of ROV operations at North Vancouver-based Canpac Marine Services. Tetarenko is the lead designer behind the new science submersible and recently dubbed it Jenny in homage to Forrest Gump, because the fictional character named all of his boats Jenny. Swapping out the data loggers west of Vancouver Island’s Clayoquot Sound was part of a weeklong shakedown to test Jenny’s unique combination of dexterity, visualization chops, power, and pressure resistance.

Jenny is only the third science ROV designed for subsea work to a depth of 6,000 meters.

By all accounts Jenny sailed through. Tetarenko says the worst they saw was a leaky O-ring and the need to add some spring to a few bumpers. “Usually you see more things come up the first time you dive a vehicle to those depths,” says Tetarenko.

Jenny’s successful maiden cruise is just as important for Victoria, B.C.–based Ocean Networks Canada (ONC), which operates the NEPTUNE undersea observatory. The North-East Pacific Time-series Undersea Networked Experiments array boasts thousands of sensors and instruments, including deep-sea video cameras, seismometers, and robotic rovers sprawled across this corner of Pacific. Most of these are connected to shore via an 812-kilometer power and communications cable. Jenny was custom-designed to perform the annual maintenance and equipment swaps that have kept live data streaming from that cabled observatory nearly continuously for the past 15 years, despite trawler strikes, a fault on its backbone cable, and insults from corrosion, crushing pressures, and fouling.

NEPTUNE remains one of the world’s largest installations for oceanographic science despite a proliferation of such cabled observatories since it went live in 2009. ONC’s open data portal has over 37,000 registered users tapping over 1.5 petabytes of ocean data—information that’s growing in importance with the intensification of climate change and the collapse of marine ecosystems.

Over the course of Jenny’s maiden cruise, her operators swapped devices in and out at half a dozen ONC sites, including at several of NEPTUNE’s five nodes and at one of NEPTUNE’s smaller sister observatories closer to Vancouver.

Inside Jenny

ROV Jenny aboard the Valour, Canpac’s 50-meter offshore workhorse, ahead of October’s NEPTUNE observatory maintenance cruise.Ocean Networks Canada

What makes Jenny so special?

• Jenny is only the third science ROV designed for subsea work to a depth of 6,000 meters.
• Motion sensors actively adjust her 7,000-meter-long umbilical cable to counteract topside wave action that would otherwise yank the ROV around at depth and, in rough seas, could damage or snap the cable.
• Dual high-dexterity manipulator arms are controlled by topside operators via a pair of replica mini-manipulators that mirror the movements.
• Each arm is capable of picking up objects weighing about 275 kilograms, and the ROV itself can transport equipment weighing up to 3,000 kg.
• 11 high-resolution cameras deliver 4K video, supported by 300,000 lumens of lighting that can be tuned to deliver the soft red light needed to observe bioluminescence.
• Dual multibeam sonar systems maximize visibility in turbid water.

Meghan Paulson, ONC’s executive director for observatory operations, says the sonar imaging system will be particularly invaluable during dives to shallower sites where sediments stirred up by waves and weather can cut visibility from meters to centimeters. “It really reduces the risk of running into things accidentally,” says Paulson.

To experience the visibility conditions for yourself, check out recordings of the live video broadcast from the NEPTUNE maintenance cruise. Tetarenko says that next year they hope to broadcast not only the main camera feed but also one of the sonar images.

3D video could be next, according to Canpac ROV pilot and Jenny codesigner, James Barnett. He says they would need to boost the computing power installed topside, to process that “firehose of data,” but insists that real-time 3D is “definitely not impossible.” Tetarenko says the science ROV community is collaborating on software to help make that workable: “3D imagining is kind of the very latest thing that’s being tested on lots of ROV systems right now, but nobody’s really there yet.”

More Than Science

Expansion of the cabled observatory concept is the more certain technological legacy for ONC and NEPTUNE. In fact, the technology has evolved beyond just oceanography applications.

ONC tapped Alcatel Submarine Networks (ASN) to design and build the Neptune backbone and the French firm delivered a system that has reliably delivered multigigabit Ethernet plus 10 kilovolts of direct-current electricity to the deep sea. Today ASN deploys a second-generation subsea power and communications networking solution, developed with the Norwegian international energy company Equinor.

ASN’s “Direct Current/Fiber Optic” or DC/FO system provides the 100-km backbone for the ARCA subsea neutrino observatory near Sicily, in addition to providing control systems for a growing number of offshore oil and gas installations. The latter include projects led by Equinor and BP where DC/FO networks drive the subsea injection of captured carbon dioxide and monitor its storage below the seabed. Future oil and gas projects will increasingly rely on the cables’ power supply to replace the hydraulic lines that have traditionally been used to operate machinery on the seafloor, according to Ronan Michel, ASN’s product line manager for oil and gas solutions.

Michel says DC/FO incorporates important lessons learned from the Neptune installation. And the latter’s existence was a crucial prerequisite. “The DC/FO solution would probably not exist if Neptune Canada would not have been developed,” says Michel. “It probably gave confidence to Equinor that ASN was capable to develop subsea power and coms infrastructure.”

Simone Giertz came to fame in the 2010s by becoming the self-proclaimed “queen of shitty robots.” On YouTube she demonstrated a hilarious series of self-built mechanized devices that worked perfectly for ridiculous applications, such as a headboard-mounted alarm clock with a rubber hand to slap the user awake.

But Giertz has parlayed her Internet renown into Yetch, a design company that makes commercial consumer products. (The company name comes from how Giertz’s Swedish name is properly pronounced.) Her first release, a daily habit-tracking calendar, was picked up by prestigious outlets such as the Museum of Modern Art design store in New York City. She has continued to make commercial products since, as well as one-off strange inventions for her online audience.

Where did the motivation for your useless robots come from?

Simone Giertz: I just thought that robots that failed were really funny. It was also a way for me to get out of creating from a place of performance anxiety and perfection. Because if you set out to do something that fails, that gives you a lot of creative freedom.

You built up a big online following. A lot of people would be happy with that level of success. But you moved into inventing commercial products. Why?

Giertz: I like torturing myself, I guess! I’d been creating things for YouTube and for social media for a long time. I wanted to try something new and also find longevity in my career. I’m not super motivated to constantly try to get people to give me attention. That doesn’t feel like a very good value to strive for. So I was like, “Okay, what do I want to do for the rest of my career?” And developing products is something that I’ve always been really, really interested in. And yeah, it is tough, but I’m so happy to be doing it. I’m enjoying it thoroughly, as much as there’s a lot of face-palm moments.

Giertz’s every day goal calendar was picked up by the Museum of Modern Art’s design store. Yetch

What role does failure play in your invention process?

Giertz: I think it’s inevitable. Before, obviously, I wanted something that failed in the most unexpected or fun way possible. And now when I’m developing products, it’s still a part of it. You make so many different versions of something and each one fails because of something. But then, hopefully, what happens is that you get smaller and smaller failures. Product development feels like you’re going in circles, but you’re actually going in a spiral because the circles are taking you somewhere.

What advice do you have for aspiring inventors?

Giertz: Make things that you want. A lot of people make things that they think that other people want, but the main target audience, at least for myself, is me. I trust that if I find something interesting, there are probably other people who do too. And then just find good people to work with and collaborate with. There is no such thing as the lonely genius, I think. I’ve worked with a lot of different people and some people made me really nervous and anxious. And some people, it just went easy and we had a great time. You’re just like, “Oh, what if we do this? What if we do this?” Find those people.

This article appears in the November 2024 print issue as “The Queen of Useless Robots.”