AI News, Research makes robots better at following spoken instructions

Research makes robots better at following spoken instructions

The research was led by Dilip Arumugam and Siddharth Karamcheti, both undergraduates at Brown when the work was performed (Arumugam is now a Brown graduate student).

'The issue we're addressing is language grounding, which means having a robot take natural language commands and generate behaviors that successfully complete a task,' Arumugam said.

That's a highly abstract command that implies a number of smaller sub-steps -- lining up the lift, putting the forks underneath and hoisting it up.

But without taking into account the specificity of the instructions, the robot might overplan for simple instructions, or underplan for more abstract instructions that involve more sub-steps.

In addition to simply inferring a desired task from language, the new system also analyzes the language to infer a distinct level of abstraction.

The online domain consists of a few color-coded rooms, a robotic agent and an object that can be manipulated -- in this case, a chair that can be moved from room to room.

Mechanical Turk volunteers watched the robot agent perform a task in the Cleanup World domain -- for example, moving the chair from a red room to an adjacent blue room.

The instructions ranged from the high-level: 'Take the chair to the blue room' to the stepwise-level: 'Take five steps north, turn right, take two more steps, get the chair, turn left, turn left, take five steps south.'

Humans Need Not Apply

Discuss this video:

Transparent Role Assignment and Task Allocation in Human Robot Collaboration

Accompanying video for the following ICRA 2017 paper: Roncone, A. and Mangin, O. and Scassellati, B. Transparent role assignment and task allocation in ...

David Mindell: "Our Robots, Ourselves" | Talks at Google

David Mindell visited Google's office in Los Angeles, CA to discuss his book "Our Robots, Ourselves: Robotics and the Myths of Autonomy". This talk was on ...

Conversational AI: Best Practices for Building Bots

Conversational digital affordances are fast becoming a norm for users everywhere – from the office to the kitchen; from the car to the living room. We can type ...

Developing enterprise bots with Office 365 - BRK3221

The excitement around bots is perhaps even more relevant in the enterprise, where bots can be used to manage workflow, automate business process, and ...

DEF CON 24 - Chris Eagle, Sk3wlDbg - Emulating many of the things with Ida

It is not uncommon that a software reverse engineer finds themselves desiring to execute a bit of code they are studying in order to better understand that code ...



Good practices for efficient dataflow between field and office

This video takes you through six steps of a typical surveying workflow – from the initial capturing of reality to the final as-built check and reporting. Original ...

City at World's End by Edmond Hamilton

A surprise nuclear war may cause the End of the World, but not the way anyone could have imagined. Chapter 01. Cataclysm - 00:00 Chapter 02. The Incredible ...