Microsoft conducts research on use of ChatGPT to instruct robots, drones

In order to test if people can use ChatGPT to instruct robots without knowing programming languages or understanding robotics systems, Microsoft has conducted research

IANS San Francisco
US, UK and allies link China with global hacking spree: Report

In order to test if people can use ChatGPT to instruct robots without knowing programming languages or understanding robotics systems, Microsoft has conducted research to see if it can think outside the text and think about the physical world to help with robotics tasks.

"The key challenge here is teaching ChatGPT how to solve problems considering the laws of physics, the context of the operating environment, and how the robot's physical actions can change the state of the world," Microsoft said in a blogpost.

"It turns out that ChatGPT can do a lot by itself, but it still needs some help. Our technical paper describes a series of design principles that can be used to guide language models towards solving robotics tasks. These include, and are not limited to, special prompting structures, high-level APIs, and human feedback via text," it added.

After ChatGPT was given access to object-detection and object-distance data via application interfaces, the Microsoft researchers investigated its ability to generate code, mostly in Python, for robotics scenarios such as zero-shot planning and code generation.

As the AI chatbot was trained on a large amount of code and written text, it can generate code.

The system can solve coding problems and debug programmes, as well as respond to dialogue and seek clarifications, according to the researchers.

Also Read

Microsoft infuses billions of dollars in ChatGPT developer OpenAI

ChatGPT's paid version available for $42 a month for some early users

ChatGPT vs humans: What it can and cannot accomplish

Microsoft in talks to invest $10 bn in ChatGPT owner, says report

OpenAI to soon monetise ChatGPT platform with a paid professional version

Over 31,179 fake customer care numbers duping Indian consumers: Report

Amazon's Alexa introduces new male voice as it completes 5 years in India

Qualcomm demonstrates world's first stable diffusion on Android phone

Video-sharing platform YouTube to allow dubbing videos in multi-languages

WhatsApp's new feature to let users report status updates on iOS beta

Moreover, ChatGPT was tested as a language-based interface between a non-technical user and a drone using these dialogue and clarification capabilities in mind.

The researchers note that while GPT-3, LaMDA, and Codex demonstrated good results when it comes to robotics planning and coding, ChatGPT stands out as "a potentially more versatile robotics tool because it incorporates natural language and code generation models with dialogue flexibility".

"ChatGPT asked clarification questions when the user's instructions were ambiguous and wrote complex code structures for the drone such as a zig-zag pattern to visually inspect shelves," the researchers said.

Microsoft tested ChatGPT to use a robotic arm to move blocks around to form the Microsoft logo, with writing an algorithm for a drone to reach a point without crashing into obstacles, and whether ChatGPT can decide where a robot should go based on sensor feedback in real-time.



(Only the headline and picture of this report may have been reworked by the Business Standard staff; the rest of the content is auto-generated from a syndicated feed.)

First Published: Feb 24 2023 | 9:57 PM IST

Explore News