The unicorn tech company’s Figure AI robot is equipped with OpenAI’s image language model for natural human interaction.

In a video released by Figure AI on March 13th, the company’s humanoid robot, Figure 01, can seamlessly converse with humans. The company states that the robot integrates the latest Visual Language Model (VLM) developed by OpenAI, which enables speech-to-speech interaction for communication.

Specifically, the VLM utilizes OpenAI’s multimodal model with the ability to understand images, text captured from the robot’s camera, based on real-time voice conversation. These data are analyzed by the robot to provide responsive feedback to the interlocutor. This differs from GPT-4, which focuses on text-based prompts.

Additionally, the robot also employs “learned hand gestures.” The system seamlessly collects and controls the arms’ movements. “The image processing network operates at a frequency of 10 Hz and generates 24-DOF actions (wrist poses and finger joint angles) at a frequency of 200 Hz,” according to Figure AI.

A demo video shows that Figure 01 can interact with humans quite naturally, although the responses are not yet sufficiently fast. Business Insider evaluates the humanoid robot equipped with the leading company’s AI like OpenAI as a “powerful combination,” but “it may evoke a mix of awe and fear.”

Figure AI asserts that the content in the video is based on the system’s learning process and is not remotely controlled.

“Without witnessing it firsthand, it’s challenging to verify Figure AI’s claims. Or the company may have gone through hundreds of iterations to achieve such results,” TechRadar comments. “But if it’s 100% true, it would be fantastic.”

Figure AI is a newly established startup in the US in 2022 but has made a strong impression on investors, becoming a unicorn valued at $2.6 billion by unveiling and continuously improving the humanoid robot Figure 01. This robot is expected to be deployed in manufacturing, transportation, logistics, warehousing, and retail – areas facing labor shortages.

Source: vnexpress.net