Español
Português
Việt Nam
日本語
русский 
عربي 
Deutsch
한국어
Türkçe
Français
Italiano
Human-computer interaction (HCI) refers to the information exchange process between the operator and the mobile robot through the built-in input devices and output devices of the mobile robot. Through human-computer interaction, the operator can input instructions, teach actions, set parameters, etc. to the mobile robot, and the mobile robot can also feed back robot status parameters, environmental monitoring data, and abnormal alarm information to the operator. According to different types, the input and output devices of mobile robots can be divided into electrical human-computer interaction equipment, interface human-computer interaction equipment, multimedia human-computer interaction equipment, and wearable human-computer interaction equipment.
Electrical human-computer interaction equipment
Electrical human-computer interaction devices are devices that interact with mobile robots through electrical signals, including buttons, buttons, switches, buzzers, indicator lights, etc. They respond quickly and are highly reliable, and are the most commonly used types of input and output devices for mobile robots , often used for startup, emergency stop, shutdown, status indication, etc. of the mobile robot, and is generally arranged on the operation panel of the mobile robot or a conspicuous place on the surface of the body for the operator to use and observe.
Interface human-computer interaction equipment
Interface human-computer interaction equipment includes: keyboard, mouse, light pen, touch screen, display screen, teaching device, etc. Operators can use input devices such as keyboards, mice, and light pens to operate elements such as text boxes, menu bars, scroll bars, and command buttons on the UI interface, and issue commands or set parameters to the mobile robot. At the same time, the UI interface displays the status of the robot in the form of data, images, videos, etc. through the touch screen or display screen.
Multimedia human-computer interaction equipment
Multimedia interactive devices include voice interactive devices and visual interactive devices.
Voice human-computer interaction devices include microphones and speakers. Based on the built-in speech recognition engine, the speaker's voice collected by the microphone will be translated into instructions that the robot can understand, and will be broadcast through the speaker to realize human-computer voice interaction. The functions that can be realized by voice interaction include: voice wake-up, voice control, human voice recognition, man-machine dialogue, voice reminder, etc.
Video human-computer interaction devices are mainly various cameras. The visual information of the environment is input to the mobile robot through the camera for processing, and the processing results can be used for mapping and positioning, body gesture recognition, gait recognition, face recognition, expression recognition, object recognition, object tracking, etc.
Wearable Human-Computer Interaction Devices
Wearable human-computer interaction devices are directly worn on the operator's body. They are interactive devices that collect human biological information output and feed back information to human sensory organs. They mainly include: data gloves, myoelectric collectors, EEG collectors, and 3D glasses. Wait. Through the equipment worn by the operator, the setting and control of the robot can be completed with the help of human biological information such as mechanical signals, electromyography (EMG), and electroencephalogram (EEG), and the multi-modal information of the robot can be received by means of 3D glasses, etc. feedback.