Investigating the Integration of Pepper Robot and ChatGPT: A Study on Enhancing User Experience and Engagement.
Pepper-GPT is an integration system with the Whisper Small Model and gpt-3.5-turbo embedded into the Pepper robot for user experience enhancement.
Pepper-GPT consists of two programs: Black Box and Pepper Controller, which require a connection between these two programs.
The Pepper robot in the robotics lab connects to a private WiFi, which needs to connect via a VPN. To avoid complications, Black Box runs in Python 3 in Windows 11. And Pepper Controller is running in Python 2.7 in Ubuntu 20.04 with the VPN.
To connect the Black Box client, open a terminal in Linux and input:
sudo ip route
sudo ip route add 172.22.1.21/32 dev vpn
This will list out all the ip route. Then delete all the other ip route with the word "vpn":
e.g. sudo ip route del 10.0.0.0/8
Before running the programs, make sure the device is with a GPU.
Ensure the system is installed with ffmpeg and conda.
All the libraries are listed in the requirements.txt file. Use the command:
pip install -r requirements.txt
The installation for the Pepper robot's python SDK (Naoqi 2.5 SDK) should following the steps below:
source ~/naoqi.sh # Install naoqi SDK
~/naoqi/naoqi-sdk-2.1.4.13-linux64/naoqi # Check the installation by executing NAOqi
""" You should see an output similar to:
Starting NAOqi version 2.1.4.13 . NAOqi is listening on 0.0.0.0:9559 . . NAOqi is ready... Press CTRL-C to exit. """
gedit ~/.bashrc # config the environment, write following content at the end of the document
alias python='/usr/bin/python2.7'
export PYTHONPATH=${PYTHONPATH}:~/naoqi/pynaoqi-python2.7-2.1.4.13-linux64
export LD_LIBRARY_PATH=${LD_LIBRARY_PATH}:~/naoqi/pynaoqi-python2.7-2.1.4.13-linux64
source ~/.bashrc # activate the new configuration
"""
if there is an error of "ImportError:libboost_regex.so.1.55.0:cannot open shared object file: No such file or directory "
use the command "locate libboost_regex.so.1.55.0" find its path
open the path, find this file and copy it to the LD_LIBRARY_PATH
"""
- Install the programs into different systems (Black Box in Win 11; Pepper Controller in Ubuntu 20.04)
- Run the VPN.
- Set the network according to the section Network Settings
- Run the
server.pyfile in Ubuntu for starting - Run the
main.pyfile in Ubuntu to open the client of Pepper Controller - Run the
main.pyfile in Windows to open the client of Black Box (Remember to fill the api_key inchatGPT.pyfile) - If the terminal prints out the information "
Press Enter to Start.", then the project runs successfully.