Skip to content

Latest commit

 

History

History
46 lines (36 loc) · 1.28 KB

README.md

File metadata and controls

46 lines (36 loc) · 1.28 KB

ButlerBrain

Combining Knowledge Base Reasoning Systems like Knowrob with Deeplearning for improving Robot Cognition, Learning and Human-Robot Interaction.

Demonstration Video

Dependencies

openai (GPT-3) -> pip install openai
fuzzywuzzy (string similarity) -> pip install fuzzywuzzy
pip install torch torchvision
pip install transformers
pip install -U sentence-transformers
gTTs (google text to speech) -> pip install gTTS
pyyaml -> pip install pyyaml
rospkg -> pip install rospkg
pyaudio -> sudo apt-get install portaudio19-dev && pip install pyaudio
pip install --upgrade google-cloud-speech
pip install SpeechRecognition
pip install google-cloud-texttospeech
pip install torchtext
rosprolog
knowrob
mpg321 -> sudo apt install mpg321

Google Cloud API

https://cloud.google.com/docs/authentication/provide-credentials-adc

get sevice account key json file and add its path to bashrc:

export GOOGLE_APPLICATION_CREDENTIALS="path/to/json"

Usage

Replace knowrob.owl in the knowrob package with the knowrob.owl found in this package's owl folder

sudo systemctl start mongodb.service
roslaunch rosprolog rosprolog.launch initial_package=knowrob

In a new terminal:

rosrun butler_brain butler_brain.py