Skip to content

Commit

Permalink
Create generative-robot-behavior
Browse files Browse the repository at this point in the history
  • Loading branch information
kpwelsh authored Nov 20, 2024
1 parent 2fc87d9 commit 2f03576
Showing 1 changed file with 17 additions and 0 deletions.
17 changes: 17 additions & 0 deletions projects/generative-robot-behavior
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
---
layout: project
type: project
image: img/cotton/cotton-square.png
title: "Cotton"
date: 2024
published: true
labels:
- Robotics
- ROS2
summary: "TODO:"
---


# Generative Behavior Generation

Its very hard to program a robot. One reason is that the algorithms are difficult and subtle. Another reason is that the interfaces are complex and unnatural. Using generative AI models at the core of a program synthesis engine, we developed an augmented reality based, bidirectional communication interface that allows users to give commands to a robot while sharing the same space. Users can point to things, draw outlines, and use hand gestures to communicate direction to a robotic system. The AI can then examine the low level tools it has at its disposal and come up with a way to perform the presented task.

0 comments on commit 2f03576

Please sign in to comment.