Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve Receptionist #916

Closed
LeroyR opened this issue Oct 30, 2024 · 5 comments
Closed

Improve Receptionist #916

LeroyR opened this issue Oct 30, 2024 · 5 comments
Labels

Comments

@LeroyR
Copy link
Member

LeroyR commented Oct 30, 2024

Is your idea/suggestion related to a problem? Please describe.

Something about receptionist..

The median score is high -> the task is solved
Task is very static. e.g.

  • The Robots are telling the person where to stand instead of looking at them dynamically
  • The introduction/getting to know name and drink is also very predictable, boring and 'hardcoded'
    We do not have any pose/gesture recognition

Describe the solution you'd like

  • Keep/ReIntroduce Subjective Interaction scoring (survey)? -> some 'interesting' interaction has to happen
  • Have multiple people around/front of the robot
    • The robot has to recognize the speaking person (sound source or moving lips?) to score eye contact points
  • Reward completion -> add one more guest and reduce scores?
    • The robot could handle introduction during guidance to save time
  • The 2nd guests could point at one of the persons and ask the robot for name/drink of that person
  • Smalltalk during guidance: I don't want to be guided to the seating area in silence somehow reward doing 'smalltalk'.
    • Add points for stating some trivia about the person which has to be obtained by talking. (job/time of arrival/country of origin etc)
@LeroyR LeroyR added the Idea label Oct 30, 2024
@johaq
Copy link
Member

johaq commented Nov 25, 2024

No survey. Just too time and work intensive to do while the test runs. Only thing I see as doable would a couple of yes or no questions, but that's not really a survey anymore then.

Personally I really like the proposed sound source localization aspect because it is not really a part of any of the tests anymore.
I would remove the host from the scenario at least for the introductions. It does not make sense to introduce a guest to the host, they should know their guests. Maybe have the host still sit there as a distraction but introductions need to be made between guests only. Then introductions need to be made more closely, i.e. approaching the first guest and introducing the second guest to them.

@SparkRibeiro21
Copy link
Contributor

SparkRibeiro21 commented Nov 27, 2024

Some suggestions:

  • Add showing the guest where the drinks are, and offer a drink to the guest (if stickler is removed than this may be an option) since time is so limited maybe exceptionally just for this task put the drinks on a furniture on the way to the living room. Or have the robot go get a drink after sitting the guest.
  • The door opening points are VERY misadjusted. Opening the door is much more complex than opening the cabinet door in storing groceries, and teams get 200 points for the cabinet door and 100 points for the entrance door. In the entrance door you have to identify the handle, pull down the handle, pull the door, ... whereas the cabinet door is much simpler. I believe no team even tries to attempt this (even though a couple of teams showed in their qualification videos from last year they could open doors), means that the number of points doesn't compensate the risk that is attempting to open the door.
  • Add hearing more information from each guest (currently we are doing name and drink, maybe add food, or interests in general such as: sports, cooking, ... (i think adding interests would be nice but we should not have a list of possible answers like we have for the names and drinks, make it broad enough so that it can not be hard coded to be one of the options)

@hawkina
Copy link
Contributor

hawkina commented Dec 1, 2024

Some suggestions:

* Add showing the guest where the drinks are, and offer a drink to the guest (if stickler is removed than this may be an option) since time is so limited maybe exceptionally just for this task put the drinks on a furniture on the way to the living room. Or have the robot go get a drink after sitting the guest.

I like the robot showing the guest where the drinks are, before it leads the guest into the living room. I would however do not require the robot to pick up the drink and hand it to the guest, it could be enough to just offer the drinks by guiding the guest to them and saying what is available. I would give bonus points though if someone tries to pick up + handover

* The door opening points are **VERY** misadjusted. Opening the door is much more complex than opening the cabinet door in storing groceries, and teams get 200 points for the cabinet door and 100 points for the entrance door. In the entrance door you have to identify the handle, pull down the handle, pull the door, ... whereas the cabinet door is much simpler. I believe no team even tries to attempt this (even though a couple of teams showed in their qualification videos from last year they could open doors), means that the number of points doesn't compensate the risk that is attempting to open the door.

ok we should change this

* Add hearing more information from each guest (currently we are doing name and drink, maybe add food, or interests in general such as: sports, cooking, ... (i think adding interests would be nice but we should not have a list of possible answers like we have for the names and drinks, make it broad enough so that it can not be hard coded to be one of the options)

This could be really cool! Bonus points for if the robot manages to match guests by their interest. E.g. mention during introduction that both people like the same sport or similar.

@ARTenshi
Copy link
Collaborator

ARTenshi commented Dec 2, 2024

Hello,

I like these two ideas:

Have multiple people around/front of the robot

The 2nd guests could point at one of the persons and ask the robot for name/drink of that person

Another point:

The door opening points are VERY misadjusted. Opening the door is much more complex than opening the cabinet door in storing groceries, and teams get 200 points for the cabinet door and 100 points for the entrance door.

Yes, but opening the front door is a recurrent task; increasing the score would bias what happens inside the arena for teams able to open the door; we might consider those few points as a partial score considering all the chances that a team will have to open the door (almost for every test).

@sunava
Copy link
Contributor

sunava commented Dec 9, 2024

I or a student of mine will do a PR soon

LeroyR added a commit that referenced this issue Jan 20, 2025
# Proposed Solution for issue #916 
with @sunava 
Changes proposed in this pull request:
- the robot shows both guests where the drinks are and detects if their
favorite drink is available
- There are passive guests in the background
- Points for finding one hobby/interest of each guest
- At the end, only the guests get introduced 
- optional goal 'describing the first guest' changes. describe first
guest to second guest **before** reaching the living room (updated
10.01)
- guest paces from left to right during conversation with robot (update
10.01)
-  ~~Added optional goal picking up a drink~~ (updated 10.01)
- Added optional goal for finding similar interest between guests or
guest and host
- added a procedural guide for quicker and easier understanding of the
challenge
- Changed scoresheet accordingly

## Updated procedure summarized
Both guests arrive separately. The robot either opens the door for the
guest or
waits for them at the starting point. It greets the guest and asks for
their name.
The robot then guides the guest to the beverage area, where it asks for
their
favorite drink and checks if the drink is available on the table. The
robot gathers
one interest of the guest at a freely chosen moment.
After showing the guest the beverage area, the robot escorts them to the
living
room and offers a free seat. Once both guests are seated, the robot
introduces
them to each other.

## Other comments
- ~~I would suggest making it an obligation to log what the robot is
saying.
This makes the process easier for the referee in a noisy arena to check
the output quickly after the challenge~~

- The passive guests and the host could be spectators if it is not too
much effort.

---------

Co-authored-by: Tiago Ribeiro <[email protected]>
Co-authored-by: Leroy Rügemer <[email protected]>
@LeroyR LeroyR closed this as completed Jan 20, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

6 participants