Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Receptionist] updates for the challenge #930

Merged
merged 19 commits into from
Jan 20, 2025
Merged
Show file tree
Hide file tree
Changes from 6 commits
Commits
Show all changes
19 commits
Select commit Hold shift + click to select a range
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
28 changes: 18 additions & 10 deletions scoresheets/Receptionist.tex
Original file line number Diff line number Diff line change
@@ -1,22 +1,30 @@
\begin{scorelist}[startbutton=false,timelimit=5]
\scoreheading{Main Goal}
\scoreitem[2]{15}{Guide the guest to the other guests (navigate to the guest group)}
\scoreitem[2]{50}{Look in the direction of navigation or at the navigation goal}
\scoreitem[2]{50}{Introduce a new guest to every other guest and the host}
\scoreitem[2]{30}{show the guest around (navigate to the beverage area and living room)}
LeroyR marked this conversation as resolved.
Show resolved Hide resolved
\scoreitem[1]{30}{Look in the direction of navigation or at the navigation goal}
\scoreitem[2]{20}{identify favorite drink}
\scoreitem[2]{20}{identify interest of guest}
Julislz marked this conversation as resolved.
Show resolved Hide resolved
\scoreitem[2]{20}{tell position of favorite drink}
LeroyR marked this conversation as resolved.
Show resolved Hide resolved
\scoreitem[2]{100}{Offer a free seat to the new guest}
\scoreitem[2]{25}{Look at the person talking}
\scoreitem[2]{50}{Look at the person the robot is introducing the guest to}
\scoreitem[2]{75}{Look at the person talking}
\scoreitem[1]{75}{Introduce both guests to each other}


\scoreheading{Bonus Rewards}
\scoreitem[2]{100}{Open the entrance door for a guest}
\scoreitem[4]{30}{Describe the first guest to the second guest (per corect attribute)}
\penaltyitem[4]{30}{Describe the first guest to the second guest (per incorrect attribute)}
\scoreitem[2]{125}{Open the entrance door for a guest}
\scoreitem[1]{50}{find the same interest between two guests or a guest and the host}
Julislz marked this conversation as resolved.
Show resolved Hide resolved
\scoreitem[4]{30}{Describe the first guest to the second guest (per correct attribute)}


\scoreheading{Penalties}
\penaltyitem{50}{Wrong guest information was memorized (continue with wrong name or drink)}
\penaltyitem[2]{50}{Wrong guest information was memorized (continue with wrong name or drink)}
\penaltyitem[2]{50}{interest was not or wrongly memorized}
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
\penaltyitem[2]{50}{interest was not or wrongly memorized}
\penaltyitem[2]{50}{Interest was not or wrongly memorized}

\penaltyitem{50}{Persistent inappropriate gaze (away from conversational partner)}
\penaltyitem{10}{Persistent gaze not in the direction of the navigation while moving.}
\penaltyitem{25}{Persistent gaze not in the direction of the navigation while moving.}
\penaltyitem[2]{20}{wrongly identifying the favorite drink on the table}
Julislz marked this conversation as resolved.
Show resolved Hide resolved
\penaltyitem[2]{10}{wrongly stating the position of drink on the table}
\penaltyitem[4]{30}{Describe the first guest to the second guest (per incorrect attribute)}
\penaltyitem[1]{30}{wrongly stating a similarity}
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
\penaltyitem[1]{30}{wrongly stating a similarity}
\penaltyitem[1]{30}{Wrongly stating a similarity}


\scoreheading{Deus Ex Machina}
\penaltyitem[2]{75}{Alternative HRI}
Expand Down
47 changes: 30 additions & 17 deletions tasks/Receptionist.tex
Original file line number Diff line number Diff line change
Expand Up @@ -4,13 +4,15 @@ \subsection*{Description}
The robot has to take two new guests to the living room to introduce them and offer a free place to sit.\\

\textbf{Main goal:}
Introduce and usher two newcomers to a party and maintain appropriate gaze direction (at person, direction of navigation).
The robot must welcome and assist two newcomers at a party and maintain appropriate gaze direction while conversation (at person, direction of navigation).
Julislz marked this conversation as resolved.
Show resolved Hide resolved

% \vspace{-5pt}
\textbf{Optional goals:}
\begin{enumerate}[nosep]
\item Open the entrance door for each arriving guest.
\item Describe the first guest for the second guest.
\item Opening the door for the arriving guests
Julislz marked this conversation as resolved.
Show resolved Hide resolved
\item Describe the first guest for the second guest before reaching the living room
\item Identify similarities between the guests and the host and incorporate them into the conversation.
\end{enumerate}

\subsection*{Focus}
Expand All @@ -23,36 +25,45 @@ \subsection*{Setup}
\begin{itemize}
\item The test takes place in the living room.
\item The robot starts inside the \Arena{} at a predefined location.
\item a table with drinks is prepared near the living room
SparkRibeiro21 marked this conversation as resolved.
Show resolved Hide resolved
\item \textbf{Entrance:} The entrance door is open by default. The team leader can request to close the door to score additional points by opening it for the guests.
\end{itemize}

\item \textbf{People:}
\begin{itemize}
\item \textbf{Host:} The host's name and favorite drink will be announced before the test. The host is already sitting in the living room.
\item \textbf{Host:} The host's name, favorite drink and interest will be announced before the test. The host is already sitting in the living room.

\item \textbf{Guests:} Both guests have a name and favorite drink. An arriving guest will either step in front of the robot or ring the bell or knock on the door if the door is closed. Guests have to be guided to the living room to be introduced. Each of the guest will arrive separately. The sound of the bell will be provided to teams
during setup period before competition (if not using door knocking).
\item \textbf{Arriving Guests:} Both guests have a name, favorite drink, and a interest. An arriving guest will either step in front of the robot or wait behind the door to step in if the door is closed. Guests have to be guided to the beverage area and then the living room where the robot will introduce the guests to each other. Each of the guest will arrive separately.

\item \textbf{Passive Guests:} Other Guests: A few individuals, including possibly spectators, are standing in small groups of two or three, all over the arena but not covering relevant places e.g. the couch, seats or the area with the drinks.
\end{itemize}

\end{itemize}

\subsection*{Procedure}
Both guests arrive separately. The robot either opens the door for the guest or waits for them at the starting point. It greets the guest and asks for their name. The robot then guides the guest to the beverage area, where it asks for their favorite drink and checks if the drink is available on the table and where it stands. The robot finds out the interest of the guest at a freely chosen moment. After showing the guest the beverage area, the robot escorts them to the living room and offers a free seat. Once both guests are seated, the robot introduces them to each other.
\begin{itemize}
\item \textbf{Introductions:} When introducing guests, the robot must clearly identify the person being introduced and state their name and favorite drink. Introducing two people means to introduce them to each other.
\item \textbf{Greeting guests:} the person paces a little to the left and right during conversation with the robot. other people might appear in the background
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This seems very weird. And kinda difficult for volunteers who might already have trouble interacting with the robot. In my experience proper tracking can usually be checked here regardless because people will turn to the referee, step towards the robot, bend down to the robot etc.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

was that also discussed in the TC meeting? Cause i was specifically told that this should be added.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It was specifically requested above in order to make sure the robot keeps eye-contact. It might be enough if one person does this just to see that the robot is capable of keeping tracking on them. If we hand out post-its with Name, Drink, Interest, it should be fine I think.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

what we talked in the TC meeting is that is must be added one way or the other, a lot of robots don't do this and many times robots are talking to a person, the person moves aw bit and the robot keeps looking to an empty space. This just seems very weird. As @hawkina said, doing this with one person is enough to understand if the robot does dynamic tracking or not.

SparkRibeiro21 marked this conversation as resolved.
Show resolved Hide resolved

\item \textbf{Looking at person:} During verbal interactions and descriptions of people, robot
looks at the conversational partner. The conversational partner will make small movements to each side to confirm the robot is dynamically looking at the person. Points for looking at the person talking, will only be awarded if the robot proves to continuously look at the moving person.

\item \textbf{Looking at direction of navigation:} During navigation robot looks in the direction where it is going. Persistently gazing towards unrelated person or incorrect direction while moving during the task deducts points.

\item \textbf{Smalltalk} ask each guest for one interest
SparkRibeiro21 marked this conversation as resolved.
Show resolved Hide resolved

\item \textbf{Finding the drink} the robot shows both guest the drinking area where it will ask for their favorite drink and tell the guest if and where (left, center right is enough) that drink is available on the table.
LeroyR marked this conversation as resolved.
Show resolved Hide resolved

\item \textbf{Seating People:} The robot must point at a place or location where the guest can sit.

\item \textbf{Switching Places:} Guests may switch places after they were seated.

\item \textbf{Describing the First Guest:} Naming 4 characteristics of the first guest, i.e., color of clothes, color of hair, gender, and age, earns bonus points.
\item \textbf{Looking at person/direction of navigation:} During verbal interactions and descriptions of people, robot
looks at the conversational partner. Robot can point at the person being introduce/described or alternate gaze between two people. During navigation robot looks in the direction where it is going. Persistently gazing towards unrelated
person or incorrect direction while moving during the task deducts points.
\item \textbf{Introductions:} When introducing guests, the robot must clearly identify the person being introduced and state their name favorite drink and a interest. Introducing two people means to introduce them to each other.
LeroyR marked this conversation as resolved.
Show resolved Hide resolved
\end{itemize}

\subsection*{Additional rules and remarks}
\begin{enumerate}[nosep]
\item \textbf{Misunderstanding:} Not understanding the guests and asking them again is fine. Continuing with a wrong name or drink causes a score reduction of 50pts.
\item \textbf{Misunderstanding:} Not understanding the guests and asking them again is fine. Continuing with a wrong name, drink or interest causes a score reduction of 50pts.

\item \textbf{Partial Scoring:} The main task allows partial (per guest) scoring.

Expand All @@ -73,26 +84,28 @@ \subsubsection*{To Referee}

The referees need to:
\begin{itemize}
\item Assign name and drink to 3 volunteers.
\item Assign name, drink and one interest to 3 volunteers.
\item Arrange (and re-arrange) people in the living room.
\item change the selection in the beverage area
LeroyR marked this conversation as resolved.
Show resolved Hide resolved
\item Open the door when requested by the robot.
\end{itemize}

\subsubsection*{To OC}


During setup day:
\begin{itemize}
\item Provide the dorbell sound (if not using door knocking).
\item the list of names and drinks is given (a list of interests will not be provided)
Julislz marked this conversation as resolved.
Show resolved Hide resolved
\end{itemize}
Julislz marked this conversation as resolved.
Show resolved Hide resolved


At least two hours before test:
\begin{itemize}
\item Announce starting position.
\item Announce host's name and favorite drink.
\item Recruit volunteers as host and guests.
\item Announce host's name, favorite drink and interest.
\item Recruit volunteers as host and two guests and passive guests .
Julislz marked this conversation as resolved.
Show resolved Hide resolved
\end{itemize}

% \newpage
\subsection*{Score sheet}
\input{scoresheets/Receptionist.tex}

\input{scoresheets/Receptionist.tex}