Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Draft] New finals #928

Draft
wants to merge 1 commit into
base: master
Choose a base branch
from
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
12 changes: 3 additions & 9 deletions documents/scoresheets.tex
Original file line number Diff line number Diff line change
Expand Up @@ -155,16 +155,10 @@

% %%% FINALS %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%

% Final (Jury)
\renewcommand{\currentTest}{Final Demonstration --- Jury Evaluation}
% Final
\renewcommand{\currentTest}{Final Demonstration}
\begin{scoresheet}
\input{scoresheets/FinalsJury.tex}
\end{scoresheet}

% Final (EC)
\renewcommand{\currentTest}{Final Demonstration --- Executive Committee}
\begin{scoresheet}
\input{scoresheets/FinalsExec.tex}
\input{scoresheets/Finals.tex}
\end{scoresheet}

\end{document}
Expand Down
16 changes: 16 additions & 0 deletions scoresheets/Finals.tex
Original file line number Diff line number Diff line change
@@ -0,0 +1,16 @@
\begin{scorelist}[timelimit=10, attempts=1, outstanding=false, specialpenbonus=false]
\scoreheading{Main Goal}
\scoreitem[3]{150}{Find and clearly state an encountered problem}
\scoreitem[3]{650}{Solve a problem}

\scoreheading{Deus Ex Machina Penalties}
\penaltyitem[3]{150}{Asking for location of a problem}
\penaltyitem[3]{650}{Instructing a human to perform parts of the task will apply a percentage penalty according to similar penalties in other Stage II tests.}
\end{scorelist}




% Local Variables:
% TeX-master: "../rulebook"
% End:
File renamed without changes.
File renamed without changes.
52 changes: 4 additions & 48 deletions tasks/Finals.tex
Original file line number Diff line number Diff line change
@@ -1,70 +1,26 @@
\chapter{Finals}

The competition ends with the Finals on the last day, where the two teams with the highest total score compete.
The \iterm{Finals} are conducted as a final themed demonstration.

%To avoid logistical issues during the last day of the competition, the \iterm{Finals} are divided into two sets of demonstrations: the Bronze Competition and the RoboCup @Home Grand Finale.
%The Bronze Competition is a set of demonstrations that are carried out before the RoboCup @home Grand Finale. Here, all the leagues run in parallel, with the fourth and third highest scored teams competing for the bronze.
%Finally, the two teams with the highest score in each League present their demonstrations in a serialized manner during the RoboCup @Home Grand Finale.

Even though each league has its own first, second and third place, the \iterm{Finals} are meant to show the best of all leagues to the jury members as well as the audience and, thus, warrants a single schedule slot.

\section{Structure and Theme}

The \iterm{Finals} are a demonstration of achieving an objective that is pre-selected by the TC/EC. These objectives are chosen as a type of yearly theme of the competition, and to provide a baseline for the juries (not to mention the audience) to state which team is the winner.

The objectives for each league for this year are:

\begin{itemize}
\item The robot helps a person in preparing dinner.
\end{itemize}


The teams are expected to provide a demonstration that is telling a story which includes achieving the objective. The teams can choose freely how to achieve it, which includes choosing the participants, what items to use, the methods employed, etc. The juries, as explained later, will reward elegance and difficulty.

As it can be seen, the objectives are open enough that a story can be told around them which can include additional objectives that the team wants their robot to also solve. Thus, the teams are welcome to include in their demonstration any additional tasks to be solved, which can serve as a type of forum where they can present their own research. The innovation and success of these tasks will also be used as part of the score (as it is described later). In this regard, it is expected that teams present the scientific and technical contributions they submitted in both \iterm{team description paper} and the \iterm{RoboCup\char64Home Wiki}.

In addition, teams may provide a printed document to the jury (max 1 page) that summarizes the demonstrated robot capabilities and contributions. However, teams are discouraged to provide any material that would distract from their demonstration.

Story-telling is an important factor, so it is recommended to spend the least amount of time using the microphone to explain the demonstration and let the demonstration speak for itself.


\section{Evaluating Juries for Final Demonstrations}
The \iterm{Finals} are evaluated by two juries, here described.

\begin{enumerate}
\item\textbf{League-internal jury:} The league-internal jury is formed by the Executive Committee. The evaluation of the league-internal jury is based on the following criteria:
\begin{compactenum}
\item Efficacy/elegance of the solution
\item Innovation/contribution to the league of the additional tasks solved
\item Difficulty of the overall demonstration
\end{compactenum}

\item \textbf{League-external jury:} The league-external jury consists of people not being involved in the RoboCup@Home league, but having a related background (not necessarily robotics). They are appointed by the Executive Committee. The evaluation of the league-external jury is based on the following criteria:
\begin{compactenum}
\item Originality and presentation (story-telling is to be rewarded)
\item Relevance/usefulness to everyday life
\item Elegance/success of overall demonstration
\end{compactenum}
\end{enumerate}

\section{Scoring}
The final score and ranking are determined by the jury evaluations and by the previous performance (in Stages I and II) of the team, in the following manner:

\begin{enumerate}
\item The influence of the league-internal jury to the final ranking is \SI{25}{\percent}.
\item The influence of the league-external jury to the final ranking is \SI{25}{\percent}.
\item The influence of the final ranking is \SI{50}{\percent}.
\item The influence of the total sum of points scored by the team in Stage I and II is \SI{50}{\percent}.
\end{enumerate}

These demonstrations are carried out in a serialized fashion, one League performing after another in one \Arena{}.


\subsection{Task}
The procedure for the demonstration and the timing of slots is as follows:
\OpenDemonstrationTask{ten}{five}
The procedure for the demonstration is the same as for Enhanced General Purpose Service Robot (see~Task~\ref{test:egpsr})

\OpenDemonstrationChanges
\subsection*{Score sheet}
\input{scoresheets/Finals.tex}

%% %%%%%%%%%%%%%%%%%%%%%%%%
\section{Final Ranking and Winner}
Expand Down
90 changes: 90 additions & 0 deletions tasks/old/ThemedFinals.tex
Original file line number Diff line number Diff line change
@@ -0,0 +1,90 @@
\chapter{Finals}

The competition ends with the Finals on the last day, where the two teams with the highest total score compete.
The \iterm{Finals} are conducted as a final themed demonstration.

%To avoid logistical issues during the last day of the competition, the \iterm{Finals} are divided into two sets of demonstrations: the Bronze Competition and the RoboCup @Home Grand Finale.
%The Bronze Competition is a set of demonstrations that are carried out before the RoboCup @home Grand Finale. Here, all the leagues run in parallel, with the fourth and third highest scored teams competing for the bronze.
%Finally, the two teams with the highest score in each League present their demonstrations in a serialized manner during the RoboCup @Home Grand Finale.

Even though each league has its own first, second and third place, the \iterm{Finals} are meant to show the best of all leagues to the jury members as well as the audience and, thus, warrants a single schedule slot.

\section{Structure and Theme}

The \iterm{Finals} are a demonstration of achieving an objective that is pre-selected by the TC/EC. These objectives are chosen as a type of yearly theme of the competition, and to provide a baseline for the juries (not to mention the audience) to state which team is the winner.

The objectives for each league for this year are:

\begin{itemize}
\item The robot helps a person in preparing dinner.
\end{itemize}


The teams are expected to provide a demonstration that is telling a story which includes achieving the objective. The teams can choose freely how to achieve it, which includes choosing the participants, what items to use, the methods employed, etc. The juries, as explained later, will reward elegance and difficulty.

As it can be seen, the objectives are open enough that a story can be told around them which can include additional objectives that the team wants their robot to also solve. Thus, the teams are welcome to include in their demonstration any additional tasks to be solved, which can serve as a type of forum where they can present their own research. The innovation and success of these tasks will also be used as part of the score (as it is described later). In this regard, it is expected that teams present the scientific and technical contributions they submitted in both \iterm{team description paper} and the \iterm{RoboCup\char64Home Wiki}.

In addition, teams may provide a printed document to the jury (max 1 page) that summarizes the demonstrated robot capabilities and contributions. However, teams are discouraged to provide any material that would distract from their demonstration.

Story-telling is an important factor, so it is recommended to spend the least amount of time using the microphone to explain the demonstration and let the demonstration speak for itself.


\section{Evaluating Juries for Final Demonstrations}
The \iterm{Finals} are evaluated by two juries, here described.

\begin{enumerate}
\item\textbf{League-internal jury:} The league-internal jury is formed by the Executive Committee. The evaluation of the league-internal jury is based on the following criteria:
\begin{compactenum}
\item Efficacy/elegance of the solution
\item Innovation/contribution to the league of the additional tasks solved
\item Difficulty of the overall demonstration
\end{compactenum}

\item \textbf{League-external jury:} The league-external jury consists of people not being involved in the RoboCup@Home league, but having a related background (not necessarily robotics). They are appointed by the Executive Committee. The evaluation of the league-external jury is based on the following criteria:
\begin{compactenum}
\item Originality and presentation (story-telling is to be rewarded)
\item Relevance/usefulness to everyday life
\item Elegance/success of overall demonstration
\end{compactenum}
\end{enumerate}

\section{Scoring}
The final score and ranking are determined by the jury evaluations and by the previous performance (in Stages I and II) of the team, in the following manner:

\begin{enumerate}
\item The influence of the league-internal jury to the final ranking is \SI{25}{\percent}.
\item The influence of the league-external jury to the final ranking is \SI{25}{\percent}.
\item The influence of the total sum of points scored by the team in Stage I and II is \SI{50}{\percent}.
\end{enumerate}

These demonstrations are carried out in a serialized fashion, one League performing after another in one \Arena{}.


\subsection{Task}
The procedure for the demonstration and the timing of slots is as follows:
\OpenDemonstrationTask{ten}{five}

\OpenDemonstrationChanges

%% %%%%%%%%%%%%%%%%%%%%%%%%
\section{Final Ranking and Winner}

There will be an award for 1st, 2nd and 3rd place of each league.

The winner of the competition is the team that gets the highest ranking in the \iterm{Finals}.

The second place will be the team that got the second-highest ranking in the \iterm{Finals}.

The third place will be the team with the highest score that did not made it to the \iterm{Finals}.

Additional certificates would be granted if:

\begin{enumerate}
\item If the number of teams in the league is above 11, a certificate will be awarded to the 4th ranked team.
\item If the number of teams in the league is above 14, a certificate will be awarded to the 5th ranked team.
\end{enumerate}


% Local Variables:
% TeX-master: "Rulebook"
% End:
Loading