review_form.html

---
layout: default
title: Review Form
hide: true
---

<h1>{{ site.conference.short_name }} {{ site.conference.year }} Review Form</h1>

<p>Reviewers must submit their reviews through <a href="https://cmt3.research.microsoft.com/AISTATS2021">CMT</a>. Below is a copy of the review form for reference.</p>


<ol>
<li style="font-weight:bold"><span style="font-weight:normal">*Summary and contributions: Briefly summarize the paper and its contributions.</span></li>

	<p><b>Type:</b> Comment</p>

<li style="font-weight:bold"><span style="font-weight:normal">*Strengths: Describe the strengths of the work. Typical criteria include: soundness of the claims (theoretical grounding, empirical evaluation), significance and novelty of the contribution, and relevance to the AISTATS community.</span></li>

	<p><b>Type:</b> Comment</p>

<li style="font-weight:bold"><span style="font-weight:normal">*Weaknesses: Explain the limitations of this work along the same axes as above.</span></li>

	<p><b>Type:</b> Comment</p>

<li style="font-weight:bold"><span style="font-weight:normal">*Correctness: Are the claims and method correct? Is the empirical methodology correct?</span></li>

	<p><b>Type:</b> Comment</p>

<li style="font-weight:bold"><span style="font-weight:normal">*Clarity: Is the paper well written?</span></li>

	<p><b>Type:</b> Comment</p>

<li style="font-weight:bold"><span style="font-weight:normal">*Relation to prior work: Is it clearly discussed how this work differs from previous contributions?</span></li>

	<p><b>Type:</b> Comment</p>

<li style="font-weight:bold"><span style="font-weight:normal">*Reproducibility: Are there enough details to reproduce the major results of this work?</span></li>

	<p><b>Type:</b> Options</p>
	<ul>
	<li>1: No, the work is not reproducible</li>
	<li>2: Some aspects of the work are reproducible</li>
	<li>3: Yes, most aspects are reproducible</li>
	</ul>

<li style="font-weight:bold"><span style="font-weight:normal">Additional feedback, comments, suggestions for improvement and questions for the authors:</span></li>

	<p><b>Type:</b> Comment</p>

<li style="font-weight:bold"><span style="font-weight:normal">*Please provide an "overall score" for this submission.</span></li>

	<p><b>Type:</b> Options</p>
	<ul>
	<li>1: Trivial or wrong or already known.</li>
	<li>2: I'm surprised this work was submitted to AISTATS; a strong reject.</li>
	<li>3: A clear reject.</li>
	<li>4: An okay submission, but not good enough; a reject.</li>
	<li>5: Marginally below the acceptance threshold.</li>
	<li>6: Marginally above the acceptance threshold.</li>
	<li>7: A good submission; an accept.</li>
	<li>8: Top 50% of accepted AISTATS papers. A very good submission; a clear accept.</li>
	<li>9: Top 15% of accepted AISTATS papers. An excellent submission; a strong accept.</li>
	<li>10: Top 5% of accepted AISTATS papers. Truly groundbreaking work.</li>
	</ul>

<li style="font-weight:bold"><span style="font-weight:normal">*Please provide a "confidence score" for your assessment of this submission.</span></li>

	<p><b>Type:</b> Options</p>
	<ul>
	<li>1: Your assessment is an educated guess.</li>
	<li>2: You are willing to defend your assessment, but it is quite likely that you did not understand central parts of the submission or that you are unfamiliar with some pieces of related work. Math/other details were not carefully checked.</li>
	<li>3: You are fairly confident in your assessment.</li>
	<li>4: You are confident in your assessment, but not absolutely certain.</li>
	<li>5: You are absolutely certain about your assessment.</li>
	</ul>

<li style="font-weight:bold"><span style="font-weight:normal">*Does the submission raise potential ethical concerns? This includes methods, applications, or data that create or reinforce unfair bias or that have a primary purpose of harm or injury.</span></li>

	<p><b>Type:</b> Options</p>
	<ul>
	<li>Yes</li>
	<li>No</li>
	</ul>

<li style="font-weight:bold"><span style="font-weight:normal">If you said 'Yes' in 11, please briefly explain the potential ethical concerns.</span></li>

	<p><b>Type:</b> Comment</p>

<li style="font-weight:bold"><span style="font-weight:normal">*While performing my duties as a reviewer (including writing reviews and participating in discussions), I have and will continue to abide by the <a href="http://aistats.org/aistats2021/conduct.html">AISTATS Code of Conduct</a>.</span></li>

	<p><b>Type:</b> Agreement</p>

<li style="font-weight:bold"><span style="font-weight:normal">If you have any confidential comments for the Area Chair, please provide them here.</span></li>

	<p><b>Type:</b> Comment</p>

</ol>