Some reviewers and authors have contacted us to inquire if the only factor in the eventual decision on a submission will be the overall score. That's not how the review process should work, and it is not how it will work for NAACL HLT 2018. We know (http://inverseprobability.com/2014/12/16/the-nips-experiment) that reviewing is imperfect. We constructed a … Continue reading It’s Not All About the Number
A Review of Reviewer Assignment Methods
Authors: Amanda Stent and Heng Ji (NAACL-HLT2018 PC Chairs) The Reviewer Assignment Problem The reviewer assignment problem is the task of assigning submissions to reviewers so as to ensure a "fair" and "balanced" assignment. This problem has been widely studied (Price & Flach, 2017). The problem is most often described in terms of constraint satisfaction; … Continue reading A Review of Reviewer Assignment Methods
Updates from the Industry Track
Authors: Srinivas Bangalore (Interactions Labs) Jennifer Chu-Carroll (Elemental Cognition) Yunyao Li (IBM Research - Almaden) First off, a reminder that the paper submission deadline for the Industry Track is February 20, less than a month away! Please see the call for papers for more information. Now for the exciting news: we will have two … Continue reading Updates from the Industry Track
Workshop review process for ACL, COLING, EMNLP, and NAACL 2018
Authors: Jason Williams (Microsoft Research) Brendan O’Connor (University of Massachusetts Amherst) Eva Maria Vecchi (University of Cambridge) Tim Baldwin (University of Melbourne) Yoav Goldberg (Bar Ilan University) Jing Jiang (Singapore Management University) Marie Meteer (Brandeis University) Marieke van Erp (KNAW Humanities Cluster) Vincent Ng (University of Texas at Dallas) For approximately the last 10 … Continue reading Workshop review process for ACL, COLING, EMNLP, and NAACL 2018
About Our Reviewers
You may recall that one of our goals for NAACL HLT 2018 is to ensure broad participation. We recruited a pool of 1247 program committee members. To do this in a non-biased fashion, we re-used a method used for NAACL HLT 2016 - we invited people who have published repeatedly in *CL venues (ACL, NAACL, EMNLP, … Continue reading About Our Reviewers
A Review Form FAQ
To help you navigate and understand the new review form, Amanda and Heng (the PC chairs) have each reviewed an already published paper. In this post, we provide our reviews. At the bottom there is a FAQ. Recall that our main goals with this new form are to get better quality reviews and put together … Continue reading A Review Form FAQ
Onsite Childcare
Posted on January 19 By Beth Ann Hockey and Chris Calliston-Burch (NAACL 2018 Famly-Friendly chairs) We are excited to post some good news for families: we will have onsite childcare provided by KiddieCorp for the full 6 days of the conference. This will cover the main conference, plus the workshops and tutorials days. KiddieCorp is … Continue reading Onsite Childcare
Test-of-Time Paper Nominations, or, Classic Computational Linguistics Papers!
Thanks to the wonderful efforts by all area chairs, here are the classic computational linguistics papers nominated so far for the Test-of-Time Paper Award. The paper links are added now. If you are one of the 1000 productive authors, we will ask you to vote soon! Note on paper #18: this great paper by Amanda … Continue reading Test-of-Time Paper Nominations, or, Classic Computational Linguistics Papers!
Short Paper Submissions
We received 425 short paper submissions (excluding withdrawn submissions). In total we received 392 more papers than NAACL-HLT2016. We make sure each area chair gets a light meta-review load, usually < 15 long+short papers which match the chair's expertise. Each reviewer gets <=3 papers across all long and short tracks so everyone will have time … Continue reading Short Paper Submissions
With Great Power Comes Great Responsibility
Author: Omer Levy (University of Washington) PC Chair Note: Omer is an outstanding reviewer and author, one of my favorite rising stars. -Heng Writing reviews is a time-consuming task, and it can be tempting to get it over quickly or view it as one of the thankless chores of academia. However, it's also a rare … Continue reading With Great Power Comes Great Responsibility