It’s Not All About the Number

Some reviewers and authors have contacted us to inquire if the only factor in the eventual decision on a submission will be the overall score. That's not how the review process should work, and it is not how it will work for NAACL HLT 2018. We know (http://inverseprobability.com/2014/12/16/the-nips-experiment) that reviewing is imperfect. We constructed a … Continue reading It’s Not All About the Number

Advertisements

A Review of Reviewer Assignment Methods

Authors: Amanda Stent and Heng Ji (NAACL-HLT2018 PC Chairs) The Reviewer Assignment Problem The reviewer assignment problem is the task of assigning submissions to reviewers so as to ensure a "fair" and "balanced" assignment. This problem has been widely studied (Price & Flach, 2017). The problem is most often described in terms of constraint satisfaction; … Continue reading A Review of Reviewer Assignment Methods

Updates from the Industry Track

Authors: Srinivas Bangalore (Interactions Labs) Jennifer Chu-Carroll (Elemental Cognition) Yunyao Li (IBM Research - Almaden)   First off, a reminder that the paper submission deadline for the Industry Track is February 20, less than a month away! Please see the call for papers for more information. Now for the exciting news: we will have two … Continue reading Updates from the Industry Track

Workshop review process for ACL, COLING, EMNLP, and NAACL 2018

Authors: Jason Williams (Microsoft Research) Brendan O’Connor (University of Massachusetts Amherst) Eva Maria Vecchi (University of Cambridge) Tim Baldwin (University of Melbourne) Yoav Goldberg (Bar Ilan University) Jing Jiang (Singapore Management University) Marie Meteer (Brandeis University) Marieke van Erp (KNAW Humanities Cluster) Vincent Ng (University of Texas at Dallas)   For approximately the last 10 … Continue reading Workshop review process for ACL, COLING, EMNLP, and NAACL 2018