It’s Not All About the Number

Some reviewers and authors have contacted us to inquire if the only factor in the eventual decision on a submission will be the overall score. That's not how the review process should work, and it is not how it will work for NAACL HLT 2018. We know (http://inverseprobability.com/2014/12/16/the-nips-experiment) that reviewing is imperfect. We constructed a … Continue reading It’s Not All About the Number

Advertisement

A Review of Reviewer Assignment Methods

Authors: Amanda Stent and Heng Ji (NAACL-HLT2018 PC Chairs) The Reviewer Assignment Problem The reviewer assignment problem is the task of assigning submissions to reviewers so as to ensure a "fair" and "balanced" assignment. This problem has been widely studied (Price & Flach, 2017). The problem is most often described in terms of constraint satisfaction; … Continue reading A Review of Reviewer Assignment Methods

Updates from the Industry Track

Authors: Srinivas Bangalore (Interactions Labs) Jennifer Chu-Carroll (Elemental Cognition) Yunyao Li (IBM Research - Almaden)   First off, a reminder that the paper submission deadline for the Industry Track is February 20, less than a month away! Please see the call for papers for more information. Now for the exciting news: we will have two … Continue reading Updates from the Industry Track

Workshop review process for ACL, COLING, EMNLP, and NAACL 2018

Authors: Jason Williams (Microsoft Research) Brendan O’Connor (University of Massachusetts Amherst) Eva Maria Vecchi (University of Cambridge) Tim Baldwin (University of Melbourne) Yoav Goldberg (Bar Ilan University) Jing Jiang (Singapore Management University) Marie Meteer (Brandeis University) Marieke van Erp (KNAW Humanities Cluster) Vincent Ng (University of Texas at Dallas)   For approximately the last 10 … Continue reading Workshop review process for ACL, COLING, EMNLP, and NAACL 2018

Test-of-Time Paper Nominations, or, Classic Computational Linguistics Papers!

Thanks to the wonderful efforts by all area chairs, here are the classic computational linguistics papers nominated so far for the Test-of-Time Paper Award. The paper links are added now. If you are one of the 1000 productive authors, we will ask you to vote soon! Note on paper #18: this great paper by Amanda … Continue reading Test-of-Time Paper Nominations, or, Classic Computational Linguistics Papers!

With Great Power Comes Great Responsibility

Author: Omer Levy (University of Washington) PC Chair Note: Omer is an outstanding reviewer and author, one of my favorite rising stars. -Heng Writing reviews is a time-consuming task, and it can be tempting to get it over quickly or view it as one of the thankless chores of academia. However, it's also a rare … Continue reading With Great Power Comes Great Responsibility