It’s Not All About the Number

Some reviewers and authors have contacted us to inquire if the only factor in the eventual decision on a submission will be the overall score. That's not how the review process should work, and it is not how it will work for NAACL HLT 2018. We know (http://inverseprobability.com/2014/12/16/the-nips-experiment) that reviewing is imperfect. We constructed a …

A Review of Reviewer Assignment Methods

Authors: Amanda Stent and Heng Ji (NAACL-HLT2018 PC Chairs) The Reviewer Assignment Problem The reviewer assignment problem is the task of assigning submissions to reviewers so as to ensure a "fair" and "balanced" assignment. This problem has been widely studied (Price & Flach, 2017). The problem is most often described in terms of constraint satisfaction; …

Updates from the Industry Track

Authors: Srinivas Bangalore (Interactions Labs) Jennifer Chu-Carroll (Elemental Cognition) Yunyao Li (IBM Research - Almaden)   First off, a reminder that the paper submission deadline for the Industry Track is February 20, less than a month away! Please see the call for papers for more information. Now for the exciting news: we will have two …

Workshop review process for ACL, COLING, EMNLP, and NAACL 2018

Authors: Jason Williams (Microsoft Research) Brendan O’Connor (University of Massachusetts Amherst) Eva Maria Vecchi (University of Cambridge) Tim Baldwin (University of Melbourne) Yoav Goldberg (Bar Ilan University) Jing Jiang (Singapore Management University) Marie Meteer (Brandeis University) Marieke van Erp (KNAW Humanities Cluster) Vincent Ng (University of Texas at Dallas)   For approximately the last 10 …

About Our Reviewers

You may recall that one of our goals for NAACL HLT 2018 is to ensure broad participation. We recruited a pool of 1247 program committee members. To do this in a non-biased fashion, we re-used a method used for NAACL HLT 2016 - we invited people who have published repeatedly in *CL venues (ACL, NAACL, EMNLP, …

A Review Form FAQ

To help you navigate and understand the new review form, Amanda and Heng (the PC chairs) have each reviewed an already published paper. In this post, we provide our reviews. At the bottom there is a FAQ. Recall that our main goals with this new form are to get better quality reviews and put together …

Onsite Childcare

Posted on January 19 By Beth Ann Hockey and Chris Calliston-Burch (NAACL 2018 Famly-Friendly chairs) We are excited to post some good news for families:  we will have onsite childcare provided by KiddieCorp for the full 6 days of the conference.  This will cover the main conference, plus the workshops and tutorials days.  KiddieCorp is …

Test-of-Time Paper Nominations, or, Classic Computational Linguistics Papers!

Thanks to the wonderful efforts by all area chairs, here are the classic computational linguistics papers nominated so far for the Test-of-Time Paper Award. The paper links are added now. If you are one of the 1000 productive authors, we will ask you to vote soon! Note on paper #18: this great paper by Amanda …

Short Paper Submissions

We received 425 short paper submissions (excluding withdrawn submissions). In total we received 392 more papers than NAACL-HLT2016. We make sure each area chair gets a light meta-review load, usually < 15 long+short papers which match the chair's expertise. Each reviewer gets <=3 papers across all long and short tracks so everyone will have time …

With Great Power Comes Great Responsibility

Author: Omer Levy (University of Washington) PC Chair Note: Omer is an outstanding reviewer and author, one of my favorite rising stars. -Heng Writing reviews is a time-consuming task, and it can be tempting to get it over quickly or view it as one of the thankless chores of academia. However, it's also a rare …