Sameer Singh

2 paper cards in Mova's library · 2019–2020

Sameer Singh wrote 2 of the papers Mova reads, in 2019–2020; often with Dheeru Dua, Matt Gardner, Pradeep Dasigi.

The profile is the library's match of the name; two people with one name are not always told apart.

Papers

Evaluating Models' Local Decision Boundaries via Contrast Sets (2020) measured
Standard test sets come from the same distribution as the training data, so a dataset with systematic gaps or annotation artifacts lets models score well with shallow heuristics.
DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphs (2019)
DROP has 96,567 questions on about 7,000 Wikipedia passages rich in numbers (American-football game summaries, history), written adversarially against a reading model so that answering needs discrete operations over several places in the text.