Publications

Preprints

One fish, two fish, but not the whole sea: Alignment reduces language models' conceptual diversity
Sonia K. Murthy, Tomer Ullman, Jennifer Hu
2024
paper

Elements of World Knowledge (EWOK): A cognition-inspired framework for evaluating basic world knowledge in language models
Anna A. Ivanova, Aalok Sathe, Benjamin Lipkin, Unnathi Kumar, Setayesh Radkani, Thomas H. Clark, Carina Kauf, Jennifer Hu, R. T. Pramod, Gabriel Grand, Vivian Paulun, Maria Ryskina, Ekin Akyurek, Ethan Wilcox, Nafisa Rashid, Leshem Choshen, Roger Levy, Evelina Fedorenko, Joshua Tenenbaum, Jacob Andreas
2024
paper code

A Rate–Distortion view of human pragmatic reasoning
Noga Zaslavsky, Jennifer Hu, Roger Levy
2020
paper

2024

Deep and shallow thinking in a single forward pass
Jennifer Hu, Michael Franke
Workshop on Behavioral Machine Learning @ NeurIPS 2024
2024
paper

Auxiliary task demands mask the capabilities of smaller language models
Jennifer Hu, Michael C. Frank
Proceedings of the Conference on Language Modeling
2024
✨ Outstanding Paper Award ✨
paper code

Language models align with human judgments on key grammatical constructions
Jennifer Hu, Kyle Mahowald, Gary Lupyan, Anna Ivanova, Roger Levy
Proceedings of the National Academy of Sciences
2024
paper code

The Task Task: Creative problem generation in humans and language models
Junyi Chu, Jennifer Hu, Tomer Ullman
Proceedings of the Cognitive Science Society
2024

Shades of Zero: Distinguishing impossibility from inconceivability
Jennifer Hu, Felix Sosa, Tomer Ullman
Proceedings of the Cognitive Science Society
2024

2023

Prompting is not a substitute for probability measurements in large language models
Jennifer Hu, Roger Levy
Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
2023
paper code

Pragmatics in Grounded Language Learning: Phenomena, Tasks, and Modeling Approaches
Daniel Fried, Nicholas Tomlin, Jennifer Hu, Roma Patel, Aida Nematzadeh
Findings of the Association for Computational Linguistics: EMNLP 2023
2023
paper

Expectations over unspoken alternatives predict pragmatic inferences
Jennifer Hu, Roger Levy, Judith Degen, Sebastian Schuster
Transactions of the Association for Computational Linguistics
2023
paper code

A fine-grained comparison of pragmatic language understanding in humans and language models
Jennifer Hu, Sammy Floyd, Olessia Jouravlev, Evelina Fedorenko, Edward Gibson
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics
2023
paper code

I Cast Detect Thoughts: Learning to Converse and Guide with Intents and Theory-of-Mind in Dungeons and Dragons
Pei Zhou, Andrew Zhu, Jennifer Hu, Jay Pujara, Xiang Ren, Chris Callison-Burch, Yejin Choi, Prithviraj Ammanabrolu
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics
2023
paper

Learning syntactic structures from string input
Ethan Wilcox, Jon Gauthier, Jennifer Hu, Peng Qian, Roger Levy
Algebraic Structures in Natural Language
2023
paper

2022

Predicting scalar diversity with context-driven expectations
Jennifer Hu, Roger Levy, Sebastian Schuster
Proceedings of the Experimental Pragmatics Conference (XPRAG)
2022

Teasing apart models of pragmatics using optimal reference game design
Irene Zhou, Jennifer Hu, Roger Levy, Noga Zaslavsky
Proceedings of the Cognitive Science Society
2022
paper

Predicting scalar diversity with context-driven uncertainty over alternatives
Jennifer Hu, Roger Levy, Sebastian Schuster
ACL Workshop on Cognitive Modeling and Computational Linguistics
2022
paper

Precision fMRI reveals that the language-selective network supports both phrase-structure building and lexical access during language production
Jennifer Hu, Hannah Small, Hope Kean, Atsushi Takahashi, Leo Zelekman, Daniel Kleinman, Elizabeth Ryan, Alfonso Nieto-Castañón, Victor Ferreira, Evelina Fedorenko
Cerebral Cortex
2022
paper code

Facilitative Effect Induced by Classifier-Noun Mismatch in Mandarin Chinese
Yiwen Wang, Jennifer Hu, Roger Levy, Peng Qian
The 35th Annual Conference on Human Sentence Processing
2022

2021

Controlled Evaluation of Grammatical Knowledge in Mandarin Chinese Language Models
Yiwen Wang, Jennifer Hu, Roger Levy, Peng Qian
Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing
2021
paper code

Scalable pragmatic communication via self-supervision
Jennifer Hu, Roger Levy, Noga Zaslavsky
ICML Workshop on Self-Supervised Learning for Reasoning and Perception
2021
paper

Competition from novel features drives scalar inferences in reference games
Jennifer Hu, Noga Zaslavsky, Roger Levy
Proceedings of the Cognitive Science Society
2021
paper code

Empirical support for a Rate–Distortion account of pragmatic reasoning
Irene Zhou, Jennifer Hu, Roger Levy, Noga Zaslavsky
Proceedings of the Cognitive Science Society
2021

A Rate–Distortion view of human pragmatic reasoning
Noga Zaslavsky, Jennifer Hu, Roger Levy
Proceedings of the Society for Computation in Linguistics
2021

2020

Distributed and overlapping neural mechanisms for lexical access and syntactic encoding during language production
Jennifer Hu, Hannah Small, Hope Kean, Atsushi Takahashi, Leo Zekelman, Daniel Kleinman, Elizabeth Ryan, Victor Ferreira, Evelina Fedorenko
Proceedings of the Society for the Neurobiology of Language
2020

On the predictive power of neural language models for human real-time comprehension behavior
Ethan Wilcox, Jon Gauthier, Jennifer Hu, Peng Qian, Roger Levy
Proceedings of the Cognitive Science Society
2020
paper code

Benchmarking neural networks as models of human language processing
Ethan Wilcox, Jon Gauthier, Jennifer Hu, Peng Qian, Roger Levy
Proceedings of the 26th Architectures and Mechanisms for Language Processing Conference
2020

A Systematic Assessment of Syntactic Generalization in Neural Language Models
Jennifer Hu, Jon Gauthier, Peng Qian, Ethan Wilcox, Roger Levy
Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics
2020
paper code

SyntaxGym: An Online Platform for Targeted Evaluation of Language Models
Jon Gauthier, Jennifer Hu, Ethan Wilcox, Peng Qian, Roger Levy
Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics: System Demonstrations
2020
paper

Evaluating the effect of model inductive bias and training data in predicting human reading times
Ethan Wilcox, Jon Gauthier, Peng Qian, Jennifer Hu, Roger Levy
Proceedings of the 33rd Annual CUNY Human Sentence Processing Conference
2020

Emergence of pragmatic reasoning from least-effort optimization
Noga Zaslavsky, Jennifer Hu, Roger Levy
Proceedings of Evolution of Language International Conferences
2020

A closer look at the performance of neural language models on reflexive anaphor licensing
Jennifer Hu, Sherry Yong Chen, Roger Levy
Proceedings of the Society for Computation in Linguistics
2020
paper

2019

Separating object resonance and room reverberation in impact sounds
Jennifer Hu, James Traer, Josh H. McDermott
Proceedings of the Cognitive Science Society
2019

2018

Generating Bilingual Pragmatic Color References
Will Monroe, Jennifer Hu, Andrew Jong, Christopher Potts
Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers)
2018
paper

A graph-theoretic approach to comparing typologies in Parallel OT and Harmonic Serialism
Jennifer Hu
Proceedings of the 92nd Annual Meeting of the Linguistic Society of America
2018

glint

@ Johns Hopkins

Department of Cognitive Science