Close
This site uses cookies

By using this site, you consent to our use of cookies. You can view our terms and conditions for more information.

Worth the Weight: Integration of Verbal and Numeric Information in Graduate Admissions

Authors
Mr. James Adaryukov
University of Kansas ~ Psychology
Tim Pleskac
Indiana University ~ Psychological and Brain Sciences
Dr. Monica Biernat
University of Kansas ~ Psychology
Dr. Jeff Girard
University of Kansas ~ Psychology Department
Abstract

In graduate admissions, as in many merit-based decisions, evaluators must judge candidates from a flood of information, including recommendation letters, personal statements, grades, and standardized test scores. Some of this information is conveyed numerically, while some is conveyed verbally. This creates a challenge for studying these decisions, as most theories of behavioral economics specifically focus on evaluating decisions using only verbal or numeric information – not both. The goal of this study is to evaluate how verbal and numeric information are used within graduate admissions decisions. We examine a uniquely comprehensive dataset of 2,231 graduate applications to the University of Kansas, containing full application packages, demographics, and final admissions decisions for each applicant. To make sense of our documents, we apply structural topic modeling, an extension of correlated topic modeling which allows topic content and prevalence to covary based on other metadata (i.e. department of study). This allows us to examine not only what information letters and statements contain, but also the effects of gender, race, and department on how that information is conveyed. We find that admissions decision committees behaved as if they prioritized numeric metrics, using verbal information to check for disqualifications if at all. Furthermore, we find that applicant race and gender influence the prevalence of topics in their letters and statements.

Tags

Keywords

decision-making
policy capture
machine learning
natural language processing
topic modeling
multiattribute choice
big data
graduate admissions
demographics
Discussion
New

There is nothing here yet. Be the first to create a thread.

Cite this as:

Adaryukov, J., Pleskac, T., Biernat, M. R., & Girard, J. (2023, July). Worth the Weight: Integration of Verbal and Numeric Information in Graduate Admissions. Abstract published at MathPsych/ICCM/EMPG 2023. Via mathpsych.org/presentation/1112.