Andrew Head

Assistant Professor

Department of Computer and Information Science

University of Pennsylvania

https://andrewhead.info head@seas.upenn.edu Google Scholar

Citations: 1932 h-index: 23 i10-index: 31

Generated on 1 August 2025. The most recent version of this CV can be accessed at https://andrewhead.info/cv.

Employment

'22–Present

University of Pennsylvania

Assistant Professor

'21

Allen Institute for AI

Semantic Scholar Research Team

Postdoctoral Scholar

Advised by Daniel S. Weld

'20–'21

University of California, Berkeley

Postdoctoral Scholar

Advised by Marti A. Hearst

'14–'20

University of California, Berkeley

Ph.D. Student

Advised by Björn Hartmann and Marti A. Hearst

'19

Allen Institute for AI

Semantic Scholar Research Team

Research Intern

Advised by Daniel S. Weld

'18

Microsoft Research

Visualization and Interaction for Business and Entertainment Group

Research Intern

Advised by Robert DeLine and Steven M. Drucker

'17

Google

Engineering Productive Research Team

Software Engineering Intern

Advised by Caitlin Sadowski and Emerson Murphy-Hill

'13–'14

University of Pittsburgh

Research assistant

Advised by Jingtao Wang

'10

Intel

Embedded Applications Group

Research Intern

Advised by Patricia Wang

Funding

f.6

Harnessing Artificial Intelligence and Language Modeling for Enhancing Innovation and Evaluating Research Claims (HAILMEIER-C)

January 2025 - December 2028

PI: Chris Callison-Burch

Penn PIs: Andrew Head, Eric Wong, and Duncan Watts

Agency: DARPA

Amount: $5,889,359

f.5

SHF: HCC: Medium: Property-Based Testing for the People

May 2024 - April 2027

PI: Benjamin Pierce

Co-PI: Andrew Head

Agency: NSF

Amount: $1,000,000

f.4

Tyche: An IDE for Property-Based Testing

April 2024 - March 2025

PI: Benjamin Pierce

Co-PI: Andrew Head

Amount: $40,000 + $20,000 in compute credits

f.3

VERSE: Verification Engineering for Real-world Software Engineers

January 2024 - May 2025

PI: Galois, Inc.

Penn PIs: Benjamin Pierce, Andrew Head, and Stephanie Weirich

Agency: DARPA

Amount: $2,199,636 (for Penn)

f.2

Re-Imagining Childhood Asthma and Electronic Health Records: A Community-Based Approach

June 2023 - May 2024

PIs: Kenrick Cato and Andrew Head

Amount: $51,496

f.1

Unrestricted gift

January 2022

PI: Andrew Head

Amount: $100,000

Publications

Peer-reviewed journal articles

j.2

The Semantic Reader Project: Augmenting scholarly documents through AI-powered interactive reading interfaces [pdf]

Kyle Lo, Joseph Chee Chang, Andrew Head, Jonathan Bragg, Amy X. Zhang, Cassidy Trier, 47 others, Marti A. Hearst, and Daniel S. Weld

Communications of the ACM (CACM), 2024

12 pages

j.1

Paper Plain: Making Medical Research Papers Approachable to Healthcare Consumers with Natural Language Processing [pdf]

Tal August, Lucy Lu Wang, Jonathan Bragg, Marti A. Hearst, Andrew Head, and Kyle Lo

ACM Transactions on Computer-Human Interaction (TOCHI), 2023

38 pages

Peer-reviewed conference publications

c.30

Answering Developer Questions with Annotated Agent-Discovered Program Traces [pdf]

Litao Yan, Jeffrey Tao, Lydia Chilton, and Andrew Head

ACM User Interfaces Software and Technology Symposium (UIST), 2025

14 pages

(To appear.)

c.29

QED in Context: An Observation Study of Proof Assistant Users [pdf]

Jessica Shi, Cassia Torczon, Harrison Goldstein, Benjamin C. Pierce, and Andrew Head

Proceedings of the ACM on Programming Languages (OOPSLA), 2025

27 pages

c.28

FreeForm: Flexibly Augmenting Formulas with Synchronized Markup and Graphical Edits [pdf]

Jeffrey Tao, Litao Yan, Jessica Shi, Mia Ginsberg, and Andrew Head

ACM Conference on Human Factors in Computing Systems (CHI), 2025

12 pages

c.27

Tyche: Making Sense of Property-Based Testing Effectiveness [pdf]

Harrison Goldstein, Jeffrey Tao, Zac Hatfield-Dodds, Benjamin C. Pierce, and Andrew Head

ACM User Interfaces Software and Technology Symposium (UIST), 2024

16 pages (acceptance rate: 22%)

c.26

Ivie: Lightweight Anchored Explanations of Just-Generated Code [pdf]

Litao Yan, Alyssa Hwang, Zhiyuan Wu, and Andrew Head

ACM Conference on Human Factors in Computing Systems (CHI), 2024

15 pages (acceptance rate: 24%)

c.25

Explainable Notes: Examining How to Unlock Meaning in Medical Notes with Interactivity and Artificial Intelligence [pdf]

Hita Kambhamettu, Danaé Metaxa, Kevin Johnson, and Andrew Head

ACM Conference on Human Factors in Computing Systems (CHI), 2024

19 pages (acceptance rate: 24%)

c.24

Property-Based Testing in Practice [pdf]

Harrison Goldstein, Joseph W. Cutler, Daniel Dickstein, Benjamin C. Pierce, and Andrew Head

ACM/IEEE International Conference on Software Engineering (ICSE), 2024

Best Paper Award

13 pages (acceptance rate: 15%)

c.23

FFL: A Language and Live Runtime for Styling and Labeling Typeset Math Formulas [pdf]

Zhiyuan Wu, Jiening Li, Kevin Ma, Hita Kambhamettu, and Andrew Head

ACM User Interfaces Software and Technology Symposium (UIST), 2023

16 pages (acceptance rate: 22%)

c.22

CALYPSO: LLMs as Dungeon Master's Assistants [pdf]

Andrew Zhu, Lara Martin, Andrew Head, and Chris Callison-Burch

AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment (AIIDE), 2023

11 pages

c.21

Rewriting the Script: Adapting Text Instructions for Voice Interaction [pdf]

Alyssa Hwang, Natasha Oza, Chris Callison-Burch, and Andrew Head

ACM Conference on Designing Interactive Systems (DIS), 2023

16 pages (acceptance rate: 25%)

c.20

Scim: Intelligent Skimming Support for Scientific Papers [pdf]

Raymond Fok, Hita Kambhamettu, Luca Soldaini, Jonathan Bragg, Kyle Lo, Marti A. Hearst, Andrew Head, and Daniel S. Weld

ACM Conference on Intelligent User Interfaces (IUI), 2023

15 pages (acceptance rate: 27%)

c.19

CiteSee: Augmenting Citations in Scientific Papers with Persistent and Personalized Historical Context [pdf]

Joseph Chee Chang, Amy X. Zhang, Jonathan Bragg, Andrew Head, Kyle Lo, Doug Downey, and Daniel S. Weld

ACM Conference on Human Factors in Computing Systems (CHI), 2023

Best Paper Award

15 pages (acceptance rate: 24%)

c.18

Colaroid: A Literate Programming Approach for Authoring Explorable Multi-Stage Tutorials [pdf]

April Yi Wang, Andrew Head, Ashley Zhang, Steve Oney, and Christopher Brooks

ACM Conference on Human Factors in Computing Systems (CHI), 2023

Nominated for Best Paper Award

21 pages (acceptance rate: 24%)

c.17

Bolt-on, Compact, and Rapid Program Slicing for Notebooks [pdf]

Shreya Shankar, Stephen Macke, Sarah Chasins, Andrew Head, and Aditya Parameswaran

International Conference on Very Large Data Bases (VLDB), 2023

10 pages

c.16

Math Augmentation: How Authors Enhance the Readability of Formulas using Novel Visual Design Practices [pdf]

Andrew Head, Amber Xie, and Marti A. Hearst

ACM Conference on Human Factors in Computing Systems (CHI), 2022

Best Paper Award

18 pages (acceptance rate: 24%)

c.15

From Who You Know to What You Read: Augmenting Scientific Recommendations with Implicit Social Networks [pdf]

Hyeonsu B. Kang, Rafal Kocielnik, Andrew Head, Jiangjiang Yang, Matt Latzke, Aniket Kittur, Daniel S. Weld, Doug Downey, and Jonathan Bragg

ACM Conference on Human Factors in Computing Systems (CHI), 2022

23 pages (acceptance rate: 24%)

c.14

Fine-Grained Lineage for Safer Notebook Interactions [pdf]

Stephen Macke, Hongpu Gong, Doris Jung-Lin Lee, Andrew Head, Doris Xin, and Aditya Parameswaran

International Conference on Very Large Data Bases (VLDB), 2021

9 pages

c.13

Augmenting Scientific Papers with Just-in-Time, Position-Sensitive Definitions of Terms and Symbols [pdf]

Andrew Head, Kyle Lo, Dongyeop Kang, Raymond Fok, Sam Skjonsberg, Daniel S. Weld, and Marti A. Hearst

ACM Conference on Human Factors in Computing Systems (CHI), 2021

18 pages (acceptance rate: 24%)

c.12

Composing Flexibly-Organized Step-by-Step Tutorials from Linked Source Code, Snippets, and Outputs [pdf]

Andrew Head, Jason Jiang, James Smith, Marti A. Hearst, and Björn Hartmann

ACM Conference on Human Factors in Computing Systems (CHI), 2020

Nominated for Best Paper Award

12 pages (acceptance rate: 24%)

c.11

Managing Messes in Computational Notebooks [pdf]

Andrew Head, Fred Hohman, Titus Barik, Steven M. Drucker, and Robert DeLine

ACM Conference on Human Factors in Computing Systems (CHI), 2019

Best Paper Award

12 pages (acceptance rate: 24%)

c.10

Gamut: A Design Probe to Understand How Data Scientists Understand Machine Learning Models [pdf]

Fred Hohman, Andrew Head, Rich Caruana, Robert DeLine, and Steven M. Drucker

ACM Conference on Human Factors in Computing Systems (CHI), 2019

13 pages (acceptance rate: 24%)

c.9

Interactive Extraction of Examples from Existing Code [pdf]

Andrew Head, Elena L. Glassman, Björn Hartmann, and Marti A. Hearst

ACM Conference on Human Factors in Computing Systems (CHI), 2018

Nominated for Best Paper Award

12 pages (acceptance rate: 26%)

c.8

WiFröst: Bridging the Information Gap for Debugging of Networked Embedded Systems [pdf]

Will McGrath, Jeremy Warner, Mitchell Karchemsky, Andrew Head, Daniel Drew, and Björn Hartmann

ACM User Interfaces Software and Technology Symposium (UIST), 2018

9 pages (acceptance rate: 21%)

c.7

When Not to Comment: Questions and Tradeoffs with API Documentation for C++ Projects [pdf]

Andrew Head, Caitlin Sadowski, Emerson Murphy-Hill, and Andrea Knight

ACM International Conference on Software Engineering (ICSE), 2018

11 pages (acceptance rate: 15%)

c.6

Writing Reusable Code Feedback at Scale with Mixed-Initiative Program Synthesis [pdf]

Andrew Head*, Elena Glassman*, Gustavo Soares*, Ryo Suzuki, Lucas Figueredo, Loris D'Antoni, and Björn Hartmann

ACM Conference on Learning at Scale (L@S), 2017

'*' denotes equal contribution.

10 pages (acceptance rate: 13%)

c.5

Can Human Development be Measured with Satellite Imagery? [pdf]

Andrew Head, Mélanie Manguin, Nhat Tran, and Joshua E. Blumenstock

International Conference on Information and Communication Technologies and Development (ICTD), 2017

11 pages (acceptance rate: 19%)

c.4

TraceDiff: Debugging Unexpected Code Behavior Using Trace Divergences [pdf]

Ryo Suzuki, Gustavo Soares, Andrew Head, Elena Glassman, Ruan Reis, Melina Mongiovi, Loris D'Antoni, and Björn Hartmann

IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC), 2017

9 pages (acceptance rate: 27%)

c.3

Tutorons: Generating Context-Relevant, On-Demand Explanations and Demonstrations of Online Code [pdf]

Andrew Head, Codanda Appachu, Marti A. Hearst, and Björn Hartmann

IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC), 2015

Nominated for Best Paper Award

9 pages (acceptance rate: 29%)

c.2

Lamello: Passive Acoustic Sensing for Tangible Input Components [pdf]

Valkyie Savage, Andrew Head, Wilmot Li, Gautham Mysore, Dan B Goldman, and Björn Hartmann

ACM Conference on Human Factors in Computing Systems (CHI), 2015

4 pages (acceptance rate: 23%)

c.1

ToneWars: Connecting Language Learners and Native Speakers through Collaborative Mobile Games [pdf]

Andrew Head, Yi Xu, and Jingtao Wang

International Conference on Intelligent Tutoring Systems (ITS), 2014

10 pages (acceptance rate: 18%)

Refereed workshop papers

w.8

Designing Proof Deautomation for Rocq [pdf]

Jessica Shi, Cassia Torczon, Harrison Goldstein, Andrew Head, and Benjamin C. Pierce

SPLASH Workshop on the Intersection of HCI and PL (PLATEAU), 2025

18 pages

w.7

Traceable Texts and Their Effects: A Study of Source-Summary Links in AI-Generated Summaries [pdf]

Hita Kambhamettu, Jamie Flores, and Andrew Head

ACM Conference on Human Factors in Computing Systems, Late-Breaking Work (CHI Late-Breaking Work), 2025

7 pages

w.6

Towards a Science of Interactive Proof Reading [pdf]

Jessica Shi, Benjamin Pierce, and Andrew Head

SPLASH Workshop on the Intersection of HCI and PL (PLATEAU), 2023

7 pages

w.5

Some Problems with Properties: A Study on Property-Based Testing in Industry [pdf]

Harrison Goldstin, Joseph W. Cutler, Adam Stein, Benjamin C. Pierce, and Andrew Head

SPLASH Workshop on Human Aspects of Types and Reasoning Assistants (HATRA), 2022

9 pages

w.4

Document-Level Definition Detection in Scholarly Documents: Existing Models, Error Analyses, and Future Directions [pdf]

Dongyeop Kang, Andrew Head, Risham Sidhu, Kyle Lo, Daniel S. Weld, and Marti A. Hearst

EMNLP First Workshop on Scholarly Document Processing , 2020

11 pages

w.3

Static Analysis for Safer Notebook Interactions [pdf]

Stephen Macke, Hongpu Gong, Doris Jung-Lin Lee, Andrew Head, Doris Xin, and Aditya Parameswaran

SPLASH Workshop on the Intersection of HCI and PL (PLATEAU), 2020

w.2

Discovering API Usability Problems at Scale [pdf]

Emerson Murphy-Hill, Caitlin Sadowski, Andrew Head, John Daughtry, Andrew Macvean, Ciera Jaspan, and Collin Winter

ICSE Workshop on API Usage and Evolution (WAPI), 2018

4 pages

w.1

Exploring the Design Space of Automatically Synthesized Hints for Introductory Programming Assignments [pdf]

Ryo Suzuki, Gustavo Soares, Elena Glassman, Andrew Head, Loris D'Antoni, and Björn Hartmann

ACM Conference on Human Factors in Computing Systems, Late-Breaking Work (CHI Late-Breaking Work), 2017

8 pages (acceptance rate: 20%)

Research mentoring

Doctoral mentoring

'25–Present

Xiaorui Liu

'23–Present

Jeffrey Tao (2nd year)

co-advised with Ryan Marcus

'23–Present

Jessica Shi (4th year)

Distinction: CETLI Graduate Fellowship for Teaching Excellence

co-advised with Benjamin Pierce

'22–Present

Litao Yan (3rd year)

'22–Present

Hita Kambhamettu (3rd year)

Distinction: NSF Graduate Research Fellow

'21–Present

Alyssa Hwang (5th year)

Distinction: NSF Graduate Research Fellow

co-advised with Boon Thau Loo

'22–'24

Harrison Goldstein

Distinction: ACM SIGPLAN Doctoral Dissertation Award

Now Assistant professor at UBuffalo.

advised as project advisor; official advisor Benjamin Pierce

'20–'22

Raymond Fok

advised as project advisor; official advisors Daniel S. Weld and James Fogarty

'21–'22

Tal August

Now Assistant professor at UIUC.

advised as project advisor; official advisors Katharina Reinecke and Noah Smith

Dissertation committees

'24

Harrison Goldstein

Dissertation: Property-Based Testing for the People

'22

Yi Zhang (now at AWS AI Labs)

Dissertation: Extending Provenance for Understanding Claims and Data Analyses

Master’s mentoring

'24–Present

Eric Dai

'24–Present

Zain Khan

'23

Jiening Li

'22–'23

Zhiyuan Wu

'20–'21

Vivek Aithal

'20

Daniel McAndrew

'18–'19

Kunal Chadhary

Thesis: Jupyter’s Archive: Searchable Output Histories for Computational Notebooks

Bachelor’s mentoring

'22

Kevin Ma

'21

Amber Xie (now Ph.D. student at Stanford)

'20–'21

Risham Sidhu (now Ph.D. student at UIUC)

'19–'21

Jason Jiang

'19–'21

Jocelyn Sun

'19–'20

Zachary Kirby

'19–'20

Jusheen Kim

'18–'19

Benjamin Barantschik (now at Google)

'18–'19

Luming Chen (now at Microsoft)

'18–'19

Nidhi Kakulawaram

'18–'19

RJ Pimentel

'18

Nathan Khuu

'15–'16

Austin Le (now at Adobe)

'14–'15

Matthew Waliman

'13

Bill Wang

High school mentoring

'22

Max Berger

Selected awards

'24

ICSE Distinguished Paper Award

Awarded to 10% of accepted papers.

'23

Best of CHI Best Paper Award

Awarded to top 1% of submitted papers.

'23

Best of CHI Honorable Mention for Best Paper Award

Awarded to top 5% of submitted papers.

'22

Best of CHI Best Paper Award

Awarded to top 1% of submitted papers.

'20

Best of CHI Honorable Mention for Best Paper Award

Awarded to top 5% of submitted papers.

'19

Outstanding Graduate Student Instructor Award

Awarded to 10% of graduate student instructors in the department.

'19

Timothy B. Campbell Innovation Award

Presented to computer science or electrical engineering graduate student who demonstrates a spirit of innovation, collaboration, and creativity through her or his research and personal life. Read more here.

'19

Best of CHI Best Paper Award

Awarded to top 1% of submitted papers.

'18

Best of CHI Honorable Mention for Best Paper Award

Awarded to top 5% of submitted papers.

'16

National Defense Science and Engineering Graduate Fellowship

Awarded to about 200 of 3,000 scholarship applicants.

'16

National Science Foundation Graduate Research Fellowship Honorable Mention

'15

Best Paper Nomination at VL/HCC

Awarded to the top 11% of accepted papers.

'14

National Science Foundation Graduate Research Fellowship Honorable Mention

'14

UC Berkeley EECS Departmental First-Year Fellowship

'14

Emma Locke Memorial Award Nomination

'13

Dietrich School of Arts and Sciences Summer Undergraduate Research Award

'13

University Scholar, Swanson School of Engineering

'10

University Scholar, Dietrich School of Arts and Sciences

'10

NSF International Research and Education in Engineering Grant

'08

Pitt Club of Greater Philadelphia Scholar

'08

University of Pittsburgh Honors College Full Tuition Scholarship

Teaching

sp25, sp24

CIS4120/5120: Introduction to Human-Computer Interaction

sp24

CIS7000-004: Interactive Reading

sp23

CIS3990: Introduction to Human-Computer Interaction

fa22

CIS7000-001: Designing Programming Environments: Live and Literate Programming

sp22

CIS700-003: Human-Computer Interaction

sp19

CS160: User Interface Design and Development (Berkeley)

Co-instructor with Sarah Sterman.

sp17

CS 194-131: Designing Technology to Counter Violent Extremism (Berkeley)

Teaching assistant

su15

CS160: User Interface Design and Development (Berkeley)

Head teaching assistant

fa09, sp10

PHYS 0475: Honors Physics (UPitt)

Teaching assistant

Invited talks

'25

UMD Human-Computer Interaction Lab

Reading, Augmented

Host: Joel Chan

FAU Erlangen-Nürnberg Knowledge Adaptation and Reasoning for Content group

Math Augmentation: Authoring tools for explaining math

Host: Michael Kohlhase

'24

AI@Rowan (Rowan University)

Augmenting Scholarly Reading: Case Studies in AI for Scholarly Support

Host: Claude Willan

GitHub ML for code reading group (invited by GitHub Next)

Ivie: Lightweight Anchored Explanations of Just-Generated Code

with Litao Yan.

Host: Eddie Aftandilian

VSCode APIs team

Ivie: Lightweight Anchored Explanations of Just-Generated Code

with Litao Yan.

Host: Joyce Er

'23

MIT HCI Seminar

Designing the Interactive Paper

Host: Arvind Satyanarayan

Stanford HCI Seminar

Designing the Interactive Paper

Host: Michael Bernstein

'22

KAIST

Designing the Interactive Paper

Host: Juho Kim

COLING Workshop on Scholarly Document Processing

Designing the Interactive Paper

UW Seminar on The Future of Scientific Communication

Designing the Interactive Paper

Host: Jeff Heer

BAYCHI (San Francisco Bay Area chapter of ACM SIGCHI)

Power Tools for Reading and Authoring Complex Documents

Host: Ted Selker

Penn course CIS 810, Writing and Speaking with Style

Interactive Program Distillation

Host: Benjamin Pierce

'21

University of Pennsylvania PLClub

Interactive Program Distillation

Host: Steve Zdancewic

UC Berkeley Course CS 160, User Interface Design and Implementation

Input Devices and Proxemics: Designing Beyond the Screen

Host: Nate Weinman and Janaki Vivrekar

Allen Institute for AI