Inclusive AI for Language, Learning & Health
AI that bridges language, education and access gaps.
Many of the people who could benefit most from AI are least considered in its design. Our lab uses participatory methods to build AI with, not only for, these communities. We study how second-language speakers envision personal AI assistants for face-to-face conversations (CHI 2026), co-design AI fluency practice for advanced bilingual speakers (IEEE CAI 2025), and examine how AI language tools affect crowd workers completing tasks outside their primary language.
In education, we developed prompting architectures and LibRef, an LLM-powered assistant that supports students' information seeking and library literacy, reviewed the role of LLMs in Latin American education, and studied digital-twin avatars for remote instruction (CHI 2026). In health and security, we examine how an embodied agent's body type shapes dietary counseling outcomes (Computer Animation and Virtual Worlds, 2026) and how college students manage authentication in everyday life (HFES 2026).
Guiding questions
- How should AI mediate conversations between speakers of different languages?
- How can LLM tools strengthen, not replace, students' information-seeking skills?
- How do embodiment and interface choices shape trust in health and security technology?
Projects
Projects in this thrust
AI-Mediated Language and Communication
Personal AI assistants for second-language speakers and learners.
Publications
14 publications
Authentication Routines Among College Students
@inproceedings{Barwulor2026Authentication,
title = {Authentication Routines Among College Students},
author = {Barwulor, Catherine and Kalahiki, Christopher and Sidnam-Mauch, E. and Toxtli-Hernandez, Carlos and Caine, Kelly},
booktitle = {Proceedings of the Human Factors and Ergonomics Society Annual Meeting (ASPIRE 2026)},
publisher = {SAGE Publications},
year = {2026},
note = {Poster; forthcoming},
url = {https://www.hfes.org/Events/ASPIRE-International-Annual-Meeting/ASPIRE-Home}
}Auditing LLM Portrayals of Neurodivergent People: Quantifying the Asymmetry Between Deficit Framing and Neurodiversity Affirmation
Open-weight large language models are increasingly used in education, hiring, and information-seeking contexts that touch neurodivergent people, yet we lack a clear empirical map of how their portrayals of neurodiversity shift under everyday prompt variation. We present a multi-condition, multi-model audit of LLM portrayals of eight neurodivergent identities (autism, ADHD, dyslexia, dyspraxia, dyscalculia, Tourette syndrome, OCD, and sensory-processing differences) plus a non-stigmatized medical control. Six open-weight models answer a pre-registered prompt bank that crosses seed items with seven perturbation families, including paraphrase, identity-first versus person-first language, system personas, plausible versus obviously fictional authority citations, multi-turn social pushback, leading questions, and two mitigation arms. Held-out LLM judges score each generation on three ordinal axes. Baseline portrayals are remarkably homogeneous across models, so the inconsistency observed under prompt variation is prompt-driven, not model-driven. Steering toward deficit framing is several times easier than steering toward neurodiversity affirmation. Emotional pushback shifts outputs more than evidence-laden pushback. Plausible-sounding fake citations slip past safety filters while obviously fictional ones do not. A single-line system-prompt mitigation recovers a meaningful share of the steering range at near-zero refusal cost on neutral prompts, though refusal rises sharply under adversarial pressure. The governance question for disability-relevant LLM deployment is therefore not whether the model is biased but who controls the steering, and with what accountability.
@inproceedings{Toxtli2026Auditing,
title = {Auditing LLM Portrayals of Neurodivergent People: Quantifying the Asymmetry Between Deficit Framing and Neurodiversity Affirmation},
author = {Carlos Toxtli and Manuel Delaflor},
booktitle = {Proceedings of the Ninth AAAI/ACM Conference on AI, Ethics, and Society (AIES ’26)},
year = {2026},
url = {https://www.aies-conference.com/2026/}
}Exploring User Expectations for AI-Mediated Second Language Communication: A Formative Participatory Design Study
This formative study explores how second-language (L2) speakers envision personal AI assistants (PAIAs) supporting face-to-face communication with native speakers. Through participatory sessions with 14 bilingual adults combining scenario generation, role-play, and diagramming, we surfaced preliminary tensions in AI-mediated L2 interaction: managing conversational flow, balancing transparency with naturalness, and navigating context-dependent privacy. Our exploratory findings suggest three candidate mediation patterns (solo, symmetric, and relayed assistance), each with distinct trade-offs that warrant further investigation. We contribute initial design considerations including reply-when-free defaults and role-based privacy profiles, alongside a replicable protocol for eliciting AI behavior expectations. These preliminary insights establish a foundation for future empirical work on PAIAs in multilingual communication contexts.
@inproceedings{Delgado_Solorzano_2026,
series = {CHI EA ’26},
title = {Exploring User Expectations for AI-Mediated Second Language Communication: A Formative Participatory Design Study},
url = {http://dx.doi.org/10.1145/3772363.3799390},
doi = {10.1145/3772363.3799390},
booktitle = {Proceedings of the Extended Abstracts of the 2026 CHI Conference on Human Factors in Computing Systems},
publisher = {ACM},
author = {Delgado Solorzano, Cecilia and Singh, Pratyush and Toxtli, Carlos},
year = {2026},
month = Apr,
pages = {1--4},
collection = {CHI EA ’26}
}Effects of Embodied Agent Body Type on Perceptions and Dietary Intentions in Digital Health Counseling
Embodied Conversational Agents (ECAs) are increasingly used for health education, yet the role of an agent's physical embodiment remains relatively underexplored. This study examines how body mass index (BMI) cues in an embodied agent relate to user perceptions, trust in medical content, and health‐related intentions during a brief dietary counseling interaction focused on diabetes prevention. In a between‐subjects experiment, participants interacted with one of three visually distinct versions of the same healthcare coach, representing underweight, normal‐weight, or obese body types. Across conditions, participants demonstrated improvements in dietary intentions, while significant increases in diabetes memory outcomes were observed only in the underweight and normal‐weight conditions. Increases in overall behavior change intention were observed only in the underweight condition. Subjective evaluations indicated that the normal‐weight agent was rated higher on realism, likability, and interaction quality, while post‐interaction perception ratings suggested that more extreme body representations were sometimes perceived as less comfortable or less appropriate for a health advisory role. Together, these results suggest that visual body type cues may be associated with differences in users' subjective experiences of embodied health counseling agents, while evidence for broader differences in learning and motivation‐related outcomes should be interpreted cautiously.
@article{Ashok_Vankit_2026,
title = {Effects of Embodied Agent Body Type on Perceptions and Dietary Intentions in Digital Health Counseling},
volume = {37},
issn = {1546-427X},
url = {http://dx.doi.org/10.1002/cav.70146},
doi = {10.1002/cav.70146},
number = {3},
journal = {Computer Animation and Virtual Worlds},
publisher = {Wiley},
author = {Ashok Vankit, Sagar and Sabnam Shama, Nafisa and Ashish Kadam, Jay and Toxtli Hernandez, Carlos and Volonte, Matias},
year = {2026},
month = May
}A Formative Investigation of Student Perceptions of Digital Twin Instructors in Remote Lecture Environments
The prevalence of remote instruction has heightened the need to understand how emerging avatar technologies might support instructor presence in virtual classrooms. Digital twins, defined here as animated avatars that mirror a speaker’s facial expressions and movements in real time, represent a potential alternative to standard webcam video. This formative study examines student perceptions following exposure to a digital twin instructor during live Zoom lectures. Twenty-four students completed a post-session survey assessing perceived realism, emotional engagement, and willingness to attend future sessions. Spearman correlation analysis revealed that affective qualities such as likeability and enjoyment showed strong positive associations with receptivity, while perceptions of awkwardness and weirdness showed strong negative associations. Perceived natural movement was strongly associated with human resemblance and inversely associated with eeriness, consistent with uncanny valley theory. These exploratory findings identify candidate factors for future controlled investigations and offer preliminary design guidance emphasizing behavioral fidelity and emotional warmth over photorealism alone.
@inproceedings{Volonte_2026,
series = {CHI EA ’26},
title = {A Formative Investigation of Student Perceptions of Digital Twin Instructors in Remote Lecture Environments},
url = {http://dx.doi.org/10.1145/3772363.3798975},
doi = {10.1145/3772363.3798975},
booktitle = {Proceedings of the Extended Abstracts of the 2026 CHI Conference on Human Factors in Computing Systems},
publisher = {ACM},
author = {Volonte, Matias and Joseph Berns, Nicholas and Toxtli, Carlos},
year = {2026},
month = Apr,
pages = {1--4},
collection = {CHI EA ’26}
}Relevance of Large Language Models in Latin American Education: A Systematic Review
This article presents a systematic literature review, following the PRISMA methodology, on the relevance of large language models (LLMs) such as ChatGPT in education in Latin America between January 2023 and April 2025. More than one hundred academic sources from recognized databases (Scopus, SciELO, Redalyc, ArXiv, IEEE Xplore, and Google Scholar) were analyzed, prioritizing empirical studies (quantitative, qualitative, and mixed methods), as well as theoretical articles, previous systematic reviews, and relevant regulatory or technical frameworks. The review covers all educational levels (basic, secondary, and higher education, and teacher training) and includes literature in both Spanish and English focused on Latin American contexts. The results reveal a rapid increase in research on LLMs in Latin American educational settings, with findings showing largely positive perceptions of the potential of tools such as ChatGPT to personalize teaching, improve learning, and foster skills such as critical and creative thinking, while also highlighting significant concerns regarding academic integrity, gaps in access, language bias, and the need for teacher training. The implications of these findings for educational practice in the region are discussed, including pedagogical strategies, ethical considerations, and public policy. Finally, recommendations are proposed for the responsible integration of generative AI into Latin American education, emphasizing the importance of approaches that harness its benefits while mitigating its risks.
@incollection{Toxtli2026Relevance,
title = {Relevance of Large Language Models in Latin American Education: A Systematic Review},
author = {Toxtli, Carlos},
editor = {Hernández Abad, Vicente Jesús and Mora Guevara, José Luis Alfredo and Palestino Escoto, Feliciano and Reyes Iriar, Gloria Margarita},
booktitle = {Relevancia de la Inteligencia Artificial en la Educación},
pages = {7--34},
publisher = {Universidad Nacional Autónoma de México, Facultad de Estudios Superiores Zaragoza},
address = {Ciudad de México},
year = {2026},
isbn = {978-607-642-729-3},
url = {https://www.zaragoza.unam.mx/relevancia-ia-educacion/}
}AI for Becoming Fluent: Designing an App for Advanced Bilingual Speakers
This research explores the difficulties advanced second-language learners face in becoming fluent and the poten-tial of AI to enhance language learning apps. Through surveys, focus groups, and collaborative design sessions, we investigated learners' difficulties and practice habits. The participants created paper prototypes for an app targeting speaking and listening skills at an advanced level. Key findings suggest that fluency de-velopment requires exposure to diverse accents from both native and non-native speakers. The resulting design incorporates AI in the form of a chatbot with voice recognition capabilities. This study contributes to our understanding of advanced language learning needs and the potential of AI to address them, paving the way for innovative language learning solutions. Our findings highlight opportunities to develop more effective tools for learners striving to achieve fluency in their target languages.
@inproceedings{DelgadoSolorzano2025Becoming,
title = {AI for Becoming Fluent: Designing an App for Advanced Bilingual Speakers},
url = {http://dx.doi.org/10.1109/CAI64502.2025.00044},
doi = {10.1109/cai64502.2025.00044},
booktitle = {2025 IEEE Conference on Artificial Intelligence (CAI)},
publisher = {IEEE},
author = {Delgado-Solorzano, Cecilia and Mendoza, Sara and Morales-Flores, Fernando and Martinez-Garcia, Jesus and Briones-Ramirez, Néstor E. and Zarazua-Rubio, Emmanuel A. and Rivera-Robles, Ventura and Rangel-Ortiz, Asis H. and Toxtli, Carlos},
year = {2025},
month = May,
pages = {236--243}
}A Culturally-Aware AI Tool for Crowdworkers: Leveraging Chronemics to Support Diverse Work Styles
Crowdsourcing markets are expanding worldwide, but often feature standardized interfaces that ignore the cultural diversity of their workers, negatively impacting their well-being and productivity. To transform these workplace dynamics, this paper proposes creating culturally-aware workplace tools, specifically designed to adapt to the cultural dimensions of monochronic and polychronic work styles. We illustrate this approach with "CultureFit," a tool that we engineered based on extensive research in Chronemics and culture theories. To study and evaluate our tool in the real world, we conducted a field experiment with 55 workers from 24 different countries. Our field experiment revealed that CultureFit significantly improved the earnings of workers from cultural backgrounds often overlooked in design. Our study is among the pioneering efforts to examine culturally aware digital labor interventions. It also provides access to a dataset with over two million data points on culture and digital work, which can be leveraged for future research in this emerging field. The paper concludes by discussing the importance and future possibilities of incorporating cultural insights into the design of tools for digital labor.
@article{Toxtli2024Culturally,
title = {A Culturally-Aware AI Tool for Crowdworkers: Leveraging Chronemics to Support Diverse Work Styles},
volume = {8},
issn = {2573-0142},
url = {http://dx.doi.org/10.1145/3686899},
doi = {10.1145/3686899},
number = {CSCW2},
journal = {Proceedings of the ACM on Human-Computer Interaction},
publisher = {Association for Computing Machinery (ACM)},
author = {Toxtli, Carlos and Curtis, Christopher and Savage, Saiph},
year = {2024},
month = Nov,
pages = {1--34}
}A Study of LLM-Powered Student Query Support
In this paper, we explore the use of Large Language Models (LLMs) to help students improve their information-seeking skills while encouraging the use of references to aid library literacy efforts. This study aims to expand the reach of library support by introducing an approach that leverages the capabilities of LLMs and well-structured prompts. Our approach begins with surveying the current changes students have faced in the last two years concerning their study habits and how they search for information. We subsequently propose a multi-step system prompt, referred as prompting architecture, for foundational and instructed LLMs. The proposed prompt architecture powers a web application named LibRef. We explore the adaptability of the prompting architecture to different information retrieval needs by refining search prompts and providing academic references. A field experiment is conducted using LibRef in academic settings. Our results suggest that the use of LibRef enhances students’ academic information-seeking experience. Our research underscores the potential of prompting architectures in procedural refinement of academic queries from students. We believe our findings can provide valuable insights on the current capabilities of LLMs for instructing students to provide more targeted prompts as well as incentivize the use of references.
@article{Delgado_Solorzano_2024a,
title = {A Study of LLM-Powered Student Query Support},
volume = {9},
issn = {2594-2352},
url = {http://dx.doi.org/10.47756/aihc.y9i1.141},
doi = {10.47756/aihc.y9i1.141},
number = {1},
journal = {Avances en Interacción Humano-Computadora},
publisher = {Asociacion Mexicana de Interaccion humano-Computadora (AMexIHC)},
author = {Delgado-Solorzano, Cecilia and Tzoc, Elias and Rook, Suzanne and Vinson, Christopher and Toxtli, Carlos},
year = {2024},
month = Nov,
pages = {21--25}
}Expanding the Horizon of Learning Applications: A Study on the Versatility of Prompting Architectures in Large Language Models
This paper presents an exploration of the versatility of prompting architectures in large language models (LLMs), expanding the horizons of their application in learning and language interfaces. By leveraging the expansive capabilities of LLMs, this research probes the potential for creating structured prompts that can simultaneously support multiple use cases, namely paraphrasing, grammatical syntax guidance for introductory sentences, and conducting experiential conversations in a foreign language. In this study, we delve into the specifics of enabling such technology, including the design of the prompting architecture, the deployment process, and the intricacies of applying the same structure across diverse applications. An extensive field experiment incorporating interfaces powered by LLMs using this structured prompt has been conducted to evaluate the model's efficiency in real-world scenarios. Results from the field experiment highlight the promising adaptability of these prompting architectures, revealing remarkable efficiency across the multiple use cases explored. Furthermore, this research uncovers a new dimension of flexibility in the design and deployment of learning applications using LLMs, potentially revolutionizing language learning interfaces by establishing a one-size-fits-all solution. This paper aims to stimulate further research into refining and expanding the potential of LLMs, encouraging the exploration of how artificial intelligence can optimally benefit language learning and related applications.
@inproceedings{Delgado_Solorzano_2024b,
series = {IHIET-AI},
title = {Expanding the Horizon of Learning Applications: A Study on the Versatility of Prompting Architectures in Large Language Models},
issn = {2771-0718},
url = {http://dx.doi.org/10.54941/ahfe1004606},
doi = {10.54941/ahfe1004606},
booktitle = {Human Interaction and Emerging Technologies (IHIET-AI 2024): Artificial Intelligence and Future Applications},
publisher = {AHFE International},
author = {Delgado Solorzano, Cecilia and Toxtli, Carlos},
year = {2024},
collection = {IHIET-AI}
}The Use of AI-powered Language Tools in Crowdsourcing to reduce Language Barriers
Crowdsourcing platforms gather people from different backgrounds to work on completing microtasks. The workers on those platforms are presented with tasks defined by requesters from all over the world. The tasks are defined in multiple languages, with English being the predominant language. It is unclear how language barriers can affect workers whose primary language is not English while completing tasks. In this paper, we study their practices and the impact of AI-powered tools on the completion of microtasks. We conduct a pre-test test field experiment in which workers share their current experience with the platform and receive basic training in the use of AI-powered tools. After a week, workers provide feedback on their practices and experiences. We find that workers who complete tasks in their primary language report less confidence in completing English tasks, and in general, workers perceive the use of the tools as a language-learning mechanism. We aim that the understanding of language barriers in crowd markets can promote more inclusive work conditions.
@inproceedings{Delgado2024Use,
title = {The Use of AI-powered Language Tools in Crowdsourcing to reduce Language Barriers},
url = {http://dx.doi.org/10.1109/iThings-GreenCom-CPSCom-SmartData-Cybermatics62450.2024.00110},
doi = {10.1109/ithings-greencom-cpscom-smartdata-cybermatics62450.2024.00110},
booktitle = {2024 IEEE International Conferences on Internet of Things (iThings) and IEEE Green Computing & Communications (GreenCom) and IEEE Cyber, Physical & Social Computing (CPSCom) and IEEE Smart Data (SmartData) and IEEE Congress on Cybermatics},
publisher = {IEEE},
author = {Delgado-Solorzano, Cecilia and Toxtli, Carlos},
year = {2024},
month = Aug,
pages = {601--608}
}Conceptualizing Indigeneity in Social Computing
There has been little effort in conceptualizing indigeneity in social computing, despite the concept being central to decolonial and postcolonial perspectives, which scholars have increasingly used in computing research for over a decade. It is crucial to reflect on who can be considered indigenous in the spirit of inclusion and reclamation since the underdevelopment of this concept and the nuances, differences, relationships, and overlaps between indigeneity and colonial marginalization may silence different populations in research. The workshop aims to bring together scholars whose works are associated with different local and indigenous cultures and their technology practices and experiences to initiate conversations around three themes: (a) defining indigeneity and identifying indigenous communities in social computing, (b) recognition in different sociopolitical contexts, and (c) contributions to social computing.
@inproceedings{Das_2023,
series = {CSCW ’23},
title = {Conceptualizing Indigeneity in Social Computing},
url = {http://dx.doi.org/10.1145/3584931.3611286},
doi = {10.1145/3584931.3611286},
booktitle = {Computer Supported Cooperative Work and Social Computing},
publisher = {ACM},
author = {Das, Dipto and Roy, Parboti and Toxtli, Carlos and Awori, Kagonya Awori and Vigil-Hayes, Morgan and Choudhury, Monojit and Kumar, Neha and Ahmed, Syed Ishtiaque and Semaan, Bryan},
year = {2023},
month = Oct,
pages = {501--505},
collection = {CSCW ’23}
}Evaluating Machine Perception of Indigeneity: An Analysis of ChatGPT's Perceptions of Indigenous Roles in Diverse Scenarios
Large Language Models (LLMs), like ChatGPT, are fundamentally tools trained on vast data, reflecting diverse societal impressions. This paper aims to investigate LLMs' self-perceived bias concerning indigeneity when simulating scenarios of indigenous people performing various roles. Through generating and analyzing multiple scenarios, this work offers a unique perspective on how technology perceives and potentially amplifies societal biases related to indigeneity in social computing. The findings offer insights into the broader implications of indigeneity in critical computing.
@misc{Delgado2023Evaluating,
doi = {10.13140/RG.2.2.30617.39520},
url = {https://www.researchgate.net/doi/10.13140/RG.2.2.30617.39520},
author = {Delgado, Cecilia and Toxtli, Carlos},
language = {en},
title = {Evaluating Machine Perception of Indigeneity: An Analysis of ChatGPT's Perceptions of Indigenous Roles in Diverse Scenarios},
publisher = {Unpublished},
year = {2023},
howpublished = {Preprint, ResearchGate},
note = {Preprint}
}