What the research establishes
Published research shows that a conversational text-message assistant can help admitted students finish their paperwork before the term starts. It does not show that a chatbot on a college website increases enrollment. The strongest trials are American, test messages sent by the institution to admitted students, and use non-generative AI.
A note on method: no paid keyword-volume tool was available for this piece, so the topic was scoped from public search results. Every study below was traced to its source (journal, working paper or institutional host). No figure comes from Skolbot or any client.
| Study | Population and design | Published result |
|---|---|---|
| Page and Gehlbach, AERA Open, 2017 | Georgia State University, summer 2016: 3,745 admitted students assigned to the chatbot, 3,744 to control | 3.3 percentage points more on-time enrollment among students committed to the university |
| Castleman and Page, 2015 | Randomized trials in Dallas, Philadelphia and Boston, personalized texts or peer mentors | Positive effects in three of four sites, none in Boston |
| Nurshatayeva et al., 2021 | 4,442 students at a four-year university | About 4 points on loan acceptance; about 8 points for first-generation students |
| Meyer et al., EdWorkingPaper 22-564 | Randomized trials in undergraduate courses, non-generative AI | Higher final grades; similar across groups except one subgroup |
| Oreopoulos and Petronijevic, NBER 26059 | Nearly 25,000 students, three campuses | No significant effect on academic outcomes |
Georgia State: the one large trial of an admissions chatbot
Page and Gehlbach remains the reference study. In 2016 Georgia State deployed "Pounce", a text-message assistant built with a vendor, to guide admitted students through the summer: financial aid forms, immunization records, transcripts, course registration.
Admitted students were randomly assigned to receive the messages or not. Among those who had committed to the university, on-time enrollment rose by 3.3 percentage points. The authors say that is comparable to heavier interventions tested earlier, with far less staff effort.
Two limits matter. The effect concerns finishing tasks after admission, not the decision to apply or to choose a school. And the trial dates from 2016, well before today's generative assistants, so its result does not transfer directly to an open-ended generative chatbot.
Summer melt: targeted texts work where help is scarce
Before chatbots, Castleman and Page tested personalized texts on low-income high school graduates. Results varied by site: positive in three of four districts, null in Boston, where students already had plenty of school and nonprofit support.
For a college, the lesson is that the effect of an automated message depends on what the student would have received anyway. Where an advisor already answers fast, the added value is small.
Targeting changes the result
Nurshatayeva, Page, White and Gehlbach replicated the Georgia State design at another university (4,442 students). The overall effect on loan acceptance was about 4 points, rising to about 8 points for first-generation students, with about 3 points on course registration and enrollment.
The authors' practical message is that proactive outreach pays most for students with the least family or school backing. They also report that the community-college strand of their project could not be run properly because cell phone numbers were missing. Contact data quality limits a study just as it limits a rollout.
Beyond admissions: course chatbots show a similar pattern
Meyer, Page and co-authors tested a non-generative chatbot in undergraduate courses through pre-registered randomized trials. Messages raised final grades and use of academic support. Effects were broadly similar across demographic groups, apart from women in one microeconomics course, whose grades rose by about seven percentage points.
This concerns enrolled students. It shows the "short message, specific task, right moment" pattern recurring at several stages, but it measures nothing about converting a prospect.
The counter-example: not every nudge works
Oreopoulos and Petronijevic followed nearly 25,000 students across three campuses. Online coaching and text messages improved well-being and study time slightly, but no intervention significantly changed academic outcomes.
That tempers the other findings. Messages seem to work best on a precise, dated administrative task such as submitting a form, less well on diffuse behavior change. Page and colleagues reach a similar conclusion in their analysis of when nudging works.
What the research does not say
It says nothing about a generative chatbot on a college website answering prospects' questions. We found no published randomized trial measuring its effect on applications or enrollment.
Most of the evidence is American, which both helps and limits. It helps because the studies fit the US process: after the Common App and the offer, an admitted student must complete financial aid, housing, immunization and deposit steps largely alone, and "summer melt" is a recognized problem. It limits because every institution's checklist is different, and the Georgia State result came from a large public university. A small private college with a high-touch admissions office may see a smaller gain, as the Boston result suggests.
Finally, the studies describe assistants designed and monitored by research teams. A product deployed without that rigor has no guaranteed result.
What it means for a US college
The legal frame matters more than the measured effects. FERPA governs education records once a student is enrolled, and the Student Privacy Policy Office explains how it applies, but applicant data is usually handled under the institution's own privacy notice and state law. California, Colorado and other states have consumer privacy statutes with their own thresholds, so check which apply to you. Text outreach also falls under the Telephone Consumer Protection Act, which requires the right consent, and the FTC polices deceptive claims about what an automated assistant can do.
The EU AI Act does not bind a US college unless it recruits in the EU, but it classes systems that determine access to education as high risk, which is a useful benchmark. An assistant that informs is not a system that decides. Keep admission decisions with people, and say clearly when a student is talking to a machine.
Four practical points follow:
- Aim at dated tasks: missing documents, campus visit dates, deposit deadlines, interview slots. That is where trials find effects.
- Target the least-supported students rather than sending everyone the same message.
- Fix contact data and consent before any rollout.
- Measure with a control group: randomly hold back a sample of students from the nudge, then compare completion and enrollment.
For next steps, read our guide to AI agents for student recruitment, the definition of an AI admissions agent, the piece on yield management and post-offer drop-out and the AI chatbot guide for student recruitment.



