What the research establishes
Published research shows that a conversational text-message assistant can help admitted applicants finish their paperwork before term starts. It does not show that a chatbot on a university website increases enrolment. The strongest trials come from the United States, test messages sent by the institution to admitted students, and use non-generative AI.
A note on method: no paid keyword-volume tool was available for this piece, so the topic was scoped from public search results. Every study below was traced to its source (journal, working paper or institutional host). No figure comes from Skolbot or any client.
| Study | Population and design | Published result |
|---|---|---|
| Page and Gehlbach, AERA Open, 2017 | Georgia State University, summer 2016: 3,745 admitted students assigned to the chatbot, 3,744 to control | 3.3 percentage points more on-time enrolment among students committed to the university |
| Castleman and Page, 2015 | Randomised trials in Dallas, Philadelphia and Boston, personalised texts or peer mentors | Positive effects in three of four sites, none in Boston |
| Nurshatayeva et al., 2021 | 4,442 students at a four-year university | About 4 points on loan acceptance; about 8 points for first-generation students |
| Meyer et al., EdWorkingPaper 22-564 | Randomised trials in undergraduate courses, non-generative AI | Higher final grades; similar across groups except one subgroup |
| Oreopoulos and Petronijevic, NBER 26059 | Nearly 25,000 students, three campuses | No significant effect on academic outcomes |
Georgia State: the one large trial of an admissions chatbot
Page and Gehlbach remains the reference study. In 2016 Georgia State deployed "Pounce", a text-message assistant built with a vendor, to guide admitted students through the summer: financial aid forms, immunisation records, transcripts, course registration.
Admitted students were randomly assigned to receive the messages or not. Among those who had committed to the university, on-time enrolment rose by 3.3 percentage points. The authors say that is comparable to heavier interventions tested earlier, with far less staff effort.
Two limits matter. The effect concerns finishing tasks after admission, not the decision to apply or to choose a school. And the trial dates from 2016, well before today's generative assistants, so its result does not transfer directly to an open-ended generative chatbot.
Summer melt: targeted texts work where help is scarce
Before chatbots, Castleman and Page tested personalised texts on low-income school leavers. Results varied by site: positive in three of four districts, null in Boston, where students already had plenty of school and charity support.
For an institution, the lesson is that the effect of an automated message depends on what the applicant would have received anyway. Where an adviser already answers fast, the added value is small.
Targeting changes the result
Nurshatayeva, Page, White and Gehlbach replicated the Georgia State design at another university (4,442 students). The overall effect on loan acceptance was about 4 points, rising to about 8 points for first-generation students, with about 3 points on course registration and enrolment.
The authors' practical message is that proactive outreach pays most for applicants with the least family or school backing. They also report that the community-college strand of their project could not be run properly because phone numbers were missing. Contact data quality limits a study just as it limits a rollout.
Beyond admissions: course chatbots show a similar pattern
Meyer, Page and co-authors tested a non-generative chatbot in undergraduate courses through pre-registered randomised trials. Messages raised final grades and use of academic support. Effects were broadly similar across demographic groups, apart from women in one microeconomics course, whose grades rose by about seven percentage points.
This concerns enrolled students. It shows the "short message, specific task, right moment" pattern recurring at several stages, but it measures nothing about converting a prospect.
The counter-example: not every nudge works
Oreopoulos and Petronijevic followed nearly 25,000 students across three campuses. Online coaching and text messages improved well-being and study time slightly, but no intervention significantly changed academic outcomes.
That tempers the other findings. Messages seem to work best on a precise, dated administrative task such as submitting a form, less well on diffuse behaviour change. Page and colleagues reach a similar conclusion in their analysis of when nudging works.
What the research does not say
It says nothing about a generative chatbot placed on a university website to answer prospects' questions. We found no published randomised trial, in the UK or elsewhere, measuring its effect on applications or enrolments.
It also does not let you carry an American percentage over to a British institution. Admitted US students must complete a chain of steps alone before term. In the UK, UCAS structures the calendar: applications, offers, firm and insurance choices, and Clearing all run through one service, so many of the steps studied simply do not exist in the same form.
Finally, the studies describe assistants designed and monitored by research teams. A product deployed without that rigour has no guaranteed result.
What it means for a UK institution
The legal frame matters more than the measured effects. UK GDPR applies to any message sent to an applicant, and the ICO expects transparency, data minimisation and a lawful basis for AI processing. Many applicants are under 18 at the point of first contact, so the notice must be readable.
The EU AI Act lists systems that determine access to education as high risk. It applies directly only where you serve EU applicants, but it is a useful benchmark: an assistant that informs is not a system that decides, while a tool that ranks applications comes close. Keep admission decisions with people.
Four practical points follow:
- Aim at dated tasks: missing documents, open day dates, deposit deadlines, interview slots. That is where trials find effects.
- Target the least-supported applicants rather than sending everyone the same message.
- Fix contact data and consent before any rollout.
- Measure with a control group: randomly hold back a sample of applicants from the nudge, then compare completion and enrolment.
For next steps, read our guide to AI agents for student recruitment, the definition of an AI admissions agent, the piece on yield management and post-offer drop-out and the AI chatbot guide for student recruitment.


