What the research establishes
Published research shows that a conversational text-message assistant can help admitted applicants finish their paperwork before semester starts. It does not show that a chatbot on a university website increases enrolments. The strongest trials are American, test messages sent by the institution to admitted students, and use non-generative AI.
A note on method: no paid keyword-volume tool was available for this piece, so the topic was scoped from public search results. Every study below was traced to its source. No figure comes from Skolbot or any client.
| Study | Population and design | Published result |
|---|---|---|
| Page and Gehlbach, AERA Open, 2017 | Georgia State University, summer 2016: 3,745 admitted students assigned to the chatbot, 3,744 to control | 3.3 percentage points more on-time enrolment among students committed to the university |
| Castleman and Page, 2015 | Randomised trials in Dallas, Philadelphia and Boston, personalised texts or peer mentors | Positive effects in three of four sites, none in Boston |
| Nurshatayeva et al., 2021 | 4,442 students at a four-year university | About 4 points on loan acceptance; about 8 points for first-generation students |
| Meyer et al., EdWorkingPaper 22-564 | Randomised trials in undergraduate courses, non-generative AI | Higher final grades; similar across groups except one subgroup |
| Oreopoulos and Petronijevic, NBER 26059 | Nearly 25,000 students, three campuses | No significant effect on academic outcomes |
Georgia State: the one large trial of an admissions chatbot
Page and Gehlbach remains the reference study. In 2016 Georgia State deployed "Pounce", a text-message assistant built with a vendor, to guide admitted students through the summer: financial aid forms, immunisation records, transcripts, course registration.
Admitted students were randomly assigned to receive the messages or not. Among those who had committed to the university, on-time enrolment rose by 3.3 percentage points. The authors say that is comparable to heavier interventions tested earlier, with far less staff effort.
Two limits matter. The effect concerns finishing tasks after admission, not the decision to apply or to choose a university. And the trial dates from 2016, well before today's generative assistants, so its result does not transfer directly to an open-ended generative chatbot.
Summer melt: targeted texts work where help is scarce
Before chatbots, Castleman and Page tested personalised texts on low-income school leavers. Results varied by site: positive in three of four districts, null in Boston, where students already had plenty of school and nonprofit support.
For a university, the lesson is that the effect of an automated message depends on what the applicant would have received anyway. Where an adviser already answers fast, the added value is small.
Targeting changes the result
Nurshatayeva, Page, White and Gehlbach replicated the Georgia State design at another university (4,442 students). The overall effect on loan acceptance was about 4 points, rising to about 8 points for first-generation students, with about 3 points on course registration and enrolment.
The authors' practical message is that proactive outreach pays most for applicants with the least family or school backing. They also report that the community-college strand of their project could not be run properly because mobile numbers were missing. Contact data quality limits a study just as it limits a rollout.
Beyond admissions: course chatbots show a similar pattern
Meyer, Page and co-authors tested a non-generative chatbot in undergraduate courses through pre-registered randomised trials. Messages raised final grades and use of academic support. Effects were broadly similar across demographic groups, apart from women in one microeconomics course, whose grades rose by about seven percentage points.
This concerns enrolled students. It shows the "short message, specific task, right moment" pattern recurring at several stages, but it measures nothing about converting a prospect.
The counter-example: not every nudge works
Oreopoulos and Petronijevic followed nearly 25,000 students across three campuses. Online coaching and text messages improved well-being and study time slightly, but no intervention significantly changed academic outcomes.
That tempers the other findings. Messages seem to work best on a precise, dated administrative task such as submitting a form, less well on diffuse behaviour change. Page and colleagues reach a similar conclusion in their analysis of when nudging works.
What the research does not say for Australia
It says nothing about a generative chatbot on an Australian university website answering prospects' questions. We found no published randomised trial, in Australia or elsewhere, measuring its effect on applications or enrolments.
Australian admissions differ from the settings studied. Many domestic applicants apply through state tertiary admissions centres such as UAC in New South Wales and the ACT, using an ATAR or an alternative pathway, and offers arrive in rounds. Group of Eight universities, TAFE and private providers each have different lead times. The steps where a nudge could help, such as accepting an offer, enrolling and arranging fees through HECS-HELP, are specific to this system.
Finally, the studies describe assistants designed and monitored by research teams. A product deployed without that rigour has no guaranteed result.
What it means for an Australian institution
The legal frame matters more than the measured effects. The Privacy Act 1988 and the Australian Privacy Principles govern how institutions handle personal information, and the OAIC enforces them. Privacy reforms have been phased in, so check the current obligations on automated decision-making and transparency. Marketing messages must also comply with the Spam Act 2003, which requires consent for commercial electronic messages.
The EU AI Act does not bind an Australian provider unless it recruits in the EU, but it classes systems that determine access to education as high risk, a useful benchmark. An assistant that informs is not a system that decides. Keep admission decisions with people. For registered providers, TEQSA sets the regulatory standards, and an automated message should never promise something the provider cannot deliver.
Four practical points follow:
- Aim at dated tasks: missing documents, open day dates, acceptance deadlines, interview slots. That is where trials find effects.
- Target the least-supported applicants rather than sending everyone the same message.
- Fix contact data and consent before any rollout.
- Measure with a control group: randomly hold back a sample of applicants from the nudge, then compare completion and enrolment.
For next steps, read our guide to AI agents for student recruitment, the definition of an AI admissions agent, the piece on yield management and post-offer drop-out and the AI chatbot guide for student recruitment.



