What the research establishes
Published research shows that a conversational text-message assistant can help admitted applicants finish their paperwork before the term starts. It does not show that a chatbot on a university or college website increases enrolment. The strongest trials are American, test messages sent by the institution to admitted students, and use non-generative AI.
A note on method: no paid keyword-volume tool was available for this piece, so the topic was scoped from public search results. Every study below was traced to its source. No figure comes from Skolbot or any client.
| Study | Population and design | Published result |
|---|---|---|
| Page and Gehlbach, AERA Open, 2017 | Georgia State University, summer 2016: 3,745 admitted students assigned to the chatbot, 3,744 to control | 3.3 percentage points more on-time enrolment among students committed to the university |
| Castleman and Page, 2015 | Randomized trials in Dallas, Philadelphia and Boston, personalized texts or peer mentors | Positive effects in three of four sites, none in Boston |
| Nurshatayeva et al., 2021 | 4,442 students at a four-year university | About 4 points on loan acceptance; about 8 points for first-generation students |
| Meyer et al., EdWorkingPaper 22-564 | Randomized trials in undergraduate courses, non-generative AI | Higher final grades; similar across groups except one subgroup |
| Oreopoulos and Petronijevic, NBER 26059 | Nearly 25,000 students, three campuses | No significant effect on academic outcomes |
Georgia State: the one large trial of an admissions chatbot
Page and Gehlbach remains the reference study. In 2016 Georgia State deployed "Pounce", a text-message assistant built with a vendor, to guide admitted students through the summer: financial aid forms, immunization records, transcripts, course registration.
Admitted students were randomly assigned to receive the messages or not. Among those who had committed to the university, on-time enrolment rose by 3.3 percentage points. The authors say that is comparable to heavier interventions tested earlier, with far less staff effort.
Two limits matter. The effect concerns finishing tasks after admission, not the decision to apply or to choose a school. And the trial dates from 2016, well before today's generative assistants, so its result does not transfer directly to an open-ended generative chatbot.
Summer melt: targeted texts work where help is scarce
Before chatbots, Castleman and Page tested personalized texts on low-income high school graduates. Results varied by site: positive in three of four districts, null in Boston, where students already had plenty of school and nonprofit support.
For an institution, the lesson is that the effect of an automated message depends on what the applicant would have received anyway. Where an advisor already answers fast, the added value is small.
Targeting changes the result
Nurshatayeva, Page, White and Gehlbach replicated the Georgia State design at another university (4,442 students). The overall effect on loan acceptance was about 4 points, rising to about 8 points for first-generation students, with about 3 points on course registration and enrolment.
The authors' practical message is that proactive outreach pays most for applicants with the least family or school backing. They also report that the community-college strand of their project could not be run properly because cell phone numbers were missing. Contact data quality limits a study just as it limits a rollout.
Beyond admissions: course chatbots show a similar pattern
Meyer, Page and co-authors tested a non-generative chatbot in undergraduate courses through pre-registered randomized trials. Messages raised final grades and use of academic support. Effects were broadly similar across demographic groups, apart from women in one microeconomics course, whose grades rose by about seven percentage points.
This concerns enrolled students. It shows the "short message, specific task, right moment" pattern recurring at several stages, but it measures nothing about converting a prospect.
The counter-example: not every nudge works
Oreopoulos and Petronijevic followed nearly 25,000 students across three campuses. Online coaching and text messages improved well-being and study time slightly, but no intervention significantly changed academic outcomes.
That tempers the other findings. Messages seem to work best on a precise, dated administrative task such as submitting a form, less well on diffuse behaviour change. Page and colleagues reach a similar conclusion in their analysis of when nudging works.
What the research does not say for Canada
It says nothing about a generative chatbot on a Canadian university or college website answering prospects' questions. We found no published randomized trial, in Canada or elsewhere, measuring its effect on applications or enrolment.
Education is provincial in Canada, so there is no single admissions process. In Ontario, applications to universities run through the OUAC; other provinces use their own services or direct application, and Quebec has its own system built around the CEGEP. The moments where a follow-up message could matter, such as offer acceptance, residence and deposits, vary by province and institution. The research itself was run in US settings.
Finally, the studies describe assistants designed and monitored by research teams. A product deployed without that rigour has no guaranteed result.
What it means for a Canadian institution
The legal frame matters more than the measured effects. At the federal level, PIPEDA governs private-sector handling of personal information, and the Office of the Privacy Commissioner publishes guidance. Public universities often fall under provincial laws instead, such as FIPPA in Ontario. In Quebec, Law 25 adds consent, transparency and privacy impact assessment duties, and it applies to a Quebec-based institution or to a recruiter handling Quebec residents' data.
The EU AI Act does not bind a Canadian institution unless it recruits in the EU, but it classes systems that determine access to education as high risk, a useful benchmark. An assistant that informs is not a system that decides. Keep admission decisions with people, and disclose that a machine is answering. The proposed federal AI bill did not become law, so check the current position before relying on it.
Four practical points follow:
- Aim at dated tasks: missing documents, campus visit dates, deposit deadlines, interview slots. That is where trials find effects.
- Target the least-supported applicants rather than sending everyone the same message.
- Fix contact data and consent before any rollout.
- Measure with a control group: randomly hold back a sample of applicants from the nudge, then compare completion and enrolment.
For next steps, read our guide to AI agents for student recruitment, the definition of an AI admissions agent, the piece on yield management and post-offer drop-out and the AI chatbot guide for student recruitment.



