Continuum Speech Therapy

Full stack Swift App made by Arjun, Kahnishga, and Nyleah!
Bear mascot art was commissioned!

Continuum, a gamified speech practice app designed to guide kids on English phonemes to stay engaged with speech therapy at home, while also enabling anxious parents to monitor progress without having to be beside them.

Parent View allow for parents to set phoneme practice targets for their kid to practice as well as time goals. Furthermore, they can track time spent, increases in score improvement, and attempts at practice games.

Kid View: Practice Phonemes in 4 games. Flashcards allow for them to hear the sound. Try allows for them to watch someone else to mimic facial movements. Sandbox allows for them to practice endurance as they hold the sound and trace spelling. And finally, test allows them to pronounce words with the target sound and earn a score to help gather data for parents.

Data held locally with SwiftData, scoring done with Apple SpeechAnalyzer’s Neural Network.

It was super hard to make a backend that could score the pronunciation. I started out trying to make a classification model with Apple CreateML, but without enough training data, it was super inaccurate and either made values 0-10% accuracy or 90%, never in-between. Then I tried cosine similarity, but audio vectors are super hard to use for that since the volume, accent, and when or how long you say a sound makes it super different from another recording of the same sound. I eventually landed on Apple’s SpeechAnalyzer which saved me.

You can only test this on IOS 26+ and it is also on the App Store already. App Store link is the demo link.