speak2me logo

Speak2Me

iOS App for Facial Movement
Tracking in Speech Therapy

My Role: UX Researcher and UX/UI Designer

Project Overview:

Speak2Me is an iOS app designed to help speech therapists track and analyze facial movements during speech therapy sessions. The app uses facial movement tracking technology to capture and analyze the movements of the user's face, and provides feedback on the user's speech.

Problem Statement:

Speech therapists often struggle to track and analyze facial movements during speech therapy sessions, and traditional methods of tracking facial movements are often inaccurate and time-consuming.

Solution:

The solution focused on the development of an iOS app that uses facial movement tracking technology to capture and analyze the movements of the user's face, and provides feedback on the user's speech.

  1. Facial Movement Tracking with ARKit:

    • Utilized ARKit to precisely track facial movements, providing therapists with a detailed and accurate analysis of patients' facial movements during exercises.
  2. Real-Time Feedback and Progress Tracking:

    • Provided real-time feedback on the user's speech, helping therapists to identify areas for improvement and track progress over time.
  3. Personalized Exercise Creation:

    • Designed an intuitive interface that allows therapists to create personalized exercise regimine tailored to individual patient needs.
  4. Objective Facial Asymmetry Tracking:

    • Incorporated objective measurements for facial asymmetry tracking, reducing the reliance on subjective assessments.
    • Provided visual analytics and progress reports to therapists, enabling them to make data-driven decisions in the treatment process.
  5. Paperless Curriculum Management:

    • Integrated trust-building elements such as testimonials, case studies, or certifications to instill confidence in the speech therapy company's expertise and reliability.
    • Utilized a clean and professional design aesthetic to convey a sense of security and trustworthiness.
  6. Billing Integration:

    • Streamlined billing processes by integrating a billing module within the app, reducing the likelihood of errors.
    • Provided a seamless transition from therapy sessions to billing, saving time and improving the overall administrative experience for therapists.
  7. Gamification:

    • To assist in adoption and retention of users we set out to gamify the exercises.
    • The goal was to make interactive excercises that were challenging but also fun with engaging graphics to make the patients excited to log in and complete their excercises.

Before: