PsychPilot

For my Master thesis, I developed a therapeutic application that serves as psychotherapist. The application is web-based and was developed with Next.js in the frontend and Python for data processing and emotion detection in the backend. In a user study I then investigated various emotional factors between 3 different versions of the application. For this different emotion detection techniques were included in the application e.g. where one takes use of LLMs which apply emotion detection on text. Others were real-time emotion detection approaches based on the user's facial expressions, where MediaPipe Task Vision was utilized. LLMs were also used for other tasks, such as creating abstract facial expression animation with the blendshapes technique. The great potential of LLMs for various tasks was demonstrated, which helped to trigger more targeted emotions in the user.