Xi WANG

The goal of Focus Play is to demonstrate the value of multimodal interaction in children’s education. This project, including two interactive games called memory game and noise game, is implemented to help children to improve the skills to focus. It also provides an opportunity for children to learn by computers. I was the team leader of this project. I came up with the idea about this project, and was responsible for designing all graphical user interfaces and coding the noise game.

The memory game and noise game target children who are visually oversensitive and cannot focus attention in a noisy environment respectively. The memory game has a gesture mode: we implement OpenCV to recognize hand gesture so that users can turn over the pictures by gesture instead of the mouse. The noise game has a speech mode: users can speak out the answers, then system uses Google Speech API to transcribe the speech to text.