Human activity recognition for home robots
Come do robotics in beautiful Vancouver, British Columbia, Canada! Are you interested in building robots that help people? Join us in an exciting project jointly sponsored by the SFU Rosie Lab and JDQ Systems Inc.
We are building a robot to help caregivers in a home for the Developmental Disabilities Association. One of the tasks that our clients have asked to automate is the recognition of various movements and activities, such as sitting, standing, laying on the floor, exercising, eating, etc. to better track the progress of residents in a group home. You will have access to working with a robot on-site, with real data and real clients.
The project involves:
- Understanding the use case defined by the client and partner JDQ systems
- Developing algorithms and code to implement activity recognition using various sensor input: i.e., 2D camera, and potentially 3D camera, LIDAR, location of robot
- Integrating the activity recognition module with an existing robot (running ROS), equipped with user identification and SLAM systems, already developed along with a team of engineers
- Running demonstrations of the activity recognition module running in real-time
Following the deliverable to the client, you will be given the time and opportunity to write up the results in a publication, particularly noting the in-the-wild aspect. Depending on the progress of the project, there is a possibility for extension of the position to further identify mental states, such as playing, sleeping, fallen and needs help, etc.
- You are currently enrolled in or hold an M.Sc. or Ph.D. in Computer Science or related discipline
- Ability to code in Python or C++
- Background in machine learning and/or signal processing
- Experience with computer vision or multimodal recognition techniques
- You have a team-oriented attitude -- building robots takes a family!
Apply to SFU Rosie Lab by filling out our online application form. Please note that you may only be contacted in the case of a successful application.