| Full text | |
| Author(s): |
Xavier Cejnog, Luciano Walenty
;
Cesar, Roberto Marcondes, Jr.
;
de Campos, Teofilo E.
;
Carril Elui, Valria Meirelles
;
IEEE
Total Authors: 5
|
| Document type: | Journal article |
| Source: | 2019 14TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2019); v. N/A, p. 5-pg., 2019-01-01. |
| Abstract | |
We introduce a framework for dynamic evaluation of the fingers movements: flexion, extension, abduction and adduction. This framework estimates angle measurements from joints computed by a hand pose estimation algorithm using a depth sensor ( Realsense SR300). Given depth maps as input, our framework uses Pose-REN [ 1], which is a state-of-art hand pose estimation method that estimates 3D hand joint positions using a deep convolutional neural network. The pose estimation algorithm runs in real-time, allowing users to visualise 3D skeleton tracking results at the same time as the depth images are acquired. Once 3D joint poses are obtained, our framework estimates a plane containing the wrist and MCP joints and measures flexion/extension and abduction/adduction angles by applying computational geometry operations with respect to this plane. We analysed flexion and abduction movement patterns using real data, extracting the movement trajectories. Our preliminary results show this method allows an automatic discrimination of hands with Rheumatoid Arthritis ( RA) and healthy patients. The angle between joints can be used as an indicative of current movement capabilities and function. Although the measurements can be noisy and less accurate than those obtained statically through goniometry, the acquisition is much easier, non-invasive and patient-friendly, which shows the potential of our approach. The system can be used with and without orthosis. Our framework allows the acquisition of measurements with minimal intervention and significantly reduces the evaluation time. (AU) | |
| FAPESP's process: | 15/22308-2 - Intermediate representations in Computational Science for knowledge discovery |
| Grantee: | Roberto Marcondes Cesar Junior |
| Support Opportunities: | Research Projects - Thematic Grants |
| FAPESP's process: | 14/50769-1 - Hand tracking for occupational therapy |
| Grantee: | Roberto Marcondes Cesar Junior |
| Support Opportunities: | Regular Research Grants |
| FAPESP's process: | 16/13791-4 - A framework for hand gesture analysis and tracking: the case for hands with unusual shapes and movements |
| Grantee: | Luciano Walenty Xavier Cejnog |
| Support Opportunities: | Scholarships in Brazil - Doctorate |