Development of an optical fiber force myography sensor for applications in human-robot interfaces

• Grant number: 17/25666-2
• Support Opportunities: Regular Research Grants
• Start date: May 01, 2018
• End date: April 30, 2020
• Field of knowledge: Engineering - Electrical Engineering - Electrical, Magnetic and Electronic Measurements, Instrumentation
• Principal Investigator: Eric Fujiwara
• Grantee: Eric Fujiwara
• Host Institution: Faculdade de Engenharia Mecânica (FEM). Universidade Estadual de Campinas (UNICAMP). Campinas , SP, Brazil
• Associated researchers: Carlos Kenichi Suzuki

Abstract

The force myography (FMG) is the mechanical counterpart of the surface electromyography, in which the hand movements and forces are estimated from the radial pressure exerted by the forearm muscles, providing a robust and straightforward method for applications in teleoperation, prosthesis control, and human-robot interaction. In this sense, the project proposes the development of an optical fiber sensor system for postures identification by FMG. The wearable optomechanical transducers will be designed based on techniques such as light intensity modulation and specklegram analyses, with further characterization and refinements in order to achieve 10 N sensitivity and 100 ms dynamic response. Next, waveform features extraction procedures and artificial neural networks classifiers will be implemented for correlating the acquired FMG signals to the performed postures, with 90% target accuracy. Finally, the measurement system will be integrated with a virtual anthropomorphic manipulator for real-time control, so the robot behavior will be described by an event-driven finite state machine switched by the classifier output. The successful accomplishment of this project will provide a novel, robust, and low-cost technology for human-robot interaction, with further applications in bionic prostheses control and virtual reality systems, thus generating technical contributions to the fields of photonics, robotics, and automation, as well as multidisciplinary scientific results. (AU)

Scientific publications

(30)

(References retrieved automatically from Web of Science and SciELO through information on FAPESP grants and their corresponding numbers as mentioned in the publications by the authors)

FUJIWARA, ERIC; HAYASHI, JULIANO G.; DELFINO, TIAGO DA SILVA; JORGE, PEDRO A. S.; DE BARROS CORDEIRO, CRISTIANO MONTEIRO. Optical Fiber Anemometer Based on a Multi-FBG Curvature Sensor. IEEE SENSORS JOURNAL, v. 19, n. 19, SI, p. 8727-8732, OCT 1 2019. (14/50632-6, 17/25666-2, 16/25196-3)

CABRAL, THIAGO D.; DA SILVA, LUIZ E.; FUJIWARA, ERIC; NG, ALSON K. L.; EBENDORFF-HEIDEPRIEM, HEIKE; CORDEIRO, CRISTIANO M. B.. Reusable polymer optics fiber strain sensor with memory capability based on ABS crazing. APPLIED OPTICS, v. 58, n. 36, p. 9870-9875, DEC 20 2019. (18/10409-7, 17/25666-2)

CABRAL, THIAGO D.; FUJIWARA, ERIC; WARREN-SMITH, STEPHEN C.; EBENDORFF-HEIDEPRIEM, HEIKE; CORDEIRO, CRISTIANO M. B.. Multimode exposed core fiber specklegram sensor. OPTICS LETTERS, v. 45, n. 12, JUN 15 2020. (18/10409-7, 17/25666-2)

FUJIWARA, ERIC; WU, YU TZU; GOMES, MATHEUS K.; SILVA, WILLIAN H. A.; SUZUKI, CARLOS K.; IEEE. Haptic Interface Based on Optical Fiber Force Myography Sensor. 2019 26TH IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES (VR), v. N/A, p. 2-pg., 2019-01-01. (17/25666-2)

FUJIWARA, ERIC; WU, YU TZU; SILVA, LUIZ E.; FREITAS, HUGO E.; ARISTILDE, STENIO; CORDEIRO, CRISTIANO M. B.; IEEE. Optical Fiber 3D Shape Sensor for Motion Capture. 2019 26TH IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES (VR), v. N/A, p. 2-pg., 2019-01-01. (17/25666-2, 14/50632-6)

ROSA, LIDIA O.; MORAIS, EDUARDA F.; CORDEIRO, CRISTIANO M. B.; FUJIWARA, ERIC; IEEE. Biodegradable ball lenses made of agar. 2023 INTERNATIONAL CONFERENCE ON OPTICAL MEMS AND NANOPHOTONICS, OMN AND SBFOTON INTERNATIONAL OPTICS AND PHOTONICS CONFERENCE, SBFOTON IOPC, v. N/A, p. 2-pg., 2023-01-01. (17/25666-2)

NETO, ANTONIO RIBAS; FAJARDO, JULIO; FERMAN, VICTOR; FUJIWARA, ERIC; ROHMER, ERIC; IEEE. A Hybrid Control Strategy for Tendon-actuated Robotic Glove and Functional Electrical Stimulation - A Preliminary Study. 2019 IEEE 4TH INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS AND MECHATRONICS (ICARM 2019), v. N/A, p. 6-pg., 2019-01-01. (17/25666-2)

FUJIWARA, ERIC; HAYASHI, JULIANO G.; DELFINO, TIAGO DA SILVA; JORGE, PEDRO A. S.; DE BARROS CORDEIRO, CRISTIANO MONTEIRO. Optical Fiber Anemometer Based on a Multi-FBG Curvature Sensor. IEEE SENSORS JOURNAL, v. 19, n. 19, p. 6-pg., 2019-10-01. (17/25666-2, 14/50632-6, 16/25196-3)

FUJIWARA, ERIC; DA SILVA DELFINO, TIAGO; DESTRI CABRAL, THIAGO; CORDEIRO, CRISTIANO MONTEIRO DE BARROS. All-Optical Fiber Anemometer Based on the Pitot-Static Tube. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, v. 69, n. 4, p. 7-pg., 2020-04-01. (17/25666-2, 14/50632-6, 16/25196-3)

FUJIWARA, ERIC; CABRAL, THIAGO D.; CORDEIRO, CRISTIANO M. B.; IEEE. Optical Fiber Specklegram Sensors for Measurement of Liquids. 2019 SBFOTON INTERNATIONAL OPTICS AND PHOTONICS CONFERENCE (SBFOTON IOPC), v. N/A, p. 5-pg., 2019-01-01. (17/25666-2, 14/50632-6)

CORDEIRO, CRISTIANO M. B.; FUJIWARA, ERIC. A Quantitative Experiment of Liquid Dispersion Using Merely a Partially Submerged Mirror and Sunlight. PHYSICS TEACHER, v. 60, n. 2, p. 4-pg., 2022-02-01. (17/25666-2)

FUJIWARA, ERIC; DA SILVA, LUIZ EVARISTO; MARQUES, THIAGO H. R.; CORDEIRO, CRISTIANO M. B.. Polymer optical fiber specklegram strain sensor with extended dynamic range. Optical Engineering, v. 57, n. 11, NOV 2018. (17/25666-2, 14/50632-6)

FUJIWARA, ERIC; CORDEIRO, CRISTIANO M. B.. Model-Based Design and Simulation of Paraxial Ray Optics Systems. APPLIED SCIENCES-BASEL, v. 10, n. 22, NOV 2020. (17/25666-2)

WU, YU TZU; FUJIWARA, ERIC; SUZUKI, CARLOS K.. Evaluation of Optical Myography Sensor as Predictor of Hand Postures. IEEE SENSORS JOURNAL, v. 19, n. 13, p. 5299-5306, JUL 1 2019. (17/25666-2)

FUJIWARA, ERIC; FRACAROLLI, JULIANA A.; CORDEIRO, CRISTIANO M. B.. idactic laser speckle experiments with a lensless camer. European Journal of Physics, v. 42, n. 6, NOV 2021. (17/25666-2)

FUJIWARA, ERIC; CABRAL, THIAGO DESTRI. Optical fiber specklegram sensor for multi-point curvature measurements. APPLIED OPTICS, v. 61, n. 23, p. 8-pg., 2022-08-10. (17/25666-2)

FUJIWARA, ERIC; DA SILVA DELFINO, TIAGO; DESTRI CABRAL, THIAGO; CORDEIRO, CRISTIANO MONTEIRO DE BARROS. All-Optical Fiber Anemometer Based on the Pitot-Static Tube. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, v. 69, n. 4, 2, p. 1805-1811, APR 2020. (14/50632-6, 17/25666-2, 16/25196-3)

FUJIWARA, ERIC; RI, YOSHI; WU, YU TZU; FUJIMOTO, HIROSHI; SUZUKI, CARLOS KENICHI. Evaluation o image matching techniques for optical fiber specklegram sensor analysis. APPLIED OPTICS, v. 57, n. 33, p. 9845-9854, NOV 20 2018. (17/25666-2)

FUJIWARA, ERIC; RODRIGUES, MATHEUS DOS SANTOS; GOMES, MATHEUS KAUE; WU, YU TZU; SUZUKI, CARLOS KENICHI. Identification of Hand Gestures Using the Inertial Measurement Unit of a Smartphone: A Proof-of-Concept Study. IEEE SENSORS JOURNAL, v. 21, n. 12, p. 13916-13923, JUN 15 2021. (17/25666-2)

WU, YU TZU; GOMES, MATHEUS K.; DA SILVA, WILLIAN H. A.; LAZARI, PEDRO M.; FUJIWARA, ERIC. Integrated Optical Fiber Force Myography Sensor as Pervasive Predictor of Hand Postures. BIOMEDICAL ENGINEERING AND COMPUTATIONAL BIOLOGY, v. 11, MAR 2020. (17/25666-2)

ARISTILDE, STENIO; SOARES, MARCO CESAR PRADO; CABRAL, THIAGO D.; RODRIGUES, GILDO; FUJIWARA, ERIC; FRUETT, FABIANO; CORDEIRO, CRISTIANO M. B.. Measurement of Multiphase Flow by Tilted Optical Fiber Bragg Grating Sensor. IEEE SENSORS JOURNAL, v. 21, n. 2, p. 1534-1539, JAN 15 2021. (17/25666-2, 19/22554-4, 18/10409-7)

FUJIWARA, ERIC; CABRAL, THIAGO D.; SATO, MIKO; OKU, HIROMASA; CORDEIRO, CRISTIANO M. B.. Agarose-based structured optical fibre. SCIENTIFIC REPORTS, v. 10, n. 1, APR 27 2020. (17/25666-2)

FUJIWARA, ERIC; WU, YU TZU; SUZUKI, CARLOS K.. Oscillating optical fiber speckle patterns: modeling and application. OPTICS CONTINUUM, v. 1, n. 12, p. 13-pg., 2022-12-15. (17/25666-2)

FUJIWARA, ERIC; DA SILVA, LUIZ EVARISTO; CABRAL, THIAGO DESTRI; DE FREITAS, HUGO EUGENIO; WU, YU TZU; DE BARROS CORDEIRO, CRISTIANO MONTEIRO. Optical Fiber Specklegram Chemical Sensor Based on a Concatenated Multimode Fiber Structure. Journal of Lightwave Technology, v. 37, n. 19, p. 5041-5047, OCT 1 2019. (14/50632-6, 17/25666-2)

CABRAL, THIAGO D.; FRANCO, DOUGLAS F.; FUJIWARA, ERIC; NALIN, MARCELO; CORDEIRO, CRISTIANO M. B.. Magnetic Field Fiber Specklegram Sensors Based on Tb³⁺-Doped Magneto-Optical Glasses With High Verdet Constants. IEEE SENSORS JOURNAL, v. 23, n. 7, p. 8-pg., 2023-04-01. (14/50632-6, 13/07793-6, 17/25666-2, 16/16900-9, 18/19272-4)

FUJIWARA, ERIC; DA SILVA, LUIZ E.; DE FREITAS, HUGO E.; WU, YU TZU; CORDEIRO, CRISTIANO M. B.; IEEE. Optical Fiber Chemical Sensor Based on the Analysis of Fiber Specklegrams Characteristics. 2018 SBFOTON INTERNATIONAL OPTICS AND PHOTONICS CONFERENCE (SBFOTON IOPC), v. N/A, p. 5-pg., 2018-01-01. (17/25666-2, 14/50632-6)

FAJARDO, JULIO; NETO, ANTONIO RIBAS; SILVA, WILLIAN; GOMES, MATHEUS; FUJIWARA, ERIC; ROHMER, ERIC; IEEE. A Wearable Robotic Glove based on Optical FMG Driven Controller. 2019 IEEE 4TH INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS AND MECHATRONICS (ICARM 2019), v. N/A, p. 6-pg., 2019-01-01. (17/25666-2)

FUJIWARA, ERIC; MACHADO, PEDRO L.; OLIVEIRA, TARCISIO C. D.; SOARES, MARCO C. P.; CABRAL, THIAGO D.; CORDEIRO, CRISTIANO M. B.; IEEE. Using the Smartphone as an Ubiquitous Platform for Implementing Optical Fiber Sensors. 2019 SBFOTON INTERNATIONAL OPTICS AND PHOTONICS CONFERENCE (SBFOTON IOPC), v. N/A, p. 5-pg., 2019-01-01. (17/25666-2, 14/50632-6)

OSORIO, JONAS H.; CABRAL, THIAGO D.; FUJIWARA, ERIC; FRANCO, MARCOS A. R.; AMRANI, FOUED; DELAHAYE, FREDERIC; GEROME, FREDERIC; BENABID, FETAH; CORDEIRO, CRISTIANO M. B.. Displacement sensor based on a large-core hollow fiber and specklegram analysis. Optical Fiber Technology, v. 78, p. 7-pg., 2023-04-26. (17/25666-2, 21/13097-9)

FUJWARA, ERIC; WU, YU TZU; VILLELA, CAIO S.; GOMES, MATHEUS K.; SOARES, MARCO C. P.; SUZUKI, CARLOS K.; RIBAS NETO, ANTONIO; ROHMER, ERIC; IEEE. Design and Application of Optical Fiber Sensors for Force Myography. 2018 SBFOTON INTERNATIONAL OPTICS AND PHOTONICS CONFERENCE (SBFOTON IOPC), v. N/A, p. 5-pg., 2018-01-01. (18/00688-6, 17/25666-2, 13/07559-3)