Robotics and machine learning for mining

Inspection robots, conveyor-belt monitoring, teleoperation and computer vision for the mining industry.

At ITV I worked on several projects with Vale that use robots and machine learning to make mining operations safer. I coordinated a framework for monitoring conveyor belts (2016–2021) that used mobile robots and drones for visual inspection, together with augmented-reality tools for the inspectors. Other projects included the ROSI robot for harsh outdoor inspection, automatic preparation of steel-cord belt splices, deep-learning detection of damage in tailing pipes, hyperspectral detection of contaminated soil, an autonomous platform for loading explosives, and, at UFMG, teleoperation of mining equipment with haptic and immersive interfaces.

Collaborations in this area continue, for example on estimating iron-ore particle size during crushing and on auditable safety inspections with robots and blockchain.

Publications

  1. SN CS
    Towards an Automated and Auditable Industrial Safety Inspection Using Robots and Blockchain
    Garcia, Rodrigo Dutra, Henriques, Miguel Bragante, Cid, André Luiz Maciel, Cruz Júnior, Gilmar Pereira, Azpúrua, Héctor and 5 more authors Garcia, Rodrigo Dutra, Henriques, Miguel Bragante, Cid, André Luiz Maciel, Cruz Júnior, Gilmar Pereira, Azpúrua, Héctor, Ramachandran, Gowri, Saboia, Maíra, Freitas, Gustavo M., Pessin, Gustavo and Ueyama, Jó
    SN Computer Science 2025
  2. JCAE
    Automatic Procedure for Steel Cord Belt Splicing Preparation
    Barros, Luiz Guilherme Dias, Santos, Luan Fernandes, Azpúrua, Héctor, Pritzelwitz, Philip, Pessin, Gustavo and 1 more author Barros, Luiz Guilherme Dias, Santos, Luan Fernandes, Azpúrua, Héctor, Pritzelwitz, Philip, Pessin, Gustavo and Freitas, Gustavo Medeiros
    Journal of Control, Automation and Electrical Systems 2022
  3. JINT
    ROSI: A Robotic System for Harsh Outdoor Industrial Inspection - System Design and Applications
    Rocha, Filipe, Garcia, Gabriel, Pereira, Raphael F. S., Faria, Henrique D., Silva, Thales H., …, Azpúrua, Héctor and 12 more authors Rocha, Filipe, Garcia, Gabriel, Pereira, Raphael F. S., Faria, Henrique D., Silva, Thales H., Andrade, Ricardo H. R., Barbosa, Evelyn S., Almeida, André, Cruz, Emanuel, Andrade, Wagner, Serrantola, Wenderson G., Moura, Luiz, Azpúrua, Héctor, Franca, André, Pessin, Gustavo, Freitas, Gustavo M., Costa, Ramon R. and Lizarralde, Fernando
    Journal of Intelligent & Robotic Systems 2021
  1. SAS
    Deep Learning with Semantic Segmentation for Iron Ore Particle Size Estimation in Primary Crushing
    Souza, Lucas R., Santos, André A., Azpúrua, Héctor, Resende Filho, Levi Welington, Domingues, Jacó and 3 more authors Souza, Lucas R., Santos, André A., Azpúrua, Héctor, Resende Filho, Levi Welington, Domingues, Jacó, Matos, Saulo N., Euzébio, Thiago and Pessin, Gustavo
    In IEEE Sensors Applications Symposium (SAS 2026)
  2. EANN
    Contaminated Soil Detection: A Proposal Using Machine Learning and Hyperspectral Imaging
    Duarte, Fernando H. Oliveira, Resende Filho, Levi Welington, Azpúrua, Héctor, Santos, André A., Souza, Jefferson R. and 2 more authors Duarte, Fernando H. Oliveira, Resende Filho, Levi Welington, Azpúrua, Héctor, Santos, André A., Souza, Jefferson R., Pessin, Gustavo and Correa, Rosa Elvira
    In International Conference on Engineering Applications of Neural Networks (EANN 2021)
  3. VISAPP
    Early Defect Detection in Conveyor Belts using Machine Vision
    Netto, Guilherme, Coelho, Bruno, Delabrida, Saul, Sinatora, Amilton, Azpúrua, Héctor and 3 more authors Netto, Guilherme, Coelho, Bruno, Delabrida, Saul, Sinatora, Amilton, Azpúrua, Héctor, Pessin, Gustavo, Oliveira, Ricardo and Bianchi, Andrea
    In 16th International Conference on Computer Vision Theory and Applications 2021
  4. CASE
    Deep Learning for Early Damage Detection of Tailing Pipes Joints witha Robotic Device
    Resende Filho, Levi Welington, Santos, André Almeida, Azpúrua, Héctor, Garcia, Gabriel and Pessin, Gustavo
    In 2020 IEEE 16th International Conference on Automation Science and Engineering
  5. ICMLA
    Deep Learning-Based Object Detection for Digital Inspection in the Mining Industry
    D’Angelo, Thiago, Mendes, Marina, Keller, Breno, Ferreira, Rafael, Delabrida, Saul, Azpúrua, Héctor and 1 more author D’Angelo, Thiago, Mendes, Marina, Keller, Breno, Ferreira, Rafael, Delabrida, Saul, Azpúrua, Héctor and Bianchi, Andrea G. C.
    In IEEE ICMLA (International Conference on Machine Learning and Applications) 2019
  6. SBAI
    Sistema automatico para a inspeção visual de transportadores de correia
    Santos, André A., Rocha, Filipe Augusto Santos, Azpúrua, Héctor, Reis, Agnaldo J. da Rocha and Guimarães, Frederico G.
    In Simpósio Brasileiro de Automação Inteligente, SBAI 2019
  7. LARS
    An Immersion Enhancing Robotic Head-Like Device for Teleoperation
    Rezeck, Paulo, Chamone, Felipe, Soares, Jéssica Ferreira, Frade, Bruna, Pinto, Luan Gabriel, Azpúrua, Héctor and 4 more authors Rezeck, Paulo, Chamone, Felipe, Soares, Jéssica Ferreira, Frade, Bruna, Pinto, Luan Gabriel, Azpúrua, Héctor, Macharet, Douglas G., Chaimowicz, Luiz, Freitas, Gustavo and Campos, Mario F. M.
    In IEEE LARS 2018 15th Latin American Robotics Symposium
  8. LARS
    Framework for Haptic Teleoperation of a Remote Robotic Arm Device
    Rezeck, Paulo, Frade, Bruna, Soares, Jéssica Ferreira, Pinto, Luan Gabriel, Chamone, Felipe, Azpúrua, Héctor and 4 more authors Rezeck, Paulo, Frade, Bruna, Soares, Jéssica Ferreira, Pinto, Luan Gabriel, Chamone, Felipe, Azpúrua, Héctor, Macharet, Douglas G., Freitas, Gustavo, Chaimowicz, Luiz and Campos, Mario F. M.
    In IEEE LARS 2018 15th Latin American Robotics Symposium
  9. LARS
    Teleoperation of an ABB IRB 120 robotic manipulator and BarrettHand BH8-282 using a Geomagic Touch X haptic device and ROS
    Lima, Amanda, Rocha, Filipe Augusto Santos, Torre, Marcos, Azpúrua, Héctor and Freitas, Gustavo
    In IEEE LARS 2018 15th Latin American Robotics Symposium
  10. SBAI
    Implementação De Uma Plataforma Móvel E Autônoma Para Carregamento De Explosivos Na Mineração
    Ferreira, Jhony Alan Tavares, Fidêncio, Aline Xavier, Azpúrua, Héctor, Freitas, Gustavo and Miola, Wilson
    In Simpósio Brasileiro de Automação Inteligente 2017
  11. SBAI
    Metodologia Para Avaliação De Interfaces De Teleoperação
    Fidêncio, Aline Xavier, Ferreira, Jhony Alan Tavares, Freitas, Gustavo, Monteiro, Paulo Marcos De Barros, Campos, Felipe Rigueira, Azpúrua, Héctor and 1 more author Fidêncio, Aline Xavier, Ferreira, Jhony Alan Tavares, Freitas, Gustavo, Monteiro, Paulo Marcos De Barros, Campos, Felipe Rigueira, Azpúrua, Héctor and Miola, Wilson
    In Simpósio Brasileiro de Automação Inteligente 2017
  12. ABM
    Robótica na Mineração
    Cota, Eduardo, Campos, Felipe Rigueira, Ferreira, Jhony Alan Tavares, Fidêncio, Aline Xavier, Rodrigues, Guilherme Brito, …, Azpúrua, Héctor and 3 more authors Cota, Eduardo, Campos, Felipe Rigueira, Ferreira, Jhony Alan Tavares, Fidêncio, Aline Xavier, Rodrigues, Guilherme Brito, Monteiro, Paulo Marcos De Barros, Azpúrua, Héctor, Freitas, Gustavo and Miola, Wilson
    In 18º Simpósio de Mineração. Anais dos Seminários de Redução, Minério de Ferro e Aglomeração. (ABMWEEK) 2017
  1. IROS
    Evaluation Methodology for Teleoperation Interfaces
    Fidêncio, Aline Xavier, Ferreira, Jhony Alan Tavares, Freitas, Gustavo, Azpúrua, Héctor, Campos, Felipe Rigueira and 2 more authors Fidêncio, Aline Xavier, Ferreira, Jhony Alan Tavares, Freitas, Gustavo, Azpúrua, Héctor, Campos, Felipe Rigueira, Monteiro, Paulo Marcos De Barros and Miola, Wilson
    In 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
  2. IROS
    Implementation of an Autonomous Mobile Platform for Loading Explosives in Mining Applications
    Ferreira, Jhony Alan Tavares, Fidêncio, Aline Xavier, Azpúrua, Héctor, Freitas, Gustavo and Miola, Wilson
    In 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)