Document Open Access Logo

Computer Vision Integration for Automated Piece Positioning in an Industry 4.0 Setup

Authors Augusto de Souza , Alexandre dos Santos Roque , Carlos Eduardo Pereira , Edison Pignaton de Freitas

PDF HTML 5

Files

Thumbnail PDF
PDF
OASIcs.NG-RES.2026.1.pdf
  • Filesize: 1.82 MB
  • 11 pages
HTML5 Logo HTML (experimental)
OASIcs.NG-RES.2026.1.html

Document Identifiers

Subject Classification

ACM Subject Classification
  • Applied computing → Industry and manufacturing
Keywords
  • Industry 4.0
  • Automation
  • Vision systems
  • Piece positioning
  • Servo motors

Metrics

Abstract

This paper presents the design and development of an alternative, cost-effective automated piece positioning system, specifically tailored for Small and Medium-sized Enterprises (SMEs), which integrates computer vision with EtherCAT-controlled servo motors. The proposed method combines a robust vision system with an AI-enhanced algorithm based on edge detection to precisely identify object contours. This enables a Programmable Logic Controller (PLC) to control the servo motor, adjusting the piece’s angle with high accuracy. Experimental results demonstrate the solution’s practical viability, achieving a minimal angular oscillation of less than 0.0012° and a promising low image processing time of approximately 20ms, showcasing its potential for enhancing manufacturing efficiency and quality in industrial applications.

Cite As Get BibTex

Augusto de Souza, Alexandre dos Santos Roque, Carlos Eduardo Pereira, and Edison Pignaton de Freitas. Computer Vision Integration for Automated Piece Positioning in an Industry 4.0 Setup. In 7th Workshop on Next Generation Real-Time Embedded Systems (NG-RES 2026). Open Access Series in Informatics (OASIcs), Volume 140, pp. 1:1-1:11, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2026) https://doi.org/10.4230/OASIcs.NG-RES.2026.1

Author Details

Augusto de Souza
  • Federal University of Rio Grande do Sul - UFRGS, Porto Alegre, Brazil
Alexandre dos Santos Roque
  • School of Information Technology, Halmstad University, Sweden
  • Regional Integrated University of High Uruguay and Missions, Santo Ângelo, Brazil
Carlos Eduardo Pereira
  • Federal University of Rio Grande do Sul - UFRGS, Porto Alegre, Brazil
Edison Pignaton de Freitas
  • School of Information Technology, Halmstad University, Sweden
  • Federal University of Rio Grande do Sul - UFRGS, Porto Alegre, Brazil

Acknowledgements

This study was financed in part by the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior - Brasil (CAPES) - Finance Code 001, and by the ELLITT Strategic Research Network, Sweden.

References

  1. Maxim Ya Afanasev, Yuri V Fedosov, Yuri S Andreev, Anastasiya A Krylova, Sergey A Shorokhov, Kseniia V Zimenko, and Mikhail V Kolesnikov. Machine vision for auto positioning in the modular industrial equipment: A case study. In IEEE Conf on Industrial Cyberphysical Systems (ICPS), volume 1, pages 223-229. IEEE, 2020. URL: https://doi.org/10.1109/ICPS48405.2020.9274689.
  2. Adem Candemir and Fatih Cemal Can. Pick &place task implementation of a scara manipulator via robot operating system and machine vision. International Journal of Mechanical Engineering, ISSN: 0974-5823, 7(6):420-430, 2022. Google Scholar
  3. Shuaihua Chen. Research and practice of industrial sorting technology based on machine vision. In 2021 6th International Conference on Intelligent Computing and Signal Processing (ICSP), pages 1075-1078. IEEE, 2021. URL: https://doi.org/10.1109/ICSP51882.2021.9408646.
  4. Oto Haffner, Erik Kučera, and Danica Rosinová. Applications of machine learning and computer vision in Industry 4.0, 2024. URL: https://doi.org/10.3390/app14062431.
  5. Darko Hercog, Primož Bencak, Uroš Vincetič, and Tone Lerher. Product assembly assistance system based on pick-to-light and computer vision technology. Sensors, 22(24):9769, 2022. URL: https://doi.org/10.3390/s22249769.
  6. Nian-Ze Hu, Qi-Ren Lin, Ruo-Wei Wu, You-Xing Zeng, Bo-An Lin, Shang-Wei Liu, Kai-Hsun Hsu, Jeng-Dao Lee, Ying-Hsiu Hung, and Chun-Min Tsai. Develop an intelligent robotic arm grasp and control system capable of determining the angle of objects. In 2022 IEEE 4th Eurasia Conference on IOT, Communication and Engineering (ECICE), pages 582-584. IEEE, 2022. URL: https://doi.org/10.1109/ECICE55674.2022.10042951.
  7. Yiren Huang, Weidong Hao, Zhihao Wang, and Hao Wu. Engineering applications based on Industrial robots and machine vision. In Int Conf on Image Proc, Computer Vision and Machine Learning (ICICML), pages 496-500. IEEE, 2022. URL: https://doi.org/10.1109/ICICML57342.2022.10009862.
  8. Sudhanshu Joshi, Manu Sharma, Shalini Bartwal, Tanuja Joshi, and Mukesh Prasad. Critical challenges of integrating opex strategies with i4. 0 technologies in manufacturing SMEs: A few pieces of evidence from developing economies. The TQM Journal, 36(1):108-138, 2024. URL: https://doi.org/10.1108/TQM-08-2022-0245.
  9. Fotios K Konstantinidis, Spyridon G Mouroutsos, and Antonios Gasteratos. The role of machine vision in Industry 4.0: an automotive manufacturing perspective. In 2021 IEEE International Conference on imaging systems and techniques (IST), pages 1-6. IEEE, 2021. URL: https://doi.org/10.1109/IST50367.2021.9651453.
  10. Paulo Leitão, Flávia Pires, Stamatis Karnouskos, and Armando Walter Colombo. Quo vadis Industry 4.0? position, trends, and challenges. IEEE Open Journal of the Industrial Electronics Society, 1:298-310, 2020. URL: https://doi.org/10.1109/OJIES.2020.3031660.
  11. Mingfei Li, Haibin Liu, Donglai Xu, and Chaowei Lu. Research on the mechanical zero position capture and transfer of steering gear based on machine vision. In 2021 2nd International Symposium on Computer Engineering and Intelligent Communications (ISCEIC), pages 1-6. IEEE, 2021. URL: https://doi.org/10.1109/ISCEIC53685.2021.00008.
  12. Yifan Li, Yingchun Niu, Yang Liu, Li Zheng, Zichen Wang, and Wenming Zhe. Computer vision based conveyor belt congestion recognition in logistics industrial parks. In 2021 26th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA), pages 1-8. IEEE, 2021. URL: https://doi.org/10.1109/ETFA45728.2021.9613245.
  13. Zorana Mandić, Stevan Stankovski, Gordana Ostojić, and Božidar Popović. Potential of edge computing PLCs in Industrial automation. In 2022 21st International Symposium INFOTEH-JAHORINA (INFOTEH), pages 1-5. IEEE, 2022. URL: https://doi.org/10.1109/INFOTEH53737.2022.9751324.
  14. Phansak Nerakae, Pichitra Uangpairoj, and Kontorn Chamniprasart. Using machine vision for flexible automatic assembly system. Procedia Computer Science, 96:428-435, 2016. URL: https://doi.org/10.1016/j.procs.2016.08.090.
  15. OMRON. Technology overview pattern matching algorithm shape search III. Technical report, SAE Technical Paper, 2013. Google Scholar
  16. E Reinhard and S Abdoli. Smart pick and place as an application of digital transformation in small and medium-sized enterprises (SMEs). In 2024 IEEE International Conference on Industrial Engineering and Engineering Management (IEEM), pages 989-993. IEEE, 2024. URL: https://doi.org/10.1109/IEEM62345.2024.10857002.
  17. Ismail Rokhim, Nur Jamiludin Ramadhan, and Tazkia Rusdiana. Image processing based ur5e manipulator robot control in pick and place application for random position and orientation of object. In 2021 3rd International Symposium on Material and Electrical Engineering Conference (ISMEE), pages 124-130. IEEE, 2021. URL: https://doi.org/10.1109/ISMEE54273.2021.9774170.
  18. Alexandre dos Santos Roque, Daniel Pohren, Edison Pignaton Freitas, and Carlos Eduardo Pereira. An approach to address safety as non-functional requirements in distributed vehicular control systems. Journal of Control, Automation and Electrical Systems, 30(5):700-715, 2019. Google Scholar
  19. Alexandre S Roque, Vinicius W Krebs, Iuri Castro Figueiro, and Nasser Jazdi. An analysis of machine learning algorithms in rotating machines maintenance. IFAC-PapersOnLine, 55(2):252-257, 2022. URL: https://doi.org/10.1016/j.ifacol.2022.04.202.
  20. Jian Wang, Heyang Xu, and Ziting Chen. Vision-based conveyor belt workpiece grabbing using the SCARA robotic arm. In 2022 International Conference on Machine Learning, Control, and Robotics (MLCR), pages 172-176. IEEE, 2022. URL: https://doi.org/10.1109/MLCR57210.2022.00039.
  21. Astrid Weiss, Ann-Kathrin Wortmeier, and Bettina Kubicek. Cobots in Industry 4.0: A roadmap for future practice studies on human-robot collaboration. IEEE Transactions on Human-Machine Systems, 51(4):335-345, 2021. URL: https://doi.org/10.1109/THMS.2021.3092684.
  22. Longfei Zhou, Lin Zhang, and Nicholas Konz. Computer vision techniques in manufacturing. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 53(1):105-117, 2022. URL: https://doi.org/10.1109/TSMC.2022.3166397.
Any Issues?
X

Feedback on the Current Page

CAPTCHA

Thanks for your feedback!

Feedback submitted to Dagstuhl Publishing

Could not send message

Please try again later or send an E-mail
© 2023-2025 Schloss Dagstuhl – LZI GmbH About DROPS Imprint Privacy Contact