Academia.eduAcademia.edu

Outline

Microsoft Kinect V2 vision system in a manufacturing application

2017, Robotics and Computer-Integrated Manufacturing

https://doi.org/10.1016/J.RCIM.2017.04.001

Abstract

In this paper an application for the Kinect V2 sensor is described in the robotic field. The sensor is used as a vision device for detecting position, shape and dimensions of an object on the working space of a robot in order to planning the end effector path. The algorithms used for the recognition of contour and spatial position of planar shapes are described. The technique adopted for the recognition of 3D objects are presented. The first results provided by a prototype of gluing robot for the bonding of leather patches and shoe soles are presented. The results confirm the possibility of using the Kinect V2 sensor as an alternative to the well consolidated 3D measuring devices which are definitely more accurate, but also much more expensive.

References (26)

  1. A. Kolb, E. Barth, R. Koch, R. Larsen, Time-of-flight sensors in computer graphics, Proc. Eurographics (2009) 119-134.
  2. L. Yang, L. Zhang, H. Dong, A. Alelaiwi, A. El Saddik, Evaluating and Improving the depth accuracy of Kinect for windows v2, IEEE Sens. J. 15 (8) (2015).
  3. M. Gabel, R. Gilad-Bachrach, E. Renshaw, A. Schuster, Full body gait analysis with Kinect, in: Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, San Diego, CA, 2012, pp. 1964-1967. http://dx.doi.org/10.1109/EMBC.2012.6346340.
  4. B. Lange, et al., Interactive game-based rehabilitation using the Microsoft Kinect, IEEE Virtual Reality Workshops (VRW), Costa Mesa, CA, 2012,pp. 171-172. http://dx.doi.org/10.1109/VR.2012.6180935.
  5. N. Kitsunezaki, E. Adachi, T. Masuda, J.i. Mizusawa, KINECT applications for the physical rehabilitation, IEEE International Symposium on Medical Measurements and Applications (MeMeA), Gatineau, QC, 2013, pp. 294-299. http://dx.doi.org/ 10.1109/MeMeA.2013.6549755.
  6. T. Dutta, Evaluation of the kinect sensor for 3-D kinematic measurement in the workplace, Appl. Ergon. 43 (2012) 645-649.
  7. I. Weerasinghe, J. Ruwanpura, J. Boyd, A. Habib, Application of microsoft kinect sensor for tracking construction workers, Construction Research Congress, 2012, pp. 858-867. doi: http://dx.doi.org/10.1061/9780784412329.087.
  8. Z. Zhang, M. Zhang, Y. Chang, A. El-Sayed, S.K. Esche, C. Chassapis, Real-Time 3D model reconstruction and interaction using kinect for a game-based virtual laboratory, in: Proceedings of the ASME International Mechanical Engineering Congress and Exposition, Volume 5: Education and Globalization, San Diego, California, USA, 15-21 November 2013..
  9. L. Cruz, D. Lucio, L. Velho, Kinect and RGBD images: Challenges and applications, in: Proceedings of the 25th SIBGRAPI Conference, Aug. 2012, pp. 36-49.
  10. H. Richards-Rissetto, F. Remondino, G. Agugiaro, J. von Schwerin, J. Robertsson, G. Girardi, "Kinect and 3D GIS in archaeology", in: F. Ferrise (ed.) , Poceedings of the 18th International Conference on Virtual Systems and Multimedia, pp 331- 337.
  11. S. Izadi, D. Kim, O. Hilliges, D. Molyneaux, R. Newcombe, P. Kohli, J. Shotton, S. Hodges, D. Freeman, A. Davison, KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera, in: Proceedings of the Symposium on User Interface Software and Technology (UIST). 5, 2011.
  12. G. Du, P. Zhang, Markerless human-robot interface for dual robot manipulators using kinect sensor, Robot. Comput.-Integr. Manuf. 30 (2014) 150-159.
  13. Zolkiewski, S., Pioskowik, D., Robot control and online programming by human gestures using a kinect motion sensor. Advances in Intelligent Systems and Computing. New Perspectives in Information Systems and Technologies 275, 2014, pp. 593-605.
  14. R.A. El-laithy, J. Huang, M. Yeh, Study on the use of Microsoft Kinect for robotics applications, in: Proceedings of the 2012 IEEE/ION Position, Location and Navigation Symposium, Myrtle Beach, SC, 2012, pp. 1280-1288, doi: 10.1109/ PLANS.2012.6236985.
  15. E. Machida, M. Cao, T. Murao, H. Hashimoto, Human motion tracking of mobile robot with Kinect 3D sensor, in: Proceedings of the SICE Annual Conference (SICE), Akita, 2012, pp. 2207-2211.
  16. Z.-R. Robust kinect-based guidance and positioning of a multidirectional robot by Log-ab recognition, Expert Syst. Appl. 41 (2014) 1271-1282.
  17. B. Lau, C. Sprunk, W. Burgard, Efficient grid-based spatial representations for robot navigation in dynamic environments, Robot. Auton. Syst. 61 (2013) 1116-1130.
  18. K.Berger, S. Meister, R. Nair, D. Kondermann, A state of the art report on kinect sensor setups in computer vision. Time-of-Flight and Depth Imaging. Sensors, Algorithms, and Applications, Vol. 8200 of the series Lecture Notes in Computer Science, 2013, pp 257-272.
  19. B. Galna, G. Barry, D. Jackson, D. Mhiripiri, P. Olivier, L. Rochester, Accuracy of the Microsoft Kinect sensor for measuring movement in people with Parkinson's disease, Gait Posture 39 (4) (2014) 1062-1068.
  20. C. Raposo, J. P. Barreto, U. Nunes, Fast and accurate calibration of a Kinect sensor, in: Proceedings of the International Conference on 3D Vision, Jun./Jul. 2013, pp. 342-349.
  21. K. Khoshelham, S.O. Elberink, Accuracy and resolution of Kinect depth data for indoor mapping applications, Sensors 12 (2) (2012) 1437-1454.
  22. K. Khoshelham, Accuracy analysis of Kinect depth data, in Proceedings of International Society of Photogrammetry and Remote Sensing. Workshop Laser Scanning, 2011, pp. 133-138.
  23. H. Gonzalez-Jorge, B. Riveiro, E. Vazquez-Fernandez, J. Martnez-Snchez, P. Arias, Metrological evaluation of microsoft kinect and asus xtion sensors, Measurement 46 (2013) 1800-1806.
  24. E. Lachat, H. Macher, M.-A. Mittet, T. Landes, P. Grussenmeyer, First experiences with Kinect V2 sensor for close range 3D modeling, Int. Arch. Photogramm., Remote Sens. Spat. Inf. Sci. Volume XL-5/W4 (2015).
  25. Microsoft, Kinect for Windows Features. Kinect for Windows Features. Web. 31 Mar. 2015.
  26. Microsoft, Kinect for Windows SDK, Kinect for Windows SDK. Web. 31 Mar. 2015.