Real-time kinect fingers tracking and recognition for servo gripper controller

The conventional method to control something like machines such as remote controllers or wearable sensors have its limitation and cannot cater the high demands in some scenarios. To overcome this situation, a real-time Kinect finger tracking and recognition is developed to control a servo gripper vi...

Full description

Bibliographic Details
Main Authors:	Rosdiyana, Samad, Lim, Siong Hee, Mahfuzah, Mustafa, Pebrianti, Dwi, Nor Rul Hasma, Abdullah, Nurul Hazlina, Noordin
Format:	Article
Language:	English
Published:	UTeM 2018
Subjects:	TK Electrical engineering. Electronics Nuclear engineering
Online Access:	http://umpir.ump.edu.my/id/eprint/21040/ http://umpir.ump.edu.my/id/eprint/21040/ http://umpir.ump.edu.my/id/eprint/21040/1/Real-time%20kinect%20fingers%20tracking%20and%20recognition%20for%20servo%20gripper%20controller.pdf

id	ump-21040
recordtype	eprints
spelling	ump-210402018-08-27T02:41:42Z http://umpir.ump.edu.my/id/eprint/21040/ Real-time kinect fingers tracking and recognition for servo gripper controller Rosdiyana, Samad Lim, Siong Hee Mahfuzah, Mustafa Pebrianti, Dwi Nor Rul Hasma, Abdullah Nurul Hazlina, Noordin TK Electrical engineering. Electronics Nuclear engineering The conventional method to control something like machines such as remote controllers or wearable sensors have its limitation and cannot cater the high demands in some scenarios. To overcome this situation, a real-time Kinect finger tracking and recognition is developed to control a servo gripper via a single board microcontroller, Arduino. This paper presents hand and finger tracking method that can determine the number of fingers and also the angle of the finger’s position. The hand gesture is captured by the Kinect and go through a series of image processing and finally, the information will send to the Arduino. The image processing method includes a detection of hand using depth sensor on the Kinect, then finds the finger and calculates the angle of the finger’s position. The convex hull algorithm is used to represent the region of the hand. The fingertips are recognized by calculating the angle of the fingertip and each angle is compared with threshold angle. The orientation and position of the fingers are obtained by finding the middle line of the finger and compares to the vertical line of the middle finger, then calculates the angle. The result shows that the number of fingers appeared in the display can be recognized and the orientation and position of each finger can be determined. A gripper also able to react simultaneously (open and close) based on the detected finger. UTeM 2018 Article PeerReviewed pdf en cc_by http://umpir.ump.edu.my/id/eprint/21040/1/Real-time%20kinect%20fingers%20tracking%20and%20recognition%20for%20servo%20gripper%20controller.pdf Rosdiyana, Samad and Lim, Siong Hee and Mahfuzah, Mustafa and Pebrianti, Dwi and Nor Rul Hasma, Abdullah and Nurul Hazlina, Noordin (2018) Real-time kinect fingers tracking and recognition for servo gripper controller. Journal of Telecommunication, Electronic and Computer Engineering, 10 (1-2). pp. 155-160. ISSN 2180-1843 (Print); 2289-8131 (Online) http://journal.utem.edu.my/index.php/jtec/article/view/3345/2421
repository_type	Digital Repository
institution_category	Local University
institution	Universiti Malaysia Pahang
building	UMP Institutional Repository
collection	Online Access
language	English
topic	TK Electrical engineering. Electronics Nuclear engineering
spellingShingle	TK Electrical engineering. Electronics Nuclear engineering Rosdiyana, Samad Lim, Siong Hee Mahfuzah, Mustafa Pebrianti, Dwi Nor Rul Hasma, Abdullah Nurul Hazlina, Noordin Real-time kinect fingers tracking and recognition for servo gripper controller
description	The conventional method to control something like machines such as remote controllers or wearable sensors have its limitation and cannot cater the high demands in some scenarios. To overcome this situation, a real-time Kinect finger tracking and recognition is developed to control a servo gripper via a single board microcontroller, Arduino. This paper presents hand and finger tracking method that can determine the number of fingers and also the angle of the finger’s position. The hand gesture is captured by the Kinect and go through a series of image processing and finally, the information will send to the Arduino. The image processing method includes a detection of hand using depth sensor on the Kinect, then finds the finger and calculates the angle of the finger’s position. The convex hull algorithm is used to represent the region of the hand. The fingertips are recognized by calculating the angle of the fingertip and each angle is compared with threshold angle. The orientation and position of the fingers are obtained by finding the middle line of the finger and compares to the vertical line of the middle finger, then calculates the angle. The result shows that the number of fingers appeared in the display can be recognized and the orientation and position of each finger can be determined. A gripper also able to react simultaneously (open and close) based on the detected finger.
format	Article
author	Rosdiyana, Samad Lim, Siong Hee Mahfuzah, Mustafa Pebrianti, Dwi Nor Rul Hasma, Abdullah Nurul Hazlina, Noordin
author_facet	Rosdiyana, Samad Lim, Siong Hee Mahfuzah, Mustafa Pebrianti, Dwi Nor Rul Hasma, Abdullah Nurul Hazlina, Noordin
author_sort	Rosdiyana, Samad
title	Real-time kinect fingers tracking and recognition for servo gripper controller
title_short	Real-time kinect fingers tracking and recognition for servo gripper controller
title_full	Real-time kinect fingers tracking and recognition for servo gripper controller
title_fullStr	Real-time kinect fingers tracking and recognition for servo gripper controller
title_full_unstemmed	Real-time kinect fingers tracking and recognition for servo gripper controller
title_sort	real-time kinect fingers tracking and recognition for servo gripper controller
publisher	UTeM
publishDate	2018
url	http://umpir.ump.edu.my/id/eprint/21040/ http://umpir.ump.edu.my/id/eprint/21040/ http://umpir.ump.edu.my/id/eprint/21040/1/Real-time%20kinect%20fingers%20tracking%20and%20recognition%20for%20servo%20gripper%20controller.pdf
first_indexed	2023-09-18T22:30:43Z
last_indexed	2023-09-18T22:30:43Z
_version_	1777416266952212480

Real-time kinect fingers tracking and recognition for servo gripper controller

Similar Items