Object Tracking and Following Robot Using Color-Based Vision Recognition for Library Environment

Ahmad Zaki Shukor, Nur Atiqa Natrah, Aine Ilina Tarmizi, Abang Ahmad Afiq, Muhammad Herman Jamaluddin, Zamre Abd Ghani, Hairol Nizam Mohd Shah, Mohd Zamzuri Ab Rashid


In the current era of Industrial Revolution 4.0, many robots are expected to co-exist and assist humans, in different environments. It would be a common scene that years from now, service robots follow humans to help us in our everyday work. Researchers investigated various methods and techniques for a mobile robot to track and follow objects or humans. Our proposed method was to use a color-recognition scheme and decide on the motion of the robot based on pixel value (which represents area) of the identified object. The robot will move towards the object if the pixel value is lower than a threshold value (an indication of a distant object), move away if the pixel value is higher than a threshold value (the object too close) or stay still if the pixel value is within these two values. Implementation on a library environment shows the success of the algorithm, with only around average 4cm deviation from the 10 trials tested. The significance of the findings is that the robot is able to maintain its distance from the object, thus avoiding from colliding with the object or being too far from the object.


Following Robot; HSV; Image Processing; Object Tracking; Vision-Based Recognition;

Full Text:



S. Afghani, M. I. Javed, “Follow Me Robot using Infrared Beacons”, Academic Research International, pp 63-72, Vol. 4, May 2013

A. Leigh, J. Pineau, N. Olmedo, and H. Zhang, “Person Tracking and Following with 2D Laser Scanners”, Robotics and Automation (ICRA), 2015 IEEE International Conference, 26-30 May 2015

S. Frintrop, A. Konigs, F. Hoeller, and D. Schulz, “Visual Person Tracking Using a Cognitive Observation Model,” Proceedings of the IEEE ICRA, May 2009

D. Sanjay, P. R. Kumar and T. S. Savithri, “Fuzzy Control for Person Follower FPGA based Robotic System”, Indian Journal of Science and Technology, Vol 8(23, pp 1-5, September 2015

E. Petrović, A. Leu, D. R. Durrant and V. Nikolić, “Stereo VisionBased Human Tracking for Robotic Follower”, International Journal of Advanced Robotic System, Vol. 10, pp 1-10, 13 Feb 2016.

G. Doisy, A. Jevti´, E. Lucet and Y. Edan, “Adaptive Person-Following Algorithm Based on Depth Images and Mapping”, International Conference on Intelligent Robots and Systems, IROS 2012, Oct 7-12 2012

M. N. A. Bakar and A. R. M. Saad, “A Monocular Vision-based Specific Person Detection System for Mobile Robot Applications”, International Symposium on Robotics and Intelligent Sensors 2012, pp 22-31, 2012

M. S. Sefat, D. K. Sarker and M. Shahjahan, “Design and Implementation of a Vision Based Intelligent Object Follower Robot,” The 9th International Forum on Strategic Technology (IFOST), pp 425- 428, October 2014

X. Chen and Y. Jia, “Adaptive leader-follower formation control of non-holonomic mobile robots using active vision”, IET Journal The Institution of Engineering and Technology, Vol. 9, Iss. 8, pp. 1302– 1311, 2015

I. T. Ciric, Z. M Cojbasic, V. D. Nikolic, T. S. Igic and B. A. J. Tursnek, “Intelligent Optimal Control of Thermal Vision-based PersonFollowing Robot Platform”, Thermal Science, Vol. 18, No. 3, pp 657- 966, 2014

G. Cu1, A. G. Ang, A. R. Ballesteros, and J. C. Rentoy, “HUMAN FOLLOWING ROBOT USING KINECT SENSOR”, Presented at the Research Congress 2013, pp 1-7, March 7-9, 2013

A. Troppan, E. Guerreiro, F. Celiberti, G. Santos, A. Ahmad, P.U. Lima, “Unknown-Color Spherical Object Detection and Tracking”, 2013 13th International Conference on Autonomous Robot Systems (Robotica), April 2013.


  • There are currently no refbacks.

Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.

ISSN: 2180-1843

eISSN: 2289-8131