The iBUG Eye Segmentation Dataset

Authors Bingnan Luo, Jie Shen, Yujiang Wang, Maja Pantic

Thumbnail PDF


  • Filesize: 1.81 MB
  • 9 pages

Document Identifiers

Author Details

Bingnan Luo
  • Intellignet Behaviour Understanding Group, Imperial College London, United Kingdom
Jie Shen
  • Intellignet Behaviour Understanding Group, Imperial College London, United Kingdom
Yujiang Wang
  • Intellignet Behaviour Understanding Group, Imperial College London, United Kingdom
Maja Pantic
  • Intellignet Behaviour Understanding Group, Imperial College London, United Kingdom

Cite AsGet BibTex

Bingnan Luo, Jie Shen, Yujiang Wang, and Maja Pantic. The iBUG Eye Segmentation Dataset. In 2018 Imperial College Computing Student Workshop (ICCSW 2018). Open Access Series in Informatics (OASIcs), Volume 66, pp. 7:1-7:9, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2019)


This paper presents the first dataset for eye segmentation in low resolution images. Although eye segmentation has long been a vital preprocessing step in biometric applications, this work is the first to focus on low resolutions image that can be expected from a consumer-grade camera under conventional human-computer interaction and / or video-chat scenarios. Existing eye datasets have multiple limitations, including: (a) datasets only contain high resolution images; (b) datasets did not include enough pose variations; (c) a utility landmark ground truth did not be provided; (d) high accurate pixel-level ground truths had not be given. Our dataset meets all the above conditions and requirements for different segmentation methods. Besides, a baseline experiment has been performed on our dataset to evaluate the performances of landmark models (Active Appearance Model, Ensemble Regression Tree and Supervised Descent Method) and deep semantic segmentation models (Atrous convolutional neural network with conditional random field). Since the novelty of our dataset is to segment the iris and the sclera areas, we evaluate above models on sclera and iris only respectively in order to indicate the feasibility on eye-partial segmentation tasks. In conclusion, based on our dataset, deep segmentation methods performed better in terms of IOU-based ROC curves and it showed potential abilities on low-resolution eye segmentation task.

Subject Classification

ACM Subject Classification
  • Computing methodologies → Image segmentation
  • dataset
  • eye
  • segmentation
  • landmark
  • pixel-level


  • Access Statistics
  • Total Accesses (updated on a weekly basis)
    PDF Downloads


  1. Michael Chau and Margrit Betke. Real time eye tracking and blink detection with usb cameras. Technical report, Boston University Computer Science Department, 2005. Google Scholar
  2. Liang-Chieh Chen, George Papandreou, Iasonas Kokkinos, Kevin Murphy, and Alan L Yuille. Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs. IEEE transactions on pattern analysis and machine intelligence, 40(4):834-848, 2018. Google Scholar
  3. Timothy F Cootes, Gareth J Edwards, and Christopher J Taylor. Active appearance models. IEEE Transactions on Pattern Analysis &Machine Intelligence, pages 681-685, 2001. Google Scholar
  4. Song Han, Huizi Mao, and William J Dally. Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding. arXiv preprint arXiv:1510.00149, 2015. Google Scholar
  5. Bruce M Hood, J Douglas Willen, and Jon Driver. Adult’s eyes trigger shifts of visual attention in human infants. Psychological Science, 9(2):131-134, 1998. Google Scholar
  6. Huaizu Jiang and Erik Learned-Miller. Face detection with the faster R-CNN. In Automatic Face &Gesture Recognition (FG 2017), 2017 12th IEEE International Conference on, pages 650-657. IEEE, 2017. Google Scholar
  7. Vahid Kazemi and Josephine Sullivan. One millisecond face alignment with an ensemble of regression trees. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 1867-1874, 2014. Google Scholar
  8. Marc Lalonde, David Byrns, Langis Gagnon, Normand Teasdale, and Denis Laurendeau. Real-time eye blink detection with GPU-based SIFT tracking. In Computer and Robot Vision, 2007. CRV'07. Fourth Canadian Conference on, pages 481-487. IEEE, 2007. Google Scholar
  9. Vuong Le, Jonathan Brandt, Zhe Lin, Lubomir Bourdev, and Thomas S Huang. Interactive facial feature localization. In European conference on computer vision, pages 679-692. Springer, 2012. Google Scholar
  10. Yuezun Li, Ming-Ching Chang, Hany Farid, and Siwei Lyu. In Ictu Oculi: Exposing AI Generated Fake Face Videos by Detecting Eye Blinking. arXiv preprint arXiv:1806.02877, 2018. Google Scholar
  11. Peter Peer. Cvl face database. Computer vision lab., faculty of computer and information science, University of Ljubljana, Slovenia. Available at http://www. lrv. fri. uni-lj. si/facedb. html, 2005. Google Scholar
  12. Jie Shen, Stefanos Zafeiriou, Grigoris G Chrysos, Jean Kossaifi, Georgios Tzimiropoulos, and Maja Pantic. The first facial landmark tracking in-the-wild challenge: Benchmark and results. In Proceedings of the IEEE International Conference on Computer Vision Workshops, pages 50-58, 2015. Google Scholar
  13. Brian A Smith, Qi Yin, Steven K Feiner, and Shree K Nayar. Gaze locking: passive eye contact detection for human-object interaction. In Proceedings of the 26th annual ACM symposium on User interface software and technology, pages 271-280. ACM, 2013. Google Scholar
  14. Qi-Chuan Tian, Quan Pan, Yong-Mei Cheng, and Quan-Xue Gao. Fast algorithm and application of hough transform in iris segmentation. In Machine Learning and Cybernetics, 2004. Proceedings of 2004 International Conference on, volume 7, pages 3977-3980. IEEE, 2004. Google Scholar
  15. Xuehan Xiong and Fernando De la Torre. Supervised descent method and its applications to face alignment. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 532-539, 2013. Google Scholar
Questions / Remarks / Feedback

Feedback for Dagstuhl Publishing

Thanks for your feedback!

Feedback submitted

Could not send message

Please try again later or send an E-mail