Object Category Understanding via Eye Fixations on Freehand Sketches

Sarvadevabhatla, Ravi Kiran and Suresh, Sudharshan and Babu, RV (2017) Object Category Understanding via Eye Fixations on Freehand Sketches. In: IEEE TRANSACTIONS ON IMAGE PROCESSING, 26 (5). pp. 2508-2518.

PDF Iee_Tra_Ima_Pro_26-5_2508_2017.pdf - Published Version Restricted to Registered users only Download (1MB) | Request a copy

Abstract

The study of eye gaze fixations on photographic images is an active research area. In contrast, the image sub-category of freehand sketches has not received as much attention for such studies. In this paper, we analyze the results of a free-viewing gaze fixation study conducted on 3904 freehand sketches distributed across 160 object categories. Our analysis shows that fixation sequences exhibit marked consistency within a sketch, across sketches of a category and even across suitably grouped sets of categories. This multi-level consistency is remarkable given the variability in depiction and extreme image content sparsity that characterizes hand-drawn object sketches. In this paper, we show that the multi-level consistency in the fixation data can be exploited to 1) predict a test sketch's category given only its fixation sequence and 2) build a computational model which predicts part-labels underlying fixations on objects. We hope that our findings motivate the community to deem sketch-like representations worthy of gaze-based studies vis-a-vis photographic images.

Item Type:	Journal Article
Publication:	IEEE TRANSACTIONS ON IMAGE PROCESSING
Publisher:	IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC, 445 HOES LANE, PISCATAWAY, NJ 08855-4141 USA
Additional Information:	Copy right for this article belongs to the IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC, 445 HOES LANE, PISCATAWAY, NJ 08855-4141 USA
Department/Centre:	Division of Interdisciplinary Sciences > Computational and Data Sciences
Date Deposited:	20 May 2017 06:09
Last Modified:	25 Feb 2019 05:53
URI:	http://eprints.iisc.ac.in/id/eprint/56937

Actions (login required)

View Item