ePrints@IIScePrints@IISc Home | About | Browse | Latest Additions | Advanced Search | Contact | Help

Object Category Understanding via Eye Fixations on Freehand Sketches

Sarvadevabhatla, Ravi Kiran and Suresh, Sudharshan and Babu, RV (2017) Object Category Understanding via Eye Fixations on Freehand Sketches. In: IEEE TRANSACTIONS ON IMAGE PROCESSING, 26 (5). pp. 2508-2518.

[img] PDF
Iee_Tra_Ima_Pro_26-5_2508_2017.pdf - Published Version
Restricted to Registered users only

Download (1MB) | Request a copy
Official URL: http://dx.doi.org/10.1109/TIP.2017.2675539

Abstract

The study of eye gaze fixations on photographic images is an active research area. In contrast, the image sub-category of freehand sketches has not received as much attention for such studies. In this paper, we analyze the results of a free-viewing gaze fixation study conducted on 3904 freehand sketches distributed across 160 object categories. Our analysis shows that fixation sequences exhibit marked consistency within a sketch, across sketches of a category and even across suitably grouped sets of categories. This multi-level consistency is remarkable given the variability in depiction and extreme image content sparsity that characterizes hand-drawn object sketches. In this paper, we show that the multi-level consistency in the fixation data can be exploited to 1) predict a test sketch's category given only its fixation sequence and 2) build a computational model which predicts part-labels underlying fixations on objects. We hope that our findings motivate the community to deem sketch-like representations worthy of gaze-based studies vis-a-vis photographic images.

Item Type: Journal Article
Publication: IEEE TRANSACTIONS ON IMAGE PROCESSING
Publisher: IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC, 445 HOES LANE, PISCATAWAY, NJ 08855-4141 USA
Additional Information: Copy right for this article belongs to the IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC, 445 HOES LANE, PISCATAWAY, NJ 08855-4141 USA
Department/Centre: Division of Interdisciplinary Sciences > Computational and Data Sciences
Date Deposited: 20 May 2017 06:09
Last Modified: 25 Feb 2019 05:53
URI: http://eprints.iisc.ac.in/id/eprint/56937

Actions (login required)

View Item View Item