Share Email Print

Proceedings Paper

Hands-free interactive image segmentation using eyegaze
Author(s): M. Sadeghi; G. Tien; G. Hamarneh; M. S. Atkins M.D.
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

This paper explores a novel approach to interactive user-guided image segmentation, using eyegaze information as an input. The method includes three steps: 1) eyegaze tracking for providing user input, such as setting object and background seed pixel selection; 2) an optimization method for image labeling that is constrained or affected by user input; and 3) linking the two previous steps via a graphical user interface for displaying the images and other controls to the user and for providing real-time visual feedback of eyegaze and seed locations, thus enabling the interactive segmentation procedure. We developed a new graphical user interface supported by an eyegaze tracking monitor to capture the user's eyegaze movement and fixations (as opposed to traditional mouse moving and clicking). The user simply looks at different parts of the screen to select which image to segment, to perform foreground and background seed placement and to set optional segmentation parameters. There is an eyegaze-controlled "zoom" feature for difficult images containing objects with narrow parts, holes or weak boundaries. The image is then segmented using the random walker image segmentation method. We performed a pilot study with 7 subjects who segmented synthetic, natural and real medical images. Our results show that getting used the new interface takes about only 5 minutes. Compared with traditional mouse-based control, the new eyegaze approach provided a 18.6% speed improvement for more than 90% of images with high object-background contrast. However, for low contrast and more difficult images it took longer to place seeds using the eyegaze-based "zoom" to relax the required eyegaze accuracy of seed placement.

Paper Details

Date Published: 3 March 2009
PDF: 10 pages
Proc. SPIE 7260, Medical Imaging 2009: Computer-Aided Diagnosis, 72601H (3 March 2009); doi: 10.1117/12.813452
Show Author Affiliations
M. Sadeghi, Simon Fraser Univ. (Canada)
G. Tien, Simon Fraser Univ. (Canada)
G. Hamarneh, Simon Fraser Univ. (Canada)
M. S. Atkins M.D., Simon Fraser Univ. (Canada)

Published in SPIE Proceedings Vol. 7260:
Medical Imaging 2009: Computer-Aided Diagnosis
Nico Karssemeijer; Maryellen L. Giger, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?