Downloads & Projects

In here you find some of the files and projects we've released so far.



The Text 2.0 Framework

The Text 2.0 Framework, enables you to write gaze active applications for your favorite browser using simple web tools.

It is based on open standards like HTML, CSS and JavaScript, and, given you know how to do web development, it has almost no learning curve. Like PEEP, the project is open source and comes with a number of extra tools and features.

Use the button to get it directly and don't forget to look at the project page as well.



The PEEP Project

The Processing Easy Eye Tracker Plugin, or PEEP for short, is probably the easiest way you can find to develop beautifully looking eye tracker applications. It is built on top of Processing's simplicity and enhances it with real time tracking input.

With just a few lines of code you can facilitate the user's gaze and head position to create interactive, standalone tracking apps on Windows, Mac and Linux. And even if you don't have a tracker yet, PEEP comes with a simulator to help you out. This means you can start developing your apps on any computer and move to a tracker later on without altering a single line of code.

Oh, and it's free by the way ;-)

You can it directly, but you can also have a look at the project page first.



Papers & Presentations (Peer Reviewed)

Towards Robust Gaze-Based Objective Quality Measures for Text

An increasing amount of text is being read digitally. In this pa- per we explore how eye tracking devices can be used to aggregate reading data of many readers in order to provide authors and editors with objective and implicitly gathered quality feedback. We present a robust way to jointly evaluate the gaze data of multiple readers, with respect to various reading-related features. We conducted an experiment in which a group of high school students composed ...

Presented at Seventh ACM Symposium on Eye Tracking Research & Applications, ETRA 2012
Download Paper




A Robust Realtime Reading-Skimming Classifier

In this paper we propose a method for constructing and training a classifier that is able to robustly distinguish reading from skimming patterns. It operates in real time, considering a window of saccades and computing features such as the average forward speed and angularity. The algorithm inherently deals with distorted eye tracking data and pro- vides a robust, linear classification into the two classes read and skimmed. It facilitates reaction times of 750ms on average, ...

Presented at Seventh ACM Symposium on Eye Tracking Research & Applications, ETRA 2012
Download Paper




Reading and Estimating Gaze on Smart Phones

While lots of reading happens on mobile devices, little research has been performed on how the reading-interaction actually takes place. Therefore we describe our findings on a study conducted with 18 users which were asked to read a number of texts while their touch and gaze data was being recorded. We found three reader types and identified their preferred alignment of text on the screen. Based on our findings we are ...

Presented at Seventh ACM Symposium on Eye Tracking Research & Applications, ETRA 2012
Download Paper




Universal Eye-Tracking Based Text Cursor Warping

In this paper we present an approach to build an eye-tracking based text cursor placement system. When triggered, the system employs a computer vision based analysis of the screen’s content around the current gaze position to find the most likely designated gaze target. Eventually it synthesizes a mouse event at that position, allowing for a rapid text cursor repositioning even in applications which do not support eye tracking explicitly ...

Presented at Seventh ACM Symposium on Eye Tracking Research & Applications, ETRA 2012
Download Paper




Emotional Text Tagging

We created and evaluated a system capable of observing the reader’s emotions and tag the perused text. By using either a web camera or an Emotiv neuroheadset displayed emotions like happiness, interest, boredom and doubt can be recorded. At the same time an eye tracker analyzes the reader’s progress. According to the reader’s current reading position in the text and the displayed emotions, the text ...

Presented at 2nd Workshop on Eye Gaze in Intelligent Human Machine Interaction, IUI 2011
Download Paper




The eyePad - Tom Riddle in the 21st Century

We created a multimodal book reader combining eye track- ing, handwriting and speech I/O in a novel storytelling con- cept. We present a number of scenarios integrated in an ad- hoc story to demonstrate new human-text interaction tech- niques and reading assists, and report on our user study con- ducted to evaluate the prototype in the real world. Our re- sults show that the new reading assists were invariably re- ported as being helpful and entertaining.

Presented at 2nd Workshop on Eye Gaze in Intelligent Human Machine Interaction, IUI 2011
Download Paper




Text 2.0

We discuss the idea of text responsive to reading and argue that the combination of eye tracking ...

Presented at CHI 2010, April 10–15, 2010, Atlanta, USA.
Download Paper




Eye Tracking Analysis of Preferred Reading Regions on the Screen

We report on an exploratory study analyzing preferred reading regions on a monitor using eye tracking ...

Presented at CHI 2010, April 10–15, 2010, Atlanta, USA.
Download Paper




The Text 2.0 Framework

We created a simple-to-use framework to construct gaze-responsive applications using web technology focussing on text. A plugin enables any compatible browser to interpret a new set of gaze handlers that behave similar to existing HTML and JavaScript mouse and keyboard event facilities. Keywords like onFixation, onGazeOver, and onRead can be attached ...

Presented at International IUI 2010 Workshop on Eye Gaze in Intelligent Human Machine Interaction.

Download Paper / Download Slides





The eyeBook

A rapid development of eye tracking technology has been observed in recent years. Today’s eye trackers can determine the current focus point of the eye precisely while being relatively unobtrusive in their application. Also, a variety of research and commercial groups has been working on this technology, and there is a growing interest for such devices on the market. Eye tracking has great potential and it can be assumed ...

Published in Informatik Spektrum

Obtain Paper





Segment-Level Display Time as Implicit Feedback: A Comparison to Eye Tracking

We examine two basic sources for implicit relevance feed- back on the segment level for search personalization: eye tracking and display time. A controlled study has been con- ducted where 32 participants had to view documents in front of an eye tracker, query a search engine, and give explicit relevance ratings for the results. We examined the perfor- mance of the basic implicit feedback methods with respect to improved ...

Presented at SIGIR’09, July 19–23, 2009, Boston, Massachusetts, USA

Download Paper





Eye Movements as Implicit Relevance Feedback

Reading detection is an important step in the process of automatic relevance feedback generation based on ...

Presented at CHI 2008, April 5–10, 2008, Florence, Italy.
Download Paper




Query Expansion Using Gaze-Based Feedback on the Subdocument Level

We examine the effect of incorporating gaze-based attention feedback from the user on personalizing the search process. Employing eye tracking data, we keep track of document parts the user read in some way. We use this information on the subdocument level as implicit feedback for query expansion and reranking ...

Presented at SIGIR’08, July 20–24, 2008, Singapore.

Download Paper





Generating and Using Gaze-Based Document Annotations

In this paper we describe a prototypical system that is able to generate document annotations based ...

Presented at CHI 2008, April 5–10, 2008, Florence, Italy.
Download Paper






Theses (Internally Reviewed)

EEG Signal Processing and Emotiv’s Neuro Headset

Recently, there has been a growing interest in employing electroencephalographs(EEGs) for human-computer-interfaces as the prices for low-cost EEGs have been fallen to a level that makes them affordable for consumers. In this thesis a general introduction to the topic of EEG, data-acquisition and processing of the EEG-signal will be given. Special attention will be paid to artifact and noise. Two different experiments will be presented: In the first the Epoc’s applicability to the P300 speller(a method that allows users to spell by using their mind) and more generally event-related potentials was studied. ...

Download Document






Misc Presentations (Not Reviewed)

Text 2.0 - Eine Einführung

Stellen Sie sich vor, Ihr Buch weiß, wo Sie lesen. Genau passend zur gerade betrachteten Stelle werden untermalende Musik, Geräuscheffekte, Bilder oder Hintergrundthemen eingeblendet ...

Download Document






For the Press

All material within this section is licensed as cc-by. If technically possible, please give credit to the DFKI when them.