Unraveling Language Processing with eye-tracking

eye-tracking

welcome to our

Bilingualism & Language

processing lab

What is eye-tracking?

Simple Calendar Icon

It records eye movements (e.g., fixations and saccades) to explore cognitive processing.

Simple Minimal File Document Icon

HOW DOES EYE-TRACKING WORK?

Brushstroke Arrow Rapid Curved Long

eye-tracking: a window into the mind

Simple Calendar Icon
Loudspeaker Vector Icon for Announce in Public Media. Loud Speaker Line Symbol Illustration
Where s the baby Can you find it

(Fernald et al., 2008)

Brushstroke Arrow Rapid Small
Human Ear Vector
Buildable Abstract Character Expression Relaxed Face Open Eyes
Red Circle Marker
Red Circle Marker
Brushstroke Arrow Rapid Small
Eye movements can reveal infants linguistic knowledge

Measuring Infants’ Vocabulary

Letter a Icon
Letter B Icon

NOT know the word “baby”

>> Random looking to the two pics

Know the word “baby”

>>Preferential looking to the baby pic

eye-tracking: a window into the mind

Simple Calendar Icon
Loudspeaker Vector Icon for Announce in Public Media. Loud Speaker Line Symbol Illustration
The tourist expected rain when the sun went behind the cloud

( Ito et al., 2018)

Handdrawn Girl Looking Through a Telescope
Red Circle Marker

rain?

sun went behind?

... cloud ...

Rainy Day Weather Forecast
Eye movements can reveal intuitive behaviours like linguistic predictions

Measuring Semantic Prediction

Letter a Icon

Predict the upcoming “cloud”

>> Preferential looking to the cloud pic

Letter B Icon

NOT predict the upcoming “cloud”

>> Random looking to the four pics

Eye-tracker Setting-UP

Checkmark Sign Icon
To ensure the most accurate capture of pupils
Thumbs Down Illustration
Thumbs Down Illustration
Red Circle Marker

Threshold Too

Low: Noisy

Red Circle Marker

Threshold Too

High: Shadows

CR Smearing

Red Circle Marker
Red Pencil Cross

Poor CR

Camera Set-up

Examples of Pupil and CR

Images from SR Research

Simple Minimal Light Bulb Icon

Calibration

Good Calibration

Speech Bubble Illustration

A Heart doesn't ​shape a good ​calibration but A ​square does!

Poor Calibration

What can eye-trackers tell us?

Female User Avatar Icon

Eye movements are a combination of fixations and saccades!

Saccades can reveal information about the decision-making process, while fixation duration may indicate mental effort.

Simple Minimal Calendar Icon

Eye movements provide rich data!

Eye movement measures in the AOI

To reveal reading patterns and the cognitive processes

Scan Path

To visualize the sequence of eye movements

Heat Map

To visualize which elements draw more attention than others
Arrow Pointing Down Icon

Scan the qr code for our lab

Pair of Eyes

Bilingualism and Language ​Processing Lab

at AS5-02-04

Hand-drawn Child Encouraging Friend

Created by Danning Sun & Daiwen Gong

Powered by Canva.com