Weichen Liu¹ (), Chiyuan Chang², Russell Cohen Hoffing³, Steven Thurman³, Cory Stevenson⁴, Tzyy-Ping Jung⁴, Ying Choon Wu⁴; ¹UC San Diego, Department of Computer Science and Engineering, ²Beth Israel Deaconess Medical Center, ³US DEVCOM Army Research Laboratory, ⁴Institute for Neural Computation

This study explored the feasibility of detecting steady state evoked potentials (SSVEPs) and endeavored to uncover the time course of SSVEP signal response under conditions of unrestricted head and eye movement in three dimensional space. Leveraging immersive, head-mounted virtual reality (VR), we recorded continuous eye and head movement data simultaneously with 64-channel electroencephalogram (EEG) during a virtual visual fixation task. Participants were instructed to fixate centrally until prompted to shift their gaze towards a flickering target appearing in their field of view at different distances towards the periphery (near target: 15 degrees, far target: 30 degrees). This gaze shift was accomplished either through a saccade alone or a self-directed head turn paired with saccading. Preprocessed EEG was epoched based upon time-locking to either stimulus, fixation or gaze (based on the gaze intersection point) onset. Canonical Correlation Analysis (CCA) was performed to identify the response frequency of each SSVEP trial using a certain time window. Aligning epochs using the fixation rather than stimulus onset led to higher classification accuracy for both near and far targets (e.g., 500ms - stimulus: 25.9%, fixation: 51.7%; 1500ms - stimulus: 54.9%, fixation: 70.3%). Further, it was found that CCA scores, which reflect the correlation between the single trial EEG and a set of reference frequencies, tended to increase in accuracy even before the onset of the gaze or fixation locking point, while the head and/or the eyes were still moving. In conclusion, we demonstrate that in realistic, unconstrained viewing conditions, SSVEP signal detection can be improved through fixation- and gaze-locking. Additionally, combined head and eye movement did not fully suppress processing of the visual signal, suggesting that the “blanking effect” reported in prior studies may not be accurately characterized as a full suppression of visual processing.

Acknowledgements: The project is supported by Army Research Laboratory (W911NF2120154)