Learning Hierarchical Integration of Foveal and Peripheral Vision for Vergence Control by Active Efficient Coding

Zhetuo Zhao; Jochen Triesch; Bertram E. Shi

doi:10.1007/978-3-319-97628-0_7

Learning Hierarchical Integration of Foveal and Peripheral Vision for Vergence Control by Active Efficient Coding

Zhetuo Zhao, Jochen Triesch, Bertram E. Shi^*

^*Corresponding author for this work

HKUST Fok Ying Tung Graduate School

Research output: Chapter in Book/Conference Proceeding/Report › Conference Paper published in a book › peer-review

1 Citation (Scopus)

Abstract

The active efficient coding (AEC) framework parsimoniously explains the joint development of visual processing and eye movements, e.g., the emergence of binocular disparity selective neurons and fusional vergence, the disjunctive eye movements that align left and right eye images. Vergence can be driven by information in both the fovea and periphery, which play complementary roles. The high resolution fovea can drive precise short range movements. The lower resolution periphery supports coarser long range movements. The fovea and periphery may also contain conflicting information, e.g. due to objects at different depths. While past AEC models did integrate peripheral and foveal information, they did not explicitly take into account these characteristics. We propose here a two-level hierarchical approach that does. The bottom level generates different vergence actions from foveal and peripheral regions. The top level selects one. We demonstrate that the hierarchical approach performs better than prior approaches in realistic environments, exhibiting better alignment and less oscillation.

Original language	English
Title of host publication	From Animals to Animats 15 - 15th International Conference on Simulation of Adaptive Behavior, SAB 2018, Proceedings
Editors	Poramate Manoonpong, Jørgen Christian Larsen, Xiaofeng Xiong, John Hallam, Jochen Triesch
Publisher	Springer Verlag
Pages	78-89
Number of pages	12
ISBN (Print)	9783319976273
DOIs	https://doi.org/10.1007/978-3-319-97628-0_7
Publication status	Published - 2018
Event	15th International Conference on the Simulation of Adaptive Behavior, SAB 2018 - Frankfurt/Main, Germany Duration: 14 Aug 2018 → 17 Aug 2018

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	10994 LNAI
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	15th International Conference on the Simulation of Adaptive Behavior, SAB 2018
Country/Territory	Germany
City	Frankfurt/Main
Period	14/08/18 → 17/08/18

Bibliographical note

Publisher Copyright:
© 2018, Springer Nature Switzerland AG.

Keywords

Disparity
Foveal vision
Peripheral vision
Vergence

Access to Document

10.1007/978-3-319-97628-0_7

Cite this

Zhao, Z., Triesch, J., & Shi, B. E. (2018). Learning Hierarchical Integration of Foveal and Peripheral Vision for Vergence Control by Active Efficient Coding. In P. Manoonpong, J. C. Larsen, X. Xiong, J. Hallam, & J. Triesch (Eds.), From Animals to Animats 15 - 15th International Conference on Simulation of Adaptive Behavior, SAB 2018, Proceedings (pp. 78-89). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10994 LNAI). Springer Verlag. https://doi.org/10.1007/978-3-319-97628-0_7

Zhao, Zhetuo ; Triesch, Jochen ; Shi, Bertram E. / Learning Hierarchical Integration of Foveal and Peripheral Vision for Vergence Control by Active Efficient Coding. From Animals to Animats 15 - 15th International Conference on Simulation of Adaptive Behavior, SAB 2018, Proceedings. editor / Poramate Manoonpong ; Jørgen Christian Larsen ; Xiaofeng Xiong ; John Hallam ; Jochen Triesch. Springer Verlag, 2018. pp. 78-89 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{03f06574ebbc48d9b07f4677e80068e6,

title = "Learning Hierarchical Integration of Foveal and Peripheral Vision for Vergence Control by Active Efficient Coding",

abstract = "The active efficient coding (AEC) framework parsimoniously explains the joint development of visual processing and eye movements, e.g., the emergence of binocular disparity selective neurons and fusional vergence, the disjunctive eye movements that align left and right eye images. Vergence can be driven by information in both the fovea and periphery, which play complementary roles. The high resolution fovea can drive precise short range movements. The lower resolution periphery supports coarser long range movements. The fovea and periphery may also contain conflicting information, e.g. due to objects at different depths. While past AEC models did integrate peripheral and foveal information, they did not explicitly take into account these characteristics. We propose here a two-level hierarchical approach that does. The bottom level generates different vergence actions from foveal and peripheral regions. The top level selects one. We demonstrate that the hierarchical approach performs better than prior approaches in realistic environments, exhibiting better alignment and less oscillation.",

keywords = "Disparity, Foveal vision, Peripheral vision, Vergence",

author = "Zhetuo Zhao and Jochen Triesch and Shi, \{Bertram E.\}",

note = "Publisher Copyright: {\textcopyright} 2018, Springer Nature Switzerland AG.; 15th International Conference on the Simulation of Adaptive Behavior, SAB 2018 ; Conference date: 14-08-2018 Through 17-08-2018",

year = "2018",

doi = "10.1007/978-3-319-97628-0\_7",

language = "English",

isbn = "9783319976273",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Verlag",

pages = "78--89",

editor = "Poramate Manoonpong and Larsen, \{J{\o}rgen Christian\} and Xiaofeng Xiong and John Hallam and Jochen Triesch",

booktitle = "From Animals to Animats 15 - 15th International Conference on Simulation of Adaptive Behavior, SAB 2018, Proceedings",

}

Zhao, Z, Triesch, J & Shi, BE 2018, Learning Hierarchical Integration of Foveal and Peripheral Vision for Vergence Control by Active Efficient Coding. in P Manoonpong, JC Larsen, X Xiong, J Hallam & J Triesch (eds), From Animals to Animats 15 - 15th International Conference on Simulation of Adaptive Behavior, SAB 2018, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 10994 LNAI, Springer Verlag, pp. 78-89, 15th International Conference on the Simulation of Adaptive Behavior, SAB 2018, Frankfurt/Main, Germany, 14/08/18. https://doi.org/10.1007/978-3-319-97628-0_7

Learning Hierarchical Integration of Foveal and Peripheral Vision for Vergence Control by Active Efficient Coding. / Zhao, Zhetuo; Triesch, Jochen; Shi, Bertram E.
From Animals to Animats 15 - 15th International Conference on Simulation of Adaptive Behavior, SAB 2018, Proceedings. ed. / Poramate Manoonpong; Jørgen Christian Larsen; Xiaofeng Xiong; John Hallam; Jochen Triesch. Springer Verlag, 2018. p. 78-89 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10994 LNAI).

Research output: Chapter in Book/Conference Proceeding/Report › Conference Paper published in a book › peer-review

TY - GEN

T1 - Learning Hierarchical Integration of Foveal and Peripheral Vision for Vergence Control by Active Efficient Coding

AU - Zhao, Zhetuo

AU - Triesch, Jochen

AU - Shi, Bertram E.

PY - 2018

Y1 - 2018

N2 - The active efficient coding (AEC) framework parsimoniously explains the joint development of visual processing and eye movements, e.g., the emergence of binocular disparity selective neurons and fusional vergence, the disjunctive eye movements that align left and right eye images. Vergence can be driven by information in both the fovea and periphery, which play complementary roles. The high resolution fovea can drive precise short range movements. The lower resolution periphery supports coarser long range movements. The fovea and periphery may also contain conflicting information, e.g. due to objects at different depths. While past AEC models did integrate peripheral and foveal information, they did not explicitly take into account these characteristics. We propose here a two-level hierarchical approach that does. The bottom level generates different vergence actions from foveal and peripheral regions. The top level selects one. We demonstrate that the hierarchical approach performs better than prior approaches in realistic environments, exhibiting better alignment and less oscillation.

AB - The active efficient coding (AEC) framework parsimoniously explains the joint development of visual processing and eye movements, e.g., the emergence of binocular disparity selective neurons and fusional vergence, the disjunctive eye movements that align left and right eye images. Vergence can be driven by information in both the fovea and periphery, which play complementary roles. The high resolution fovea can drive precise short range movements. The lower resolution periphery supports coarser long range movements. The fovea and periphery may also contain conflicting information, e.g. due to objects at different depths. While past AEC models did integrate peripheral and foveal information, they did not explicitly take into account these characteristics. We propose here a two-level hierarchical approach that does. The bottom level generates different vergence actions from foveal and peripheral regions. The top level selects one. We demonstrate that the hierarchical approach performs better than prior approaches in realistic environments, exhibiting better alignment and less oscillation.

KW - Disparity

KW - Foveal vision

KW - Peripheral vision

KW - Vergence

UR - https://www.webofscience.com/wos/woscc/full-record/WOS:000484703700007

UR - https://openalex.org/W3135044147

UR - https://www.scopus.com/pages/publications/85051443551

U2 - 10.1007/978-3-319-97628-0_7

DO - 10.1007/978-3-319-97628-0_7

M3 - Conference Paper published in a book

SN - 9783319976273

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 78

EP - 89

BT - From Animals to Animats 15 - 15th International Conference on Simulation of Adaptive Behavior, SAB 2018, Proceedings

A2 - Manoonpong, Poramate

A2 - Larsen, Jørgen Christian

A2 - Xiong, Xiaofeng

A2 - Hallam, John

A2 - Triesch, Jochen

PB - Springer Verlag

T2 - 15th International Conference on the Simulation of Adaptive Behavior, SAB 2018

Y2 - 14 August 2018 through 17 August 2018

ER -

Zhao Z, Triesch J, Shi BE. Learning Hierarchical Integration of Foveal and Peripheral Vision for Vergence Control by Active Efficient Coding. In Manoonpong P, Larsen JC, Xiong X, Hallam J, Triesch J, editors, From Animals to Animats 15 - 15th International Conference on Simulation of Adaptive Behavior, SAB 2018, Proceedings. Springer Verlag. 2018. p. 78-89. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-319-97628-0_7

Learning Hierarchical Integration of Foveal and Peripheral Vision for Vergence Control by Active Efficient Coding

Abstract

Publication series

Conference

Bibliographical note

Keywords

Access to Document

Other files and links

Fingerprint

Cite this