eduzhai > Applied Sciences > Computer Science >

Conjunctive Visual and Auditory Development via Real-Time Dialogue

  • paiqiu
  • (0) Download
  • 20210805
  • Save

... pages left unread,continue reading

Document pages: 8 pages

Abstract: Human developmental learning is capable ofdealing with the dynamic visual world, speech-baseddialogue, and their complex real-time association.However, the architecture that realizesthis for robotic cognitive development hasnot been reported in the past. This paper takesup this challenge. The proposed architecture doesnot require a strict coupling between visual andauditory stimuli. Two major operations contributeto the “abstraction” process: multiscale temporalpriming and high-dimensional numeric abstractionthrough internal responses with reduced variance.As a basic principle of developmental learning,the programmer does not know the natureof the world events at the time of programmingand, thus, hand-designed task-specific representationis not possible. We successfully tested thearchitecture on the SAIL robot under an unprecedentedchallenging multimodal interaction mode:use real-time speech dialogue as a teaching sourcefor simultaneous and incremental visual learningand language acquisition, while the robot is viewinga dynamic world that contains a rotating objectto which the dialogue is referring.

Please select stars to rate!

         

0 comments Sign in to leave a comment.

    Data loading, please wait...
×