Visualization and Intelligent Systems Laboratory
VISLab

 

 

Contact Information

VISLab
Winston Chung Hall Room 216
University of California, Riverside
900 University Avenue
Riverside, CA 92521-0425


Tel: (951)-827-3954

CRIS
Bourns College of Engineering
UCR
NSF IGERT on Video Bioinformatics

UCR Collaborators:
CSE
ECE
ME
STAT
PSYC
ENTM
BIOL
BPSC
ECON
MATH
BIOENG
MGNT

Other Collaborators:
Keio University

Other Activities:
IEEE Biometrics Workshop 2014
IEEE Biometrics Workshop 2013
Worshop on DVSN 2009
Multibiometrics Book

Webmaster Contact Information:
Alex Shin
wshin@ece.ucr.edu

Last updated: July 1, 2017

 

 

Real-Time Robot Learning

Presented by: Pat Leang

ABSTRACT: The goal of this NSF-sponsored Research Experience project was to develop a miniature robot, which, through environmental sensing or computer vision or both, would learn to navigate a maze by the optimum route. We have investigated, evaluated, and implemented various theoretical concepts including robot design, maze design, user-interface design, a specific class of learning algorithms known as Reinforcement Learning algorithms, a real-time system engineering. We will provide an overview of the key system components including the design and construction of the robot, as well as the most important algorithms behind the user-interface and learning portion of the system. We will present the results of our experiments and compare with "ideal" theoretical values obtained from running a simulation program of the reinforcement learning algorithm.