CSCI 235 - Intelligent Robotics
Spring 2017
Project #8: Real-time Learning
Library
The library files are in modeselection.zip. This includes all of the library files from the previous assignments.
Sample Programs
The sample programs are in proj8.zip.
Assignment
Implement three programs that use real-time learning:
- The first program should employ two actions to avoid obstacles. It won't require any additional programming beyond the examples; your effort should be focused on the training process itself.
- For each of the second and third programs, devise an interesting application that makes use of real-time learning.
Questions
- For each program, devise a metric for its performance on its task. How
well did each program perform? Feel free to experiment with different
parameter settings to optimize performance. Be sure to discuss the most useful
parameter settings in your report and presentation.
- What was a good balance between the number of nodes, the amount of image
shrinkage, and the cycle time for each of your applications? Why?
- Compare and contrast the use of this real-time learning module and
Q-learning. What are some advantages and disadvantages of each approach?
- What combinations of techniques did you find most useful in
completing each of your tasks? Why?