AI for Robotics

Mandatory course I took in Q4 of my first year while at Twente. It covered mostly information from the Image Processing and Computer Vision course and overall computer-vision related tasks that can be done with AI (e.g. YOLO for detection and tracking, MiDAS for depth estimation).

Topics covered

• Detectors and Tracking
• SLAM, but mostly covered the camera oriented side
• MiDaS
• Machine Learning Paradigms
• Deep Learning SfM, SLAM, and VO
• Single Image Depth Estimation (SIDE), Depth Accuracy for Stereo Cameras, Bundle Adjustment
• Deep Feature Matching
• Reinforcement Learning Basics, Markov Decision Process
• Imitation Learning, Model-Based Reinforcement Learning, Decision Transformers
• Value Based Methods
  • Monte Carlo Learning
  • Temporal Difference Learning
  • Q-Learning
  • Deep Q-Learning
• Policy Gradient Methods
  • PPO
• Actor Critic Methods
  • PPO
  • SAC
  • TD3