Главная
Study mode:
on
1
Intro
2
Exercise
3
Sparse Pattern Recognition
4
Clutter
5
How can we handle different viewpoints?
6
Viewpoint Equivariance
7
What stays constant?
8
Coordinate frame
9
How to work in this vector format?
10
How can we detect objects?
11
How to detect objects? • An object exists if there is agreement between multiple part predictions
12
Agreement and Assignment
13
Capsule Network
14
Squashed Capsules: Agreement
15
Squashed Capsules: Assignment Dynamic Routing
16
New visual symbols for clarity
17
EM routing for Gaussian Capsules
18
Transform
19
Agreement (M step)
20
Assignment (Estep)
21
Routing in action
22
Viewpoint generalization
23
Constellations
Description:
Explore capsule networks for computer vision in this 31-minute tutorial from the CVPR 2019 conference, presented by Sara Sabour from Google. Delve into sparse pattern recognition, clutter handling, and viewpoint equivariance. Learn about coordinate frames, vector formats, and object detection through part prediction agreement. Discover capsule network concepts, including squashed capsules, dynamic routing, and EM routing for Gaussian capsules. Examine the transform, agreement, and assignment steps in routing, and observe how capsule networks generalize viewpoints and handle constellations. Gain insights into this innovative approach to computer vision that addresses limitations of traditional convolutional neural networks.

Introduction to Capsule Networks for Computer Vision

University of Central Florida
Add to list
0:00 / 0:00