Главная
Study mode:
on
1
Intro
2
Computational Cost of Capsule Voting
3
Conventional Convolutional Layers
4
Convolutional Capsule Layers
5
Capsule Pooling
6
Video Capsule Networks
7
Video Action Detection Networks
8
VideoCapsuleNet Architecture
9
Coordinate Addition
10
Capsule Masking
11
VideoCapsuleNet Training
12
Action Localization Accuracy
13
Qualitative Results - Entire Videos
14
Synthetic Dataset Experiments
15
Summary
16
Capsules in multiple modalities
17
Combining Video and Text
18
Overall Approach
19
Multi-modal Capsule Routing Algorithm
20
Full Architecture
21
Sentence Encoder
22
Merging Modalities and Masking
23
Upsampling Network
24
Quantitative Results - A2D Dataset
25
Semi-Supervised Video Object Segmentation
26
VOS using Capsules
27
Attention Routing
28
Video Encoder
29
Frame Encoder with Memory Module
30
Conv Capsule Layer and Decoder Network
31
Objective Function
32
Quantitative Results -Speed Analysis
33
Qualitative Results - Single Object
34
Qualitative Results - Multiple Objects
35
Effect of Memory Module
36
Effect of the Zooming Module
37
Effect of Zooming Module
Description:
Explore generalization techniques for video capsules in this comprehensive lecture by Kevin Duarte from the University of Central Florida. Delve into advanced topics in computer vision, including capsule networks, video object segmentation, and multi-modal approaches. Learn about the computational costs of capsule voting, convolutional capsule layers, and capsule pooling. Discover the architecture and training of VideoCapsuleNet for action detection and localization. Examine synthetic dataset experiments and qualitative results for entire videos. Investigate the combination of video and text modalities using capsule routing algorithms. Study semi-supervised video object segmentation techniques, including attention routing and memory modules. Analyze quantitative results, speed performance, and the effects of various modules on object segmentation tasks.

Generalization to Video Capsules - From Convolutional to Video Capsule Networks

University of Central Florida
Add to list
0:00 / 0:00