Friday, November 17, 2017

CapsuleNet

Are we at the dawn of a new era in convolutional networks?
Is it possible to combine CapsuleNet with CortexNet?

__________________________________
News:
Technology Review
ML Review


__________________________________
Notable papers:
2017
Dynamic Routing Between Capsules
Sara Sabour, Nicholas Frosst, Geoffrey Hinton
more

(Under review; submitted to ICLR 2018)
Matrix capsules with EM routing
more

2014
Optimizing Neural Networks that Generate Images
Tijmen Tieleman
See page 26

2011
Transforming Auto-encoders
Geoffrey Hinton, Alex Krizhevsky, Sida D. Wang
more

2006
To Recognize Shapes, First Learn to Generate Images
Geoffrey Hinton
See page 4, "fifth strategy"

1995
The wake-sleep algorithm for unsupervised neural networks
Geoffrey Hinton, Peter Dayan, Brendan Frey, Radford Neal
more

1981
Shape representation in parallel systems
Geoffrey Hinton
more

1979
Some demonstrations of the effects of structural descriptions in mental imagery
Geoffrey Hinton
more

1958
Oliver Selfridge
Pandemonium: A paradigm for learning
See also


__________________________________
Video:

2017
Aurélien Géron
Capsule Networks (CapsNet) - Tutorial
more

How to implement CapsNets using TensorFlow
more

2014
Geoffrey Hinton
What is wrong with Convolutional Neural Networks?
more

2012
Geoffrey Hinton: "Does the Brain do Inverse Graphics?"
more


__________________________________
Blogs:
Adrian Colyer
Dynamic routing between capsules
more

Max Pechyonkin
Understanding Hinton’s Capsule Networks. Part I: Intuition
more

Understanding Hinton’s Capsule Networks. Part II: How Capsules Work
more

Jonathan Hui
Understanding Dynamic Routing between Capsules (Capsule Network)
more

Kendrick Tan
Capsule Networks Explained
more

Mike Ross
A Visual Representation of Capsule Network Computations
more

Debarko De
What is a CapsNet or Capsule Network?
more

Thibault Neveu
Understand and apply CapsNet on Traffic sign classification
more

__________________________________
Discussion:
dynamic_routing_between_capsules
capsule_networks_explained
a_visual_representation_of_capsule_network

How to treat Hinton's thesis "Dynamic Routing Between Capsules"? (Chinese)
more

__________________________________
Implementation:
CapsuleNet on TensorFlow on MNIST
CapsuleNet in Keras on MNIST
CapsuleNet in Keras on Cifar dataset
CapsuleNet in TensorFlow on German traffic sign dataset
CapsuleNet in TensorFlow on MNIST
CapsuleNet in Kaggle on MNIST