- Published on
PerceiverIO
- Authors
- Name
- Martin Andrews
- @mdda123
Presentation Link
Sam Witteveen and I started the TensorFlow and Deep Learning Singapore group on MeetUp in February 2017, and the thirty-fourth MeetUp was the first under its new name "Machine Learning Singapore" (or MLSG for short).
Our presentation "Back to the cutting edge - How Transformers are being applied everywhere" was in two parts:
"Transformers : Beyond NLP & Language Models" - Sam :
- How the Transformer architecture has made it's way out of just being used for text to
- Computer Vision tasks
- Geometric deep learning
- ... and more
- How the Transformer architecture has made it's way out of just being used for text to
"PerceiverIO & PonderNet - DeepMind hype or the future?" - Martin :
- The newest iteration of the Perceiver architecture
- how it can be applied to a whole variety of different inputs and outputs
- And DeepMind's "PonderNet" that can think for longer "like a human does"...
- The newest iteration of the Perceiver architecture
The slides for my talk are here :
If there are any questions about the presentation please ask below, or contact me using the details given on the slides themselves.
