CS25 I Stanford Seminar - DeepMind’s Perceiver and Perceiver IO: new data family architecture
A central goal of artificial intelligence is to build systems that can flexibly process all the world’s data, but current neural network architectures are designed to handle essentially one data configuration. This includes models like 2D convnets and more recent Vision Transformer models, which scale well on images but can be challenging to apply to other data. In this talk, I’ll be describing Perceivers, a new family of architectures that scale well to many kinds of high-dimensional data while making essentially no domain assumptions. Perceivers leverage an asymmetric attention mechanism to encode and decode data from a latent bottleneck. This mechanism allows Perceivers to handle inputs and outputs several orders of magnitude larger than can be used with standard Transformers. Using this architecture, we obtain performance comparable to or better than domain-specific architectures on a wide range of tasks, including image classification, natural language understanding, optical flow, multimodal autoencoding & classification, set processing, and multi-task learning.
Drew Jaegle is a Senior Research Scientist at DeepMind. His research focuses on developing domain-general perceptual and reasoning systems, and his work spans architecture design, imitation learning and RL, self-supervised learning, physical inference, and philosophy of science. Before joining DeepMind, he worked on computer vision and computational neuroscience at the University of Pennsylvania, where he did a PhD in the GRASP Lab with Kostas Daniilidis and a postdoc with Nicole Rust.
A full list of guest lectures can be found here:
5 views
7
2
8 months ago 00:09:12 1
Как убрать инпут лаг новые способы 2021
8 months ago 00:10:24 1
Обзор Call of Duty: Infinite Warfare | Где купить дёшево
8 months ago 00:12:45 1
Как научиться играть в CS 2
8 months ago 00:00:00 1
Начинаем все с нуля. В погоне за рейтингом - 25/02/2024г #cs2 #csgo #steam #stream
8 months ago 00:26:13 1
ДЕТАЛЬНЫЙ ОБЗОР ПО МЕТФОРМИНУ (торговые названия ГЛЮКОФАЖ, СИОФОР, МЕТАМИН, ДИАФОРМИН, МЕТФОРМИН)
8 months ago 01:10:15 1
ПРАВДА О РЕИНКАРНАЦИИ. Что будет после смерти? Откровение оккультиста (English, CS Subtitles)
8 months ago 00:20:24 1
ОН НЕ ЗНАЛ, ЧТО ЖДЕТ ЕГО!!! УГАРНЫЕ ПРЯТКИ В CS 2!!!
8 months ago 00:02:50 1
『REYNATIS/レナティス』1st Trailer
8 months ago 00:00:00 1
НОВЫЙ КЕЙС В CS 2 // ВЫБИВАЮ НОЖ КУКРИ В КС 2 // НОВОЕ ОБНОВЛЕНИЕ В CS:GO