CP Lectures

 

On the Inductive Biases in Data Augmentation and Adversarial Robustness

Dr. techn. Hamid Eghbal-zadeh
24/11/2020  10:30-11:30 (CET)

 

Abstract
"In this talk, first we look at how different inductive biases can be incorporated into machine learning systems, and what are the consequences of such inductive biases. We then review some of the widely-used inductive biases in deep learning models, and try to understand how they help models improve their prediction performance. More specifically, we look at popular data augmentation techniques, and their inductive biases. Further, we look at how the decision boundaries of deep neural networks can cause deep neural networks to be more vulnerable to adversarial attacks, and how this can be systematically and objectively measured. And in the end, we look at how data augmentation techniques affect decision boundary of deep neural networks, from two different aspects: 1) incorporating an inductive bias, and 2) incorporating stochasticity into training data. Using tools from statistics, we disentangle these factors, and try to analyze their effects independently, using our proposed analysis framework."

Slides

arXiv

Video

Hopfield Networks is All You Need

Hubert, Ramsauer, MSc
06/10/2020  10:30-11:30 (CEST)

arXiv

 

Introduction to Transformers

Dr. Navid Rekabsaz
22/09/2020  11:00-12:00 (CEST)

Slides