IFDS

SILO-Qiaomin Xie
2021-11-10 12:30 (America/Chicago)

IFDS Ideas Forum-Sushrut Karmalkar
2021-11-08 12:30 - 13:00 (America/Chicago) | Orchard View Room, 330 N. Orchard Street, 3rd Floor NE, Madison, Wisconsin, 53715, United States
UNTIL FURTHER NOTICE: Seminars are hybrid in-person and via zoom.

IFDS All-Hands: Kevin Jamieson
2021-11-05 13:30 - 14:30 (America/Los_Angeles)
Title: Instance Dependent Sample Complexity Bounds for Interactive Learning

Abstract: The sample complexity of an interactive learning problem, such as multi-armed bandits or reinforcement learning, is the number of interactions with nature required to output an answer (e.g., a recommended arm or policy) that is approximately close to optimal with high probability. While minimax guarantees can be useful rules of thumb to gauge the difficulty of a problem class, algorithms optimized for this worst-case metric often fail to adapt to “easy” instances where fewer samples suffice. In this talk, I will highlight some of my group’s work on algorithms that obtain optimal, finite time, instance dependent sample complexities that scale with the true difficulty of the particular instance, versus just the worst-case. In particular, I will describe a unifying experimental design based approach used to obtain such algorithms for best-arm identification for linear bandits, contextual bandits with arbitrary policy classes, and smooth losses for linear dynamical systems.

Kevin’s website: https://homes.cs.washington.edu/~jamieson/about.html

Zoom link: contact organizer

(The talk will not be recorded, we hope you can join us live!)

SILO-Sebastien Roch
2021-11-03 12:30 (America/Chicago)

IFDS Ideas Forum-Hanbaek Lyu
2021-11-01 12:30 - 13:00 (America/Chicago) | Orchard View Room, 330 N. Orchard Street, 3rd Floor NE, Madison, Wisconsin, 53715, United States

ML-Opt@UW Stephen Mussmann
2021-10-29 13:30 - 14:30 (America/Los_Angeles)
Understanding and analyzing the effectiveness of uncertainty sampling

Active learning techniques attempt to reduce the amount of data required to learn a classifier by leveraging adaptivity. In particular, an algorithm iteratively selects and labels points from an unlabeled pool of data points. Over the history of active learning, many algorithms have been developed, though one heuristic algorithm, uncertainty sampling, stands out by its popularity, effectiveness, simplicity, and intuitiveness. Despite this, uncertainty sampling has known failure modes and lacks the theoretical underpinnings of some other algorithms such as those based on disagreement. Here, we present a few analyses of uncertainty sampling. First, we find that uncertainty sampling iterations implicitly optimizes the (generally non-convex) zero-one loss, explaining how uncertainty sampling can achieve lower error than labeling the entire unlabeled pool and highlighting the importance of a good initialization. Second, for logistic regression, we show that the extent to which uncertainty sampling outperforms random sampling is inversely proportional to the asymptotic error, both theoretically and empirically. Finally, we use the previous insights to show uncertainty sampling works very well on a particular NLP task due to extreme label imbalance. Taken together, these results provide a sturdier foundation for understanding and using uncertainty sampling.

https://washington.zoom.us/j/99919016373?pwd=[REDACTED]

SILO-Hanie Sedghi
2021-10-27 12:30 (America/Chicago)

IFDS Ideas Forum-Zhiyan Ding
2021-10-25 12:30 - 13:00 (America/Chicago) | Orchard View Room, 330 N. Orchard Street, 3rd Floor NE, Madison, Wisconsin, 53715, United States
Different regimes of overparameterized neural network: NTK and mean-field limit
UNTIL FURTHER NOTICE: Seminars are hybrid in-person and via zoom.

SILO-Josiah Hanna
2021-10-20 12:30 (America/Chicago)

E & A SIG:
2021-10-20 12:00 - 13:00 (America/Los_Angeles)

IFDS Ideas Forum: TBD
2021-10-18 12:30 - 13:00 (America/Chicago) | Zoom
REMOTE only

SILO-TBA
2021-10-13 12:30, 2021-10-06 12:30 (America/Chicago)

IFDS Ideas Forum-Multilingual NLP: Zero-shot Cross-lingual Transfer Learning
2021-10-11 12:30 - 13:00 (America/Chicago) | Orchard View Room, 330 N. Orchard Street, 3rd Floor NE, Madison, Wisconsin, 53715, United States

IFDS All-Hands: Qin Li
2021-10-08 13:30 - 14:30 (America/Los_Angeles)
Title:
Mean field theory in Inverse Problems from Bayesian inference to overparameterization of networks

Abstract:
Bayesian sampling and neural networks are seemingly two different machine learning areas, but they both deal with many particle systems. In sampling, one evolves a large number of samples (particles) to match a target distribution function, and in optimizing over-parameterized neural networks, one can view neurons particles that feed each other information in the DNN flow. These perspectives allow us to employ mean-field theory, a powerful tool that translates dynamics of many particle system into a partial differential equation (PDE), so rich PDE analysis techniques can be used to understand both the convergence of sampling methods and the zero-loss property of over-parameterization of ResNets. We showcase the use of mean-field theory in these two machine learning areas, and we also invite the audience to brainstorm other possible applications.

IFDS Ideas Forum-Chaobing Song
2021-10-04 13:30 - 14:00 (America/Chicago) | Orchard View Room, 330 N. Orchard Street, 3rd Floor NE, Madison, Wisconsin, 53715, United States

SILO-Jeff Linderoth
2021-09-29 12:30 (America/Chicago)
Subspace cluster with missing data via integer programming

IFDS Ideas Forum-Greg Canal
2021-09-27 12:30 - 13:30 (America/Chicago) | Orchard View Room, 330 N. Orchard Street, 3rd Floor NE, Madison, Wisconsin, 53715, United States

SILO-Michael Unser
2021-09-22 12:30 (America/Chicago)
New representer theorems for inverse problems and machine learning

IFDS Ideas Forum-Jasper Lee
2021-09-20 12:30 - 13:00 (America/Chicago) | Orchard View Room, 330 N. Orchard Street, 3rd Floor NE, Madison, Wisconsin, 53715, United States

SILO-Greg Canal
2021-09-15 12:30 (America/Chicago)

E & A SIG: Krishna Pillutla
2021-09-15 12:00 - 13:00 (America/Los_Angeles)

IFDS Ideas Forum-Ahmet Alacaoglu
2021-09-13 12:30 - 13:00 (America/Chicago) | Orchard View Room, 330 N. Orchard Street, 3rd Floor NE, Madison, Wisconsin, 53715, United States

SILO-Shivani Agrawal
2021-09-08 12:30 (America/Chicago)

MadLab Workshop
2021-08-02 - 2021-08-04

IFDS Summer School
2021-07-26 - 2021-07-30

TRIPODS PI meeting
2021-06-10 - 2021-06-11

ML-Opt: Romain Camilleri and Swati Padmanabhan
2021-06-04 13:30 - 14:30 (America/Los_Angeles)
The final talks of the ML-OPT seminar of the spring quarter will be given Friday (6/4) at 1:30pm PST by Romain Camilleri and Swati Padmanabhan.

Title: High-Dimensional Experimental Design and Kernel Bandits

Abstract: I will talk about high-dimensional bandits. First I want to review how the classical approach to solving linear bandits motivates an experimental design problem. Then I plan to justify why common rounding techniques cannot be applied in a potentially infinite-dimensional space. Lastly, I will show that one can avoid relying on rounding techniques by using a Catoni estimator.

Bio: Romain Camilleri is a 3rd year Ph.D. student at the Paul G. Allen School of Computer Science and Engineering at the University of Washington, where he is advised by Kevin Jamieson.

—————————————-
Title: Computing Lewis Weights to High Precision

Abstract: We present an algorithm for computing high-precision approximate L_p Lewis weights for p > 2. Given an m x n real full-rank matrix A and p>=3, our algorithm computes epsilon-approximate L_p-Lewis weights using O(p^3 log (m p / epsilon)) iterations, where each iteration takes time linear in the sparsity of the input matrix plus the time to compute the leverage scores of a diagonal rescaling of A. Previously, such iteration complexities were known only for 0< p < 4 [CohenPeng2015]. Consequently, our result helps complete the picture on near-optimal reduction from leverage scores to L_p-Lewis weights for all p>0.
[Joint work with Maryam Fazel, Yin Tat Lee, and Aaron Sidford]

Bio: Swati is a graduate student working on problems in convex optimization, advised by Yin Tat Lee.

SILO: Dimitris Tsipras
2021-05-19 12:30 - 13:30 (America/Chicago)
Title: Robust Machine Learning: The Worst-Case and Beyond
Abstract:
One of the key challenges in the real-world deployment of machine learning models is their brittleness: their performance significantly degrades when exposed to even small variations of their training environments.
How can we build ML models that are more robust?
In this talk, I will present a methodology for training models that are invariant to a broad family of worst-case input perturbations. I will then describe how such robust learning leads to models that learn fundamentally different data representations, and how this can be useful even outside the adversarial context. Finally, I will discuss model robustness beyond the worst-case: ways in which our models fail to generalize and how we can guide further progress on this front.”
Bio:
“Dimitris Tsipras is a PhD student in the MIT EECS Department, advised by Aleksander Mądry. His work revolves around the reliability and robustness of machine learning systems, as well as the science of modern machine learning. He is currently being supported by a Facebook PhD Fellowship
UNTIL FURTHER NOTICE: Seminars are virtual. Sign up for the SILO email list to receive the links to each talk at https://groups.google.com/ and browse for silo

Data Science Day
2021-05-14 08:45 - 15:00 (America/Chicago)
Uses and Abuses of Data in Higher Education
Virtual Event via Zoom with Opportunities for Engagement
Details and registration: https://citl.ucsc.edu/data-science-day-2021/
