Tata Institute of Fundamental Research
Hilbert Schmidt Independence Criterion (HSIC)
STCS Student Seminar
Speaker:
Jatin Batra
Organiser:
Eeshan Modak
Date:
Friday, 13 May 2022, 16:00 to 17:00
Venue:
A-201 (STCS Seminar Room)
(Scan to add to calendar)
Abstract:
Suppose we have access to $n$ empirical observations of two random variables X,Y and we want to know - are X,Y independent? One way to answer this is to compute empirical versions of various statistical quantities like covariance and mutual information. However, because all we have access to is a finite number ($n$) of empirical observations, we might simply get unlucky. Can we guarantee that our test accuracy increases rapidly with $n$? The Hilbert Schmidt Independence Criterion (HSIC) proposed by Gretton, Bousquet, Smola and Scholkopft resolves this issue by providing an estimate of dependence that provably gets more accurate at a $1/\sqrt{n}$ rate. In this talk, I will describe (following Gretton et al. in http://www.gatsby.ucl.ac.uk/~gretton/papers/GreBouSmoSch05.pdf) how HSIC arises quite naturally as a kernel invariant version of the covariance estimate and also allude to some later applications of HSIC.
| Speaker: | Jatin Batra |
| Organiser: | Eeshan Modak |
| Date: | Friday, 13 May 2022, 16:00 to 17:00 |
| Venue: | A-201 (STCS Seminar Room) |
(Scan to add to calendar)
Abstract:
Suppose we have access to $n$ empirical observations of two random variables X,Y and we want to know - are X,Y independent? One way to answer this is to compute empirical versions of various statistical quantities like covariance and mutual information. However, because all we have access to is a finite number ($n$) of empirical observations, we might simply get unlucky. Can we guarantee that our test accuracy increases rapidly with $n$? The Hilbert Schmidt Independence Criterion (HSIC) proposed by Gretton, Bousquet, Smola and Scholkopft resolves this issue by providing an estimate of dependence that provably gets more accurate at a $1/\sqrt{n}$ rate. In this talk, I will describe (following Gretton et al. in http://www.gatsby.ucl.ac.uk/~gretton/papers/GreBouSmoSch05.pdf) how HSIC arises quite naturally as a kernel invariant version of the covariance estimate and also allude to some later applications of HSIC.