Generalization in Unsupervised Learning
Full Text: ecml15b.pdf
We are interested in the following questions. Given a finite data set ๎ฟ , with neither labels nor side information, and an unsupervised learning algorithm ๐ , can the generalization of ๐ be assessed on ๎ฟ ? Similarly, given two unsupervised learning algorithms, ๐ 1 and ๐ 2 , for the same learning task, can one assess whether one will generalize โbetterโ on future data drawn from the same source as ๎ฟ ? In this paper, we develop a general approach to answering these questions in a reliable and efficient manner using mild assumptions on ๐ . We first propose a concrete generalization criterion for unsupervised learning that is analogous to prediction error in supervised learning. Then, we develop a computationally efficient procedure that realizes the generalization criterion on finite data sets, and propose and extension for comparing the generalization of two algorithms on the same data set. We validate the overall framework on algorithms for clustering and dimensionality reduction (linear and nonlinear).
Citation
K. Abou-Moustafa, D. Schuurmans. "Generalization in Unsupervised Learning". European Conference on Machine Learning (ECML), (ed: Appice A., Rodrigues P., Santos Costa V., Soares C., Gama J., Jorge A.), pp 300-317, September 2015.| Keywords: | |
| Category: | In Conference |
| Web Links: | DOI |
| Springer |
BibTeX
@incollection{Abou-Moustafa+Schuurmans:ECML15,
author = {Karim T. Abou-Moustafa and Dale Schuurmans},
title = {Generalization in Unsupervised Learning},
Editor = {Appice A., Rodrigues P., Santos Costa V., Soares C., Gama J., Jorge
A.},
Pages = {300-317},
booktitle = {European Conference on Machine Learning (ECML)},
year = 2015,
}Last Updated: February 14, 2020Submitted by Sabina P
