Skip to Main content Skip to Navigation
Conference papers

UCSL : A Machine Learning Expectation-Maximization framework for Unsupervised Clustering driven by Supervised Learning

Abstract : Subtype Discovery consists in finding interpretable and consistent subparts of a dataset, which are also relevant to a certain supervised task. From a mathematical point of view, this can be defined as a clustering task driven by supervised learning in order to uncover subgroups in line with the supervised prediction. In this paper, we propose a general Expectation-Maximization ensemble framework entitled UCSL (Unsupervised Clustering driven by Supervised Learning). Our method is generic, it can integrate any clustering method and can be driven by both binary classification and regression. We propose to construct a non-linear model by merging multiple linear estimators, one per cluster. Each hyperplane is estimated so that it correctly discriminates-or predictonly one cluster. We use SVC or Logistic Regression for classification and SVR for regression. Furthermore, to perform cluster analysis within a more suitable space, we also propose a dimension-reduction algorithm that projects the data onto an orthonormal space relevant to the supervised task. We analyze the robustness and generalization capability of our algorithm using synthetic and experimental datasets. In particular, we validate its ability to identify suitable consistent sub-types by conducting a psychiatric-diseases cluster analysis with known ground-truth labels. The gain of the proposed method over previous state-of-theart techniques is about +1.9 points in terms of balanced accuracy. Finally, we make codes and examples available in a scikit-learn-compatible Python package.
Complete list of metadata

https://hal.telecom-paris.fr/hal-03277176
Contributor : Pietro Gori Connect in order to contact the contributor
Submitted on : Friday, July 2, 2021 - 5:09:12 PM
Last modification on : Tuesday, October 19, 2021 - 4:10:33 PM
Long-term archiving on: : Sunday, October 3, 2021 - 8:24:34 PM

File

ECMLPKDD-arxiv.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-03277176, version 1

Citation

Robin Louiset, Pietro Gori, Benoit Dufumier, Josselin Houenou, Antoine Grigis, et al.. UCSL : A Machine Learning Expectation-Maximization framework for Unsupervised Clustering driven by Supervised Learning. ECML/PKDD, Sep 2021, Bilbao, Spain. ⟨hal-03277176⟩

Share

Metrics

Record views

164

Files downloads

80