Source Quote
“Without further assumptions, unsupervised disentanglement is fundamentally impossible.”
Atom
Disentanglement alone is insufficient without causal structure
Learning statistically independent latent factors does not guarantee that factors correspond to true causal variables or support interventional reasoning.
Reasoning
Because: Disentanglement methods optimize for statistical independence, but independent components can be rotated arbitrarily without changing the likelihood. Only causal structure breaks this symmetry.
Boundaries: If true causal variables happen to be statistically independent, disentanglement may approximately recover them. But this is a special case.
Atom note
Learning statistically independent latent factors does not guarantee that factors correspond to true causal variables or support interventional reasoning.
“Without further assumptions, unsupervised disentanglement is fundamentally impossible.”
Because: Disentanglement methods optimize for statistical independence, but independent components can be rotated arbitrarily without changing the likelihood. Only causal structure breaks this symmetry.
Boundaries: If true causal variables happen to be statistically independent, disentanglement may approximately recover them. But this is a special case.
Capture context
Reflection · Used
Disentanglement is too weak without causal assumptions
The paper’s critique is that statistical factorization alone cannot recover variables that support intervention and transfer.
“Without further assumptions, unsupervised disentanglement is fundamentally impossible.”
This blocks a common shortcut in representation learning and forces the system toward structural assumptions instead of aesthetic latent spaces.
Source grounding
Schölkopf, Locatello, Bauer, Ke, Kalchbrenner, Goyal, Bengio (2021) · 1/1 ch.
Toward Causal Representation Learning
Causal models provide the right abstraction for robust, transferable representations — the ICM principle bridges causality and representation learning.
Where this appears
Slide Deck · Shipped
Toward CRL: Schölkopf et al. 2021 — Key Claims & Architecture
Full paper: Sections 1-6 covering ICM, disentanglement critique, multi-env supervision, and CRL roadmap
+18 pts