1d ago

Shubhendu Trivedi locates 2006 ACM paper as earliest deep generative models reference

0

Mark Goldstein at the Flatiron Institute posted a query seeking the earliest occurrence of the phrase deep generative models. An initial search surfaced academic papers from 2008 to 2011 involving Geoffrey Hinton, Sam Roweis and others. Shubhendu Trivedi identified a 2006 ACM-hosted paper as the first documented instance and noted Geoffrey Hinton's 2006 Deep Belief Nets video lectures that used the phrasing.

Original post

what's the earliest occurrence of the phrase "deep generative models"? a cursory first search yields some papers from 2008-2011 by combinations of Hinton, Roweis, Taylor, Salakhutdinov, Ranzato, Susskind and Mnih

2:34 PM · May 15, 2026 View on X

@marikgoldstein This seems to be the first https://dl.acm.org/doi/pdf/10.1145/1273496.1273596 but I had seen talks by Hinton on Deep Belief Nets on videolectures sometime in 2011/2010, in which he uses the term (the talks were from 2006). Would be quite an exercise to find them. Not sure if videolectures even exists now.

Mark GoldsteinMark Goldstein@marikgoldstein

what's the earliest occurrence of the phrase "deep generative models"? a cursory first search yields some papers from 2008-2011 by combinations of Hinton, Roweis, Taylor, Salakhutdinov, Ranzato, Susskind and Mnih

9:34 PM · May 15, 2026 · 1.7K Views
10:29 PM · May 15, 2026 · 372 Views

what's the earliest occurrence of the phrase "deep generative models"?

a cursory first search yields some papers from 2008-2011 by combinations of Hinton, Roweis, Taylor, Salakhutdinov, Ranzato, Susskind and Mnih

9:34 PM · May 15, 2026 · 1.7K Views

@_onionesque thanks for the ref! Makes sense that it would be in this paper

Shubhendu TrivediShubhendu Trivedi@_onionesque

@marikgoldstein This seems to be the first https://dl.acm.org/doi/pdf/10.1145/1273496.1273596 but I had seen talks by Hinton on Deep Belief Nets on videolectures sometime in 2011/2010, in which he uses the term (the talks were from 2006). Would be quite an exercise to find them. Not sure if videolectures even exists now.

10:29 PM · May 15, 2026 · 372 Views
11:20 PM · May 15, 2026 · 65 Views
Shubhendu Trivedi locates 2006 ACM paper as earliest deep generative models reference · Digg