Back to the deep

The Chronicle has a nice profile of Geoffrey Hinton, which details some of the history behind neural nets and deep learning. See also Neural networks and deep learning and its sequel. The recent flourishing of deep neural nets is not primarily due to theoretical advances, but rather the appearance of GPUs and large training data …

More

Neural Networks and Deep Learning 2

Inspired by the topics discussed in this earlier post, I’ve been reading Michael Nielsen’s online book on neural nets and deep learning. I particularly liked the subsection quoted below. For people who think deep learning is anything close to a solved problem, or anticipate a near term, quick take-off to the Singularity, I suggest they …

More

Neural Networks and Deep Learning

One of the SCI FOO sessions I enjoyed the most this year was a discussion of deep learning by AI researcher Juergen Schmidhuber. For an overview of recent progress, see this recent paper. Also of interest: Michael Nielsen’s pedagogical book project. An application which especially caught my attention is described by Schmidhuber here: Many traditional methods …

More