What’s New In Machine Learning? (IT Best Kept Secret Is Optimization)

What's New In #MachineLearning? Hint: it hasn't changed that much in 25 years

  • We look for the model that minimizes a combination of prediction error and model simplicity.
  • Many more machine learning algorithms can be described as optimization algorithms, see for instance thi s ni ce p rese ntat io n from Stephen Wright.
  • Some say that Machine Learning should be called Statistical Machine Learning .
  • I care because I got a PhD in Machine Learning in 1990.
  • A machine learning algorithms selects among a family of possible models the model that minimizes the prediction error.

What has changed in Machine Learning in the past 25 years?  You may not care about this question.  You may even not realize that Machine Learning as a technical and scientific field is older than 25 years.  But I do care about this question.  I care because I got a PhD in Machine Learning in 1990.  I then moved sidetrack to work on constraint programming and mathematical optimization.  I am back to machine learning since a couple of years, and I did ask myself this: is my PhD still relevant, or has Machine Learning changed so much that I need to learn it again from scratch?   To cut a long story short: yes…
Continue reading “What’s New In Machine Learning? (IT Best Kept Secret Is Optimization)”

Geoffrey Hinton talks about Deep Learning, Google and Everything

Learn top @google #AI thought leader, Geoffrey Hinton's perspective on #Deeplearning:

  • KDnuggets Home > News > 2014 > Dec > Opinions, Interviews, Reports > Geoffrey Hinton talks about Deep Learning, Google and Everything ( 14:n32 )
  • Dr. Hinton made a couple of points about Deep Learning and how our brain works on his AMA.
  • Its the first time I’ve believed that deep learning would be able to do real reasoning in the not too distant future.
  • I think the long-term future (of machine learning) is quite likely to be something that most researchers currently regard as utterly ridiculous and would reject as a NIPS paper.
  • Dr. Hinton started a course “Neural Networks for machine learning” on Coursera, which introduces artificial neural networks and its application.


A review of Dr. Geoffrey Hinton’s Ask Me Anything on Reddit. He talked about his current research and his thought on some deep learning issues.

Continue reading “Geoffrey Hinton talks about Deep Learning, Google and Everything”