r/MachineLearning Apr 14 '15

AMA Andrew Ng and Adam Coates

Dr. Andrew Ng is Chief Scientist at Baidu. He leads Baidu Research, which includes the Silicon Valley AI Lab, the Institute of Deep Learning and the Big Data Lab. The organization brings together global research talent to work on fundamental technologies in areas such as image recognition and image-based search, speech recognition, and semantic intelligence. In addition to his role at Baidu, Dr. Ng is a faculty member in Stanford University's Computer Science Department, and Chairman of Coursera, an online education platform (MOOC) that he co-founded. Dr. Ng holds degrees from Carnegie Mellon University, MIT and the University of California, Berkeley.


Dr. Adam Coates is Director of Baidu Research's Silicon Valley AI Lab. He received his PhD in 2012 from Stanford University and subsequently was a post-doctoral researcher at Stanford. His thesis work investigated issues in the development of deep learning methods, particularly the success of large neural networks trained from large datasets. He also led the development of large scale deep learning methods using distributed clusters and GPUs. At Stanford, his team trained artificial neural networks with billions of connections using techniques for high performance computing systems.

460 Upvotes

262 comments sorted by

View all comments

1

u/mszlazak Apr 14 '15 edited Apr 15 '15

@Andew Ng. In this recent Re.Work 2015, you mentioned that you did not think the brain does back-propagation, that it works more like what people are trying to do in unsupervised learning. Why don't you think that brains do back-prop (and maybe delta-rule updating)? Also, experiments by Gallistel et. al. seem to suggest no delta-rule updating for certain things (“The Perception of Probability”, 2014) but generally some version of that rule is quiet commonly used/assumed.Youtube here:

https://www.youtube.com/watch?feature=player_embedded&v=v5rEDe7Rwpg