backpropagation
23 episodes mention this concept
lexfridmanSep 20, 2021Jay McClelland on Neural Networks, the Emergence of Cognition, and the Mind-Brain Connection
NeuroscienceNeural Networks (artificial and biological)Cognitive PsychologyParallel Distributed Processing (PDP)Backpropagation- lexfridmanMay 8, 2020
Ilya Sutskever on the Deep Learning Revolution, AI's Unity, and the Future of Intelligence
TechnologyDeep Learning RevolutionNeural NetworksBackpropagationHessian-free optimizer - lexfridmanApr 27, 2020
The Turing Test: Can Machines Think? A Philosophical and Engineering Deep Dive into AI
PhilosophyTuring TestImitation GameArtificial Intelligence (AI)Machine Learning - lexfridmanFeb 29, 2020
John Hopfield on the Physics of Mind, Neurobiology, and the Future of AI
ScienceAssociative neural networksHopfield networksDeep learningEvolutionary biology - lexfridmanJan 10, 2020
Deep Learning: State of the Art in 2020, Key Advancements, Limitations, and Future Research
TechnologyDeep LearningNeural NetworksPerceptron (single-layer, multi-layer)Backpropagation - lexfridmanAug 31, 2019
Yann LeCun on Deep Learning's Foundations, AI Reasoning, and Ethical Alignment
TechnologyDeep LearningConvolutional Neural Networks (ConvNets)Value MisalignmentObjective Functions - lexfridmanApr 18, 2019
Ian Goodfellow on Generative Adversarial Networks, Deep Learning Limitations, and the Future of AI Cognition
TechnologyGenerative Adversarial Networks (GANs)Deep LearningRepresentation LearningMachine Learning - lexfridmanApr 3, 2019
Greg Brockman on OpenAI, AGI, and Shaping the Future of Intelligence
TechnologyArtificial General Intelligence (AGI)Deep LearningReinforcement LearningValue Alignment - lexfridmanJan 11, 2019
Deep Learning Basics: Foundations, Progress, and Future Challenges
TechnologyDeep LearningNeural NetworksOptimizationMachine Learning - lexfridmanApr 25, 2018
Ilya Sutskever on Deep Learning Foundations, Meta-Learning, and Self-Play for AGI
TechnologyDeep Learning PrinciplesGeneralization Theory (shortest program)Computational Intractability (program search)Backpropagation (circuit search) - lexfridmanSep 27, 2016
The Evolution, Architecture, and Impact of Convolutional Neural Networks in Computer Vision
TechnologyDeep LearningComputer VisionNeural NetworksConvolutional Neural Networks (CNNs) - lexfridmanSep 27, 2016
Theano: A Symbolic Expression Compiler for Deep Learning and GPU Acceleration
TechnologyTheanoSymbolic expression compilerComputation graphAutomatic differentiation - lexfridmanSep 27, 2016
Foundations of Deep Learning: Feedforward Neural Networks, Backpropagation, and Training Techniques
TechnologyFeedforward Neural NetworksInput VectorHidden LayersPre-activation - lexfridmanSep 27, 2016
Foundations of Unsupervised Deep Learning: Sparse Coding, Autoencoders, and Generative Models
TechnologyUnsupervised LearningSupervised LearningDeep LearningHierarchical Representations - lexfridman
Recurrent Neural Networks and the Fundamentals of Backpropagation for Steering Through Time
TechnologyRecurrent Neural Networks (RNNs)BackpropagationVanishing GradientsExploding Gradients - lexfridman
MIT 6.S094: Deep Learning for Self-Driving Cars - Foundations, Challenges, and Human-Centered AI
TechnologyDeep LearningSelf-Driving CarsArtificial Intelligence (AI)Reinforcement Learning - lexfridman
Deep Reinforcement Learning Fundamentals: From Perceptrons to Q-Learning for Motion Planning
TechnologyDeep Reinforcement Learning (DRL)Supervised LearningUnsupervised LearningSemi-supervised Learning - lexfridman
MIT 6.S094: Introduction to Deep Learning, Neural Networks, and Self-Driving Cars
TechnologyDeep LearningDeep Neural NetworksSelf-Driving CarsDeep Reinforcement Learning - lexfridman
Recurrent Neural Networks and the Fundamentals of Backpropagation for Steering Through Time
TechnologyRecurrent Neural Networks (RNNs)BackpropagationVanishing GradientsExploding Gradients - lexfridman
MIT AGI: Engineering Intelligence - Bridging Theory, Practice, and Societal Impact
TechnologyArtificial General Intelligence (AGI)Deep LearningReinforcement LearningComputational Cognitive Science - lexfridman
Reverse Engineering Human Intelligence for Advanced AI and AGI: A Cognitive Science Approach
ScienceArtificial General Intelligence (AGI)AI TechnologiesDeep LearningPattern Recognition - lexfridman
The Business and Philosophy of Machine Learning: Promise, Limitations, and the Quest for General Intelligence
TechnologyMachine LearningArtificial Intelligence (AI)Deep LearningSupervised Learning - lexfridman
Ray Kurzweil on the Future of Intelligence, AGI, Deep Learning, and the Hierarchical Neocortex
TechnologyArtificial General Intelligence (AGI)Deep LearningNeural NetworksLaw of Accelerating Returns
Knowledge Graph
Related concepts — line thickness indicates connection strength. Click any node to explore.
Want to explore how this connects to concepts you choose? Try Nexus →