gradient descent
12 episodes mention this concept
lexfridmanMar 30, 2023Eliezer Yudkowsky on the Existential Dangers of AI and the End of Human Civilization
TechnologySuperintelligent AGIAI AlignmentAI ConsciousnessQualia- lexfridmanDec 2, 2020
DeepMind's AlphaFold 2: Solving Protein Folding and Its Profound Impact on AI and Life Sciences
ScienceProtein FoldingAlphaFold 2Structural BiologyX-ray Crystallography - lexfridmanMay 10, 2020
The Unification of AI Modalities: Vision, Language, and Reinforcement Learning, and the Elusive Definition of 'Hardness' in AI
TechnologyDeep LearningComputer VisionNatural Language Processing (NLP)Reinforcement Learning (RL) - lexfridmanMay 8, 2020
Ilya Sutskever on the Deep Learning Revolution, AI's Unity, and the Future of Intelligence
TechnologyDeep Learning RevolutionNeural NetworksBackpropagationHessian-free optimizer - lexfridmanFeb 21, 2020
Andrew Ng's Expert Advice on Getting Started and Building a Career in Deep Learning and AI
TechnologyDeep LearningMachine LearningNeural NetworksGradient Descent - lexfridmanOct 10, 2019
The Fundamental Limits of Deep Learning: Generalization, Hybrid AI, and the Path to True Intelligence
TechnologyDeep Learning LimitsFunction ApproximatorsLocal GeneralizationExtreme Generalization - lexfridmanApr 18, 2019
Ian Goodfellow on Generative Adversarial Networks, Deep Learning Limitations, and the Future of AI Cognition
TechnologyGenerative Adversarial Networks (GANs)Deep LearningRepresentation LearningMachine Learning - lexfridmanDec 23, 2018
Juergen Schmidhuber on Gödel Machines, Meta-Learning, LSTMs, and the Simplicity of Universal Intelligence
TechnologyRecursive self-improvementMeta-learning (learning to learn)Gödel machinesLong Short-Term Memory (LSTMs) - lexfridmanSep 27, 2016
Theano: A Symbolic Expression Compiler for Deep Learning and GPU Acceleration
TechnologyTheanoSymbolic expression compilerComputation graphAutomatic differentiation - lexfridman
Deep Reinforcement Learning Fundamentals: From Perceptrons to Q-Learning for Motion Planning
TechnologyDeep Reinforcement Learning (DRL)Supervised LearningUnsupervised LearningSemi-supervised Learning - lexfridman
Recurrent Neural Networks and the Fundamentals of Backpropagation for Steering Through Time
TechnologyRecurrent Neural Networks (RNNs)BackpropagationVanishing GradientsExploding Gradients - lexfridman
Andrew Ng on Deep Learning, Education, Automation, and the Future of AI Development
TechnologyMachine LearningDeep LearningArtificial Intelligence (AI)Automation
Knowledge Graph
Related concepts — line thickness indicates connection strength. Click any node to explore.
Related concepts
Concepts that appear alongside gradient descent across episodes.
- backpropagation
- neural networks
- supervised learning
- deep learning
- machine learning
- convolutional neural networks (cnns)
- unsupervised learning
- symbolic ai
- turing test
- reinforcement learning
- artificial intelligence (ai)
- forward pass
- reinforcement learning (rl)
- exploration (in rl)
- qualia
- generative adversarial networks (gans)
- transformer networks
- natural language processing (nlp)
- recurrent neural networks (rnns)
- lasagne (deep learning library)