hyperbolic tangent
2 episodes mention this concept
lexfridmanSep 27, 2016Sequence to Sequence Deep Learning: From Smart Reply to Attention Mechanisms
TechnologySequence to Sequence Learning (Seq2Seq)Recurrent Neural Networks (RNNs)Encoder-Decoder ArchitectureAttention Mechanism- lexfridmanSep 27, 2016
Foundations of Deep Learning: Feedforward Neural Networks, Backpropagation, and Training Techniques
TechnologyFeedforward Neural NetworksInput VectorHidden LayersPre-activation
Knowledge Graph
Related concepts — line thickness indicates connection strength. Click any node to explore.
Related concepts
Concepts that appear alongside hyperbolic tangent across episodes.
- beam search decoding
- sequence to sequence learning (seq2seq)
- softmax
- recurrent neural networks (rnns)
- model selection (underfitting/overfitting)
- greedy decoding
- tokenization and normalization
- word vectors
- scheduled sampling
- hidden states
- bag-of-words representation
- out-of-vocabulary (oov) words
- fixed-length representation
- logistic regression
- encoder-decoder architecture
- attention mechanism
- auto-regressive models
- stochastic gradient descent (sgd)
- auto-differentiation