Machine Learning

• Loss function
• Regularization
• Overfitting
• Underfitting
• Generalization
• Expectation
• Variance
• Bias
• Error
• Residual
• Regression
• Classification
• Feature selection
• Pattern recognition
• Supervised learning
• Unsupervised learning
• Reinforcement learning
• Discriminative model
• Generative model
• Clustering
• Bootstrap method
• Ensemble learning
• Least Squares Estimation
• Maximum Likelihood Estimation
• Expectation Maximization
• Closed-form solution

Traditional Machine Learning Models

• Linear Regression
• Logistic Regression
• Support Vector Machine
• Perceptron
• Decision Tree
• Gradient Boosting
• Gradient Boosting Decision Tree
• Random Forest
• Gaussian Mixture Model
• K-means Clustering

Probabilistic Graphical Model

• Distribution
• Conditional distribution
• Joint distribution
• Marginal distribution
• Binomial distribution
• Bernoulli distribution
• Categorical distribution
• Multinomial distribution
• Gamma distribution
• Beta distribution
• Dirichlet distribution
• Gaussian distribution
• Bayes' Rule
• Prior probability
• Conjugate prior
• Posterior probability
• Cross Entropy
• Negative Log Likelihood
• KL divergence
• Sampling
• Importance sampling
• Gibbs sampling
• Random walk
• Monte Carlo Method
• Markov Chain Monte Carlo
• Detailed balance condition
• Variational inference
• Probabilistic Graphical Model
• Naive Bayes
• Hidden Markov Model
• Conditional Random Field

Deep Learning

• Forward propagation
• Backward propagation
• Gradient
• Stochastic Gradient Descent
• Convergence
• Convex optimization
• Non-convex optimization
• Activation function
• Neuron
• Weight
• Hidden layer
• Tensor
• Hyperparameter
• Batches
• Epochs
• Pooling
• Padding
• Dropout
• Embedding
• Initialization
• Batch normalization
• Neural Network
• Residual Network
• Recurrent Neural Network
• Long Short-Term memory
• Backpropagation through time
• Convolutional Neural Network
• Variational Autoencoder
• Generative Adversarial Network

(incomplete ...)