How to Count...

Counting, Permutations and Combinations

Notes on PyTorch Matrix-Matrix Multiplication

Notes on PyTorch Matrix-Matrix Multiplication torch.bmm and torch.matmul

Notes on PyTorch Tensor Representation and Autograd

Notes on PyTorch Tensor Internals including Strided Representation, Strides, View, and Autograd

Attention Mechanism - What are Query, Key, and Value?

Explain Query, Key, Value and Output in Attention Mechanism with an analogy of Information Retrieval System. Discuss different Attention Mechanisms, including Dot-Product, Scaled Dot-Product Attention, and Self Attention. Talk about the Query, Key, Value, and Output choices in the standard Transformer.

Probability Theory, Maximum Likelihood Estimate & Maximum a Posteriori Estimation

Discuss the Joint Probability, Marginal Probability, Conditional Probability and Maximum Likelihood Estimate with Math and Python.

Kaggle Competition Write-up - Stanford OpenVaccine mRNA Vaccine Degradation Prediction

Gold model solution sharing on a Kaggle Competition about applying Neural Networks to mRNA sequences to predict base degradation.