Attention Mechanism - What are Query, Key, and Value?

Explain Query, Key, Value and Output in Attention Mechanism with an analogy of Information Retrieval System. Discuss different Attention Mechanisms, including Dot-Product, Scaled Dot-Product Attention, and Self Attention. Talk about the Query, Key, Value, and Output choices in the standard Transformer.

Probability Theory, Maximum Likelihood Estimate & Maximum a Posteriori Estimation

Discuss the Joint Probability, Marginal Probability, Conditional Probability and Maximum Likelihood Estimate with Math and Python.

Kaggle Competition Write-up - Stanford OpenVaccine mRNA Vaccine Degradation Prediction

Gold model solution sharing on a Kaggle Competition about applying Neural Networks to mRNA sequences to predict base degradation.