Attention Mechanism - What are Query, Key, and Value?
Explain Query, Key, Value and Output in Attention Mechanism with an analogy of Information Retrieval System. Discuss different Attention Mechanisms, including Dot-Product, Scaled Dot-Product Attention, and Self Attention. Talk about the Query, Key, Value, and Output choices in the standard Transformer.
Probability Theory, Maximum Likelihood Estimate & Maximum a Posteriori Estimation
Discuss the Joint Probability, Marginal Probability, Conditional Probability and Maximum Likelihood Estimate with Math and Python.
Kaggle Competition Write-up - Stanford OpenVaccine mRNA Vaccine Degradation Prediction
Gold model solution sharing on a Kaggle Competition about applying Neural Networks to mRNA sequences to predict base degradation.