-
How to get gold medal in Kaggle competition, from a Competition Master perspective.
I summarized 7 key points about how to get a Kaggle competition gold medal.
-
Implementing PPO from scratch
I tried to implementing PPO from scratch and apply it to Procgen environment. Here is what I learnt.
-
Replicating Scaling Laws by using MNIST data
I tried to replicating scaling laws result by using MNIST data. Here is what I learnt.
-
Find the induction heads in GPT-2
I tried to replicating the Decoder-only transformer by following "Attention is all you need" paper and trained it on William Shakespeare's work.
-
Replicating Decoder-only Transformer by using William Shakespeare Corpus
I tried to replicating the Decoder-only transformer by following "Attention is all you need" paper and trained it on William Shakespeare's work.