AI & ML interests

Deep Learning, Computer Vision, Machine Learning

Recent Activity

ariG23498Β 
posted an update 3 months ago
view post
Post
1215
New post is live!

This time we cover some major updates to transformers.

πŸ€—
  • 1 reply
Β·
ariG23498Β 
posted an update 5 months ago
ariG23498Β 
posted an update 6 months ago
view post
Post
1738
🚨 Implement KV Cache from scratch in pure PyTorch. 🚨

We have documented all of our learning while implementing KV Cache to nanoVLM. Joint work with @kashif @lusxvr @andito @pcuenq

Blog: hf.co/blog/kv-cache
  • 1 reply
Β·
ariG23498Β 
posted an update 11 months ago
view post
Post
2852
Tried my hand at simplifying the derivations of Direct Preference Optimization.

I cover how one can reformulate RLHF into DPO. The idea of implicit reward modeling is chef's kiss.

Blog: https://huggingface.co/blog/ariG23498/rlhf-to-dpo
ariG23498Β 
posted an update 11 months ago
ariG23498Β 
posted an update about 1 year ago