Sumuk Shashidhar's picture

8 7 4

Sumuk Shashidhar PRO

sumuks

·

https://sumuk.org

AI & ML interests

Evaluations, Reasoning, Long Term Planning

Recent Activity

updated a dataset about 3 hours ago

sumuks/relevance_rerankers_large

published a dataset about 3 hours ago

sumuks/relevance_rerankers_large

updated a dataset about 3 hours ago

sumuks/relevance_reranking_msmarco_sampled

View all activity

Organizations

sumuks's activity

upvoted a collection about 1 month ago

Gemma 3 QAT

Quantization Aware Trained (QAT) Gemma 3 checkpoints. The model preserves similar quality as half precision while using 3x less memory • 15 items • Updated 20 days ago • 187

upvoted a paper about 1 month ago

YourBench: Easy Custom Evaluation Sets for Everyone

Paper • 2504.01833 • Published Apr 2 • 20

upvoted a collection about 1 month ago

YourBench: Easy Custom Evaluation Sets For Everyone

2 items • Updated Mar 30 • 1

upvoted a paper 5 months ago

Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluation

Paper • 2412.03304 • Published Dec 4, 2024 • 19

upvoted 2 papers 7 months ago

Democratizing LLMs: An Exploration of Cost-Performance Trade-offs in Self-Refined Open-Source Models

Paper • 2310.07611 • Published Oct 11, 2023 • 2

Unsupervised Human Preference Learning

Paper • 2410.03731 • Published Sep 30, 2024 • 2

upvoted a collection over 1 year ago

Recent models: last 100 repos, sorted by creation date

The last 100 repos I have created. Sorted by creation date descending, so the most recently created repos appear at the top. • 121 items • Updated Jan 31, 2024 • 534