---
title: README
emoji: 🏢
colorFrom: pink
colorTo: blue
sdk: static
pinned: false
---

**LLM360 is an initiative to open-source large language models (LLMs) that foster transparency, trust, and collaborative research.**
<img style="float: right;" src="logo-web250.png" width="250" height="250">

All models under LLM360 will release:

* Up to 360 Intermediate Model Checkpoints
* Training Data with Full Data Sequence
* Training, Data Processing, and Evaluation Source Code
* Logs and Metrics

LLM360 is proudly sponsored by Petuum, MBZUAI, and Cerebras.