Update README.md
Browse files
README.md
CHANGED
|
@@ -40,19 +40,6 @@ extra_gated_fields:
|
|
| 40 |
duplicated_from: bigcode-data/starcoderbase-1b
|
| 41 |
---
|
| 42 |
|
| 43 |
-
|
| 44 |
-
# NT-Java-1.1B
|
| 45 |
-
|
| 46 |
-
|
| 47 |
-
## Table of Contents
|
| 48 |
-
|
| 49 |
-
1. [Model Summary](#model-summary)
|
| 50 |
-
2. [Intended Uses](#intended-uses)
|
| 51 |
-
3. [Limitations](#limitations)
|
| 52 |
-
4. [Training](#training)
|
| 53 |
-
5. [License](#license)
|
| 54 |
-
6. [Citation](#citation)
|
| 55 |
-
|
| 56 |
## Model Summary
|
| 57 |
|
| 58 |
The Narrow Transformer (NT) model NT-Java-1.1B is an open-source specialized code model built by extending pre-training on StarCoderBase-1B, designed for coding tasks in Java programming. The model is a decoder-only transformer with Multi-Query Attention and with a context length of 8192 tokens. The model was trained with Java subset of the StarCoderData dataset, which is ~22B tokens.
|
|
|
|
| 40 |
duplicated_from: bigcode-data/starcoderbase-1b
|
| 41 |
---
|
| 42 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 43 |
## Model Summary
|
| 44 |
|
| 45 |
The Narrow Transformer (NT) model NT-Java-1.1B is an open-source specialized code model built by extending pre-training on StarCoderBase-1B, designed for coding tasks in Java programming. The model is a decoder-only transformer with Multi-Query Attention and with a context length of 8192 tokens. The model was trained with Java subset of the StarCoderData dataset, which is ~22B tokens.
|