infosys
/

NT-Java-1.1B

Text Generation

NarrowTransformer

text-generation-inference

Model card Files Files and versions

rajabmondal commited on May 21, 2024

Commit

f341627

·

verified ·

1 Parent(s): d1f176f

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -53,7 +53,7 @@ duplicated_from: bigcode-data/starcoderbase-1b
 ## Model Summary
-The Narrow Transformer (NT) model NT-Java-1.1B is an open-source specialized code model built by extending pre-training on StarCoderBase-1B, designed for coding tasks in Java programming. The model is a decoder-only transformer with Multi-Query-Attention and with a context length of 8192 tokens. The model was trained with Java subset of the StarCoderData dataset, which is ~22B tokens.
 - **Repository:** [bigcode/Megatron-LM](https://github.com/bigcode-project/Megatron-LM)
 - **Paper:**

 ## Model Summary
+The Narrow Transformer (NT) model NT-Java-1.1B is an open-source specialized code model built by extending pre-training on StarCoderBase-1B, designed for coding tasks in Java programming. The model is a decoder-only transformer with Multi-Query Attention and with a context length of 8192 tokens. The model was trained with Java subset of the StarCoderData dataset, which is ~22B tokens.
 - **Repository:** [bigcode/Megatron-LM](https://github.com/bigcode-project/Megatron-LM)
 - **Paper:**