Add model files

.gitattributes

@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+tokenizer.json filter=lfs diff=lfs merge=lfs -text

Modelfile

@@ -0,0 +1,11 @@
+# ollama modelfile auto-generated by llamafactory
+
+FROM .
+
+TEMPLATE """{{ if .System }}System: {{ .System }}<|im_end|>
+{{ end }}{{ range .Messages }}{{ if eq .Role "user" }}Human: {{ .Content }}<|im_end|>
+Assistant:{{ else if eq .Role "assistant" }}{{ .Content }}<|im_end|>
+{{ end }}{{ end }}"""
+
+PARAMETER stop "<|im_end|>"
+PARAMETER num_ctx 4096

README.md

@@ -1,3 +1,150 @@
----
-license: apache-2.0
----
+---
+library_name: peft
+license: other
+base_model: agentlans/Qwen2.5-1.5B-Instruct-drill
+tags:
+- llama-factory
+- generated_from_trainer
+model-index:
+- name: Qwen2.5-1.5B-Instruct-Titler
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# Qwen2.5-1.5B-Instruct-Titler
+
+This model is a fine-tuned version of [agentlans/Qwen2.5-1.5B-Instruct-drill](https://huggingface.co/agentlans/Qwen2.5-1.5B-Instruct-drill) on the [agentlans/finewebedu-annotated](https://huggingface.co/datasets/agentlans/finewebedu-annotated) dataset.
+
+## Model description
+
+This model generates a summary from a piece of text in XML format.
+
+Input format:
+```text
+Title:
+{{YOUR_TEXT_HERE}}
+```
+
+Output format:
+```xml
+<titles>
+<title>Title</title>
+<subtitle>Subtitle</subtitle>
+</titles>
+```
+
+### Example
+
+<details>
+<summary>Click here for example input prompt</summary>
+
+From Wikisource contributors. ["Sophocles' King Oedipus."](https://en.wikisource.org/wiki/Sophocles%27_King_Oedipus) Wikisource . Wikisource , 13 Mar. 2025. Web. 19 Apr. 2025.
+
+```
+Summarize:
+Oedipus. Children, descendants of old Cad­mus, why do you come before me, why do you carry the branches of suppliants, while the city smokes with incense and murmurs with prayer and lamentation? I would not learn from any mouth but yours, old man, therefore I question you myself. Do you know of anything that I can do and have not done? How can I, being the man I am, being King Oedipus, do other than all I know? I were indeed hard of heart did I not pity such suppliants.
+
+Priest. Oedipus, King of my country, you can see our ages who are before your door; some it may be too young for such a journey, and some too old, Priests of Zeus such as I, and these chosen young men; while the rest of the people crowd the market-places with their suppliant branches, for the city stumbles towards death, hardly able to raise up its head. A blight has fallen upon the fruitful blossoms of the land, a blight upon flock and field and upon the bed of marriage—plague ravages the city. Oedipus, King, not god but foremost of living men, seeing that when you first came to this town of Thebes you freed us from that harsh singer, the riddling sphinx, we beseech you, all we suppliants, to find some help. Whether you find it by your power as a man, or because, being near the gods, a god has whispered you. Uplift our State; think upon your fame; your coming brought us luck, be lucky to us still, remember that it is better to rule over men than over a waste place, since neither walled town nor ship is anything if it be empty and no man within it.
+
+Oedipus. My unhappy children! I know well what need has brought you, what suffering you endure, yet sufferers though you be, there is not a single one whose suffering is as mine—each mourns himself, but my soul mourns the city, myself, and you. It is not therefore as if you came to arouse a sleeping man. No! Be certain that I have wept many tears and searched hither and thither for some remedy. I have already done the only thing that came in to my head for all my search. I have sent the son of Menoeceus, Creon, my own wife’s brother, to the Pythian House of Phoebus, to hear if deed or word of mine may yet deliver this town. I am troubled, for he is a long time away—a longer time than should be—but when he comes I shall not be an honest man unless I do whatever the god commands.
+
+Priest. You have spoken at the right time. They have just signalled to us that Creon has arrived.
+
+Oedipus. O King Apollo, may he bring brighter fortune, for his face is shining.
+
+Priest. He brings good news, for he is crowned with bay.
+
+Oedipus. We shall know soon. Brother-in-law, Menoeceus’ son, what news from the god?
+
+Creon. Good news; for pain turns to pleasure when we have set the crooked straight.
+
+Oedipus. But what is the oracle—so far the news is neither good nor bad.
+
+Creon. If you would hear it with all these about you, I am ready to speak. Or do we go within?
+
+Oedipus. Speak before all. The sorrow I endure is less for my own life than these.
+
+Creon. Then, with your leave, I speak. Our lord Phoebus bids us drive out a defiling thing that has been cherished in this land.
+
+Oedipus. By what purification?
+
+Creon. King Laius was our king before you came to pilot us.
+
+Oedipus. I know—but not of my own knowledge, for I never saw him.
+
+Creon. He was killed; and the god now bids us revenge it on his murderers, whoever they be.
+
+Oedipus. Where shall we come upon their track after all these years? Did he meet his death in house or field, at home or in some foreign land?
+
+Creon. In a foreign land: he was journey­ing to Delphi.
+
+Oedipus. Did no fellow-traveller see the deed? Was there none there who could be questioned?
+
+Creon. All perished but one man who fled in terror and could tell for certain but one thing of all he had seen.
+
+Oedipus. One thing might be a clue to many things.
+
+Creon. He said that they were fallen upon by a great troop of robbers.
+
+Oedipus. What robbers would be so daring unless bribed from here?
+
+Creon. Such things were indeed guessed at, but Laius once dead no avenger arose. We were amid our troubles.
+
+Oedipus. But when royalty had fallen what troubles could have hindered search?
+
+Creon. The riddling sphinx put those dark things out of our thoughts—we thought of what had come to our own doors.
+
+Oedipus. But I will start afresh and make the dark things plain. In doing right by Laius I protect myself, for whoever slew Laius might turn a hand against me. Come, my children, rise up from the altar steps; lift up these suppliant boughs and let all the children of Cadmus be called hither that I may search out everything and find for all happiness or misery as god wills.
+
+Priest. May Phoebus, sender of the oracle, come with it and be our saviour and deliverer.
+```
+</details>
+
+Output:
+```xml
+<titles>
+<title>Oedipus Rex: Unraveling the Mysteries of Ancient Greek Tragedy</title>
+<subtitle>A Study of Fate, Family, and Redemption through the Eyes of Sophocles' Masterpiece</subtitle>
+</titles>
+```
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 5e-05
+- train_batch_size: 2
+- eval_batch_size: 8
+- seed: 42
+- gradient_accumulation_steps: 8
+- total_train_batch_size: 16
+- optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
+- lr_scheduler_type: cosine
+- num_epochs: 3.0
+
+### Training results
+
+
+
+### Framework versions
+
+- PEFT 0.15.0
+- Transformers 4.49.0
+- Pytorch 2.6.0+cu124
+- Datasets 3.4.1
+- Tokenizers 0.21.0

added_tokens.json

@@ -0,0 +1,24 @@
+{
+  "</tool_call>": 151658,
+  "<tool_call>": 151657,
+  "<|box_end|>": 151649,
+  "<|box_start|>": 151648,
+  "<|endoftext|>": 151643,
+  "<|file_sep|>": 151664,
+  "<|fim_middle|>": 151660,
+  "<|fim_pad|>": 151662,
+  "<|fim_prefix|>": 151659,
+  "<|fim_suffix|>": 151661,
+  "<|im_end|>": 151645,
+  "<|im_start|>": 151644,
+  "<|image_pad|>": 151655,
+  "<|object_ref_end|>": 151647,
+  "<|object_ref_start|>": 151646,
+  "<|quad_end|>": 151651,
+  "<|quad_start|>": 151650,
+  "<|repo_name|>": 151663,
+  "<|video_pad|>": 151656,
+  "<|vision_end|>": 151653,
+  "<|vision_pad|>": 151654,
+  "<|vision_start|>": 151652
+}

config.json

@@ -0,0 +1,29 @@
+{
+  "_name_or_path": "/drive2/Repo/Qwen2.5-1.5B-Instruct-drill",
+  "architectures": [
+    "Qwen2ForCausalLM"
+  ],
+  "attention_dropout": 0.0,
+  "bos_token_id": 151643,
+  "eos_token_id": 151645,
+  "hidden_act": "silu",
+  "hidden_size": 1536,
+  "initializer_range": 0.02,
+  "intermediate_size": 8960,
+  "max_position_embeddings": 32768,
+  "max_window_layers": 21,
+  "model_type": "qwen2",
+  "num_attention_heads": 12,
+  "num_hidden_layers": 28,
+  "num_key_value_heads": 2,
+  "rms_norm_eps": 1e-06,
+  "rope_scaling": null,
+  "rope_theta": 1000000.0,
+  "sliding_window": 32768,
+  "tie_word_embeddings": true,
+  "torch_dtype": "bfloat16",
+  "transformers_version": "4.49.0",
+  "use_cache": true,
+  "use_sliding_window": false,
+  "vocab_size": 151936
+}

generation_config.json

@@ -0,0 +1,14 @@
+{
+  "bos_token_id": 151643,
+  "do_sample": true,
+  "eos_token_id": [
+    151645,
+    151643
+  ],
+  "pad_token_id": 151643,
+  "repetition_penalty": 1.1,
+  "temperature": 0.7,
+  "top_k": 20,
+  "top_p": 0.8,
+  "transformers_version": "4.49.0"
+}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5511f22f16a4f6807d314c87cf22b285f700d78b7eae1bc8d2366e5af63b03ca
+size 3087467144

special_tokens_map.json

@@ -0,0 +1,31 @@
+{
+  "additional_special_tokens": [
+    "<|im_start|>",
+    "<|im_end|>",
+    "<|object_ref_start|>",
+    "<|object_ref_end|>",
+    "<|box_start|>",
+    "<|box_end|>",
+    "<|quad_start|>",
+    "<|quad_end|>",
+    "<|vision_start|>",
+    "<|vision_end|>",
+    "<|vision_pad|>",
+    "<|image_pad|>",
+    "<|video_pad|>"
+  ],
+  "eos_token": {
+    "content": "<|im_end|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<|endoftext|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9c5ae00e602b8860cbd784ba82a8aa14e8feecec692e7076590d014d7b7fdafa
+size 11421896

tokenizer_config.json

@@ -0,0 +1,209 @@
+{
+  "add_bos_token": false,
+  "add_prefix_space": false,
+  "added_tokens_decoder": {
+    "151643": {
+      "content": "<|endoftext|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151644": {
+      "content": "<|im_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151645": {
+      "content": "<|im_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151646": {
+      "content": "<|object_ref_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151647": {
+      "content": "<|object_ref_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151648": {
+      "content": "<|box_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151649": {
+      "content": "<|box_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151650": {
+      "content": "<|quad_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151651": {
+      "content": "<|quad_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151652": {
+      "content": "<|vision_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151653": {
+      "content": "<|vision_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151654": {
+      "content": "<|vision_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151655": {
+      "content": "<|image_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151656": {
+      "content": "<|video_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151657": {
+      "content": "<tool_call>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151658": {
+      "content": "</tool_call>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151659": {
+      "content": "<|fim_prefix|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151660": {
+      "content": "<|fim_middle|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151661": {
+      "content": "<|fim_suffix|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151662": {
+      "content": "<|fim_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151663": {
+      "content": "<|repo_name|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151664": {
+      "content": "<|file_sep|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    }
+  },
+  "additional_special_tokens": [
+    "<|im_start|>",
+    "<|im_end|>",
+    "<|object_ref_start|>",
+    "<|object_ref_end|>",
+    "<|box_start|>",
+    "<|box_end|>",
+    "<|quad_start|>",
+    "<|quad_end|>",
+    "<|vision_start|>",
+    "<|vision_end|>",
+    "<|vision_pad|>",
+    "<|image_pad|>",
+    "<|video_pad|>"
+  ],
+  "bos_token": null,
+  "chat_template": "{% if messages[0]['role'] == 'system' %}{% set loop_messages = messages[1:] %}{% set system_message = messages[0]['content'] %}{% else %}{% set loop_messages = messages %}{% endif %}{% if system_message is defined %}{{ 'System: ' + system_message + '<|im_end|>' + '\n' }}{% endif %}{% for message in loop_messages %}{% set content = message['content'] %}{% if message['role'] == 'user' %}{{ 'Human: ' + content + '<|im_end|>' + '\nAssistant:' }}{% elif message['role'] == 'assistant' %}{{ content + '<|im_end|>' + '\n' }}{% endif %}{% endfor %}",
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "<|im_end|>",
+  "errors": "replace",
+  "extra_special_tokens": {},
+  "model_max_length": 131072,
+  "pad_token": "<|endoftext|>",
+  "padding_side": "left",
+  "split_special_tokens": false,
+  "tokenizer_class": "Qwen2Tokenizer",
+  "unk_token": null
+}