File size: 1,115 Bytes
6216ff6
 
 
 
 
 
 
 
16f2c7e
6216ff6
 
 
 
 
b319f70
6216ff6
 
b319f70
6216ff6
b319f70
 
 
 
 
 
 
2567fa1
 
 
 
 
 
b319f70
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
---
base_model: unsloth/qwen2.5-7b-instruct-unsloth-bnb-4bit
tags:
- text-generation-inference
- transformers
- unsloth
- qwen2
- trl
- sft
license: apache-2.0
language:
- en
---

<img src="https://cdn-uploads.huggingface.co/production/uploads/647374aa7ff32a81ac6d35d4/Dzbdzn27KEc3K6zNNi070.png" style="display: block;margin-left: auto;margin-right: auto;width: 50%;">


## Description

A model tailored to be conversational and execute function calls with [LocalAI](https://github.com/mudler/LocalAI). This model is based on qwen2.5 (7B).

- llama3.2-1b version: https://huggingface.co/mudler/LocalAI-functioncall-llama3.2-1b-v0.4
- llama3.2-3b version: https://huggingface.co/mudler/LocalAI-functioncall-llama3.2-3b-v0.5
- phi-4 version: https://huggingface.co/mudler/LocalAI-functioncall-phi-4-v0.3
- qwen2.5 (7b) version: https://huggingface.co/mudler/LocalAI-functioncall-qwen2.5-7b-v0.5/

## Usage

```
local-ai run localai-functioncall-qwen2.5-7b-v0.5
```

[![local-ai-banner.png](https://cdn-uploads.huggingface.co/production/uploads/647374aa7ff32a81ac6d35d4/bXvNcxQqQ-wNAnISmx3PS.png)](https://localai.io)