File size: 1,189 Bytes
211a33c
 
 
 
 
 
 
 
 
 
 
 
 
0cd0132
211a33c
 
 
 
 
 
 
 
 
 
 
83ecc7a
 
d38ba8a
 
211a33c
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
---
license: mit
datasets:
- teapotai/synthqa
language:
- en
- fr
- ro
- de
- multilingual
library_name: transformers.js
tags:
- text2text-generation
- 783M
base_model:
- teapotai/teapotllm
pipeline_tag: text2text-generation
---

# TeapotAI TeapotLLM ONNX

ONNX version of [teapotai/teapotllm](https://huggingface.co/teapotai/teapotllm) to use with [Transformers.js](https://github.com/huggingface/transformers.js).

Also includes a JavaScript version of the teapotai python package for interacting with the model using the Transformers.js library.

View the example script [index.js](https://huggingface.co/tomasmcm/teapotai-teapotllm-onnx/blob/main/index.js).

**Check the [WebGPU ONNX Playground](https://huggingface.co/spaces/tomasmcm/teapotai-teapotllm-onnx).**

## Installation

```bash
yarn install
```

## Usage

This library provides a `TeapotAI` class that helps you interact with language models. Here's a basic example:

```javascript
import TeapotAI from './TeapotAI.js';

const ai = new TeapotAI({
  pipelineOptions: {
    dtype: 'q4'
  }
});

// Query with context
const response = await ai.query(
  "What is the capital?",
  "France is a country in Western Europe."
);
```