Prem
Collection
Finetunes and Quantizations of the Prem LLMs • 13 items • Updated • 2
How to use ucalyptus/prem-1B-chat-ONNX with Transformers.js:
// npm i @huggingface/transformers
import { pipeline } from '@huggingface/transformers';
// Allocate pipeline
const pipe = await pipeline('text-generation', 'ucalyptus/prem-1B-chat-ONNX');https://huggingface.co/premai-io/prem-1B-chat with ONNX weights to be compatible with Transformers.js.
Note: Having a separate repo for ONNX weights is intended to be a temporary solution until WebML gains more traction. If you would like to make your models web-ready, we recommend converting to ONNX using 🤗 Optimum and structuring your repo like this one (with ONNX weights located in a subfolder named onnx).