Text Generation

Basic usage

Send a prompt to a model to generate text:

import Bytez from 'bytez.js'

const sdk = new Bytez("BYTEZ_KEY");
const model = sdk.model("Qwen/Qwen2-7B-Instruct");

await model.create()

const { error, output } = await model.run(
  "Once upon a time there was a beautiful home where",
  { max_new_tokens: 200, min_new_tokens: 50, temperature: 0.5 }
);

console.log({ error, output })

Text Classification Image Generation

Model API