Skip to main content

Quickstart

Run Inference (POST) - Execute a Model
  • Endpoint: POST /models/v2/openai-community/{model}
  • Purpose: Run inference on an open-source model.
Request Body
Response

Unified Input Formats

Bytez simplifies building with 175k+ Open Source and Closed Source AI models by standardizing inputs across 33 ML tasks. This consistency eliminates the need to adjust for varying input structures, allowing seamless integration for text, messages, image, or multiple inputs.

Why Standardization?

  • Reduces integration complexity.
  • Enables task/provider switching without reformatting inputs.

Input Schemas

Text

For models that process text:
json
Tasks: fill-mask, summarization, text-to-speech, translation, text-generation

Messages

For chat, audio-text-to-text, image-text-to-text, and video-text-to-text tasks:
json
Tasks: chat, audio-text-to-text, image-text-to-text, and video-text-to-text

Image

For image processing, use either: URL:
json
Base64:
json
Tasks: image-classification, object-detection, image-to-Text.

Multi-Input

For models needing both text and image or audio or video:
json
Tasks: visual-question-answering, zero-shot-classification, etc. This unified schema accelerates development and ensures compatibility across diverse AI tasks.