Model Support

Currently Supported Models

This library currently supports the following language models:

Llama Models

• meta-llama/Meta-Llama-3-8B-Instruct

  Base model for instruction following tasks with 8B parameters

• meta-llama/Meta-Llama-3.1-70B-Instruct

  Larger instruction model with 70B parameters

Future Support

We are actively working on adding support for additional models. Check back for updates or follow our release notes for the latest additions.