17 lines
791 B
Markdown
17 lines
791 B
Markdown
---
|
|
title: Open Source Model Providers for Chat API
|
|
description: Explore tested open source models compatible with the OpenAI chat API, including OpenRouter, Perplexity, and RunPod LLMs.
|
|
---
|
|
|
|
# Instructor with open source models
|
|
Instructor works with Open source model providers that support the [OpenAI API chat endpoint](https://platform.openai.com/docs/api-reference/chat)
|
|
|
|
See examples README [here](https://github.com/jxnl/instructor/tree/main/examples/open_source_examples)
|
|
|
|
# Currently tested open source model providers
|
|
- [OpenRouter](https://openrouter.ai/)
|
|
- [Perplexity](https://www.perplexity.ai/)
|
|
- [RunPod TheBloke LLMs](https://github.com/TheBlokeAI/dockerLLM/blob/main/README_Runpod_LocalLLMsUI.md) **
|
|
|
|
|
|
** This utilizes text-generation-webui w/ Openai plugin under the hood. |