This is the multi-page printable view of this section. Click here to print.

Return to the regular view of this page.

Anthropic

Using Anthropic with Foyle

    What You’ll Learn

    How to configure Foyle to use Anthropic Models

    Prerequisites

    1. You need a Anthropic account

    Setup Foyle To Use Anthropic Models

    1. Get an API Token from the Anthropic Console and save it to a file

    2. Configure Foyle to use this API key

    foyle config set anthropic.apiKeyFile=/path/to/your/key/file
    1. Configure Foyle to use the desired Antrhopic Model
    foyle config set  agent.model=claude-3-5-sonnet-20240620
foyle config set  agent.modelProvider=anthropic

    How It Works

    Foyle uses 2 Models

    • A Chat model to generate completions
    • An embedding model to compute embeddings for RAG

    Anthropic’s models.

    Anthropic doesn’t provide embedding models so Foyle continues to use OpenAI for the embedding models. At some, we may add support for Voyage AI’s embedding models.