Skip to main content

DeepInfra Integration

DeepInfra is a platform that allows you to quickly host different open-source models. This guide describes how you can integrate DeepInfra with BricksAI.

Step 0. Deploy a model on DeepInfra​

If you haven't already, sign up on DeepInfra and deploy a model following this guide. The deployment URL can be found by clicking on your deployment and navigating to the "API" tab. Your API key can be found on your API keys page.

Step 1. Add your DeepInfra deployment​

Go to the Settings page. Under "LLM providers", click "Add provider", select "DeepInfra", fill in your deployment URL and API key, then click "Add".

Step 2. Create a proxy secret key​

To create a proxy secret key, go to the Secret keys page. Click "Create a new secret key", fill in all information, then click "Create".

Step 3. Make a call to DeepInfra via BricksAI​

Here is a list of all currently supported DeepInfra API endpoints.

Below are sample code snippets for calling DeepInfra with BricksAI:

curl --request POST \
  --url https://api.trybricks.ai/api/providers/DeepInfra/v1/chat/completions \
  --header 'Authorization: Bearer your-bricks-secret-key' \
  --header 'Content-Type: application/json' \
  --data '{
    "model": "facebook/opt-125m",
    "messages": [
      {
        "role": "user",
        "content": "What is 1+1?"
      }
    ]
  }'