Tree BG 1
Tree
Tree
TreeLeaves
TreeLeaves
Cat IdleGrassGrassRockRock

Beta Observability Evaluations Scorers Endpoints

(beta) Observability - Evaluations - Scorers API.

List scorers

GET /v1/observability/scorers#

List scorers

200

Successful Response

Playground

Test the endpoints live

curl https://api.mistral.ai/v1/observability/scorers \
 -X GET \
 -H 'Authorization: Bearer YOUR_APIKEY_HERE'

200

{
  "scorers": {
    "count": 87
  }
}

Create a scorer

POST /v1/observability/scorers#

Create a scorer

201

Successful Response

created_at#
*date-time
description#
*string|null
kind#
*"llm_judge"
latest_version#
*ScorerVersion
name#
*string
slug#
*string
updated_at#
*date-time

Playground

Test the endpoints live

curl https://api.mistral.ai/v1/observability/scorers \
 -X POST \
 -H 'Authorization: Bearer YOUR_APIKEY_HERE' \
 -H 'Content-Type: application/json' \
 -d '{
  "config": {
    "model": "mistral-small-latest",
    "output_spec": {},
    "prompt_template": "consequat do"
  },
  "kind": "llm_judge",
  "name": "My resource"
}'

201

{
  "created_at": "2025-12-17T10:25:07.818693Z",
  "description": null,
  "kind": "llm_judge",
  "latest_version": {
    "config": {
      "model": "mistral-small-latest",
      "output_spec": {},
      "prompt_template": "consequat do"
    },
    "created_at": "2025-12-17T10:25:07.818693Z",
    "creator_id": "019b2bd7-96e7-7219-8c0b-45a73da50088",
    "variables": [
      "occaecat dolor sit"
    ],
    "version": 87
  },
  "name": "My resource",
  "slug": "aute aliqua aute commodo",
  "updated_at": "2025-12-17T10:41:03.469341Z"
}

Get a scorer by slug

GET /v1/observability/scorers/{scorer_slug}#

Get a scorer by slug

200

Successful Response

created_at#
*date-time
description#
*string|null
kind#
*"llm_judge"
latest_version#
*ScorerVersion
name#
*string
slug#
*string
updated_at#
*date-time

Playground

Test the endpoints live

curl https://api.mistral.ai/v1/observability/scorers/{scorer_slug} \
 -X GET \
 -H 'Authorization: Bearer YOUR_APIKEY_HERE'

200

{
  "created_at": "2025-12-17T10:25:07.818693Z",
  "description": null,
  "kind": "llm_judge",
  "latest_version": {
    "config": {
      "model": "mistral-small-latest",
      "output_spec": {},
      "prompt_template": "consequat do"
    },
    "created_at": "2025-12-17T10:25:07.818693Z",
    "creator_id": "019b2bd7-96e7-7219-8c0b-45a73da50088",
    "variables": [
      "occaecat dolor sit"
    ],
    "version": 87
  },
  "name": "My resource",
  "slug": "aute aliqua aute commodo",
  "updated_at": "2025-12-17T10:41:03.469341Z"
}

Edit a scorer

PATCH /v1/observability/scorers/{scorer_slug}#

Edit a scorer

200

Successful Response

created_at#
*date-time
description#
*string|null
kind#
*"llm_judge"
latest_version#
*ScorerVersion
name#
*string
slug#
*string
updated_at#
*date-time

Playground

Test the endpoints live

curl https://api.mistral.ai/v1/observability/scorers/{scorer_slug} \
 -X PATCH \
 -H 'Authorization: Bearer YOUR_APIKEY_HERE' \
 -H 'Content-Type: application/json' \
 -d '{}'

200

{
  "created_at": "2025-12-17T10:25:07.818693Z",
  "description": null,
  "kind": "llm_judge",
  "latest_version": {
    "config": {
      "model": "mistral-small-latest",
      "output_spec": {},
      "prompt_template": "consequat do"
    },
    "created_at": "2025-12-17T10:25:07.818693Z",
    "creator_id": "019b2bd7-96e7-7219-8c0b-45a73da50088",
    "variables": [
      "occaecat dolor sit"
    ],
    "version": 87
  },
  "name": "My resource",
  "slug": "aute aliqua aute commodo",
  "updated_at": "2025-12-17T10:41:03.469341Z"
}