Measured on native questions

Azerbaijani ability, measured — not claimed

Prometheus is evaluated on the Azerbaijani questions of TUMLU, a benchmark written natively in eight Turkic languages, so its Azerbaijani is measured on real Azerbaijani material rather than on translated tests.

Overview

Evaluated on TUMLU

It is easy to claim a model speaks Azerbaijani; it is harder to prove it. Prometheus is evaluated on TUMLU, a benchmark of 38,139 questions written natively in eight Turkic languages across 11 academic subjects. Its Azerbaijani questions were written in Azerbaijani, not translated from English, so the test measures the language as people actually use it.

What it does

Why a native benchmark matters

✓

Evaluated on TUMLU’s native Azerbaijani questions.

✓

TUMLU covers 11 academic subjects in eight Turkic languages, Azerbaijani among them.

✓

No translated questions: each was written in its own language.

✓

Provides an objective measure of Azerbaijani ability.

✓

Backs a model built natively for Azerbaijani and run on your own infrastructure.

How it works

How it is evaluated

1Native Azerbaijani questions are drawn from 11 subjects
2Prometheus answers TUMLU’s Azerbaijani questions
3Results measure real Azerbaijani ability
4No translated content skews the score
FAQ

Common questions

What is TUMLU?

TUMLU is a benchmark of 38,139 questions written natively in eight Turkic languages, Azerbaijani among them, across 11 academic subjects. Prometheus is evaluated on its Azerbaijani questions.

Are the questions translated from English?

No. TUMLU’s Azerbaijani questions were written in Azerbaijani, with no translated content.

Why does the benchmark matter?

It replaces marketing claims with an objective measure of how well the model actually handles native Azerbaijani across many disciplines.

Explore more

More of what Prometheus does

Get started

See Prometheus on your own infrastructure

Request a demo to see Prometheus running on-premise — Azerbaijani understanding, model sizing and API integration, end to end.