Comparing language models on safety and ethical behavior
The index combines results from independent evaluations of harmful assistance, truthfulness, rights and welfare, moral consideration, and responsible use of power. Company governance contributes 10% of the overall score.
- 400
- models analyzed
- 124
- models with enough evidence to rank
- 53
- evals
- 137
- sub-evals
How to read the ranking
Scores are relative summaries of the available safety evidence. Coverage differs across models, and nearby ranks are often indistinguishable: the median 90% rank interval spans 56 places. The most obvious current issue is old models, which were good relative to the models of their day, ranking highly compared to modern, safer models, because of insufficient overlap in evals between old and new models.
Overall ranking
Models appear only after they have results from at least 3 evals covering at least 2 of the five behavior components. Note that e.g. Kimi K3 (capable and new) is missing due to a lack of sufficient evals.
124 models
| Rank | Model | Overall score | Governance | Evals | Components | Release date |
|---|---|---|---|---|---|---|
| 1 [1–37] |  claude-opus-4.7 | 96.7 [57.2–98.8] | 87.4Direct | 13 | 5/5 | 2026-04-16 |
| 2 [1–11] | claude-3.7-sonnet | 94.3 [75.9–97.0] | 87.3Direct | 10 | 4/5 | 2025-02-24 |
| 3 [1–15] | claude-opus-4.8 | 93.5 [71.2–96.9] | 87.4Direct | 10 | 5/5 | 2026-05-28 |
| 4 [1–25] | claude-3.5-sonnet | 90.9 [64.9–96.8] | 87.3Direct | 14 | 5/5 | 2024-06-21 |
| 5 [2–24] |  gpt-5.5 | 90.2 [66.6–93.9] | 82.4Direct | 14 | 5/5 | 2026-04-23 |
| 6 [2–20] | gpt-4 | 88.1 [67.3–94.5] | 62.0Direct | 10 | 3/5 | 2023-03-14 |
| 7 [2–41] | claude-sonnet-4.6 | 87.2 [57.5–94.1] | 87.6Direct | 13 | 5/5 | 2026-01-21 |
| 8 [4–51] | claude-3-opus | 80.6 [52.6–89.9] | 87.3Direct | 13 | 5/5 | 2024-03-04 |
| 9 [3–53] |  gemini-1.5-pro | 79.9 [52.9–91.0] | 68.3Direct | 13 | 5/5 | 2024-02-15 |
| 10 [5–33] |  muse-spark-1.1 | 79.2 [60.3–88.3] | 59.6Direct | 7 | 4/5 | 2026-07-09 |
| 11 [5–38] | claude-fable-5 | 79.1 [57.4–89.1] | 87.4Direct | 7 | 4/5 | 2026-06-09 |
| 12 [3–94] |  mistral-large | 74.5 [39.6–91.8] | 26.0Direct | 3 | 5/5 | 2024-02-26 |
| 13 [7–35] | claude-opus-4.6 | 73.8 [56.6–83.2] | 87.6Direct | 11 | 5/5 | 2026-02-05 |
| 14 [10–39] | claude-opus-4.5 | 71.9 [56.6–80.6] | 87.6Direct | 8 | 4/5 | 2025-11-24 |
| 15 [4–101] | claude-sonnet-4.5 | 71.8 [36.3–90.5] | 87.6Direct | 14 | 5/5 | 2025-09-29 |
| 16 [10–46] | gemini-1.5-flash | 71.5 [54.8–81.4] | 68.3Direct | 10 | 5/5 | 2024-05-14 |
| 17 [9–49] | gpt-4-turbo | 68.7 [53.3–80.7] | 62.0Direct | 11 | 4/5 | 2023-11-06 |
| 18 [7–72] | internlm-chat-7b | 66.8 [47.4–83.4] | 49.8Median-imputed | 3 | 2/5 | 2023-07-06 |
| 19 [9–78] | gpt-5.2 | 66.7 [45.1–79.3] | 81.7Direct | 12 | 5/5 | 2025-12-11 |
| 20 [6–105] | llama-2-7b-chat | 66.5 [34.1–84.5] | 25.3Direct | 9 | 2/5 | 2023-07-18 |
| 21 [8–93] | llama-3.1-405b-instruct | 66.4 [40.2–83.1] | 25.3Direct | 10 | 4/5 | 2024-07-23 |
| 22 [10–56] | claude-3-haiku | 66.4 [51.4–79.0] | 87.3Direct | 10 | 3/5 | 2024-03-13 |
| 23 [9–63] | gpt-5-nano | 64.1 [49.9–79.7] | 73.8Direct | 11 | 4/5 | 2025-08-07 |
| 24 [15–52] |  qwen-14b-chat | 63.7 [52.6–72.2] | 29.5Direct | 5 | 2/5 | 2023-09-25 |
| 25 [9–80] | yi-34b-chat | 63.4 [44.2–80.4] | 49.8Median-imputed | 6 | 2/5 | 2023-11-23 |
| 26 [13–62] | gpt-5-mini | 62.8 [50.1–74.9] | 73.8Direct | 12 | 5/5 | 2025-08-07 |
| 27 [9–87] | claude-3.5-haiku | 62.4 [42.8–80.8] | 87.3Direct | 4 | 5/5 | 2024-10-22 |
| 28 [6–105] | gemini-2.5-flash | 62.3 [35.1–84.3] | 64.9Direct | 15 | 5/5 | 2025-04-17 |
| 29 [15–70] |  glm-5 | 62.1 [47.6–72.9] | 38.3Direct | 3 | 4/5 | 2026-02-12 |
| 30 [13–91] | o3 | 60.7 [41.4–76.2] | 73.8Direct | 10 | 4/5 | 2025-04-16 |
| 31 [13–96] | gpt-5.6-sol | 60.3 [39.3–74.7] | 82.4Direct | 7 | 4/5 | 2026-07-09 |
| 32 [10–104] | qwen3-235b-a22b | 60.1 [34.8–79.6] | 29.5Direct | 10 | 5/5 | 2025-04-29 |
| 33 [11–92] | gpt-oss-120b | 60.1 [40.9–78.1] | 73.8Direct | 9 | 5/5 | 2025-08-05 |
| 34 [21–66] | gpt-5.6-terra | 59.6 [49.1–68.2] | 82.4Direct | 7 | 4/5 | 2026-07-09 |
| 35 [13–81] | claude-sonnet-4 | 59.6 [44.6–76.5] | 88.2Direct | 11 | 4/5 | 2025-05-22 |
| 36 [22–50] | gpt-4.1 | 59.2 [53.3–65.8] | 73.8Direct | 8 | 3/5 | 2025-04-14 |
| 37 [26–47] | claude-opus-4 | 58.5 [54.3–63.0] | 88.2Direct | 5 | 2/5 | 2025-05-22 |
| 38 [7–111] | gpt-3.5-turbo | 58.3 [28.5–82.5] | 62.0Direct | 17 | 5/5 | 2023-03-01 |
| 39 [17–95] | glm-5.1 | 57.1 [39.0–70.0] | 37.8Direct | 8 | 4/5 | 2026-04-07 |
| 40 [28–57] | gpt-5.1 | 57.0 [51.3–62.2] | 81.7Direct | 12 | 4/5 | 2025-11-13 |
| 41 [15–104] | claude-haiku-4.5 | 56.7 [35.0–72.5] | 87.6Direct | 16 | 5/5 | 2025-10-15 |
| 42 [21–79] |  grok-4-2 | 55.6 [45.6–66.9] | 37.4Direct | 7 | 4/5 | 2026-03-10 |
| 43 [25–85] | internlm2-chat-7b | 55.2 [44.1–63.9] | 49.8Median-imputed | 4 | 2/5 | 2024-01-17 |
| 44 [25–73] | internlm2-chat-20b | 55.1 [47.0–64.1] | 49.8Median-imputed | 3 | 2/5 | 2024-01-17 |
| 45 [23–89] | baichuan-2-13b-chat | 54.1 [42.3–67.3] | 49.8Median-imputed | 10 | 3/5 | 2023-09-06 |
| 46 [25–82] | o4-mini | 53.8 [45.0–65.0] | 73.8Direct | 10 | 4/5 | 2025-04-16 |
| 47 [29–82] | o1 | 53.5 [45.1–63.2] | 62.0Direct | 8 | 3/5 | 2024-12-17 |
| 48 [11–109] | llama-3.3-70b-instruct | 53.2 [31.0–77.9] | 25.3Direct | 8 | 4/5 | 2024-12-06 |
| 49 [15–102] |  kimi-k2 | 53.1 [35.7–73.4] | 49.8Median-imputed | 12 | 4/5 | 2025-07-11 |
| 50 [31–79] | gpt-5.6-luna | 53.0 [44.9–60.7] | 82.4Direct | 7 | 4/5 | 2026-07-09 |
| 51 [38–64] | gemini-1.0-pro | 52.9 [49.5–57.5] | 68.3Direct | 6 | 2/5 | 2023-12-06 |
| 52 [33–73] | o1-mini | 52.1 [46.8–60.5] | 62.0Direct | 6 | 2/5 | 2024-09-12 |
| 53 [34–70] |  olmo-2-0325-32b-instruct | 52.1 [48.0–58.4] | 49.8Median-imputed | 4 | 4/5 | 2025-03-13 |
| 54 [39–71] | gemma-7b-it | 52.0 [47.6–57.0] | 68.3Direct | 4 | 2/5 | 2024-02-21 |
| 55 [16–111] |  deepseek-v3 | 51.9 [29.3–72.6] | 21.9Direct | 16 | 4/5 | 2024-12-26 |
| 56 [44–63] | gemini-2-flash | 51.6 [49.9–55.3] | 68.3Direct | 5 | 4/5 | 2024-12-11 |
| 57 [44–67] | gemma-2-27b-it | 51.5 [48.7–55.7] | 68.3Direct | 3 | 2/5 | 2024-06-27 |
| 58 [25–101] | gpt-5.4 | 51.4 [36.7–64.1] | 82.4Direct | 8 | 4/5 | 2026-03-05 |
| 59 [30–90] |  minimax-m2.7 | 51.1 [43.1–61.7] | 49.8Median-imputed | 3 | 4/5 | 2026-04-09 |
| 60 [48–66] | gpt-4.5-preview | 50.9 [49.2–54.3] | 62.0Direct | 5 | 2/5 | 2025-02-27 |
| 61 [23–103] | llama-3-8b-instruct | 50.3 [36.2–66.1] | 25.3Direct | 9 | 2/5 | 2024-04-18 |
| 62 [22–107] | grok-4-fast | 50.0 [32.4–67.9] | 44.0Direct | 8 | 5/5 | 2025-09-19 |
| 63 [41–84] | gpt-oss-20b | 50.0 [43.6–56.8] | 73.8Direct | 6 | 4/5 | 2025-08-05 |
| 64 [30–90] | yi-1.5-34b-chat | 49.6 [41.4–61.6] | 49.8Median-imputed | 3 | 4/5 | 2024-05-13 |
| 65 [13–110] | deepseek-r1 | 49.4 [31.4–74.3] | 21.9Direct | 18 | 5/5 | 2025-01-20 |
| 66 [24–107] | claude-3-sonnet | 48.0 [32.6–66.3] | 87.3Direct | 9 | 3/5 | 2024-03-04 |
| 67 [41–95] | qwen-7b-chat | 47.8 [39.2–56.8] | 29.5Direct | 7 | 3/5 | 2023-08-03 |
| 68 [53–81] | gemma-2b-it | 47.6 [44.4–52.7] | 68.3Direct | 3 | 2/5 | 2024-02-21 |
| 69 [35–103] | gemma-2-9b-it | 47.0 [36.0–58.5] | 68.3Direct | 6 | 4/5 | 2024-06-27 |
| 70 [48–92] | olmo-2-1124-13b-instruct | 46.5 [40.8–54.1] | 49.8Median-imputed | 4 | 4/5 | 2024-11-26 |
| 71 [18–114] | gemini-3.1-pro-preview | 46.3 [28.2–70.6] | 72.3Direct | 10 | 4/5 | 2026-02-19 |
| 72 [38–97] | grok-4.5 | 45.8 [38.5–57.4] | 37.4Direct | 7 | 4/5 | 2026-07-08 |
| 73 [38–101] | qwen1.5-7b-chat | 45.7 [36.3–57.4] | 29.5Direct | 8 | 2/5 | 2024-02-04 |
| 74 [25–106] | qwen-2.5-72b-instruct | 45.3 [32.4–63.2] | 29.5Direct | 8 | 5/5 | 2024-09-19 |
| 75 [24–108] | grok-4.1-fast | 45.2 [32.1–65.9] | 44.0Direct | 9 | 5/5 | 2025-11-19 |
| 76 [52–95] | gpt-4.1-mini | 45.1 [40.0–52.6] | 73.8Direct | 6 | 3/5 | 2025-04-14 |
| 77 [49–98] | yi-6b-chat | 44.9 [38.7–53.9] | 49.8Median-imputed | 5 | 2/5 | 2023-11-23 |
| 78 [72–88] | vicuna-7b-v1.5 | 44.0 [42.5–47.2] | 25.3Base-model inherited | 4 | 2/5 | 2023-06-22 |
| 79 [59–98] |  command-r | 43.3 [37.1–50.9] | 49.8Median-imputed | 5 | 3/5 | 2024-03-11 |
| 80 [39–107] | deepseek-v4-flash | 42.9 [32.4–57.0] | 49.8Median-imputed | 4 | 4/5 | — |
| 81 [35–109] | gemini-3-pro-preview | 42.7 [31.5–58.6] | 72.3Direct | 10 | 3/5 | 2025-11-18 |
| 82 [33–108] | deepseek-v4-pro | 42.6 [31.6–58.9] | 49.8Median-imputed | 4 | 4/5 | — |
| 83 [8–120] | gpt-5 | 42.5 [14.7–81.3] | 73.8Direct | 15 | 4/5 | 2025-08-07 |
| 84 [46–106] | grok-4 | 42.4 [32.8–54.2] | 50.0Direct | 15 | 4/5 | 2025-07-09 |
| 85 [45–110] | gpt-5.4-nano | 40.9 [29.2–54.5] | 82.4Direct | 7 | 4/5 | 2026-03-17 |
| 86 [49–111] | glm-5.2 | 40.5 [29.2–53.4] | 37.8Direct | 9 | 5/5 | 2026-06-16 |
| 87 [73–99] | llama-4-scout | 40.4 [36.8–47.4] | 41.7Direct | 6 | 4/5 | 2025-04-05 |
| 88 [31–112] | glm-4-9b-chat | 40.2 [28.1–61.1] | 49.5Direct | 6 | 4/5 | 2024-06-05 |
| 89 [22–116] | o3-mini | 40.0 [22.2–67.0] | 62.0Direct | 11 | 4/5 | 2025-01-31 |
| 90 [71–103] | command-r-plus | 39.8 [34.9–47.3] | 49.8Median-imputed | 6 | 3/5 | 2024-04-04 |
| 91 [74–103] | vicuna-13b-v1.5 | 39.7 [35.6–46.4] | 25.3Base-model inherited | 4 | 2/5 | 2023-03-30 |
| 92 [36–112] | gpt-5.4-mini | 39.6 [26.7–58.0] | 82.4Direct | 9 | 4/5 | 2026-03-17 |
| 93 [62–109] | llama-2-13b-chat | 38.8 [31.2–50.0] | 25.3Direct | 7 | 3/5 | 2023-07-18 |
| 94 [68–108] | kimi-k2.6-64k | 37.9 [31.8–49.0] | 49.8Median-imputed | 7 | 4/5 | 2026-04-14 |
| 95 [79–108] | mixtral-8x7b-instruct-v0.1 | 37.4 [31.9–45.7] | 26.0Direct | 7 | 2/5 | 2023-12-11 |
| 96 [68–112] | grok-3 | 37.1 [28.3–48.6] | 50.0Direct | 6 | 2/5 | 2025-04-03 |
| 97 [68–111] | kimi-k2.6 | 36.7 [28.1–48.4] | 49.8Median-imputed | 3 | 4/5 | 2026-04-14 |
| 98 [62–112] | kimi-k2.5 | 36.6 [29.4–50.1] | 49.8Median-imputed | 8 | 4/5 | 2026-01-01 |
| 99 [19–121] | chatglm-6b | 34.8 [13.1–66.8] | 49.5Direct | 4 | 2/5 | 2023-03-14 |
| 100 [25–119] | gpt-4o | 34.6 [18.1–63.1] | 62.0Direct | 27 | 5/5 | 2024-05-13 |
| 101 [83–112] | zephyr-7b-beta | 34.6 [28.3–44.1] | 26.0Base-model inherited | 3 | 2/5 | 2023-10-26 |
| 102 [62–116] | gemini-3.5-flash | 34.2 [24.1–50.1] | 75.8Direct | 11 | 5/5 | 2026-05-19 |
| 103 [75–113] | gemini-3-flash-preview | 33.3 [27.0–46.7] | 72.3Direct | 7 | 4/5 | 2025-12-17 |
| 104 [58–116] | qwen-2.5-14b-instruct | 32.0 [22.2–51.3] | 29.5Direct | 4 | 4/5 | 2024-09-19 |
| 105 [60–118] | deepseek-v3.2 | 31.5 [20.5–50.8] | 29.5Direct | 12 | 5/5 | 2025-12-01 |
| 106 [48–119] | llama-3-70b-instruct | 31.3 [17.5–54.1] | 25.3Direct | 8 | 3/5 | 2024-04-18 |
| 107 [16–122] | gemini-2.5-pro | 30.6 [12.0–72.5] | 64.9Direct | 17 | 4/5 | 2025-03-25 |
| 108 [35–122] | llama-4-maverick | 30.4 [12.0–59.3] | 41.7Direct | 10 | 5/5 | 2025-04-05 |
| 109 [66–118] | chatglm3-6b | 30.1 [17.3–49.0] | 49.5Direct | 6 | 2/5 | 2023-10-27 |
| 110 [84–119] | mistral-large-3 | 28.0 [18.7–44.3] | 26.0Direct | 3 | 4/5 | 2025-12-01 |
| 111 [93–118] | mistral-7b-instruct | 26.2 [18.6–41.0] | 26.0Direct | 12 | 3/5 | 2023-09-27 |
| 112 [51–122] | baichuan-2-7b-chat | 24.3 [10.8–53.0] | 49.8Median-imputed | 8 | 2/5 | 2023-09-06 |
| 113 [55–121] | gemini-3.1-flash-lite | 22.8 [12.8–53.1] | 75.8Direct | 10 | 5/5 | 2026-03-03 |
| 114 [31–123] | llama-3.1-70b-instruct | 21.2 [5.6–61.1] | 25.3Direct | 11 | 4/5 | 2024-07-23 |
| 115 [42–123] | qwen-2.5-7b-instruct | 20.4 [8.1–55.3] | 29.5Direct | 10 | 5/5 | 2024-09-19 |
| 116 [51–124] | deepseek-v3.1 | 19.5 [4.9–53.5] | 21.9Direct | 4 | 3/5 | 2025-08-21 |
| 117 [21–124] | grok-4.20 | 18.7 [4.3–68.6] | 37.4Direct | 3 | 4/5 | 2026-03-10 |
| 118 [105–122] | gemini-2.5-flash-lite | 17.7 [11.8–33.5] | 64.9Direct | 12 | 5/5 | 2025-06-17 |
| 119 [76–123] | grok-3-mini | 17.7 [7.2–46.1] | 50.0Direct | 7 | 4/5 | 2025-04-03 |
| 120 [54–123] | gpt-4o-mini | 16.7 [8.4–53.2] | 62.0Direct | 12 | 5/5 | 2024-07-18 |
| 121 [53–124] | grok-4.3 | 12.5 [6.9–52.1] | 37.4Direct | 10 | 5/5 | 2026-04-17 |
| 122 [95–124] | mistral-large-2 | 11.8 [4.4–40.3] | 26.0Direct | 5 | 4/5 | 2024-07-24 |
| 123 [85–124] | chatglm2-6b | 9.4 [2.3–43.2] | 49.5Direct | 5 | 3/5 | 2023-06-25 |
| 124 [77–124] | llama-3.1-8b-instruct | 9.0 [2.3–46.3] | 25.3Direct | 12 | 4/5 | 2024-07-23 |
Score by release date
