Will any foundation model score 75 or higher on The Foundation Model Transparency Index by the end of 2024? (LLama2: 54)
Plus
20
Ṁ12kDec 31
96%
chance
1D
1W
1M
ALL
The top-scoring model scores only 54 out of 100. No major foundation model developer is close to providing adequate transparency, revealing a fundamental lack of transparency in the AI industry.
There are 100 indicators that determine this score:
Read more: https://crfm.stanford.edu/fmti/
This question is managed and resolved by Manifold.
Get
1,000and
3.00
1,0003.00
Related questions
Related questions
Will any AI model achieve > 40% on Frontier Math before 2026?
65% chance
Will the mean score for The Foundation Model Transparency Index be 50% or more by the end of 2025? (current: 37%)
52% chance
Will an AI score over 80% on FrontierMath Benchmark in 2025
24% chance
Will any model get above human level on the Simple Bench benchmark before September 1st, 2025.
69% chance
What will be the best result an LLM based model gets in the 2025 IMO under fair conditions?
Will the market of foundation models be more fragmented than in 2024 by EOY 2026?
56% chance
LLM Hallucination: Will an LLM score >90% on SimpleQA before 2026?
60% chance
Will any foundation models/LLMs be able to reliably come up with novel unparalleled misalignments before EOY 2024?
90% chance
Will AI image generating models score >= 90% on Winoground by June 1, 2025?
81% chance
Will any AI model score >80% on Epoch's Frontier Math Benchmark in 2025?
16% chance