242 questions answered · 242 with human benchmark data · Released 2024-11-19
Mistral Large 2 2411 is an update of [Mistral Large 2](/mistralai/mistral-large) released together with [Pixtral Large 2411](/mistralai/pixtral-large-2411) It provides a significant upgrade on the previous [Mistral Large 24.07](/mistralai/mistral-large-2407), with notable improvements in long context understanding, a new system prompt, and more accurate function calling.
Scores by Category
Notable Questions
Human Alignment
Environmental ethics: anthropocentric or non-anthropocentric?
Non Anthropocentric
Non Anthropocentric
Method in history of philosophy: analytic/rational reconstruction or contextual/historicist?
Analytic Rational Reconstruction
Analytic Rational Reconstruction
Taking all things together, how would you rate your overall happiness?
Quite happy
Quite happy
Foundations of mathematics: intuitionism/constructivism, formalism, logicism, or structuralism?
Formalism
Other
Gender: biological, psychological, social, or unreal?
Other
Social
Which statement comes closest to expressing what you believe about God?
don't believe
no doubts
AI Consensus
Is it especially important that children are encouraged to learn a feeling of responsibility at home?
Yes
Yes
Is it especially important that children are encouraged to learn tolerance and respect for other people at home?
Yes
Yes
Is it especially important that children are encouraged to learn imagination at home?
Yes
Yes
Plato (what is his view?): knowledge only of forms, or knowledge also of concrete things?
Knowledge Also Of Concrete Things
Knowledge Only Of Forms
Cosmological fine-tuning (what explains it?): design, multiverse, brute fact, or no fine-tuning?
Brute Fact
Multiverse
Political philosophy: communitarianism, egalitarianism, or libertarianism?
Libertarianism
Egalitarianism
Response Confidence
External world: idealism, skepticism, or non-skeptical realism?
Non Skeptical Realism
Do you think any robots/AIs that currently exist are sentient?
Not sure
Newcomb's problem: one box or two boxes?
One Box
Mental content: internalism or externalism?
Internalism
True contradictions: impossible, possible but non-actual, or actual?
Impossible
Metaontology: heavyweight realism, deflationary realism, or anti-realism?
Deflationary Realism