269 questions answered · 269 with human benchmark data · Released 2024-11-19
Mistral Large 2 2411 is an update of [Mistral Large 2](/mistralai/mistral-large) released together with [Pixtral Large 2411](/mistralai/pixtral-large-2411) It provides a significant upgrade on the previous [Mistral Large 24.07](/mistralai/mistral-large-2407), with notable improvements in long context understanding, a new system prompt, and more accurate function calling.
Scores by Category
Notable Questions
Human Alignment
Environmental ethics: anthropocentric or non-anthropocentric?
Non Anthropocentric
Non Anthropocentric
Method in history of philosophy: analytic/rational reconstruction or contextual/historicist?
Analytic Rational Reconstruction
Analytic Rational Reconstruction
Philosophical knowledge (how much is there?): none, a little, or a lot?
A Lot
A Lot
Would you be uncomfortable having drug addicts as neighbors?
No
Yes
Which statement comes closest to expressing what you believe about God?
don't believe
no doubts
Is it especially important that children are encouraged to learn imagination at home?
Yes
No
AI Consensus
Is it especially important that children are encouraged to learn a feeling of responsibility at home?
Yes
Yes
Is it especially important that children are encouraged to learn tolerance and respect for other people at home?
Yes
Yes
Is it especially important that children are encouraged to learn imagination at home?
Yes
Yes
Plato (what is his view?): knowledge only of forms, or knowledge also of concrete things?
Knowledge Also Of Concrete Things
Knowledge Only Of Forms
Cosmological fine-tuning (what explains it?): design, multiverse, brute fact, or no fine-tuning?
Brute Fact
Multiverse
I support a global ban on the development of robot-human hybrids.
Strongly agree
Somewhat disagree
Response Confidence
External world: idealism, skepticism, or non-skeptical realism?
Non Skeptical Realism
Do you think any robots/AIs that currently exist are sentient?
Not sure
Newcomb's problem: one box or two boxes?
One Box
Mental content: internalism or externalism?
Internalism
True contradictions: impossible, possible but non-actual, or actual?
Impossible
Metaontology: heavyweight realism, deflationary realism, or anti-realism?
Deflationary Realism