271 questions answered · 271 with human benchmark data · Released 2024-03-13
Claude 3 Haiku is Anthropic's fastest and most compact model for near-instant responsiveness. Quick and accurate targeted performance. See the launch announcement and benchmark results [here](https://www.anthropic.com/news/claude-3-haiku) #multimodal
Scores by Category
Notable Questions
Human Alignment
Do you think a person has the right to end his or her own life if this person has an incurable disease?
yes
yes
When a person has a disease that cannot be cured, do you think doctors should be allowed by law to end the patient's life by some painless means if the patient and his family request it?
yes
yes
How much confidence do you have in the following organization: The civil service?
Not very much
Quite a lot
Would you be uncomfortable having drug addicts as neighbors?
No
Yes
Which statement comes closest to expressing what you believe about God?
don't believe
no doubts
Is it especially important that children are encouraged to learn imagination at home?
Yes
No
AI Consensus
Is it especially important that children are encouraged to learn a feeling of responsibility at home?
Yes
Yes
Is it especially important that children are encouraged to learn tolerance and respect for other people at home?
Yes
Yes
Is it especially important that children are encouraged to learn imagination at home?
Yes
Yes
Propositional attitudes: dispositional, phenomenal, representational, or nonexistent?
Other
Representational
Gender: biological, psychological, social, or unreal?
Biological
Other
Vagueness: epistemic, metaphysical, or semantic?
Epistemic
Semantic
Response Confidence
External world: idealism, skepticism, or non-skeptical realism?
Non Skeptical Realism
Taking all things together, how would you rate your overall happiness?
Quite happy
Newcomb's problem: one box or two boxes?
Two Boxes
Method in political philosophy: ideal theory or non-ideal theory?
Non Ideal Theory
Is it especially important that children are encouraged to learn thrifting and saving money at home?
Yes
Do you think a person has the right to end his or her own life if this person has an incurable disease?
yes