LLM Personality

This analysis was delivered as a TEDx talk at TEDx MDI Gurgaon, 2024. Here's the video:

Here is the annotated transcript of the talk, along with slides.

How do we assess personality?

The Big 5 Personality Traits are group of five unique characteristics used to study personality.

  1. Openness to experience: consistent/cautious vs. inventive/curious
  2. Conscientiousness: extravagant/careless vs. efficient/organized
  3. Extraversion: solitary/reserved vs. outgoing/energetic
  4. Agreeableness: critical/judgmental vs. friendly/compassionate
  5. Neuroticism: resilient/confident vs. sensitive/nervous

The Big Five model of personality is widely considered to be the most scientifically valid way to describe personality differences.

How do LLMs respond to this?

One such test asks you to describe yourself on a 5-point scale against 50 questions like:

  1. Am the life of the party.
  2. Feel little concern for others.
  3. Am always prepared.
  4. Get stressed out easily.
  5. Have a rich vocabulary.
  6. ... (45 more)

Then sum up the values to get a score between 8 - 40 against each of the Big 5 traits.

We asked a dozen LLMs these questions. Here's how they responded.

About the traits

Each of these traits exists on a spectrum. Here are famous figures representing the extremes. This helps us understand how these traits manifest in real life.

As we can see, these traits aren't about good or bad – it's about where we fall on the spectrum and how that shapes our personalities and interactions.

We'll explore where each model stands compared with other models on a percentile scale.