Most political quizzes tell you what you believe. This one asks a different question:
Do you apply the same standard of evidence when you’re judging someone you politically agree with and someone you politically oppose?
That sounds easy. It isn’t.
Political-psychology research has repeatedly found that people can evaluate politically congenial and uncongenial information differently. A meta-analysis covering 51 experiments and more than 18,000 participants found a robust overall partisan-bias effect, although researchers continue to debate exactly when such differences represent irrational bias rather than reasonable prior beliefs.
That distinction matters.
This quiz does not test whether your politics are correct. It does not award points for being left-wing, right-wing, centrist, independent, apolitical or anything else.
It asks something narrower:
When the relevant evidence is held approximately constant, does your judgment change with the political identity of the person or group involved?
Take the Political Bias Test
The quiz contains 12 short fictional scenarios and normally takes about three minutes.
For the best result:
- Judge only the information stated in each scenario.
- Assume there is no additional evidence you have not been told about.
- Answer based on your actual judgment, not what you think the “objective” answer is supposed to be.
- Don’t try to reverse-engineer the scoring.
- You cannot go backward after answering a question.
If your politics do not fit neatly into left/right or Democratic/Republican categories, that does not matter. References to someone whose politics are “closer to yours” simply mean closer to your own political worldview.
What Does Your Political Consistency Score Mean?
Your score runs from 0 to 100.
A higher score means you applied more similar standards across the matched political situations in this quiz.
A lower score means your judgments changed more substantially depending on whether the political actor was closer to or farther from your own views.
As a descriptive guide:
| Score | What it means in this quiz |
|---|---|
| 90–100 | Very consistent standards across the matched cases |
| 75–89 | Mostly consistent, with some movement |
| 60–74 | Noticeable differences across political alignment |
| Below 60 | Large differences across the matched cases |
These are descriptive ranges, not validated psychological categories.
A score of 96 does not prove that you are an objective person.
A score of 48 does not prove that all of your political beliefs are biased or incorrect.
The test measures something much narrower: how consistently you treated these particular matched situations.
Your Score Does Not Tell Us Whether Your Politics Are Correct
This distinction is essential.
Imagine two people who consistently demand strong corroboration before believing allegations against public officials.
One is extremely progressive. The other is extremely conservative.
They may disagree about almost every major political issue and still both score highly because they apply their respective evidentiary standards consistently.
Likewise, someone could apply an equally terrible standard to everyone.
Consistency and correctness are different things.
This quiz therefore does not measure political truth, intelligence, morality, knowledge or ideological moderation.
It measures political standard consistency.
How the Test Actually Works
The quiz contains five underlying kinds of judgment:
- How strongly an uncorroborated allegation should be believed.
- How a corrected factual error should affect trust.
- Whether a source’s political viewpoint should override directly verifiable evidence.
- How much responsibility a political movement bears for misconduct by a small minority of participants.
- How much a documented investigation should change belief in an allegation.
Each underlying situation appears in two carefully matched forms.
One concerns a political actor, source or movement closer to your own views. The other concerns one farther from your views.
The relevant evidence is designed to remain approximately equivalent.
The questions are separated and shuffled so that the matching structure is less obvious, and some questions are phrased in the opposite direction. That reduces simple response-pattern gaming and also reduces the tendency to agree with every statement automatically.
After converting the answers to the same direction, the quiz calculates the difference between your judgments within each matched pair.
A perfectly matched pair contributes no inconsistency.
A maximum disagreement contributes six points.
Across five pairs, the maximum possible discrepancy is 30.
The score is then calculated as:
Political Consistency Score = 100 × (1 − total discrepancy ÷ 30)
The final number is rounded to the nearest whole number.
Why Can’t I Just Choose the Middle Answer Every Time?
You can, but it will not earn you a perfect score.
If eight or more of the ten responses use the neutral midpoint, the test returns an inconclusive result rather than treating uniform uncertainty as demonstrated objectivity.
That’s because someone who refuses to make a judgment has not demonstrated that they apply the same standard consistently.
They simply haven’t given us enough information to tell.
Can You Game the Political Bias Test?
Yes—if you deliberately try hard enough.
No self-administered internet quiz can prevent a participant who knows its purpose from consciously constructing answers designed to produce a particular outcome.
We therefore designed this one to prevent the easy forms of gaming rather than pretending manipulation is impossible.
The questions appear individually. Their order is randomized. Matched questions are kept apart. Which fictional case represents the politically closer versus farther actor is counterbalanced. Several questions are reverse-keyed. The score is not displayed while you answer.
Those choices make it substantially harder to earn a high score simply by clicking the same response repeatedly or recognizing an obvious left-versus-right pattern.
But the test still depends on honest participation.
If your goal is merely to obtain 100, you are measuring your ability to defeat a three-minute quiz rather than your political consistency.
Why Not Just Ask People Whether They’re Objective?
Because people are not necessarily good judges of their own susceptibility to bias.
Psychologists Emily Pronin, Daniel Lin and Lee Ross famously described a bias blind spot: across several studies, participants tended to see cognitive and motivational biases more readily in other people than in themselves.
Asking:
“Are you politically objective?”
would therefore be a weak test.
Most people who regard themselves as thoughtful and fair are capable of answering yes.
It is more informative to compare judgments.
That’s why this quiz focuses on what standard you actually apply across matched cases, rather than asking you to describe your own rationality.
Does Political Bias Really Affect How People Evaluate Evidence?
There is substantial evidence that it can.
A large 2019 meta-analysis examined experiments in which people evaluated information that supported or challenged their political beliefs or allegiances. Across the studies, researchers found a meaningful overall partisan-bias effect.
A more recent review of the literature likewise describes systematic tendencies for political partisans to seek, believe and remember information favorable to their political ingroup. But it also emphasizes an important scientific dispute: not every apparent partisan difference necessarily represents irrational reasoning. Prior beliefs and legitimate informational cues can sometimes produce different judgments without requiring motivated reasoning.
That caution is important enough that we built it into this quiz.
Research methodologists have specifically warned that simply changing a Democratic label to a Republican label can change more than political motivation. A party label may convey information about what policies or behavior someone considers likely, creating a potential confound.
That is one reason this quiz uses fictional actors, provides the relevant background information inside the scenario, avoids testing knowledge of real political controversies and asks readers to assume there are no unstated relevant facts.
It still cannot eliminate every possible prior belief.
But it considerably narrows the question.
More recent research has also used blinded evaluations as a stronger benchmark. In four studies involving 4,010 participants, researchers had some people evaluate scientific work before learning whether its results were politically congenial. Comparing those blinded judgments with unblinded judgments produced evidence that both prior beliefs and political preferences could independently influence evaluations.
The broader lesson isn’t that every political disagreement is irrational.
It’s that political identity can sometimes affect the way evidence is processed—and people should be cautious about assuming they are personally immune.
Is This a Scientifically Validated Psychological Test?
No—not yet, and we do not want to pretend otherwise.
This is a research-informed political consistency exercise, not a clinical assessment or established psychometric instrument.
Its design draws on experimental concepts used in research on partisan judgment, motivated reasoning and the bias blind spot. We have also deliberately built in matched cases, counterbalancing and reverse-keyed questions to reduce several obvious measurement problems.
But formal reliability and validity cannot simply be declared in advance.
Those require data.
For example, once enough people have taken the test, we can examine whether its different scenarios behave sensibly, whether results are reasonably stable, whether particular questions introduce ideological asymmetries and whether the score predicts anything beyond the specific scenarios included here.
Until then, the appropriate interpretation is:
This score describes how consistently you responded to these ten political judgments.
Nothing more.
That is still useful.
A short quiz does not need to diagnose the human mind to reveal an uncomfortable inconsistency.
A Low Score Doesn’t Necessarily Mean You’re Wrong
Suppose you distrust someone politically opposed to you more than an ally.
There are situations where that could be reasonable.
Perhaps you genuinely possess relevant information about their previous conduct.
Perhaps one source has a history the other does not.
Perhaps circumstances that appear superficially similar actually aren’t.
Real-world judgment depends on context.
That is why our scenarios explicitly ask you to use only the information supplied and why the actors are fictional.
The test is trying to isolate one question:
What happens when the political relationship changes but the evidence that should govern this particular judgment does not?
If your standard moves substantially anyway, that is worth noticing.
Objectivity Doesn’t Require Political Neutrality
You can have strong political convictions and still reason objectively.
Objectivity does not require believing every political faction is equally truthful, equally competent or equally supported by evidence.
That would be false balance.
The more useful standard is:
Would I consider this evidence strong if it implicated someone I liked? Would I consider the same evidence weak if it implicated someone I disliked?
Sometimes the evidence really does favor one political position over another.
Objectivity means following that evidence.
It does not mean forcing the final answer into the middle.
The challenge is maintaining the same rules for determining when the evidence deserves to move you.
That is what this quiz is trying to test.
References and Further Reading
- At Least Bias Is Bipartisan: A Meta-Analytic Comparison of Partisan Bias in Liberals and Conservatives — Ditto and colleagues’ meta-analysis of 51 experiments involving more than 18,000 participants evaluating partisan bias.
- Partisan Bias in Political Judgment — A recent Annual Review of Psychology overview of political ingroup favoritism and the continuing debate over its mechanisms and rationality.
- Of Preferences and Priors: Motivated Reasoning in Partisans’ Evaluations of Scientific Evidence — Four studies using blinded evaluations to distinguish prior beliefs from politically motivated evaluation.
- Thinking Clearly About Causal Inferences of Politically Motivated Reasoning — A methodological critique explaining why common party-cue and outcome-switching experiments can confound political motivation with other information.
- The Bias Blind Spot: Perceptions of Bias in Self Versus Others — The classic Pronin, Lin and Ross research showing that people commonly perceive bias more readily in others than in themselves.
Editorial note: This page describes the first public version of the sherafy.com Political Standard Consistency Test. If future response data support changes to the scoring system or individual questions, the methodology should be updated transparently rather than silently redefining the test.
