Within Evidence Types
Can crowdsourced context be trusted?
Community Notes can add context to misleading posts, but their trust, speed, coverage and stability are different questions.
On this page
- What Community Notes can add
- Why helpful status can change
- The risks of bias and manipulation
Page outline Jump by section
Introduction
Community Notes can be a valuable form of evidence when assessing claims on social media, but they should not be treated as definitive proof. In an evidence hierarchy for online claims, a Community Note is best understood as a crowdsourced signal that a post may be missing important context, contains an error, or is disputed by informed contributors. It often points readers towards sources they might not otherwise see. However, the existence of a note, the absence of a note, or even a note’s current status can change over time. That instability matters.
For critical thinkers navigating social media and AI-generated content, Community Notes are often worth reading. The mistake is treating them as a final verdict rather than as a potentially useful piece of evidence that still requires verification.
What Community Notes can add
Community Notes were designed to allow contributors to add context to potentially misleading posts and have that context evaluated by other contributors rather than by a central moderation team. The system attempts to surface notes that receive support from people with differing viewpoints rather than relying on simple majority voting. [X (formerly Twitter)+2X (formerly Twitter)]communitynotes.x.comX (formerly Twitter)Community NotesCommunity Notes aims to create a better-informed world, by empowering people on X to collaboratively a…
In practice, a useful Community Note can add several kinds of evidence:
- Links to original documents, datasets or reporting.
- Missing context that changes how a claim should be interpreted.
- Corrections of factual errors.
- Clarification when old images, videos or statistics are being presented as current events.
- Explanations of why a claim is disputed.
Research suggests that contextual notes are often trusted more than simple warning labels because they explain why a claim may be misleading rather than merely flagging it. Experimental studies have found that users generally perceive explanatory notes as more trustworthy than generic misinformation warnings. [OUP Academic]academic.oup.comOUP AcademicCommunity notes increase trust in fact-checking on social mediaby CP Drolsbach · 2024 · Cited by 90 — Across both sides of th…
There is also evidence that Community Notes can reduce the spread of misleading content. Large-scale studies examining hundreds of thousands of fact-checked posts on X found that visible notes can reduce engagement and limit further diffusion of misleading claims. [Nature]nature.comCommunity-based fact-checking reduces the spread of…by Y Chuai · 2026 · Cited by 1 — Here, we perform a large-scale empirical st…
For readers, the most useful function of a Community Note is often not the note itself but the evidence trail it provides. A note that links to a court filing, government report, scientific paper or primary source can help move a claim up the evidence hierarchy by directing attention towards stronger evidence.
Why helpful status can change
One of the most important features of Community Notes is also one of its least understood: note status is not necessarily permanent.
Notes typically move through statuses such as “Needs More Ratings”, “Helpful”, and “Not Helpful” as contributors continue evaluating them. The ranking system continuously reassesses whether a note still meets the platform’s criteria for public display. [X (formerly Twitter)+2ORBilu]communitynotes.x.comX (formerly Twitter)Note ranking algorithmNotes with the status Needs More Ratings remain sorted by recency (newest first), and notes wit…
This means a note that appears authoritative today may disappear later if subsequent ratings alter the consensus. Recent research examining hundreds of thousands of notes found that approximately 30% of displayed notes later lost their helpful status and were removed from public view. [ACM Digital Library+2arXiv]dl.acm.orgACM Digital LibraryConsensus Stability of Community Notes on X12 Apr 2026 — We find that 30.2% of displayed notes later lose their helpfu…
That finding has two implications.
First, visible notes should be treated as provisional rather than final. Their presence indicates that a particular consensus existed at a particular moment.
Second, screenshots of Community Notes can be misleading evidence. A screenshot may show a note that no longer exists, has been revised, or subsequently lost its helpful designation. When evaluating a screenshot, readers should consider whether the note is still active and whether its supporting sources remain persuasive.
This instability does not necessarily mean the system is failing. In some cases, changing status reflects genuine reassessment as new information becomes available or as more contributors review the evidence. The important point is that a Community Note is part of an ongoing evaluation process rather than a fixed fact-check.
Why speed and coverage matter
A common misunderstanding is that every misleading viral post will quickly receive a Community Note. In reality, Community Notes face coverage and timing constraints.
The system depends on contributors noticing a claim, writing a note, supplying sources and gathering enough ratings to reach public visibility. During fast-moving events, misinformation can accumulate large audiences before a note becomes visible. Researchers and analysts have repeatedly identified delays as a significant limitation of crowdsourced correction systems. [Institute for Strategic Dialogue+2Business Insider]isdglobal.orgInstitute for Strategic DialogueThe trust-consensus paradox: why decentralized fact-…18 Dec 2025 — Research shows that displaying Comm…
Coverage is also uneven. Some topics attract many contributors and rapid evaluation, while others receive little attention. Research suggests that notes are more likely to emerge around certain high-interest subjects, particularly political topics, while other areas may receive less scrutiny. [arXiv]arxiv.orgThe Effects of Request Alerts on the Diversity and Visibility of Community NotesApril 18, 2026…
The absence of a Community Note therefore does not mean a claim is true. It may simply mean that nobody has yet produced a note that achieved sufficient consensus for display.
For evidence evaluation, this distinction is crucial. Presence of a note can be informative; absence of a note is usually weak evidence.
The risks of bias and manipulation
Community Notes are often presented as a solution to ideological bias because they seek agreement across different groups. Yet researchers continue to debate how well the system performs under polarised conditions.
The platform’s design deliberately attempts to reward notes that receive support from contributors with differing viewpoints and to give greater influence to contributors with strong records of helpful participation. [X (formerly Twitter)+2X (formerly Twitter)]communitynotes.x.comX (formerly Twitter)Contributor helpfulness scoresHelpfulness scores are a way to give more influence to people with a track record of ma…
However, several studies have identified vulnerabilities.
Research on consensus stability found that once notes become visible, subsequent ratings can become more polarised, contributing to some notes later losing their status. [ACM Digital Library]dl.acm.orgACM Digital LibraryConsensus Stability of Community Notes on X12 Apr 2026 — We find that 30.2% of displayed notes later lose their helpfu…
Simulation-based research has suggested that crowdsourced fact-checking systems can be sensitive to rater bias, in-group preferences and coordinated behaviour. Under some conditions, relatively small groups of strategically acting contributors may be able to influence outcomes disproportionately. [arXiv]arxiv.orgarXiv Community Notes are Vulnerable to Rater Bias and ManipulationCommunity Notes are Vulnerable to Rater Bias and ManipulationNovember 4, 2025…
Other work has suggested that contributors may preferentially engage with claims that are easier to evaluate, leaving more plausible or complex misinformation less likely to receive successful notes. [arXiv]arxiv.orgThe Laziness of the Crowd: Effort Aversion Among Raters Risks Undermining the Efficacy of X's Community Notes ProgramMarch 11, 2026…
These concerns do not prove widespread manipulation. They do show that Community Notes are social systems, not neutral measuring instruments. Like polls, crowdsourced ratings or collaborative encyclopaedias, they reflect the strengths and weaknesses of collective judgement.
How much weight should a reader give a Community Note?
Within an evidence hierarchy, Community Notes usually deserve more weight than unsupported comments, reposts or influencer reactions because they often include sources and undergo a structured review process. They generally deserve less weight than the primary evidence they cite.
A practical approach is:
- Read the note carefully.
- Examine the sources it provides.
- Ask whether those sources actually support the note’s conclusion.
- Check whether the note remains active and visible.
- Look for stronger independent evidence if the claim is important.
The strongest use of Community Notes is as a gateway to better evidence. Their greatest weakness is that readers sometimes treat the note itself as the evidence rather than as a pointer towards evidence.
In the age of social media and AI-generated content, Community Notes can be a useful warning signal and a valuable source of context. They are most reliable when viewed as a provisional, crowdsourced layer of evidence that helps readers investigate further, not as a final authority that settles a question on its own.
Endnotes
-
Source: academic.oup.com
Link: https://academic.oup.com/pnasnexus/article/3/7/pgae217/7686087Source snippet
OUP AcademicCommunity notes increase trust in fact-checking on social mediaby CP Drolsbach · 2024 · Cited by 90 — Across both sides of th...
-
Source: nature.com
Link: https://www.nature.com/articles/s41467-026-72597-0Source snippet
Community-based fact-checking reduces the spread of...by Y Chuai · 2026 · Cited by 1 — Here, we perform a large-scale empirical st...
-
Source: dl.acm.org
Link: https://dl.acm.org/doi/10.1145/3774904.3792987Source snippet
ACM Digital LibraryConsensus Stability of Community Notes on X12 Apr 2026 — We find that 30.2% of displayed notes later lose their helpfu...
-
Source: arxiv.org
Title: arXiv Consensus Stability of Community Notes on X
Link: https://arxiv.org/abs/2601.14002Source snippet
Using interrupted time series models, we further show that...Read more...
-
Source: arxiv.org
Link: https://arxiv.org/abs/2604.17042Source snippet
The Effects of Request Alerts on the Diversity and Visibility of Community NotesApril 18, 2026...
Published: April 18, 2026
-
Source: arxiv.org
Title: arXiv Community Notes are Vulnerable to Rater Bias and Manipulation
Link: https://arxiv.org/abs/2511.02615Source snippet
Community Notes are Vulnerable to Rater Bias and ManipulationNovember 4, 2025...
Published: November 4, 2025
-
Source: arxiv.org
Link: https://arxiv.org/abs/2603.11120Source snippet
The Laziness of the Crowd: Effort Aversion Among Raters Risks Undermining the Efficacy of X's Community Notes ProgramMarch 11, 2026...
Published: March 11, 2026
-
Source: arxiv.org
Link: https://arxiv.org/html/2509.09956v1Source snippet
How the Request Function Shapes X's Community Notes...Sep 12, 2025 — Each community note can receive one of the three statuses: Currentl...
-
Source: arxiv.org
Link: https://arxiv.org/abs/2502.14132Source snippet
Can Community Notes Replace Professional [Fact-Checkers]({{ 'fact-checkers/' | relative_url }})? by N Borenstein · 2025 · Cited by 24 — Our analysis reveals that community notes c...
-
Source: arxiv.org
Link: https://arxiv.org/html/2509.09956v2Source snippet
How the Request Function Shapes X's Community Notes...Mar 2, 2026 — Our findings highlight both the limitations and promise of requests...
-
Source: arxiv.org
Link: https://arxiv.org/html/2502.13322v1Source snippet
Community Notes Moderate Engagement With and...18 Feb 2025 — We find that attaching fact-checking notes significantly reduces the engage...
-
Source: arxiv.org
Link: https://arxiv.org/html/2510.09585v2Source snippet
From Birdwatch to Community Notes, from Twitter to XOct 13, 2025 — The Note that receives the Helpful status based on the ratings from a...
-
Source: youtube.com
Title: Mechanics of Community Notes: [Bridging]({{ ‘bridging/’ | relative_url }}) Algorithms and Cross-Partisan Consensus
Link: https://www.youtube.com/watch?v=anleNB7b3SU -
Source: communitynotes.x.com
Link: https://communitynotes.x.com/guide/en/about/introductionSource snippet
X (formerly Twitter)Community NotesCommunity Notes aims to create a better-informed world, by empowering people on X to collaboratively a...
-
Source: communitynotes.x.com
Link: https://communitynotes.x.com/guide/en/under-the-hood/ranking-notesSource snippet
X (formerly Twitter)Note ranking algorithmNotes with the status Needs More Ratings remain sorted by recency (newest first), and notes wit...
-
Source: Wikipedia
Title: Community Notes
Link: https://en.wikipedia.org/wiki/Community_NotesSource snippet
Community NotesCommunity Notes (formerly known as Birdwatch) is a feature on X where contributors can add context such as [fact-checks]({{ 'fact-checks/' | relative_url }})...
-
Source: orbilu.uni.lu
Link: https://orbilu.uni.lu/bitstream/10993/59462/1/3686967.pdfSource snippet
Did the Roll-Out of Community Notes Reduce Engagement...by Y CHUAI · 2024 · Cited by 102 — Each note status item records the chang...
-
Source: isdglobal.org
Link: https://www.isdglobal.org/digital-dispatch/the-trust-consensus-paradox-why-decentralized-fact-checking-faces-challenges-on-polarizing-topics/Source snippet
Institute for Strategic DialogueThe trust-consensus paradox: why decentralized fact-...18 Dec 2025 — Research shows that displaying Comm...
-
Source: businessinsider.com
Link: https://www.businessinsider.com/meta-community-notes-twitter-zuckerberg-musk-how-do-they-work-2025-1Source snippet
Here's how they work — and how they don't.Mark Zuckerberg announced that Meta would implement "community notes" inspired by a simil...
-
Source: communitynotes.x.com
Link: https://communitynotes.x.com/guide/en/under-the-hood/contributor-scoresSource snippet
X (formerly Twitter)Contributor helpfulness scoresHelpfulness scores are a way to give more influence to people with a track record of ma...
-
Source: communitynotes.x.com
Title: writing and rating impact
Link: https://communitynotes.x.com/guide/en/contributing/writing-and-rating-impactSource snippet
and Writing ImpactHelp identify notes as Not Helpful. When you help a note reach a status of Not Helpful, you're also improving Community...
-
Source: transparency.meta.com
Title: community notes
Link: https://transparency.meta.com/features/community-notes/Source snippet
Notes: A New Way to Add Context to PostsMar 5, 2026 — Contributors have access to a Feed of notes that still need ratings prior to being...
-
Source: vitalik.eth.limo
Link: https://vitalik.eth.limo/general/2023/08/16/communitynotes.htmlSource snippet
do I think about Community Notes?Aug 16, 2023 — These reviews can be thought of as being votes along a 3-point scale of HELPFUL, SOMEWHA...
Additional References
-
Source: gap-map.org
Link: https://www.gap-map.org/capabilities/crowd-sourced-fact-checking/Source snippet
Crowd-Sourced Fact-CheckingA crowdsourced fact-checking system that attaches contextual annotations to tweets–to build robust community-d...
-
Source: counterhate.com
Link: https://counterhate.com/wp-content/uploads/2024/10/CCDH.CommunityNotes.FINAL-30.10.pdfSource snippet
HOW X'S COMMUNITY NOTES SYSTEM FALLS SHORT...A proposed note starts with a “Needs more ratings” status and contributors can begin to rat...
-
Source: news.yale.edu
Title: flagging misinformation social media reduces engagement study finds
Link: https://news.yale.edu/2025/09/25/flagging-misinformation-social-media-reduces-engagement-study-findsSource snippet
NewsSep 25, 2025 — Crowd-sourced fact-checking of potentially misleading information is an effective tool to combat online misinforma...
-
Source: researchgate.net
Title: 389176167 Can Community Notes Replace Professional Fact Checkers
Link: https://www.researchgate.net/publication/389176167_Can_Community_Notes_Replace_Professional_Fact-CheckersSource snippet
Can Community Notes Replace Professional Fact-Checkers?19 Feb 2025 — Fact-checking is especially crucial for notes on posts linked to bro...
-
Source: aclanthology.org
Link: https://aclanthology.org/2026.findings-eacl.71.pdfSource snippet
ACL AnthologyA Dataset for Exploring the Helpfulness of Fact-Checking...by R Xing · 2026 · Cited by 2 — If two such tags are not found...
-
Source: washingtonpost.com
Title: The Washington Post Zuckerberg fired the fact-checkers
Link: https://www.washingtonpost.com/technology/2025/08/04/meta-fact-check-community-notes-test-facebook-instagram/Source snippet
We tested their replacement.In 2025, Meta replaced its professional fact-checkers on Facebook, Instagram, and Threads with a “community n...
-
Source: faculty.washington.edu
Link: https://faculty.washington.edu/msaveski/assets/publications/2024_supernotes/paper.pdfSource snippet
washington.eduSupernotes: Driving Consensus in Crowd-Sourced Fact-...by S De · 2025 · Cited by 38 — X's Community Notes, a crowd-sourced...
-
Source: researchgate.net
Title: 399953243 Consensus Stability of Community Notes on X
Link: https://www.researchgate.net/publication/399953243_Consensus_Stability_of_Community_Notes_on_XSource snippet
(PDF) Consensus Stability of Community Notes on X23 Jan 2026 — We find that 30.2% of displayed notes later lose their helpful status and...
-
Source: abc.net.au
Title: elon musk community notes on meta facebook explained
Link: https://www.abc.net.au/news/2025-01-08/elon-musk-community-notes-on-meta-facebook-explained/104794984Source snippet
Elon Musk created Community Notes and Meta is following...7 Jan 2025 — Community Notes, formerly BirdWatch before it was rebranded, is a...
-
Source: ddia.org
Title: a deep dive into xs community notes report
Link: https://ddia.org/en/a-deep-dive-into-xs-community-notes-reportSource snippet
A Deep Dive into X's Community NotesJul 9, 2025 — While consensus on the usefulness of a Community Note is pending, the note is classifie...
Topic Tree




