Hi all!
As many of you have noticed, many Lemmy.World communities introduced a bot: @MediaBiasFactChecker@lemmy.world. This bot was introduced because modding can be pretty tough work at times and we are all just volunteers with regular lives. It has been helpful and we would like to keep it around in one form or another.
The !news@lemmy.world mods want to give the community a chance to voice their thoughts on some potential changes to the MBFC bot. We have heard concerns that tend to fall into a few buckets. The most common concern we’ve heard is that the bot’s comment is too long. To address this, we’ve implemented a spoiler tag so that users need to click to see more information. We’ve also cut wording about donations that people argued made the bot feel like an ad.
Another common concern people have is with MBFC’s definition of “left” and “right,” which tend to be influenced by the American Overton window. Similarly, some have expressed that they feel MBFC’s process of rating reliability and credibility is opaque and/or subjective. To address this, we have discussed creating our own open source system of scoring news sources. We would essentially start with third-party ratings, including MBFC, and create an aggregate rating. We could also open a path for users to vote, so that any rating would reflect our instance’s opinions of a source. We would love to hear your thoughts on this, as well as suggestions for sources that rate news outlets’ bias, reliability, and/or credibility. Feel free to use this thread to share other constructive criticism about the bot too.
To clarify what MBFC considers “MIXED” factual reporting (the same rating they give known disinformation factory Breitbart):
Further, while The Guardian has failed several fact checks, they also produce an incredible amount of content; therefore, most stories are accurate, but the reader must beware, and hence why we assign them a Mixed rating for factual reporting.
They list like five fact checks, while The Guardian puts out basically quintuple that every day. And moreover, this is the sort of asinine nitpick that they classify as a “fact check”.
“Private renting is making people ill.” “Private renting is making people ill, but maybe this happens with other housing situations too, we don’t know, so we rate this as false.”
MBFC’s ratings for “factual reporting” are a joke.
This is my problem with MBFC, and which seems to consistently get ignored by the admins and mods pushing for the bot.
MBFC seems to rate every even slightly “left wing” news source as “mixed factual reporting” for absolutely any excuse whatsoever. The fact that they deem The Guardian as reliable as Breitbart should really tell you something.
Remove it please. It’s an obtrusive advertisement for Ground News.
It’s incredibly annoying to see
comments: 1, only to click the post to see an ad. It makes me less inclined to interact with Lemmy at all. It’s the same kind of crap that ruined Reddit.We want to keep it in some form. Would you prefer not having the Ground News link?
We want to keep it in some form.
There’s your problem.
You’re not really looking for feedback if you’ve already made up your mind. Stop pretending to listen to the community if you’re ignoring the countless blocks and downvotes. That’s your feedback right there
How about you remove the bot and then fix whatever problems you have without doubling down on the bot solution? If you want community feedback on mod overburden, I’m sure people will be willing to help with that. But stop forcing the bot.
.
The bot is basically loud as fuck in a way that disrupts the comment feed.
Imagine how comments should create and add to a conversation. Imagine how various lemmy clients feed or service that conversation….
Now imagine how a double dropdown big as fuck post says “fuck you” to that conversation.
Just please consider how the form of your shit can be just as imposing as the content, which I really appreciate.
Yet somehow your posts always have me thinking “shut the fuck up” which seems antithetical to building a community.
This thread is a mess.
users: “bot is awful”
mod: “ok so it’s not terrible so that’s good”
I apologize if this thread was misunderstood. Perhaps I was not clear that this was meant for improvements, it is not a vote on removal. Should that vote ever happen, the post would be clear about that.
All of my questions were only seeking to gain more information about people’s feelings. I apologize if it came off as a promise to enact anything in particular or an endorsement of any particular stance on the bot.
Yes, you’ve been very clear from the start that you do not want to remove the bot. However, the feedback you’ve consistently received is that it provides no benefit, is misleading, reductive, and the best improvement you could make would be to remove it. You don’t seem willing or able to respond to that.
Correct, I am unable to supersede admin decisions as a mod. I am here collecting feedback on improvements. Again, I am looking for feedback on improvements, as the decision to remove the bot is not in my control.
Then you’re just wasting both your time and ours.
.
It has been helpful and we would like to keep it around in one form or another.
Bull fucking shit. The majority of feedback has been negative. I can’t recall a single person arguing in its favor, but I can think of many, myself included, arguing against it. I hope you can find my report of one particular egregious example, because Lemmy doesn’t let me see a history of things I reported. I recall that MBFC rated a particular source poorly because they dared to use the word “genocide” to describe what’s going on in Gaza. Trusting one person, who clearly starts from an American point of view, and has a clearly biased view of world events, to be the arbiter of what is liberal or conservative, or factual or fictional, is actively harmful.
No community, neither reddit nor Lemmy nor any other, has suffered for lack of such a bot. I strongly recommend removing it. Non-credible sources, misinformation, and propaganda are already prohibited under rule 8. If a particular source is so objectionable, it should be blacklisted entirely. And what is and is not acceptable should be determined in concert with the community, not unilaterally.
Edit: And another thing! It’s obnoxious for bot comments to count toward the number of comments as shown in the post list. Nobody likes seeing it and thinking “I wonder what people are saying about this” and it’s just the damn bot again. But that’s really a shortcoming in Lemmy.
Yes! The mods starting out the discussion with their preferred outcome is so incredibly telling. This is a tool to reinforce the mods bias, deliberately or not
.
@jeffw@lemmy.world Why did you stop replying to posts here? Most people is telling you the bot is bullshit. You stopped commenting in this thread while being active elsewhere, are you going to take action or not?
.
Who fact-checks the fact-checkers? Fact-checking is an essential tool in fighting the waves of fake news polluting the public discourse. But if that fact-checking is partisan, then it only acerbates the problem of people divided on the basics of a shared reality.
This is why a consortium of fact-checking institutions have joined together to form the International Fact-Checking Network (IFCN), and laid out a code of principles. You can find a list of signatories as well as vetted organizations on their website.
MBFC is not a signatory to the IFCN code of principles. As a partisan organization, it violates the standards that journalists have recognized as essential to restoring trust in the veracity of the news. I’ve spoken with @Rooki@Lemmy.World about this issue, and his response has been that he will continue to use his tool despite its flaws until something better materializes because the API is free and easy to use. This is like searching for a lost wallet far from where you lost it because the light from the nearby street lamp is better. He is motivated to disregard the harm he is doing to !politics@Lemmy.World, because he doesn’t want to pay for the work of actual fact-checkers, and has little regard for the many voices who have spoken out against it in his community.
By giving MBFC another platform to increase its exposure, you are repeating his mistake. Partisan fact-checking sites are worse than no fact-checking at all. Just like how the proliferation of fake news undermines the authority of journalism, the growing popularity of a fact-checking site by a political hack like Dave M. Van Zandt undermines the authority of non-partisan fact-checking institutions in the public consciousness.
From their methodology:
Our methodology incorporates findings from credible fact-checkers who are affiliated with the International Fact-Checking Network (IFCN). Only fact checks from the last five years are considered, and any corrected fact checks do not negatively impact the source’s rating.
Just like every good lie has a little bit of truth in it, MBFC wouldn’t be able to spin its bullshit as well without usurping the credibility of real fact-checking organizations.
What an odd form for a mea culpa to take!
You seemed to care passionately about IFCN fact-checkers doing the fact-checking. It turns out that MBFC agrees with you. Your (feigned) concern has been completely addressed in just the way you’d hoped. A person making that argument in good faith might say, “Oh! Maybe this is a better resource than I thought it was,” or maybe,“I should probably apologize to Rooki for harassing them about something I appear to have just made up.” Instead you just spin it into some other nebulous bullshit and move the goal posts. If you’re not careful, people might begin to suspect that you’re starting with the conclusion and working backwards.
Sorry, no mea culpa. Let me elaborate. Van Zandt claims to value IFCN fact-checkers in his ratings, then he uses that laundered credibility to gatekeep minority and politically inconvenient voices. Here’s a recent example brought to my attention.
It should be noted that despite no non-partisan fact checkers are listed on MBFC’s site as raising concerns about the The Cradle’s credibility, Van Zandt has arbitrarily placed it in the “Factual Reporting: Mixed” and “Credibility: Medium” categories. The concerns he posits about The Cradle’s 'lack of transparency, poor sourcing," and one-sidedness clearly apply to the weird right-wing guy who makes these opaque decisions about journalistic value.
If IFCN fact-checkers have issues with sources he’d like to denigrate, he’s happy to list them even if they’ve since been resolved. But they don’t make up the central criteria for his ‘methodology’ as he’d like you to believe. Meanwhile he’s free to make unreferenced claims about the credibility of others that uncareful readers take completely at face value.
All the concerns I have about The Cradle’s credibility have been developed in spite of MBFC, which is the opposite of what you want if your goal is accountability and media literacy. And thanks to their reliance on this charlatan, LW!news have recently punted what I think is a valuable report.
Sorry, no mea culpa.
If you think being an unrepentant liar is good for your cred, fill your boots, I guess.
It should be noted that despite no non-partisan fact checkers are listed on MBFC’s site as raising concerns about the The Cradle’s credibility, Van Zandt has arbitrarily placed it in the “Factual Reporting: Mixed” and “Credibility: Medium” categories. The concerns he posits about The Cradle’s 'lack of transparency, poor sourcing," and one-sidedness clearly apply to the weird right-wing guy who makes these opaque decisions about journalistic value.
‘I don’t understand how it works so it’s stupid!’
- The Cradle is a rag that’s been banned by Wikipedia for publishing conspiracy theories and for (gasp!) poor sourcing.
- If you had read their methodology, you’d know that MBFC wasn’t being arbitrary as lack of transparency and the impact are clearly defined:
A source is considered to lack transparency if it fails to provide an ‘About’ page or a clear description of its mission. Transparency is further compromised if the ownership of the source is not openly disclosed, including the identification of the parent company and key individuals involved. Additionally, the absence of information about major donors, funding sources, or general revenue generation methods contributes to this lack of transparency. It is essential for the source to at least disclose the country, state, or city of operation and the name of the person responsible (such as the editor). While providing a physical address is not mandatory, meeting some of these transparency criteria is important. Inadequate transparency typically results in the source’s factual reporting rating being reduced by one or two levels, depending on the extent of the shortfall.
Credibility Levels:
- High Credibility: A score of 6 or above.
- Medium Credibility: A score between 3-5 points. Sources lacking an ‘About’ page or ownership information are automatically rated as Medium Credibility.
- Low Credibility: A score of 0-2 points. Sources rated as Questionable, Conspiracy, or Pseudoscience are automatically classified as Low Credibility.
This is from the report:
The Cradle lacks transparency as they do not disclose ownership. The domain is registered in the United States.
Who could’ve seen that rating coming?
Methodical is the opposite of arbitrary. The reason it seems arbitrary to you is that you don’t understand it. As a bare minimum to be critical of MBFC you should understand how it works, understand their methodology, and probably have read their Wikipedia page. Bonus points for seeing what high quality research says about them (spoiler alert: it says you’re wrong). You’re demanding that people take very seriously your misinterpretations and assumptions about something you don’t understand. How is that a reasonable request?
Thanks, this was a very informative comment. I assume none of the IFCN signatories have a free API? Just asking since you seem pretty well versed on this
I appreciate you reading and responding to my concern instead of censoring me like your fellow mod in !news and !world:
- Censored by !news as ‘Stop Spamming’
- Censored by !news as ‘Stop Spamming’
- Censored by !world as ‘Stop Spamming’
- Censored by !news as ‘Stop Spamming’
- Censored by !world as ‘Stop Spamming’
- Censored by !news as ‘Stop Spamming’
- Censored by !world as ‘Stop Spamming’
- Censored by !news as ‘Stop Spamming’
More than half of these occurred in a community you moderate. Do you approve of this use of the term ‘spamming’ to silence criticism?
Exposing a free API for anyone to use is not typical trade practice for respectable fact-checking operations. You may be able to get free access as a non-profit organization, and that may be worth persuing. On the other hand, there’s a fundamental problem in the disconnect between the goals of real fact-checking websites and the kind of bot you are trying to create.
Thanks, that tip about being a non-profit is a good suggestion. Do you have any specific fact checkers in mind?
In terms of the comments, they look like they are off-topic. There are support communities within Lemmy.world that would be more appropriate places to post concerns. Or even other communities focused on things like Lemmy drama and similar topics like that. But copy/pasting the same comment on multiple threads? Doesn’t matter what you’re saying, we’ll delete it as spam. Done it many times myself, even if I didn’t delete your comments in particular.
This is not a case of copy/pasting the same comment in multiple threads. Please look closer at the comments and the reports. One comment is repeated once, but that is due to it being topical to MBFC’s take on the BBC, and both articles were from the BBC.
Also, I’m alarmed you consider contextualization of MBFC in comments that reply to the Bot as ‘off-topic.’ The Bot created the topic of MBFC’s credibility by linking to it as an authoritative source. If a comment about the credibility of the BBC in reply to an article published by the BBC is on-topic, then a comment about the credibility of MBFC as a reply to a review published by MBFC is also on-topic.
I love how they call your replies to bot spam but the bot isn’t.
Not just any bot spam - the most downvoted spam in Lemmy history. It is now more unpopular than the most popular Lemmy account is popular.
