Hi all!

As many of you have noticed, many Lemmy.World communities introduced a bot: @MediaBiasFactChecker@lemmy.world. This bot was introduced because modding can be pretty tough work at times and we are all just volunteers with regular lives. It has been helpful and we would like to keep it around in one form or another.

The !news@lemmy.world mods want to give the community a chance to voice their thoughts on some potential changes to the MBFC bot. We have heard concerns that tend to fall into a few buckets. The most common concern we’ve heard is that the bot’s comment is too long. To address this, we’ve implemented a spoiler tag so that users need to click to see more information. We’ve also cut wording about donations that people argued made the bot feel like an ad.

Another common concern people have is with MBFC’s definition of “left” and “right,” which tend to be influenced by the American Overton window. Similarly, some have expressed that they feel MBFC’s process of rating reliability and credibility is opaque and/or subjective. To address this, we have discussed creating our own open source system of scoring news sources. We would essentially start with third-party ratings, including MBFC, and create an aggregate rating. We could also open a path for users to vote, so that any rating would reflect our instance’s opinions of a source. We would love to hear your thoughts on this, as well as suggestions for sources that rate news outlets’ bias, reliability, and/or credibility. Feel free to use this thread to share other constructive criticism about the bot too.

  • steventhedev@lemmy.world
    link
    fedilink
    arrow-up
    3
    arrow-down
    23
    ·
    3 months ago

    I think the bot is incredibly useful. The criticism falls under a very specific group of users being very loud about their preferred source not ranking the way they expect.

    Linking additional sources will improve it. Wikipedia maintains an active list and has an incentive to do so. Personally, I’d like to see a transparent methodology applied to a source: number of articles retracted silently, corrections issued in last 30 days, etc.

    That having been said, I’d rather see efforts invested in other areas rather than inventing yet another “weighing” function for multiple ratings. Let us decide if mbfc is good enough or if we prefer ad fontes or Wikipedia or whoever. Give us two or three options and let us decide on our own.

    • fine_sandy_bottom@lemmy.federate.cc
      link
      fedilink
      arrow-up
      8
      arrow-down
      3
      ·
      3 months ago

      The criticism falls under a very specific group of users being very loud about their preferred source not ranking the way they expect.

      “Any opinions that differ from my own are simply invalid!”

    • KombatWombat@lemmy.world
      link
      fedilink
      arrow-up
      2
      arrow-down
      2
      ·
      3 months ago

      It seems bizarre to me that the only user I have seen actually trying to provide constructive criticism for the bot so far in this thread is the one that already likes it. Especially when others instead advocate for things like the mods taking a political stance to endorse and using mod powers to reinforce it.

      I like the bot. It’s valuable to have context for the organization pushing a story. I agree that others are reading too much from the orgs they like being labeled as biased. It’s assumed a news source will have some bias, and trying to avoid acknowledging that is dangerous. The takeaway is simply to be wary of any narrative being pushed (intentionally or not) by framing or omission, and get news from a variety of sources when possible. Instead, people tend to think identifying bias is advocating that the article should be disregarded, which is untrue.

      To your suggestion, I do think adding more sources for reliability and bias judgements is a good idea. It would give more credibility if multiple respected independent organizations come to the same conclusion. More insight into their methodology in the comment itself could also be nice. The downside of adding these is that it would make the comment even longer when people have already complained about its size.

      Other than that, I have seen people dislike using the American political center as a basis for alignment, but I have yet to see a good alternative. I expect a significant plurality of users are from the US, and US politics are globally relevant, so it seems to be a natural choice.

      Nearly every critic I have seen so far just thinks it should be removed entirely because they find it annoying. I would say even if it isn’t considered useful for the majority of users, the amount of value it provides people who do use it justifies whatever minor annoyance it is to others. Anyone who gets really tired of collapsing the comment or scrolling past it can block it in seconds.

      Thank you to the mod who created this thread. Even if it’s good to gather feedback, it’s obviously not easy to get bombarded with negative comments. I’m impressed with the patience you have shown in this thread.

    • jeffw@lemmy.worldOPM
      link
      fedilink
      arrow-up
      3
      arrow-down
      4
      ·
      3 months ago

      Can you elaborate on what you mean by improvements in other areas?

      • steventhedev@lemmy.world
        link
        fedilink
        arrow-up
        2
        ·
        3 months ago

        Improvements to automod, such as checking for opinion articles by regex (and building up that list). Or automatically marking/linking duplicate posts.

        Also, regex scanning of comments to autoban would be useful for moderation well outside of the news/politics realm.

        Most of the changes I’d like to see would require major changes to Lemmy though. Things like rate limiting posts/comments/votes, and allowing complex conditions for using those quotas. Also more nuanced moderation such as unlisting a post/comment (or potentially rehoming them).