• udon@lemmy.world
    link
    fedilink
    English
    arrow-up
    49
    arrow-down
    1
    ·
    7 days ago

    If these “signs of AI writing” are merely linguistic, good for them. This is as accurate as a lie detector (i.e., not accurate) and nobody should use this for any real world decision-making.

    The real signs of AI writing are not as easy to fix as just instructing an LLM to “read” an article to avoid them.

    As a teacher, all of my grading is now based on in person performances, no tech allowed. Good luck faking that with an LLM. I do not mind if students use an LLM to better prepare for class and exams. But my impression so far is that any other medium (e.g., books, youtube explanation videos) leads to better results.

    • Randelung@lemmy.world
      link
      fedilink
      arrow-up
      2
      ·
      6 days ago

      I sucked in oral exams and therefore hated them. Then again, if they had been mixed into regular school, it might not have sucked so much.

      • prole@lemmy.blahaj.zone
        link
        fedilink
        arrow-up
        8
        ·
        6 days ago

        Doesn’t need to be oral, I remember occasionally having exams that were essay questions that needed to be answered in class.

        • udon@lemmy.world
          link
          fedilink
          English
          arrow-up
          5
          ·
          6 days ago

          I do both of these as well as smaller but more frequent tests, group work, project work over several sessions etc… The only things I stopped doing are reports to write at home, paper summaries etc. Doesn’t make sense anymore.

  • markstos@lemmy.world
    link
    fedilink
    arrow-up
    33
    ·
    6 days ago

    Congrats on inventing what high school students figured out a year ago to skirt AI homework detectors.

  • dumbass@piefed.social
    link
    fedilink
    English
    arrow-up
    75
    arrow-down
    4
    ·
    7 days ago

    Wikipedia is one of the last genuine places on the Internet, and these rat bastards are trying to contaminate that, too

    Wikipedia just sold the rights to use Wikipedia for AI training to Microsoft and openai…

    • udon@lemmy.world
      link
      fedilink
      English
      arrow-up
      13
      ·
      7 days ago

      How exactly does that work? Wikipedia does not “own” the content on the website, it’s all CC-BY licensed.

      • technocrit@lemmy.dbzer0.com
        link
        fedilink
        arrow-up
        1
        arrow-down
        1
        ·
        6 days ago

        Yeah, they’re selling the work of others. That’s how the site always worked. This venture into “AI” is nothing new.

        • udon@lemmy.world
          link
          fedilink
          English
          arrow-up
          3
          ·
          6 days ago

          So? Still doesn’t make sense to me that wikipedia can sell anything meaningful here, but I’m also not a lawyer. Do they promise not to sue them or sell them some guarantee that contributors also can’t sue them? Is it just some symbolic PR washing?

    • Alcoholicorn@mander.xyz
      link
      fedilink
      arrow-up
      17
      arrow-down
      8
      ·
      7 days ago

      Why? Wikipedia has like a decade of operating expenses on hand, so they don’t need the money

      • buddascrayon@lemmy.world
        link
        fedilink
        arrow-up
        9
        ·
        6 days ago

        I just love how people just shit “facts” out of their ass while citing zero sources and people will just believe them and upvote because it confirms their bias.

      • surewhynotlem@lemmy.world
        link
        fedilink
        arrow-up
        39
        ·
        7 days ago

        This number inflates every time I read it. First it was ten years of hosting cost. Then it’s operating costs. Soon it will be ten years of the entire US GDP.

        I’d believe they have ten years of hosting costs on hand.

        My quick googling says they have 170m in assets and all 180m in annual operating costs. Give or take.

        • green_red_black@slrpnk.net
          link
          fedilink
          English
          arrow-up
          20
          arrow-down
          2
          ·
          7 days ago

          It’s a non-profit foundation with the majority being volunteers. If greed was the case one then would have to ask is why not just go ahead and inject ads

            • green_red_black@slrpnk.net
              link
              fedilink
              English
              arrow-up
              12
              arrow-down
              1
              ·
              7 days ago

              Well as mentioned Wikipedia seems to be in the red and not making enough donations to pay for the expenses. So maybe the foundation is thinking it would help with the deficit.

              Also chances are Microsoft will instruct Co-Pilot to prioritize Wikipedia whenever it scours the internet for information.

              Think it like that eye rolling Google paying Firefox to be the default search engine deal.

              • technocrit@lemmy.dbzer0.com
                link
                fedilink
                arrow-up
                3
                ·
                6 days ago

                Well as mentioned Wikipedia seems to be in the red

                They keep saying that… at least when they’re asking for more money.

              • LadyMeow@lemmy.blahaj.zone
                link
                fedilink
                arrow-up
                4
                arrow-down
                5
                ·
                7 days ago

                Is wiki in the red? Unclear, omi mean they ask for money donations, but someone in this thread claims they are set for a decade, I’ve seen people post something about how they are fine, and even donate a bunch themselves. I don’t know, and I guess it doesn’t matter.

                Not sure where you are going with your second comment, and uninterested in engaging with your comparison as I don’t think it’s very good

                • green_red_black@slrpnk.net
                  link
                  fedilink
                  English
                  arrow-up
                  7
                  ·
                  7 days ago

                  I am referring to the reply comment from surewhynotlem. They say that cost is 180 million while Wikipedia has 170 million on hand. That is a 10 million deficit.

                  While probably not enough to shut down the site it is still operating in the red.

                  Where I was going is explaining how it’s possibly not greed. Just the foundation looking for another revenue source that theoretically would not ruin the site.

                  That alt being a deal that gets Wikipedia more traffic

            • Fedizen@lemmy.world
              link
              fedilink
              arrow-up
              5
              ·
              edit-2
              7 days ago

              If microsoft is “buying access to training data” it makes what Open AI is doing look illegal. I would encourage every data broker to sell 'AI training data rights" because it undermines the only real advantage AI has and it helps pave the way to forcing AI companies to comply with open source licenses.

              Essentially selling ai data rights is a trojan horse for the AI companies. Obviously it would be better to pass laws but until that happens this is imo a better strategy than doing nothing.

  • pedz@lemmy.ca
    link
    fedilink
    arrow-up
    34
    arrow-down
    1
    ·
    7 days ago

    In French, one of the way to spot AI writing is that sentences will often miss articles or have bad grammar. Can this dude also ask the LLM to include more articles and make complete sentences in the language it’s trying to imitate?

    I was using the Discover feed on my phone but Google started to insert rewritten stories & headlines by AI and they were so annoyingly bad at making simple sentences in French that it made me stop using that thing.

      • Prunebutt@slrpnk.net
        link
        fedilink
        arrow-up
        12
        ·
        edit-2
        7 days ago

        Nice try, LLM. In French, it’s probably spelled “IA” (for “intelligence artificiel”), like basically every other originally english acronym. /j

      • pedz@lemmy.ca
        link
        fedilink
        arrow-up
        5
        ·
        6 days ago

        The most recent one I saw was “Neige cause ralentissement de REM”. It works translated in English, giving something like “Snow causes slowing down of REM”, but in French it’s missing enough articles to sound wrong. The cromulent sentence would have been “La neige cause le/un ralentissement du REM”. Back into English this would add “The snow causes the/a slowing down of the REM”. A missing “le/la”, or using “de” instead of “du” doesn’t change the meaning of a sentence, but it makes it obvious that it wasn’t from a native speaker.

        Maybe it depends on the model and the source but so far, in French, for news, most of what I’ve read becomes uncanny after a few sentences. They often read like something passed through a translation program but just a tad better. You can understand it fine but it’s missing an article there, reversing the word order in another sentence, uses vocabulary that is just slightly off, and often ends up like something written by someone that learned French as a second language for most of their life. A very good learner, nearly native level, but not quite there yet and still a bit off.

  • defunct_punk@lemmy.world
    link
    fedilink
    English
    arrow-up
    9
    arrow-down
    29
    ·
    7 days ago

    Really hope to see the day that they get marched off to the gas chambers. They’ve not only given their humanity away, theyre trying to take it from us too.

  • Bloomcole@lemmy.world
    link
    fedilink
    arrow-up
    7
    arrow-down
    11
    ·
    6 days ago

    Wikipedia is astroturfed BS for anything remotely politically related.
    Useful if you want to learn about the Ivory-billed Woodpecker or a closed-cycle regenerative heat engine, etc…
    So no politics and subjects with political implications such as history.

      • Bloomcole@lemmy.world
        link
        fedilink
        arrow-up
        2
        ·
        6 days ago

        I trust no one with my history or geopolitics but ML’s.
        Most informed, well read and thorough people on the planet

    • technocrit@lemmy.dbzer0.com
      link
      fedilink
      arrow-up
      2
      arrow-down
      4
      ·
      edit-2
      6 days ago

      It’s really “strange” how people have this delusional viewpoint of wikipedia as neutral, honest, etc.

      I guess it seems fine if you’ve got lib politics completely within the hegemonic narrative.

      • JcbAzPx@lemmy.world
        link
        fedilink
        English
        arrow-up
        3
        ·
        6 days ago

        The point is you can check the citations to validate. It can be poisoned by wuzzles but you can discover that with just a bit of effort checking the citations.

  • Phoenix3875@lemmy.world
    link
    fedilink
    arrow-up
    85
    arrow-down
    10
    ·
    7 days ago

    You do understand this is more akin to white hat testing, right?

    Those who want to exploit this will do it anyway, except they won’t publish the result. By making the exploit public, the risk will be known if not mitigated.

    • unepelle@mander.xyz
      link
      fedilink
      arrow-up
      24
      ·
      edit-2
      6 days ago

      I’m admittedly not knowledgeable in White Hat Hacking, but are you supposed to publicize the vulnerability, release a shortcut to exploit it telling people to ‘enjoy’, or even call the vulnerability handy ?

      • teft@piefed.social
        link
        fedilink
        English
        arrow-up
        15
        arrow-down
        2
        ·
        6 days ago

        Responsible disclosure is what a white hat does. You report the bug to whomever is the party responsible for patching and give them time to fix it.

        • PlexSheep@infosec.pub
          link
          fedilink
          arrow-up
          11
          ·
          6 days ago

          That sort of depends on the situation. Responsible disclosure is for if there is some relevant security hole that is an actual risk to businesses and people, while this here is just “haha look LLMs can now better pretend to write good text if you tell it to”. That’s not really responsible disclosurable. It’s not even specific to one singular product.

      • FooBarrington@lemmy.world
        link
        fedilink
        arrow-up
        11
        arrow-down
        3
        ·
        6 days ago

        Considering the “vulnerability” here is on the level of “don’t use password as your password” - yeah, releasing it all is exactly the right step.

  • cheesybuddha@lemmy.world
    link
    fedilink
    arrow-up
    20
    ·
    6 days ago

    So they are using AI to make it so AI can’t detect that they are using AI?

    What kind of technological ouroborous of nonsense is this?

  • Avid Amoeba@lemmy.ca
    link
    fedilink
    arrow-up
    26
    ·
    6 days ago

    From the repo:

    Have opinions. Don’t just report facts - react to them. “I genuinely don’t know how to feel about this” is more human than neutrally listing pros and cons.