• primalmotion@lemmy.ml
    link
    fedilink
    arrow-up
    2
    ·
    edit-2
    2 days ago

    tokens are kind of the language unit of an llm. they’re suite of chars read or generated at once. they’re not necessarly words, but you can think of them this way. Now, is what Microslop CEO says BS though? 100%.