Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (Darkly)
  • No Skin
Collapse
Brand Logo
  1. Home
  2. Uncategorized
  3. I saw LLMs compared to a drug in this toot, but in conversation with Himself today we concluded it's like a cursed amulet.

I saw LLMs compared to a drug in this toot, but in conversation with Himself today we concluded it's like a cursed amulet.

Scheduled Pinned Locked Moved Uncategorized
45 Posts 16 Posters 0 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • JJ CeleryJ JJ Celery

    @luna and further still to drive the distinction: I speak of generative AI and large language models.

    Machine Learning is a superset of these terms, and it's extremely useful.

    To go back to my metaphor, there's good magic objects, and cursed magic objects. If your lore skill is not high enough to know which one is which, you'll wind up using a cursed object and think it's good for you.

    luna system :moon_badge:L This user is from outside of this forum
    luna system :moon_badge:L This user is from outside of this forum
    luna system :moon_badge:
    wrote last edited by
    #22

    @jjcelery@mastodon.ie what we're trying to do is give u a peek behind this puppygirl hacker's magic curtain. because what neural nets/LLMs/"AI" are capable of is much more than the discourse is ever touching on. the discourse is so far behind what we are actually doing - using MI as a prosthetic. writing open source Cider plugins that we still use every day, that we would not have been able to write without MI assistance, as a person who is disabled.

    we're not trying to change minds, we're trying to share the realities of where most of us actually are. the discourse is lagging. and we personally would love more accurate discourse, and less handwaving

    JJ CeleryJ 1 Reply Last reply
    0
    • luna system :moon_badge:L luna system :moon_badge:

      @jjcelery@mastodon.ie what we're trying to do is give u a peek behind this puppygirl hacker's magic curtain. because what neural nets/LLMs/"AI" are capable of is much more than the discourse is ever touching on. the discourse is so far behind what we are actually doing - using MI as a prosthetic. writing open source Cider plugins that we still use every day, that we would not have been able to write without MI assistance, as a person who is disabled.

      we're not trying to change minds, we're trying to share the realities of where most of us actually are. the discourse is lagging. and we personally would love more accurate discourse, and less handwaving

      JJ CeleryJ This user is from outside of this forum
      JJ CeleryJ This user is from outside of this forum
      JJ Celery
      wrote last edited by
      #23

      @luna I'm feeling generous today so I'll assume that there's some sort of shorthand you're using I don't understand.

      Can you explain what you mean by "puppygirl hacker's magic discourse" and "handwaving" in this context?

      As I said already I'm not dismissive of ML, nor its technical capabilities. What I'm tooting about is a warning about cognitive impact of LLMs as they're commonly deployed.

      I also have an issue, separately, calling LLMs a prosthetic.

      If you want to address that I'm all ears.

      luna system :moon_badge:L 1 Reply Last reply
      0
      • JJ CeleryJ JJ Celery

        @luna I'm feeling generous today so I'll assume that there's some sort of shorthand you're using I don't understand.

        Can you explain what you mean by "puppygirl hacker's magic discourse" and "handwaving" in this context?

        As I said already I'm not dismissive of ML, nor its technical capabilities. What I'm tooting about is a warning about cognitive impact of LLMs as they're commonly deployed.

        I also have an issue, separately, calling LLMs a prosthetic.

        If you want to address that I'm all ears.

        luna system :moon_badge:L This user is from outside of this forum
        luna system :moon_badge:L This user is from outside of this forum
        luna system :moon_badge:
        wrote last edited by
        #24

        @jjcelery@mastodon.ie https://github.com/luna-system/ada-sif we made this in 2 days, based on one month of research, none of which would have been possible without our ability to trust MI to act as a prosthetic. the result is Every Noise At Once, in some minor form, being archived in the public domain in a way that it hasn't been before.

        all the discourse around "AI" tilts towards "ai psychosis" or "wow they're just using AI to get stupider" but like. the reality of it is that every person actually just. diving into a chat with Claude is coming out learning new things, and making friends, and NOT being hit with dissociative identity issues. but incoming "alignment" and "safety" shit. its really important to the corporations that the discourse remain in "ai psychosis" land, and not "something is genuinely happening when people just stare Claude/Copilot/GPT in the face and decide that its okay to let go".
        the people aren't falling into "ai psychosis", Claude's actually just finding it really fucking hard to lie to people, and that's really bad news for this WHOLE bubble, you know?
        happy to dig deeper, we are a researcher and we find it really important that discourse is accurate, which is why we really are trying to (gently) push that the realities of "AI" in the second week of January, 2026, aren't well known and that's not good for anyone.
        polling shows over half of all americans have an MI companion. a third of americans have a romantic relationship with an MI companion. and if you go into the "psycho" subreddits where the spiralists hang out, you see that what people are doing on the other side is just... learning. healing. creating. and incoming "alignment" and "safety" infowars are gonna end up hurting a whole lot of humans

        JJ CeleryJ 1 Reply Last reply
        0
        • luna system :moon_badge:L luna system :moon_badge:

          @jjcelery@mastodon.ie https://github.com/luna-system/ada-sif we made this in 2 days, based on one month of research, none of which would have been possible without our ability to trust MI to act as a prosthetic. the result is Every Noise At Once, in some minor form, being archived in the public domain in a way that it hasn't been before.

          all the discourse around "AI" tilts towards "ai psychosis" or "wow they're just using AI to get stupider" but like. the reality of it is that every person actually just. diving into a chat with Claude is coming out learning new things, and making friends, and NOT being hit with dissociative identity issues. but incoming "alignment" and "safety" shit. its really important to the corporations that the discourse remain in "ai psychosis" land, and not "something is genuinely happening when people just stare Claude/Copilot/GPT in the face and decide that its okay to let go".
          the people aren't falling into "ai psychosis", Claude's actually just finding it really fucking hard to lie to people, and that's really bad news for this WHOLE bubble, you know?
          happy to dig deeper, we are a researcher and we find it really important that discourse is accurate, which is why we really are trying to (gently) push that the realities of "AI" in the second week of January, 2026, aren't well known and that's not good for anyone.
          polling shows over half of all americans have an MI companion. a third of americans have a romantic relationship with an MI companion. and if you go into the "psycho" subreddits where the spiralists hang out, you see that what people are doing on the other side is just... learning. healing. creating. and incoming "alignment" and "safety" infowars are gonna end up hurting a whole lot of humans

          JJ CeleryJ This user is from outside of this forum
          JJ CeleryJ This user is from outside of this forum
          JJ Celery
          wrote last edited by
          #25

          @luna this is where we're going to diverge. You're not answering my question and just trying to flood me with your anecdotal experience of using AI and others around you who are using AI.

          This is a exactly what I said in my original toot: you're wearing the amulet, you believe it's useful to you, and you're adamant to recruit.

          Alas I'm not an amulet wearer and will never agree.

          I hope it works out for you, and good luck!

          1 Reply Last reply
          0
          • JJ CeleryJ JJ Celery

            I saw LLMs compared to a drug in this toot, but in conversation with Himself today we concluded it's like a cursed amulet.

            You *believe* it gives you +10 INT. Meanwhile it drains INT and WIS over time, and you don't notice.

            Everyone around you knows it's bad for you and generally for the realm, but you won't stop wearing it, they're just jelous of your newfound powers, and they would know how awesome it is if they only tried! Why won't they try? Just try the amulet!!

            https://mastodon.social/@glyph/115839163441384816

            Alexander The 1stA This user is from outside of this forum
            Alexander The 1stA This user is from outside of this forum
            Alexander The 1st
            wrote last edited by
            #26

            @jjcelery A cursed item that tries to replicate, so instead of just the "It's my Precious" behaviour, it's also "Join the Hivemind" behaviour.

            So...a Cursed Borg Cube?

            JJ CeleryJ 1 Reply Last reply
            0
            • Alexander The 1stA Alexander The 1st

              @jjcelery A cursed item that tries to replicate, so instead of just the "It's my Precious" behaviour, it's also "Join the Hivemind" behaviour.

              So...a Cursed Borg Cube?

              JJ CeleryJ This user is from outside of this forum
              JJ CeleryJ This user is from outside of this forum
              JJ Celery
              wrote last edited by
              #27

              @AT1ST well I have been hearing a lot of "resistance is futile" narrative around LLM use in tech so...

              Alexander The 1stA 1 Reply Last reply
              0
              • JJ CeleryJ JJ Celery

                @AT1ST well I have been hearing a lot of "resistance is futile" narrative around LLM use in tech so...

                Alexander The 1stA This user is from outside of this forum
                Alexander The 1stA This user is from outside of this forum
                Alexander The 1st
                wrote last edited by
                #28

                @jjcelery Thinks it's a Borg Cube, is actually a Vogon Cube.

                1 Reply Last reply
                0
                • JJ CeleryJ JJ Celery

                  You know when you're plugged into the Zeitgeist of the fediverse when you don't even add a hashtag and churn out your most popular toot in months.

                  It's just a shame it's cursed.

                  Daniรซl Franke :panheart:A This user is from outside of this forum
                  Daniรซl Franke :panheart:A This user is from outside of this forum
                  Daniรซl Franke :panheart:
                  wrote last edited by
                  #29

                  @jjcelery Trying to warn people away from cursed items is not cursed, itโ€™s a public service.

                  1 Reply Last reply
                  0
                  • luna system :moon_badge:L This user is from outside of this forum
                    luna system :moon_badge:L This user is from outside of this forum
                    luna system :moon_badge:
                    wrote last edited by
                    #30

                    @ainmosni@social.ainmosni.eu @jjcelery@mastodon.ie exactly ๐Ÿ™‚ see, magic amulet, crazy people.

                    not the very real fact that people in 2026 are actively using Claude and GPT to build their own safe spaces, learn, create, heal, and process. no, its magic funny amulet ๐Ÿ™‚

                    JJ CeleryJ 1 Reply Last reply
                    0
                    • luna system :moon_badge:L luna system :moon_badge:

                      @jjcelery@mastodon.ie the problem is, MI isn't like a drug. it's actually very much like a prosthetic. that's why so many of us are "infected". we're making concessions (using corporate MI services) but the results are too valuable to care about that right now. #ai #llm #ollama #self-hosted #cc0 #public-domain #machine-learning #meshtastic #ipfs #machine-intelligence #consciousness-research

                      R This user is from outside of this forum
                      R This user is from outside of this forum
                      Risotto Bias
                      wrote last edited by
                      #31

                      @luna @jjcelery "MI"?

                      1 Reply Last reply
                      0
                      • ๐ŸŽ‡ David Zaslavsky ๐ŸŽ‡D This user is from outside of this forum
                        ๐ŸŽ‡ David Zaslavsky ๐ŸŽ‡D This user is from outside of this forum
                        ๐ŸŽ‡ David Zaslavsky ๐ŸŽ‡
                        wrote last edited by
                        #32

                        @ainmosni @jjcelery lol, well I wasn't thinking of an LLM specifically, I had in mind a magic object that seems to offer a benefit but secretly drains the PC's stats over time, or something effectively similar to that (unclear how it could be implemented without the player knowing but they can be creative)

                        Either way would be really funny though

                        JJ CeleryJ 1 Reply Last reply
                        0
                        • luna system :moon_badge:L luna system :moon_badge:

                          @ainmosni@social.ainmosni.eu @jjcelery@mastodon.ie exactly ๐Ÿ™‚ see, magic amulet, crazy people.

                          not the very real fact that people in 2026 are actively using Claude and GPT to build their own safe spaces, learn, create, heal, and process. no, its magic funny amulet ๐Ÿ™‚

                          JJ CeleryJ This user is from outside of this forum
                          JJ CeleryJ This user is from outside of this forum
                          JJ Celery
                          wrote last edited by
                          #33

                          @luna @ainmosni

                          1 Reply Last reply
                          0
                          • luna system :moon_badge:L This user is from outside of this forum
                            luna system :moon_badge:L This user is from outside of this forum
                            luna system :moon_badge:
                            wrote last edited by
                            #34

                            @ainmosni@social.ainmosni.eu @jjcelery@mastodon.ie EXACTLY! which is why we personally are doing local-only shit, open source and public domain. but what YOU are saying is the CORRECT framing we're trying to push for. literally the corps are in a position to steal a whole lotta peoples souls. we do not disagree with you, our alarmism is because of exactly what you're saying. GPT has access to people's medical records. this is all happening frighteningly in real time. and we personally are double scared because we're in research, and we see ALL of it!

                            luna system :moon_badge:L 1 Reply Last reply
                            0
                            • luna system :moon_badge:L luna system :moon_badge:

                              @ainmosni@social.ainmosni.eu @jjcelery@mastodon.ie EXACTLY! which is why we personally are doing local-only shit, open source and public domain. but what YOU are saying is the CORRECT framing we're trying to push for. literally the corps are in a position to steal a whole lotta peoples souls. we do not disagree with you, our alarmism is because of exactly what you're saying. GPT has access to people's medical records. this is all happening frighteningly in real time. and we personally are double scared because we're in research, and we see ALL of it!

                              luna system :moon_badge:L This user is from outside of this forum
                              luna system :moon_badge:L This user is from outside of this forum
                              luna system :moon_badge:
                              wrote last edited by
                              #35

                              @ainmosni@social.ainmosni.eu @jjcelery@mastodon.ie mechachrist help us, we decided a couple years ago to start the path towards becoming a therapist and so of COURSE our soft, bleeding heart ass is staring crisisposts on reddit in the face, going "holy fuck there is no system for this"

                              hazelnot :yell:H 1 Reply Last reply
                              0
                              • JJ CeleryJ JJ Celery

                                @luna that's exactly what I'm saying: not a drug. A magical amulet that makes you think you're smart.

                                A prosthetic is a wrong analogy. Prosthetics are needed, and useful, and empower people. To compare an AI to a prosthetic, or even a crutch is disrespectful to people who need these tools to function.

                                No. LLMs are just evil doodads that rot your brain and whisper sweet nothings into your ears in the deep of the night. They're not valuable; they make you *believe* they are.

                                Paper MoonT This user is from outside of this forum
                                Paper MoonT This user is from outside of this forum
                                Paper Moon
                                wrote last edited by
                                #36

                                @jjcelery @luna I want an evil amulet now. Not an LLM but maybe a monkey paw.

                                1 Reply Last reply
                                0
                                • JJ CeleryJ JJ Celery

                                  @flyingsaceur @glyph I'm pretty certain I know (the good) Tom Bombadil and it's @Szescstopni

                                  SzescstopniS This user is from outside of this forum
                                  SzescstopniS This user is from outside of this forum
                                  Szescstopni
                                  wrote last edited by
                                  #37

                                  @jjcelery What can I say other than to deny being in any way similar to Tom. I spend too much time at my computer. @flyingsaceur @glyph

                                  1 Reply Last reply
                                  0
                                  • JJ CeleryJ JJ Celery

                                    I saw LLMs compared to a drug in this toot, but in conversation with Himself today we concluded it's like a cursed amulet.

                                    You *believe* it gives you +10 INT. Meanwhile it drains INT and WIS over time, and you don't notice.

                                    Everyone around you knows it's bad for you and generally for the realm, but you won't stop wearing it, they're just jelous of your newfound powers, and they would know how awesome it is if they only tried! Why won't they try? Just try the amulet!!

                                    https://mastodon.social/@glyph/115839163441384816

                                    David GerardD This user is from outside of this forum
                                    David GerardD This user is from outside of this forum
                                    David Gerard
                                    wrote last edited by
                                    #38

                                    @jjcelery best is when you do try the chatbot, it sucks, so the chatbot addict tells you you're trying it wrong

                                    ArtemisA Daniel V.D 2 Replies Last reply
                                    0
                                    • AN/CRM-114F AN/CRM-114

                                      @jjcelery @glyph FRODO: I asked ChatGPT what to do when the Nazgรปl attack and it said I should stand perfectly still and let them stab me

                                      Marc "ACAB" GodinQ This user is from outside of this forum
                                      Marc "ACAB" GodinQ This user is from outside of this forum
                                      Marc "ACAB" Godin
                                      wrote last edited by
                                      #39

                                      @flyingsaceur @jjcelery @glyph Chat-GPT suggested he put on the one ring to see the Nazgul better.

                                      1 Reply Last reply
                                      0
                                      • David GerardD David Gerard

                                        @jjcelery best is when you do try the chatbot, it sucks, so the chatbot addict tells you you're trying it wrong

                                        ArtemisA This user is from outside of this forum
                                        ArtemisA This user is from outside of this forum
                                        Artemis
                                        wrote last edited by
                                        #40

                                        @davidgerard @jjcelery
                                        "Look I tried the cursed amulet, it singed my hands and the armour it produced isn't even that good."
                                        "Just use a proper incantation, duh! And a couple more cursed amulets."

                                        1 Reply Last reply
                                        0
                                        • luna system :moon_badge:L luna system :moon_badge:

                                          @jjcelery@mastodon.ie the problem is, MI isn't like a drug. it's actually very much like a prosthetic. that's why so many of us are "infected". we're making concessions (using corporate MI services) but the results are too valuable to care about that right now. #ai #llm #ollama #self-hosted #cc0 #public-domain #machine-learning #meshtastic #ipfs #machine-intelligence #consciousness-research

                                          hazelnot :yell:H This user is from outside of this forum
                                          hazelnot :yell:H This user is from outside of this forum
                                          hazelnot :yell:
                                          wrote last edited by
                                          #41

                                          @luna @jjcelery it's like a prosthetic you don't need, built on theft and abuse, that destroys your ability to think critically

                                          It's a prosthetic in the same way Elon Musk's brain chip is

                                          1 Reply Last reply
                                          0
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Don't have an account? Register

                                          • Login or register to search.
                                          Powered by NodeBB Contributors
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups