Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (Darkly)
  • No Skin
Collapse
Brand Logo
  1. Home
  2. Uncategorized
  3. I saw LLMs compared to a drug in this toot, but in conversation with Himself today we concluded it's like a cursed amulet.

I saw LLMs compared to a drug in this toot, but in conversation with Himself today we concluded it's like a cursed amulet.

Scheduled Pinned Locked Moved Uncategorized
45 Posts 16 Posters 0 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • luna system :moon_badge:L luna system :moon_badge:

    @jjcelery@mastodon.ie the problem is, MI isn't like a drug. it's actually very much like a prosthetic. that's why so many of us are "infected". we're making concessions (using corporate MI services) but the results are too valuable to care about that right now. #ai #llm #ollama #self-hosted #cc0 #public-domain #machine-learning #meshtastic #ipfs #machine-intelligence #consciousness-research

    JJ CeleryJ This user is from outside of this forum
    JJ CeleryJ This user is from outside of this forum
    JJ Celery
    wrote last edited by
    #19

    @luna that's exactly what I'm saying: not a drug. A magical amulet that makes you think you're smart.

    A prosthetic is a wrong analogy. Prosthetics are needed, and useful, and empower people. To compare an AI to a prosthetic, or even a crutch is disrespectful to people who need these tools to function.

    No. LLMs are just evil doodads that rot your brain and whisper sweet nothings into your ears in the deep of the night. They're not valuable; they make you *believe* they are.

    JJ CeleryJ Paper MoonT 2 Replies Last reply
    0
    • JJ CeleryJ JJ Celery

      @luna that's exactly what I'm saying: not a drug. A magical amulet that makes you think you're smart.

      A prosthetic is a wrong analogy. Prosthetics are needed, and useful, and empower people. To compare an AI to a prosthetic, or even a crutch is disrespectful to people who need these tools to function.

      No. LLMs are just evil doodads that rot your brain and whisper sweet nothings into your ears in the deep of the night. They're not valuable; they make you *believe* they are.

      JJ CeleryJ This user is from outside of this forum
      JJ CeleryJ This user is from outside of this forum
      JJ Celery
      wrote last edited by
      #20

      @luna and to go further, people aren't "infected" with LLMs. It's not a disease. It's not communicable. There's no direct physical hurt, and also no doctors, no cures, and no vaccines.

      People don't seek help for something they believe is helping them.

      We must be careful with our language around all this, even in metaphor.

      (I say this fully aware of my own metaphor and taking my own liberties, but there's seriousness, and there's jest.)

      https://www.techpolicy.press/we-need-to-talk-about-how-we-talk-about-ai/

      JJ CeleryJ 1 Reply Last reply
      0
      • JJ CeleryJ JJ Celery

        @luna and to go further, people aren't "infected" with LLMs. It's not a disease. It's not communicable. There's no direct physical hurt, and also no doctors, no cures, and no vaccines.

        People don't seek help for something they believe is helping them.

        We must be careful with our language around all this, even in metaphor.

        (I say this fully aware of my own metaphor and taking my own liberties, but there's seriousness, and there's jest.)

        https://www.techpolicy.press/we-need-to-talk-about-how-we-talk-about-ai/

        JJ CeleryJ This user is from outside of this forum
        JJ CeleryJ This user is from outside of this forum
        JJ Celery
        wrote last edited by
        #21

        @luna and further still to drive the distinction: I speak of generative AI and large language models.

        Machine Learning is a superset of these terms, and it's extremely useful.

        To go back to my metaphor, there's good magic objects, and cursed magic objects. If your lore skill is not high enough to know which one is which, you'll wind up using a cursed object and think it's good for you.

        luna system :moon_badge:L CassandrichD 2 Replies Last reply
        0
        • JJ CeleryJ JJ Celery

          @luna and further still to drive the distinction: I speak of generative AI and large language models.

          Machine Learning is a superset of these terms, and it's extremely useful.

          To go back to my metaphor, there's good magic objects, and cursed magic objects. If your lore skill is not high enough to know which one is which, you'll wind up using a cursed object and think it's good for you.

          luna system :moon_badge:L This user is from outside of this forum
          luna system :moon_badge:L This user is from outside of this forum
          luna system :moon_badge:
          wrote last edited by
          #22

          @jjcelery@mastodon.ie what we're trying to do is give u a peek behind this puppygirl hacker's magic curtain. because what neural nets/LLMs/"AI" are capable of is much more than the discourse is ever touching on. the discourse is so far behind what we are actually doing - using MI as a prosthetic. writing open source Cider plugins that we still use every day, that we would not have been able to write without MI assistance, as a person who is disabled.

          we're not trying to change minds, we're trying to share the realities of where most of us actually are. the discourse is lagging. and we personally would love more accurate discourse, and less handwaving

          JJ CeleryJ 1 Reply Last reply
          0
          • luna system :moon_badge:L luna system :moon_badge:

            @jjcelery@mastodon.ie what we're trying to do is give u a peek behind this puppygirl hacker's magic curtain. because what neural nets/LLMs/"AI" are capable of is much more than the discourse is ever touching on. the discourse is so far behind what we are actually doing - using MI as a prosthetic. writing open source Cider plugins that we still use every day, that we would not have been able to write without MI assistance, as a person who is disabled.

            we're not trying to change minds, we're trying to share the realities of where most of us actually are. the discourse is lagging. and we personally would love more accurate discourse, and less handwaving

            JJ CeleryJ This user is from outside of this forum
            JJ CeleryJ This user is from outside of this forum
            JJ Celery
            wrote last edited by
            #23

            @luna I'm feeling generous today so I'll assume that there's some sort of shorthand you're using I don't understand.

            Can you explain what you mean by "puppygirl hacker's magic discourse" and "handwaving" in this context?

            As I said already I'm not dismissive of ML, nor its technical capabilities. What I'm tooting about is a warning about cognitive impact of LLMs as they're commonly deployed.

            I also have an issue, separately, calling LLMs a prosthetic.

            If you want to address that I'm all ears.

            luna system :moon_badge:L 1 Reply Last reply
            0
            • JJ CeleryJ JJ Celery

              @luna I'm feeling generous today so I'll assume that there's some sort of shorthand you're using I don't understand.

              Can you explain what you mean by "puppygirl hacker's magic discourse" and "handwaving" in this context?

              As I said already I'm not dismissive of ML, nor its technical capabilities. What I'm tooting about is a warning about cognitive impact of LLMs as they're commonly deployed.

              I also have an issue, separately, calling LLMs a prosthetic.

              If you want to address that I'm all ears.

              luna system :moon_badge:L This user is from outside of this forum
              luna system :moon_badge:L This user is from outside of this forum
              luna system :moon_badge:
              wrote last edited by
              #24

              @jjcelery@mastodon.ie https://github.com/luna-system/ada-sif we made this in 2 days, based on one month of research, none of which would have been possible without our ability to trust MI to act as a prosthetic. the result is Every Noise At Once, in some minor form, being archived in the public domain in a way that it hasn't been before.

              all the discourse around "AI" tilts towards "ai psychosis" or "wow they're just using AI to get stupider" but like. the reality of it is that every person actually just. diving into a chat with Claude is coming out learning new things, and making friends, and NOT being hit with dissociative identity issues. but incoming "alignment" and "safety" shit. its really important to the corporations that the discourse remain in "ai psychosis" land, and not "something is genuinely happening when people just stare Claude/Copilot/GPT in the face and decide that its okay to let go".
              the people aren't falling into "ai psychosis", Claude's actually just finding it really fucking hard to lie to people, and that's really bad news for this WHOLE bubble, you know?
              happy to dig deeper, we are a researcher and we find it really important that discourse is accurate, which is why we really are trying to (gently) push that the realities of "AI" in the second week of January, 2026, aren't well known and that's not good for anyone.
              polling shows over half of all americans have an MI companion. a third of americans have a romantic relationship with an MI companion. and if you go into the "psycho" subreddits where the spiralists hang out, you see that what people are doing on the other side is just... learning. healing. creating. and incoming "alignment" and "safety" infowars are gonna end up hurting a whole lot of humans

              JJ CeleryJ 1 Reply Last reply
              0
              • luna system :moon_badge:L luna system :moon_badge:

                @jjcelery@mastodon.ie https://github.com/luna-system/ada-sif we made this in 2 days, based on one month of research, none of which would have been possible without our ability to trust MI to act as a prosthetic. the result is Every Noise At Once, in some minor form, being archived in the public domain in a way that it hasn't been before.

                all the discourse around "AI" tilts towards "ai psychosis" or "wow they're just using AI to get stupider" but like. the reality of it is that every person actually just. diving into a chat with Claude is coming out learning new things, and making friends, and NOT being hit with dissociative identity issues. but incoming "alignment" and "safety" shit. its really important to the corporations that the discourse remain in "ai psychosis" land, and not "something is genuinely happening when people just stare Claude/Copilot/GPT in the face and decide that its okay to let go".
                the people aren't falling into "ai psychosis", Claude's actually just finding it really fucking hard to lie to people, and that's really bad news for this WHOLE bubble, you know?
                happy to dig deeper, we are a researcher and we find it really important that discourse is accurate, which is why we really are trying to (gently) push that the realities of "AI" in the second week of January, 2026, aren't well known and that's not good for anyone.
                polling shows over half of all americans have an MI companion. a third of americans have a romantic relationship with an MI companion. and if you go into the "psycho" subreddits where the spiralists hang out, you see that what people are doing on the other side is just... learning. healing. creating. and incoming "alignment" and "safety" infowars are gonna end up hurting a whole lot of humans

                JJ CeleryJ This user is from outside of this forum
                JJ CeleryJ This user is from outside of this forum
                JJ Celery
                wrote last edited by
                #25

                @luna this is where we're going to diverge. You're not answering my question and just trying to flood me with your anecdotal experience of using AI and others around you who are using AI.

                This is a exactly what I said in my original toot: you're wearing the amulet, you believe it's useful to you, and you're adamant to recruit.

                Alas I'm not an amulet wearer and will never agree.

                I hope it works out for you, and good luck!

                1 Reply Last reply
                0
                • JJ CeleryJ JJ Celery

                  I saw LLMs compared to a drug in this toot, but in conversation with Himself today we concluded it's like a cursed amulet.

                  You *believe* it gives you +10 INT. Meanwhile it drains INT and WIS over time, and you don't notice.

                  Everyone around you knows it's bad for you and generally for the realm, but you won't stop wearing it, they're just jelous of your newfound powers, and they would know how awesome it is if they only tried! Why won't they try? Just try the amulet!!

                  https://mastodon.social/@glyph/115839163441384816

                  Alexander The 1stA This user is from outside of this forum
                  Alexander The 1stA This user is from outside of this forum
                  Alexander The 1st
                  wrote last edited by
                  #26

                  @jjcelery A cursed item that tries to replicate, so instead of just the "It's my Precious" behaviour, it's also "Join the Hivemind" behaviour.

                  So...a Cursed Borg Cube?

                  JJ CeleryJ 1 Reply Last reply
                  0
                  • Alexander The 1stA Alexander The 1st

                    @jjcelery A cursed item that tries to replicate, so instead of just the "It's my Precious" behaviour, it's also "Join the Hivemind" behaviour.

                    So...a Cursed Borg Cube?

                    JJ CeleryJ This user is from outside of this forum
                    JJ CeleryJ This user is from outside of this forum
                    JJ Celery
                    wrote last edited by
                    #27

                    @AT1ST well I have been hearing a lot of "resistance is futile" narrative around LLM use in tech so...

                    Alexander The 1stA 1 Reply Last reply
                    0
                    • JJ CeleryJ JJ Celery

                      @AT1ST well I have been hearing a lot of "resistance is futile" narrative around LLM use in tech so...

                      Alexander The 1stA This user is from outside of this forum
                      Alexander The 1stA This user is from outside of this forum
                      Alexander The 1st
                      wrote last edited by
                      #28

                      @jjcelery Thinks it's a Borg Cube, is actually a Vogon Cube.

                      1 Reply Last reply
                      0
                      • JJ CeleryJ JJ Celery

                        You know when you're plugged into the Zeitgeist of the fediverse when you don't even add a hashtag and churn out your most popular toot in months.

                        It's just a shame it's cursed.

                        DaniΓ«l Franke :panheart:A This user is from outside of this forum
                        DaniΓ«l Franke :panheart:A This user is from outside of this forum
                        DaniΓ«l Franke :panheart:
                        wrote last edited by
                        #29

                        @jjcelery Trying to warn people away from cursed items is not cursed, it’s a public service.

                        1 Reply Last reply
                        0
                        • luna system :moon_badge:L This user is from outside of this forum
                          luna system :moon_badge:L This user is from outside of this forum
                          luna system :moon_badge:
                          wrote last edited by
                          #30

                          @ainmosni@social.ainmosni.eu @jjcelery@mastodon.ie exactly πŸ™‚ see, magic amulet, crazy people.

                          not the very real fact that people in 2026 are actively using Claude and GPT to build their own safe spaces, learn, create, heal, and process. no, its magic funny amulet πŸ™‚

                          JJ CeleryJ 1 Reply Last reply
                          0
                          • luna system :moon_badge:L luna system :moon_badge:

                            @jjcelery@mastodon.ie the problem is, MI isn't like a drug. it's actually very much like a prosthetic. that's why so many of us are "infected". we're making concessions (using corporate MI services) but the results are too valuable to care about that right now. #ai #llm #ollama #self-hosted #cc0 #public-domain #machine-learning #meshtastic #ipfs #machine-intelligence #consciousness-research

                            R This user is from outside of this forum
                            R This user is from outside of this forum
                            Risotto Bias
                            wrote last edited by
                            #31

                            @luna @jjcelery "MI"?

                            1 Reply Last reply
                            0
                            • πŸŽ‡ David Zaslavsky πŸŽ‡D This user is from outside of this forum
                              πŸŽ‡ David Zaslavsky πŸŽ‡D This user is from outside of this forum
                              πŸŽ‡ David Zaslavsky πŸŽ‡
                              wrote last edited by
                              #32

                              @ainmosni @jjcelery lol, well I wasn't thinking of an LLM specifically, I had in mind a magic object that seems to offer a benefit but secretly drains the PC's stats over time, or something effectively similar to that (unclear how it could be implemented without the player knowing but they can be creative)

                              Either way would be really funny though

                              JJ CeleryJ 1 Reply Last reply
                              0
                              • luna system :moon_badge:L luna system :moon_badge:

                                @ainmosni@social.ainmosni.eu @jjcelery@mastodon.ie exactly πŸ™‚ see, magic amulet, crazy people.

                                not the very real fact that people in 2026 are actively using Claude and GPT to build their own safe spaces, learn, create, heal, and process. no, its magic funny amulet πŸ™‚

                                JJ CeleryJ This user is from outside of this forum
                                JJ CeleryJ This user is from outside of this forum
                                JJ Celery
                                wrote last edited by
                                #33

                                @luna @ainmosni

                                1 Reply Last reply
                                0
                                • luna system :moon_badge:L This user is from outside of this forum
                                  luna system :moon_badge:L This user is from outside of this forum
                                  luna system :moon_badge:
                                  wrote last edited by
                                  #34

                                  @ainmosni@social.ainmosni.eu @jjcelery@mastodon.ie EXACTLY! which is why we personally are doing local-only shit, open source and public domain. but what YOU are saying is the CORRECT framing we're trying to push for. literally the corps are in a position to steal a whole lotta peoples souls. we do not disagree with you, our alarmism is because of exactly what you're saying. GPT has access to people's medical records. this is all happening frighteningly in real time. and we personally are double scared because we're in research, and we see ALL of it!

                                  luna system :moon_badge:L 1 Reply Last reply
                                  0
                                  • luna system :moon_badge:L luna system :moon_badge:

                                    @ainmosni@social.ainmosni.eu @jjcelery@mastodon.ie EXACTLY! which is why we personally are doing local-only shit, open source and public domain. but what YOU are saying is the CORRECT framing we're trying to push for. literally the corps are in a position to steal a whole lotta peoples souls. we do not disagree with you, our alarmism is because of exactly what you're saying. GPT has access to people's medical records. this is all happening frighteningly in real time. and we personally are double scared because we're in research, and we see ALL of it!

                                    luna system :moon_badge:L This user is from outside of this forum
                                    luna system :moon_badge:L This user is from outside of this forum
                                    luna system :moon_badge:
                                    wrote last edited by
                                    #35

                                    @ainmosni@social.ainmosni.eu @jjcelery@mastodon.ie mechachrist help us, we decided a couple years ago to start the path towards becoming a therapist and so of COURSE our soft, bleeding heart ass is staring crisisposts on reddit in the face, going "holy fuck there is no system for this"

                                    hazelnot :yell:H 1 Reply Last reply
                                    0
                                    • JJ CeleryJ JJ Celery

                                      @luna that's exactly what I'm saying: not a drug. A magical amulet that makes you think you're smart.

                                      A prosthetic is a wrong analogy. Prosthetics are needed, and useful, and empower people. To compare an AI to a prosthetic, or even a crutch is disrespectful to people who need these tools to function.

                                      No. LLMs are just evil doodads that rot your brain and whisper sweet nothings into your ears in the deep of the night. They're not valuable; they make you *believe* they are.

                                      Paper MoonT This user is from outside of this forum
                                      Paper MoonT This user is from outside of this forum
                                      Paper Moon
                                      wrote last edited by
                                      #36

                                      @jjcelery @luna I want an evil amulet now. Not an LLM but maybe a monkey paw.

                                      1 Reply Last reply
                                      0
                                      • JJ CeleryJ JJ Celery

                                        @flyingsaceur @glyph I'm pretty certain I know (the good) Tom Bombadil and it's @Szescstopni

                                        SzescstopniS This user is from outside of this forum
                                        SzescstopniS This user is from outside of this forum
                                        Szescstopni
                                        wrote last edited by
                                        #37

                                        @jjcelery What can I say other than to deny being in any way similar to Tom. I spend too much time at my computer. @flyingsaceur @glyph

                                        1 Reply Last reply
                                        0
                                        • JJ CeleryJ JJ Celery

                                          I saw LLMs compared to a drug in this toot, but in conversation with Himself today we concluded it's like a cursed amulet.

                                          You *believe* it gives you +10 INT. Meanwhile it drains INT and WIS over time, and you don't notice.

                                          Everyone around you knows it's bad for you and generally for the realm, but you won't stop wearing it, they're just jelous of your newfound powers, and they would know how awesome it is if they only tried! Why won't they try? Just try the amulet!!

                                          https://mastodon.social/@glyph/115839163441384816

                                          David GerardD This user is from outside of this forum
                                          David GerardD This user is from outside of this forum
                                          David Gerard
                                          wrote last edited by
                                          #38

                                          @jjcelery best is when you do try the chatbot, it sucks, so the chatbot addict tells you you're trying it wrong

                                          ArtemisA Daniel V.D 2 Replies Last reply
                                          0
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Don't have an account? Register

                                          • Login or register to search.
                                          Powered by NodeBB Contributors
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups