Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (Darkly)
  • No Skin
Collapse
Brand Logo
  1. Home
  2. Uncategorized
  3. Why AI writing is so generic, boring, and dangerous: Semantic ablation.

Why AI writing is so generic, boring, and dangerous: Semantic ablation.

Scheduled Pinned Locked Moved Uncategorized
46 Posts 39 Posters 0 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • Charlie StrossC Charlie Stross

    Why AI writing is so generic, boring, and dangerous: Semantic ablation.

    (We can measure semantic ablation through entropy decay. By running a text through successive AI "refinement" loops, the vocabulary diversity (type-token ratio) collapses.)

    https://www.theregister.com/2026/02/16/semantic_ablation_ai_writing/

    Sassinake! - ⊃∪∩⪽S This user is from outside of this forum
    Sassinake! - ⊃∪∩⪽S This user is from outside of this forum
    Sassinake! - ⊃∪∩⪽
    wrote last edited by
    #33

    @cstross

    nicely described by Orwell as

    'NewSpeak'

    kelleynnnK 1 Reply Last reply
    0
    • Charlie StrossC Charlie Stross

      Why AI writing is so generic, boring, and dangerous: Semantic ablation.

      (We can measure semantic ablation through entropy decay. By running a text through successive AI "refinement" loops, the vocabulary diversity (type-token ratio) collapses.)

      https://www.theregister.com/2026/02/16/semantic_ablation_ai_writing/

      0gust10 This user is from outside of this forum
      0gust10 This user is from outside of this forum
      0gust1
      wrote last edited by
      #34

      @cstross Neural networks, by mathematical nature, are lossy information-compressing artefacts !

      1 Reply Last reply
      0
      • Charlie StrossC Charlie Stross

        Why AI writing is so generic, boring, and dangerous: Semantic ablation.

        (We can measure semantic ablation through entropy decay. By running a text through successive AI "refinement" loops, the vocabulary diversity (type-token ratio) collapses.)

        https://www.theregister.com/2026/02/16/semantic_ablation_ai_writing/

        Phil Stevens :tinoflag:P This user is from outside of this forum
        Phil Stevens :tinoflag:P This user is from outside of this forum
        Phil Stevens :tinoflag:
        wrote last edited by
        #35

        @cstross No surprise that we see the textual equivalent of mad cow disease.

        1 Reply Last reply
        0
        • Charlie StrossC Charlie Stross

          @malice @JdeBP The Register is a news site: everything has to be flensed and filed down to fit in a standard format and voice. That piece is probably all that's left of an original that was three times the length.

          Peter KrausP This user is from outside of this forum
          Peter KrausP This user is from outside of this forum
          Peter Kraus
          wrote last edited by
          #36

          @malice @JdeBP @cstross That's fair. However, repeatedly including certain types of sentence construction - appealing or not - makes it look dodgy. Or just trolling. 😉

          Charlie StrossC 1 Reply Last reply
          0
          • Peter KrausP Peter Kraus

            @malice @JdeBP @cstross That's fair. However, repeatedly including certain types of sentence construction - appealing or not - makes it look dodgy. Or just trolling. 😉

            Charlie StrossC This user is from outside of this forum
            Charlie StrossC This user is from outside of this forum
            Charlie Stross
            wrote last edited by
            #37

            @pkraus @malice @JdeBP I've been reading The Reg since 1997 or thereabouts. Their house style has history behind it, not LLMs. (I suspect they'd cop to trolling from time to time, though.)

            1 Reply Last reply
            0
            • MarianneN Marianne shared this topic
            • Charlie StrossC Charlie Stross

              Why AI writing is so generic, boring, and dangerous: Semantic ablation.

              (We can measure semantic ablation through entropy decay. By running a text through successive AI "refinement" loops, the vocabulary diversity (type-token ratio) collapses.)

              https://www.theregister.com/2026/02/16/semantic_ablation_ai_writing/

              MarianneN This user is from outside of this forum
              MarianneN This user is from outside of this forum
              Marianne
              wrote last edited by
              #38

              @cstross ironically got a Google cloud genAI and ML ad right in the middle of that.

              1 Reply Last reply
              0
              • Charlie StrossC Charlie Stross

                Why AI writing is so generic, boring, and dangerous: Semantic ablation.

                (We can measure semantic ablation through entropy decay. By running a text through successive AI "refinement" loops, the vocabulary diversity (type-token ratio) collapses.)

                https://www.theregister.com/2026/02/16/semantic_ablation_ai_writing/

                J This user is from outside of this forum
                J This user is from outside of this forum
                jmj
                wrote last edited by
                #39

                @cstross hmmm, that might also explain why AI seems more effective for code.
                For the most part you want a reversion to the mean in code. Novel solutions are only needed at the cutting edge where you trying to make the computer do something that’s not been done before.

                Charlie StrossC 1 Reply Last reply
                0
                • J jmj

                  @cstross hmmm, that might also explain why AI seems more effective for code.
                  For the most part you want a reversion to the mean in code. Novel solutions are only needed at the cutting edge where you trying to make the computer do something that’s not been done before.

                  Charlie StrossC This user is from outside of this forum
                  Charlie StrossC This user is from outside of this forum
                  Charlie Stross
                  wrote last edited by
                  #40

                  @Jmj Yes. Also I suspect the semantic expressiveness of programming languages is far narrower than that of human languages: they're more precise, but it's much harder (though not impossible!) to write poetry in them. So there's less risk of losing something unique by generating output that tends to occupy the middle of the bell curve.

                  Chris (so far)P 1 Reply Last reply
                  0
                  • Charlie StrossC Charlie Stross

                    @Jmj Yes. Also I suspect the semantic expressiveness of programming languages is far narrower than that of human languages: they're more precise, but it's much harder (though not impossible!) to write poetry in them. So there's less risk of losing something unique by generating output that tends to occupy the middle of the bell curve.

                    Chris (so far)P This user is from outside of this forum
                    Chris (so far)P This user is from outside of this forum
                    Chris (so far)
                    wrote last edited by
                    #41
                    @cstross @Jmj I mean I think one could make a coherent argument that programming *is* poetry: reduced syntax, enforced structure, heavy use of metaphor…

                    It’s just most programming topics make Vogon poetry look exciting.
                    J 1 Reply Last reply
                    0
                    • Charlie StrossC Charlie Stross

                      Why AI writing is so generic, boring, and dangerous: Semantic ablation.

                      (We can measure semantic ablation through entropy decay. By running a text through successive AI "refinement" loops, the vocabulary diversity (type-token ratio) collapses.)

                      https://www.theregister.com/2026/02/16/semantic_ablation_ai_writing/

                      Colin RowatR This user is from outside of this forum
                      Colin RowatR This user is from outside of this forum
                      Colin Rowat
                      wrote last edited by
                      #42

                      @cstross "Model collapse", Shumailov, Shumaylov & Papernot (2024), Nature : https://www.nature.com/articles/s41586-024-07566-y

                      1 Reply Last reply
                      0
                      • Chris (so far)P Chris (so far)
                        @cstross @Jmj I mean I think one could make a coherent argument that programming *is* poetry: reduced syntax, enforced structure, heavy use of metaphor…

                        It’s just most programming topics make Vogon poetry look exciting.
                        J This user is from outside of this forum
                        J This user is from outside of this forum
                        jmj
                        wrote last edited by
                        #43

                        @perigrin @cstross but I think in the code case the subtle semantics of the words and combinations are less likely to be the important or desirable aspects, whereas in poetry it’s likely that those aspects are precisely the desired meaning.

                        Chris (so far)P 1 Reply Last reply
                        0
                        • Sassinake! - ⊃∪∩⪽S Sassinake! - ⊃∪∩⪽

                          @cstross

                          nicely described by Orwell as

                          'NewSpeak'

                          kelleynnnK This user is from outside of this forum
                          kelleynnnK This user is from outside of this forum
                          kelleynnn
                          wrote last edited by
                          #44

                          @Sassinake @cstross 👍 "duck speak"

                          1 Reply Last reply
                          0
                          • Charlie StrossC Charlie Stross

                            Why AI writing is so generic, boring, and dangerous: Semantic ablation.

                            (We can measure semantic ablation through entropy decay. By running a text through successive AI "refinement" loops, the vocabulary diversity (type-token ratio) collapses.)

                            https://www.theregister.com/2026/02/16/semantic_ablation_ai_writing/

                            mspongM This user is from outside of this forum
                            mspongM This user is from outside of this forum
                            mspong
                            wrote last edited by
                            #45

                            @cstross I am sitting in a room different from the one you are in now. I am recording the sound of my speaking voice and I am going to play it back into the room again and again until the resonant frequencies of the room reinforce themselves...

                            1 Reply Last reply
                            0
                            • J jmj

                              @perigrin @cstross but I think in the code case the subtle semantics of the words and combinations are less likely to be the important or desirable aspects, whereas in poetry it’s likely that those aspects are precisely the desired meaning.

                              Chris (so far)P This user is from outside of this forum
                              Chris (so far)P This user is from outside of this forum
                              Chris (so far)
                              wrote last edited by
                              #46
                              @Jmj @cstross Perl’s TIMTOWDI has ruined me.
                              1 Reply Last reply
                              0
                              Reply
                              • Reply as topic
                              Log in to reply
                              • Oldest to Newest
                              • Newest to Oldest
                              • Most Votes


                              • Login

                              • Don't have an account? Register

                              • Login or register to search.
                              Powered by NodeBB Contributors
                              • First post
                                Last post
                              0
                              • Categories
                              • Recent
                              • Tags
                              • Popular
                              • World
                              • Users
                              • Groups