Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (Darkly)
  • No Skin
Collapse
Brand Logo
  1. Home
  2. Uncategorized
  3. My experience with generative-AI has been that, at its very best, it is subtly wrong in ways that only an expert in the relevant subject would recognise.

My experience with generative-AI has been that, at its very best, it is subtly wrong in ways that only an expert in the relevant subject would recognise.

Scheduled Pinned Locked Moved Uncategorized
56 Posts 29 Posters 0 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • Jonathan HoggJ Jonathan Hogg

    My experience with generative-AI has been that, at its very best, it is subtly wrong in ways that only an expert in the relevant subject would recognise. So I don't worry about us creating super-intelligent AI, I worry about us allowing that expertise to atrophy through laziness and greed. I refuse to use LLMs not because I'm scared of how clever they are, but because I do not wish to become stupider.

    matthewcroughanM This user is from outside of this forum
    matthewcroughanM This user is from outside of this forum
    matthewcroughan
    wrote last edited by
    #2
    So far, the research is in your favour regarding atrophy!
    1 Reply Last reply
    0
    • Jonathan HoggJ Jonathan Hogg

      My experience with generative-AI has been that, at its very best, it is subtly wrong in ways that only an expert in the relevant subject would recognise. So I don't worry about us creating super-intelligent AI, I worry about us allowing that expertise to atrophy through laziness and greed. I refuse to use LLMs not because I'm scared of how clever they are, but because I do not wish to become stupider.

      coldclimateC This user is from outside of this forum
      coldclimateC This user is from outside of this forum
      coldclimate
      wrote last edited by
      #3

      @jonathanhogg belter

      1 Reply Last reply
      0
      • Jonathan HoggJ Jonathan Hogg

        My experience with generative-AI has been that, at its very best, it is subtly wrong in ways that only an expert in the relevant subject would recognise. So I don't worry about us creating super-intelligent AI, I worry about us allowing that expertise to atrophy through laziness and greed. I refuse to use LLMs not because I'm scared of how clever they are, but because I do not wish to become stupider.

        Ken MilmoreK This user is from outside of this forum
        Ken MilmoreK This user is from outside of this forum
        Ken Milmore
        wrote last edited by
        #4

        @jonathanhogg Someone was on R4 a couple of days back, I think it was prof. Joshua Bengio, going on about the dangers of AI becoming sentient and taking over. I think this sort of talk just fires politicians up that they want to be in on it. It makes AI feel like nuclear weapons: Exceptionally dangerous but every government seems to want them.

        1 Reply Last reply
        0
        • Jonathan HoggJ Jonathan Hogg

          My experience with generative-AI has been that, at its very best, it is subtly wrong in ways that only an expert in the relevant subject would recognise. So I don't worry about us creating super-intelligent AI, I worry about us allowing that expertise to atrophy through laziness and greed. I refuse to use LLMs not because I'm scared of how clever they are, but because I do not wish to become stupider.

          Jonathan HoggJ This user is from outside of this forum
          Jonathan HoggJ This user is from outside of this forum
          Jonathan Hogg
          wrote last edited by
          #5

          I will say one thing for generative AI: since these tools function by remixing/translating existing information, that vibe programming is so popular demonstrates a colossal failure on the part of our industry in not making this stuff easier. If a giant ball of statistics can mostly knock up a working app in minutes, this shows not that gen-AI is insanely clever, but that most of the work in making an app has always been stupid. We have gatekeeped programming behind vast walls of nonsense.

          bit101B Jonathan HoggJ krigK dasgrueneblattD dieTasseD 6 Replies Last reply
          0
          • Jonathan HoggJ Jonathan Hogg

            I will say one thing for generative AI: since these tools function by remixing/translating existing information, that vibe programming is so popular demonstrates a colossal failure on the part of our industry in not making this stuff easier. If a giant ball of statistics can mostly knock up a working app in minutes, this shows not that gen-AI is insanely clever, but that most of the work in making an app has always been stupid. We have gatekeeped programming behind vast walls of nonsense.

            bit101B This user is from outside of this forum
            bit101B This user is from outside of this forum
            bit101
            wrote last edited by
            #6

            @jonathanhogg I'd add that everything is built on frameworks now. Programming has mostly become configuring the framework and coming up with the correct business logic and decent UX / styling. And since most apps these days do the same kind of things, with different data, AI's job should be easy. Humans still manage to mess up the important bits like security, privacy, performance. And AI is even worse at those things.

            Jonathan HoggJ 1 Reply Last reply
            0
            • bit101B bit101

              @jonathanhogg I'd add that everything is built on frameworks now. Programming has mostly become configuring the framework and coming up with the correct business logic and decent UX / styling. And since most apps these days do the same kind of things, with different data, AI's job should be easy. Humans still manage to mess up the important bits like security, privacy, performance. And AI is even worse at those things.

              Jonathan HoggJ This user is from outside of this forum
              Jonathan HoggJ This user is from outside of this forum
              Jonathan Hogg
              wrote last edited by
              #7

              @bit101 hold on, I've got another post incoming on exactly this… 😉

              bit101B 1 Reply Last reply
              0
              • Jonathan HoggJ Jonathan Hogg

                I will say one thing for generative AI: since these tools function by remixing/translating existing information, that vibe programming is so popular demonstrates a colossal failure on the part of our industry in not making this stuff easier. If a giant ball of statistics can mostly knock up a working app in minutes, this shows not that gen-AI is insanely clever, but that most of the work in making an app has always been stupid. We have gatekeeped programming behind vast walls of nonsense.

                Jonathan HoggJ This user is from outside of this forum
                Jonathan HoggJ This user is from outside of this forum
                Jonathan Hogg
                wrote last edited by
                #8

                We seem to have largely stopped innovating on trying to lower barriers to programming in favour of creating endless new frameworks and libraries for a vanishingly small number of near-identical languages. It is the mid-2020s and people are wringing their hands over Rust as if it was some inexplicable new thing rather than a C-derivative that incorporates decades old type theory. You know what I consider to be genuinely ground-breaking programming tools? VisiCalc, HyperCard and Scratch.

                jarkmanJ Jonathan HoggJ Irenes (many)I Solar🌄GardenW 4 Replies Last reply
                0
                • Jonathan HoggJ Jonathan Hogg

                  I will say one thing for generative AI: since these tools function by remixing/translating existing information, that vibe programming is so popular demonstrates a colossal failure on the part of our industry in not making this stuff easier. If a giant ball of statistics can mostly knock up a working app in minutes, this shows not that gen-AI is insanely clever, but that most of the work in making an app has always been stupid. We have gatekeeped programming behind vast walls of nonsense.

                  krigK This user is from outside of this forum
                  krigK This user is from outside of this forum
                  krig
                  wrote last edited by
                  #9

                  @jonathanhogg Actually think you have that backwards. Making something dangerous and broken has been easy for ages, that's why a certain level of gatekeeping is actually a good thing. Like, driving a car isn't that hard. A six year old can do it with a few minutes of training. Driving a car safely on the other hand

                  Jonathan HoggJ 1 Reply Last reply
                  0
                  • Jonathan HoggJ Jonathan Hogg

                    @bit101 hold on, I've got another post incoming on exactly this… 😉

                    bit101B This user is from outside of this forum
                    bit101B This user is from outside of this forum
                    bit101
                    wrote last edited by
                    #10

                    @jonathanhogg sorry if I spoiled it! 🙂

                    1 Reply Last reply
                    0
                    • Jonathan HoggJ Jonathan Hogg

                      We seem to have largely stopped innovating on trying to lower barriers to programming in favour of creating endless new frameworks and libraries for a vanishingly small number of near-identical languages. It is the mid-2020s and people are wringing their hands over Rust as if it was some inexplicable new thing rather than a C-derivative that incorporates decades old type theory. You know what I consider to be genuinely ground-breaking programming tools? VisiCalc, HyperCard and Scratch.

                      jarkmanJ This user is from outside of this forum
                      jarkmanJ This user is from outside of this forum
                      jarkman
                      wrote last edited by
                      #11

                      @jonathanhogg That's the kind of talk you usually hear just before someone invents themselves a new language. Just saying.

                      Jonathan HoggJ michaelM 2 Replies Last reply
                      0
                      • krigK krig

                        @jonathanhogg Actually think you have that backwards. Making something dangerous and broken has been easy for ages, that's why a certain level of gatekeeping is actually a good thing. Like, driving a car isn't that hard. A six year old can do it with a few minutes of training. Driving a car safely on the other hand

                        Jonathan HoggJ This user is from outside of this forum
                        Jonathan HoggJ This user is from outside of this forum
                        Jonathan Hogg
                        wrote last edited by
                        #12

                        @krig which is why we also make bikes and scooters – convenient tools that can be used by all ages and abilities

                        krigK 1 Reply Last reply
                        0
                        • jarkmanJ jarkman

                          @jonathanhogg That's the kind of talk you usually hear just before someone invents themselves a new language. Just saying.

                          Jonathan HoggJ This user is from outside of this forum
                          Jonathan HoggJ This user is from outside of this forum
                          Jonathan Hogg
                          wrote last edited by
                          #13

                          @jarkman Heh! Most of my programming these days involves creating or using my own languages 😆

                          jarkmanJ 1 Reply Last reply
                          0
                          • Jonathan HoggJ Jonathan Hogg

                            @jarkman Heh! Most of my programming these days involves creating or using my own languages 😆

                            jarkmanJ This user is from outside of this forum
                            jarkmanJ This user is from outside of this forum
                            jarkman
                            wrote last edited by
                            #14

                            @jonathanhogg 🙂 I would like to hear more about that sometime.

                            Jonathan HoggJ 1 Reply Last reply
                            0
                            • jarkmanJ jarkman

                              @jonathanhogg 🙂 I would like to hear more about that sometime.

                              Jonathan HoggJ This user is from outside of this forum
                              Jonathan HoggJ This user is from outside of this forum
                              Jonathan Hogg
                              wrote last edited by
                              #15

                              @jarkman I can absolutely bend your ear at EMF, but conveniently I also recently gave a talk about it at Alpaca! 😀

                              https://www.youtube.com/watch?v=D9khHD9sB7M&list=PLxqmZjMvoVzw773-Fo9ajkujFfOThuFOP&index=9

                              Graham KG jarkmanJ 2 Replies Last reply
                              0
                              • jarkmanJ jarkman

                                @jonathanhogg That's the kind of talk you usually hear just before someone invents themselves a new language. Just saying.

                                michaelM This user is from outside of this forum
                                michaelM This user is from outside of this forum
                                michael
                                wrote last edited by
                                #16

                                @jarkman @jonathanhogg I get the broader point here, but at the same time, as computers have moved to encompass more and more of the human sphere, is it actually reasonable to exect any languge to be actually general purpose?

                                Perhaps for some uses cases it's the right choice, but when I look at data-science code written by vernacular developers (experts whose expertise is in a domain other than computer science) I feel the freedom from those languages just gives more scope for error/mistake/poor style that will bite them later). Why can't we embrace more DSLs?

                                Jonathan HoggJ Toby JaffeyT 2 Replies Last reply
                                0
                                • michaelM michael

                                  @jarkman @jonathanhogg I get the broader point here, but at the same time, as computers have moved to encompass more and more of the human sphere, is it actually reasonable to exect any languge to be actually general purpose?

                                  Perhaps for some uses cases it's the right choice, but when I look at data-science code written by vernacular developers (experts whose expertise is in a domain other than computer science) I feel the freedom from those languages just gives more scope for error/mistake/poor style that will bite them later). Why can't we embrace more DSLs?

                                  Jonathan HoggJ This user is from outside of this forum
                                  Jonathan HoggJ This user is from outside of this forum
                                  Jonathan Hogg
                                  wrote last edited by
                                  #17

                                  @michael @jarkman Fuck yes! I want a thousand languages to bloom. It seems like once everyone used to write their own language and we fell out of the habit. The Dragon Book used to be required reading for CS…

                                  Sten TurpinT 1 Reply Last reply
                                  0
                                  • Jonathan HoggJ Jonathan Hogg

                                    @krig which is why we also make bikes and scooters – convenient tools that can be used by all ages and abilities

                                    krigK This user is from outside of this forum
                                    krigK This user is from outside of this forum
                                    krig
                                    wrote last edited by
                                    #18

                                    @jonathanhogg good point! I think I see what you meant now. I miss the old visual basic and how easy it was to make tools using it without knowing any programming, really.

                                    1 Reply Last reply
                                    0
                                    • Jonathan HoggJ Jonathan Hogg

                                      I will say one thing for generative AI: since these tools function by remixing/translating existing information, that vibe programming is so popular demonstrates a colossal failure on the part of our industry in not making this stuff easier. If a giant ball of statistics can mostly knock up a working app in minutes, this shows not that gen-AI is insanely clever, but that most of the work in making an app has always been stupid. We have gatekeeped programming behind vast walls of nonsense.

                                      dasgrueneblattD This user is from outside of this forum
                                      dasgrueneblattD This user is from outside of this forum
                                      dasgrueneblatt
                                      wrote last edited by
                                      #19

                                      @jonathanhogg No, it's still difficult to program something so that it's exactly how you want it to be. It's apparently been underestimated how often that doesn't matter ("mostly working app" where getting it to working is more effort than starting from scratch), but we will see how that develops in the long run. Maybe plausible deniability is really enough for many things.

                                      Nobody is gatekeeping clear, testable requirements and communication without misunderstandings. People usually just can't do that.

                                      Jonathan HoggJ 1 Reply Last reply
                                      0
                                      • michaelM michael

                                        @jarkman @jonathanhogg I get the broader point here, but at the same time, as computers have moved to encompass more and more of the human sphere, is it actually reasonable to exect any languge to be actually general purpose?

                                        Perhaps for some uses cases it's the right choice, but when I look at data-science code written by vernacular developers (experts whose expertise is in a domain other than computer science) I feel the freedom from those languages just gives more scope for error/mistake/poor style that will bite them later). Why can't we embrace more DSLs?

                                        Toby JaffeyT This user is from outside of this forum
                                        Toby JaffeyT This user is from outside of this forum
                                        Toby Jaffey
                                        wrote last edited by
                                        #20

                                        @michael @jarkman @jonathanhogg (IMO) we can't have more DSLs because everything useful is now plumbed together from a series of heterogenous parts and we've somehow decided they can only interoperate at the (barbaric) C ABI level, or the (absurdly inefficient) web level. So, we rely on general purpose languages using specialised libraries, instead of the other way around.
                                        I think fixing this boundary/contract problem would fix a lot in s/w engineering.

                                        1 Reply Last reply
                                        0
                                        • dasgrueneblattD dasgrueneblatt

                                          @jonathanhogg No, it's still difficult to program something so that it's exactly how you want it to be. It's apparently been underestimated how often that doesn't matter ("mostly working app" where getting it to working is more effort than starting from scratch), but we will see how that develops in the long run. Maybe plausible deniability is really enough for many things.

                                          Nobody is gatekeeping clear, testable requirements and communication without misunderstandings. People usually just can't do that.

                                          Jonathan HoggJ This user is from outside of this forum
                                          Jonathan HoggJ This user is from outside of this forum
                                          Jonathan Hogg
                                          wrote last edited by
                                          #21

                                          @dasgrueneblatt I have now spent 40 years programming commercially in dozens of different languages; I have taught programming to CS students, art students and little kids and my experience is that most programming is hard because we have made it so. I absolutely understand the frustration of people who know what their problem is, but don't feel equipped to solve it because the tools available to them are too big and confusing. Vibe coding is our own fault

                                          dasgrueneblattD 1 Reply Last reply
                                          0
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Don't have an account? Register

                                          • Login or register to search.
                                          Powered by NodeBB Contributors
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups