Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (Darkly)
  • No Skin
Collapse
Brand Logo
  1. Home
  2. Uncategorized
  3. My experience with generative-AI has been that, at its very best, it is subtly wrong in ways that only an expert in the relevant subject would recognise.

My experience with generative-AI has been that, at its very best, it is subtly wrong in ways that only an expert in the relevant subject would recognise.

Scheduled Pinned Locked Moved Uncategorized
56 Posts 29 Posters 0 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • bit101B bit101

    @jonathanhogg I'd add that everything is built on frameworks now. Programming has mostly become configuring the framework and coming up with the correct business logic and decent UX / styling. And since most apps these days do the same kind of things, with different data, AI's job should be easy. Humans still manage to mess up the important bits like security, privacy, performance. And AI is even worse at those things.

    Jonathan HoggJ This user is from outside of this forum
    Jonathan HoggJ This user is from outside of this forum
    Jonathan Hogg
    wrote last edited by
    #7

    @bit101 hold on, I've got another post incoming on exactly this… 😉

    bit101B 1 Reply Last reply
    0
    • Jonathan HoggJ Jonathan Hogg

      I will say one thing for generative AI: since these tools function by remixing/translating existing information, that vibe programming is so popular demonstrates a colossal failure on the part of our industry in not making this stuff easier. If a giant ball of statistics can mostly knock up a working app in minutes, this shows not that gen-AI is insanely clever, but that most of the work in making an app has always been stupid. We have gatekeeped programming behind vast walls of nonsense.

      Jonathan HoggJ This user is from outside of this forum
      Jonathan HoggJ This user is from outside of this forum
      Jonathan Hogg
      wrote last edited by
      #8

      We seem to have largely stopped innovating on trying to lower barriers to programming in favour of creating endless new frameworks and libraries for a vanishingly small number of near-identical languages. It is the mid-2020s and people are wringing their hands over Rust as if it was some inexplicable new thing rather than a C-derivative that incorporates decades old type theory. You know what I consider to be genuinely ground-breaking programming tools? VisiCalc, HyperCard and Scratch.

      jarkmanJ Jonathan HoggJ Irenes (many)I Solar🌄GardenW 4 Replies Last reply
      0
      • Jonathan HoggJ Jonathan Hogg

        I will say one thing for generative AI: since these tools function by remixing/translating existing information, that vibe programming is so popular demonstrates a colossal failure on the part of our industry in not making this stuff easier. If a giant ball of statistics can mostly knock up a working app in minutes, this shows not that gen-AI is insanely clever, but that most of the work in making an app has always been stupid. We have gatekeeped programming behind vast walls of nonsense.

        krigK This user is from outside of this forum
        krigK This user is from outside of this forum
        krig
        wrote last edited by
        #9

        @jonathanhogg Actually think you have that backwards. Making something dangerous and broken has been easy for ages, that's why a certain level of gatekeeping is actually a good thing. Like, driving a car isn't that hard. A six year old can do it with a few minutes of training. Driving a car safely on the other hand

        Jonathan HoggJ 1 Reply Last reply
        0
        • Jonathan HoggJ Jonathan Hogg

          @bit101 hold on, I've got another post incoming on exactly this… 😉

          bit101B This user is from outside of this forum
          bit101B This user is from outside of this forum
          bit101
          wrote last edited by
          #10

          @jonathanhogg sorry if I spoiled it! 🙂

          1 Reply Last reply
          0
          • Jonathan HoggJ Jonathan Hogg

            We seem to have largely stopped innovating on trying to lower barriers to programming in favour of creating endless new frameworks and libraries for a vanishingly small number of near-identical languages. It is the mid-2020s and people are wringing their hands over Rust as if it was some inexplicable new thing rather than a C-derivative that incorporates decades old type theory. You know what I consider to be genuinely ground-breaking programming tools? VisiCalc, HyperCard and Scratch.

            jarkmanJ This user is from outside of this forum
            jarkmanJ This user is from outside of this forum
            jarkman
            wrote last edited by
            #11

            @jonathanhogg That's the kind of talk you usually hear just before someone invents themselves a new language. Just saying.

            Jonathan HoggJ michaelM 2 Replies Last reply
            0
            • krigK krig

              @jonathanhogg Actually think you have that backwards. Making something dangerous and broken has been easy for ages, that's why a certain level of gatekeeping is actually a good thing. Like, driving a car isn't that hard. A six year old can do it with a few minutes of training. Driving a car safely on the other hand

              Jonathan HoggJ This user is from outside of this forum
              Jonathan HoggJ This user is from outside of this forum
              Jonathan Hogg
              wrote last edited by
              #12

              @krig which is why we also make bikes and scooters – convenient tools that can be used by all ages and abilities

              krigK 1 Reply Last reply
              0
              • jarkmanJ jarkman

                @jonathanhogg That's the kind of talk you usually hear just before someone invents themselves a new language. Just saying.

                Jonathan HoggJ This user is from outside of this forum
                Jonathan HoggJ This user is from outside of this forum
                Jonathan Hogg
                wrote last edited by
                #13

                @jarkman Heh! Most of my programming these days involves creating or using my own languages 😆

                jarkmanJ 1 Reply Last reply
                0
                • Jonathan HoggJ Jonathan Hogg

                  @jarkman Heh! Most of my programming these days involves creating or using my own languages 😆

                  jarkmanJ This user is from outside of this forum
                  jarkmanJ This user is from outside of this forum
                  jarkman
                  wrote last edited by
                  #14

                  @jonathanhogg 🙂 I would like to hear more about that sometime.

                  Jonathan HoggJ 1 Reply Last reply
                  0
                  • jarkmanJ jarkman

                    @jonathanhogg 🙂 I would like to hear more about that sometime.

                    Jonathan HoggJ This user is from outside of this forum
                    Jonathan HoggJ This user is from outside of this forum
                    Jonathan Hogg
                    wrote last edited by
                    #15

                    @jarkman I can absolutely bend your ear at EMF, but conveniently I also recently gave a talk about it at Alpaca! 😀

                    https://www.youtube.com/watch?v=D9khHD9sB7M&list=PLxqmZjMvoVzw773-Fo9ajkujFfOThuFOP&index=9

                    Graham KG jarkmanJ 2 Replies Last reply
                    0
                    • jarkmanJ jarkman

                      @jonathanhogg That's the kind of talk you usually hear just before someone invents themselves a new language. Just saying.

                      michaelM This user is from outside of this forum
                      michaelM This user is from outside of this forum
                      michael
                      wrote last edited by
                      #16

                      @jarkman @jonathanhogg I get the broader point here, but at the same time, as computers have moved to encompass more and more of the human sphere, is it actually reasonable to exect any languge to be actually general purpose?

                      Perhaps for some uses cases it's the right choice, but when I look at data-science code written by vernacular developers (experts whose expertise is in a domain other than computer science) I feel the freedom from those languages just gives more scope for error/mistake/poor style that will bite them later). Why can't we embrace more DSLs?

                      Jonathan HoggJ Toby JaffeyT 2 Replies Last reply
                      0
                      • michaelM michael

                        @jarkman @jonathanhogg I get the broader point here, but at the same time, as computers have moved to encompass more and more of the human sphere, is it actually reasonable to exect any languge to be actually general purpose?

                        Perhaps for some uses cases it's the right choice, but when I look at data-science code written by vernacular developers (experts whose expertise is in a domain other than computer science) I feel the freedom from those languages just gives more scope for error/mistake/poor style that will bite them later). Why can't we embrace more DSLs?

                        Jonathan HoggJ This user is from outside of this forum
                        Jonathan HoggJ This user is from outside of this forum
                        Jonathan Hogg
                        wrote last edited by
                        #17

                        @michael @jarkman Fuck yes! I want a thousand languages to bloom. It seems like once everyone used to write their own language and we fell out of the habit. The Dragon Book used to be required reading for CS…

                        Sten TurpinT 1 Reply Last reply
                        0
                        • Jonathan HoggJ Jonathan Hogg

                          @krig which is why we also make bikes and scooters – convenient tools that can be used by all ages and abilities

                          krigK This user is from outside of this forum
                          krigK This user is from outside of this forum
                          krig
                          wrote last edited by
                          #18

                          @jonathanhogg good point! I think I see what you meant now. I miss the old visual basic and how easy it was to make tools using it without knowing any programming, really.

                          1 Reply Last reply
                          0
                          • Jonathan HoggJ Jonathan Hogg

                            I will say one thing for generative AI: since these tools function by remixing/translating existing information, that vibe programming is so popular demonstrates a colossal failure on the part of our industry in not making this stuff easier. If a giant ball of statistics can mostly knock up a working app in minutes, this shows not that gen-AI is insanely clever, but that most of the work in making an app has always been stupid. We have gatekeeped programming behind vast walls of nonsense.

                            dasgrueneblattD This user is from outside of this forum
                            dasgrueneblattD This user is from outside of this forum
                            dasgrueneblatt
                            wrote last edited by
                            #19

                            @jonathanhogg No, it's still difficult to program something so that it's exactly how you want it to be. It's apparently been underestimated how often that doesn't matter ("mostly working app" where getting it to working is more effort than starting from scratch), but we will see how that develops in the long run. Maybe plausible deniability is really enough for many things.

                            Nobody is gatekeeping clear, testable requirements and communication without misunderstandings. People usually just can't do that.

                            Jonathan HoggJ 1 Reply Last reply
                            0
                            • michaelM michael

                              @jarkman @jonathanhogg I get the broader point here, but at the same time, as computers have moved to encompass more and more of the human sphere, is it actually reasonable to exect any languge to be actually general purpose?

                              Perhaps for some uses cases it's the right choice, but when I look at data-science code written by vernacular developers (experts whose expertise is in a domain other than computer science) I feel the freedom from those languages just gives more scope for error/mistake/poor style that will bite them later). Why can't we embrace more DSLs?

                              Toby JaffeyT This user is from outside of this forum
                              Toby JaffeyT This user is from outside of this forum
                              Toby Jaffey
                              wrote last edited by
                              #20

                              @michael @jarkman @jonathanhogg (IMO) we can't have more DSLs because everything useful is now plumbed together from a series of heterogenous parts and we've somehow decided they can only interoperate at the (barbaric) C ABI level, or the (absurdly inefficient) web level. So, we rely on general purpose languages using specialised libraries, instead of the other way around.
                              I think fixing this boundary/contract problem would fix a lot in s/w engineering.

                              1 Reply Last reply
                              0
                              • dasgrueneblattD dasgrueneblatt

                                @jonathanhogg No, it's still difficult to program something so that it's exactly how you want it to be. It's apparently been underestimated how often that doesn't matter ("mostly working app" where getting it to working is more effort than starting from scratch), but we will see how that develops in the long run. Maybe plausible deniability is really enough for many things.

                                Nobody is gatekeeping clear, testable requirements and communication without misunderstandings. People usually just can't do that.

                                Jonathan HoggJ This user is from outside of this forum
                                Jonathan HoggJ This user is from outside of this forum
                                Jonathan Hogg
                                wrote last edited by
                                #21

                                @dasgrueneblatt I have now spent 40 years programming commercially in dozens of different languages; I have taught programming to CS students, art students and little kids and my experience is that most programming is hard because we have made it so. I absolutely understand the frustration of people who know what their problem is, but don't feel equipped to solve it because the tools available to them are too big and confusing. Vibe coding is our own fault

                                dasgrueneblattD 1 Reply Last reply
                                0
                                • Jonathan HoggJ Jonathan Hogg

                                  @dasgrueneblatt I have now spent 40 years programming commercially in dozens of different languages; I have taught programming to CS students, art students and little kids and my experience is that most programming is hard because we have made it so. I absolutely understand the frustration of people who know what their problem is, but don't feel equipped to solve it because the tools available to them are too big and confusing. Vibe coding is our own fault

                                  dasgrueneblattD This user is from outside of this forum
                                  dasgrueneblattD This user is from outside of this forum
                                  dasgrueneblatt
                                  wrote last edited by
                                  #22

                                  @jonathanhogg Well yes, but vibe coding does not solve that, or does it? People kind of know what they want, but they still cannot get it. Just something that looks like it and is really hard to debug. That's got be even more frustrating? Maybe I misunderstood you. I'm definitely not arguing that programming (what's the other one called now? the non-vibe programming. Does it have a name yet?) is easy and fun and the tools are good, oh no.

                                  I'm honestly very surprised by the love for chat interfaces. I don't get it. But apparently that's an amazing way to for example search the web. Not keyword -> list of links, but full question -> long answer text -> follow-up question -> even more text, etc. I thought people don't like to read long texts? But apparently the key is something in the wording. Make it say "i" and "talk" to me and add emotions.

                                  Maybe we'll get better tools out of this in the long run? Harness the power of the ball of statistics to create not the subtly wrong full app, but parts, smaller, clearly delineated building blocks of well-known, testable code that are easy to put together to create the whole thing? Okay, that's libraries, aehm, but with a different interface? Scratch/blockly but as a chat?

                                  Jonathan HoggJ 1 Reply Last reply
                                  0
                                  • Jonathan HoggJ Jonathan Hogg

                                    We seem to have largely stopped innovating on trying to lower barriers to programming in favour of creating endless new frameworks and libraries for a vanishingly small number of near-identical languages. It is the mid-2020s and people are wringing their hands over Rust as if it was some inexplicable new thing rather than a C-derivative that incorporates decades old type theory. You know what I consider to be genuinely ground-breaking programming tools? VisiCalc, HyperCard and Scratch.

                                    Jonathan HoggJ This user is from outside of this forum
                                    Jonathan HoggJ This user is from outside of this forum
                                    Jonathan Hogg
                                    wrote last edited by
                                    #23

                                    You know what? HyperCard was a glorious moment in time that I dearly miss: an army of non-experts were bashing together and sharing weird and wonderful stacks that were part 'zine, part adventure game and part database. Instead of laughing at vibe-coders, maybe we should ask ourselves why the current state-of-the-art in beginner-friendly programming tools is a planet-boiling roulette wheel.

                                    Irenes (many)I Magneto was rightP Stacey Cornelius 🇨🇦S Reginald BraithwaiteR Jonathan HoggJ 10 Replies Last reply
                                    0
                                    • dasgrueneblattD dasgrueneblatt

                                      @jonathanhogg Well yes, but vibe coding does not solve that, or does it? People kind of know what they want, but they still cannot get it. Just something that looks like it and is really hard to debug. That's got be even more frustrating? Maybe I misunderstood you. I'm definitely not arguing that programming (what's the other one called now? the non-vibe programming. Does it have a name yet?) is easy and fun and the tools are good, oh no.

                                      I'm honestly very surprised by the love for chat interfaces. I don't get it. But apparently that's an amazing way to for example search the web. Not keyword -> list of links, but full question -> long answer text -> follow-up question -> even more text, etc. I thought people don't like to read long texts? But apparently the key is something in the wording. Make it say "i" and "talk" to me and add emotions.

                                      Maybe we'll get better tools out of this in the long run? Harness the power of the ball of statistics to create not the subtly wrong full app, but parts, smaller, clearly delineated building blocks of well-known, testable code that are easy to put together to create the whole thing? Okay, that's libraries, aehm, but with a different interface? Scratch/blockly but as a chat?

                                      Jonathan HoggJ This user is from outside of this forum
                                      Jonathan HoggJ This user is from outside of this forum
                                      Jonathan Hogg
                                      wrote last edited by
                                      #24

                                      @dasgrueneblatt I think you have misunderstood me: I think vibe coding is a horrendous problem, but it is a symptom of an industry failing. That people are trying to steer a tank with a speak'n'spell is because we have not made decent bikes.

                                      dasgrueneblattD Solar🌄GardenW 2 Replies Last reply
                                      0
                                      • Jonathan HoggJ Jonathan Hogg

                                        @dasgrueneblatt I think you have misunderstood me: I think vibe coding is a horrendous problem, but it is a symptom of an industry failing. That people are trying to steer a tank with a speak'n'spell is because we have not made decent bikes.

                                        dasgrueneblattD This user is from outside of this forum
                                        dasgrueneblattD This user is from outside of this forum
                                        dasgrueneblatt
                                        wrote last edited by
                                        #25

                                        @jonathanhogg That's a great picture, thank you. Yes, vibe coding as a symptom.

                                        I need to think about this. Thank you for starting it.

                                        1 Reply Last reply
                                        0
                                        • Jonathan HoggJ Jonathan Hogg

                                          @michael @jarkman Fuck yes! I want a thousand languages to bloom. It seems like once everyone used to write their own language and we fell out of the habit. The Dragon Book used to be required reading for CS…

                                          Sten TurpinT This user is from outside of this forum
                                          Sten TurpinT This user is from outside of this forum
                                          Sten Turpin
                                          wrote last edited by
                                          #26

                                          @jonathanhogg @michael @jarkman I once asked a very senior HPC developer at Red Hat what keeps him up at night and he said, paraphrasing and pulling from memory that's about 15 years old now, "we haven't created new computer science since the 1960s and I fear we'll exhaust what we know before we discover anything new," and I think about that a lot these days.

                                          1 Reply Last reply
                                          0
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Don't have an account? Register

                                          • Login or register to search.
                                          Powered by NodeBB Contributors
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups