Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (Darkly)
  • No Skin
Collapse
Brand Logo
  1. Home
  2. Uncategorized
  3. Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.

Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.

Scheduled Pinned Locked Moved Uncategorized
289 Posts 146 Posters 0 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • David GerardD David Gerard

    @tanfonto @firefoxwebdevs "stolen" https://mas.to/@twifkak/115849848003348176

    JonJ This user is from outside of this forum
    JonJ This user is from outside of this forum
    Jon
    wrote last edited by
    #207

    potayto, potahto

    @davidgerard @tanfonto @firefoxwebdevs

    1 Reply Last reply
    0
    • Firefox for Web DevelopersF Firefox for Web Developers

      Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.

      They're not LLMs. They're trained on open data.

      Should translation be disabled if the AI 'kill switch' is active?

      Kat SK This user is from outside of this forum
      Kat SK This user is from outside of this forum
      Kat S
      wrote last edited by
      #208

      @firefoxwebdevs Is it an off-switch, or isn't it?

      "Off-switch except for this PM's pet project" is not an off-switch.

      1 Reply Last reply
      0
      • David GerardD David Gerard

        @gatesvp @firefoxwebdevs @sil @jmax this is the sort of obfuscatory claim I see from AI marketers. "You say you hate slop, so that means you must hate X-ray scanning! Checkmate, AI hater!" It's not convincing.

        Gaëtan PerraultG This user is from outside of this forum
        Gaëtan PerraultG This user is from outside of this forum
        Gaëtan Perrault
        wrote last edited by
        #209

        @davidgerard

        Let's assume you're correct.
        People only care about AI slop.

        Why is Firefox even running this survey? Like who cares? Translations aren't "AI slop", they don't need to be covered by the "AI Kill Switch"... why are they even asking this question?

        Now take that assumption and read the rest of the comments. From what I'm reading, people care about more than just the AI slop. People are asking questions about the models being used for ML systems, systems that are incapable of generating AI slop.

        So we're at a weird spot here. You believe that people care only about AI slop. Firefox obviously believes that people care about more than that, because they're running this survey. And people responding are asking questions that also indicate they care about more than AI slop.

        So how do we square this?
        What do you think is a better outcome for Firefox and the community?

        RAOFR 1 Reply Last reply
        0
        • mccM mcc

          @mdavis @firefoxwebdevs I don't like the word "idiot". But a programmer who would use LLM codegen is a programmer with bad judgement. A programmer who has bad judgement cannot spot the errors made by LLM codegen. QED.

          Anyway I already got what I wanted: Servo, the web browser which will replace Firefox, has *already* banned "AI" code contributions. So it's only a matter of time before Servo is complete enough for day to day use, and I can delete the AI-infected Firefox from my computer.

          Mastodon MigrationM This user is from outside of this forum
          Mastodon MigrationM This user is from outside of this forum
          Mastodon Migration
          wrote last edited by
          #210

          @mcc @mdavis @firefoxwebdevs

          Points for "AI infected". Treating AI like a computer virus is a helpful concept.

          1 Reply Last reply
          0
          • Firefox for Web DevelopersF Firefox for Web Developers

            Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.

            They're not LLMs. They're trained on open data.

            Should translation be disabled if the AI 'kill switch' is active?

            Osma A 🇫🇮🇺🇦O This user is from outside of this forum
            Osma A 🇫🇮🇺🇦O This user is from outside of this forum
            Osma A 🇫🇮🇺🇦
            wrote last edited by
            #211

            The translation models are opt-in, because each language must be individually loaded. The same approach should apply to every other AI-adjacent function - those using remote services included. Especially those.
            @firefoxwebdevs

            1 Reply Last reply
            0
            • Duke of Germany 💫D Duke of Germany 💫

              Don‘t „design a kill switch“. Just put all the slop features into seperate extensions.
              Then see how many people will bother to install them, so you get a realistic idea for the actual demand.

              @firefoxwebdevs @zzt

              Cap E BaraC This user is from outside of this forum
              Cap E BaraC This user is from outside of this forum
              Cap E Bara
              wrote last edited by
              #212

              @duke_of_germany @firefoxwebdevs @zzt how can we cook the books by showing rational demand? too rigorous for the valley

              1 Reply Last reply
              0
              • Firefox for Web DevelopersF Firefox for Web Developers

                @chillicampari @joepie91 fwiw I asked about translation because we're figuring out what to do specifically about translation.

                Toast, Shiitake Toast 🕵️‍♂️S This user is from outside of this forum
                Toast, Shiitake Toast 🕵️‍♂️S This user is from outside of this forum
                Toast, Shiitake Toast 🕵️‍♂️
                wrote last edited by
                #213

                @firefoxwebdevs @chillicampari @joepie91 I don’t think ML translation is what most people are thinking of when they’re complaining about AI. Machine translation has been around for over 20 years at this point, is fairly efficient, and while it makes mistakes (and those mistakes keep real translators if business for things that matter), it’s not the carbon spewing plagiarism machine that generative AI is. When I want an AI kill switch, I mean I don’t want my queries to create “summary” responses, or to add to a corpus that leaks my private information. Similarly, I want my radiologist’s CT software to flag potential issues, but I don’t want it to make up phantom blood clots, either.

                1 Reply Last reply
                0
                • W6KMEW W6KME

                  @raymaccarthy @firefoxwebdevs @zzt I don't want a "browser experience". If it's doing its job, I won't be aware of it at all. I only use a browser as a viewer of content, period.

                  A browser should make websites viewable and allow the user to store locations in a way that makes sense to the *user*. Not a designer, not a bonehead CEO who thinks AI is really spiffy.

                  That's all it should do. It's very clear that browser execs never use tools. They have no idea what "tool" means.

                  Stijn van DrongelenS This user is from outside of this forum
                  Stijn van DrongelenS This user is from outside of this forum
                  Stijn van Drongelen
                  wrote last edited by
                  #214

                  @W6KME @raymaccarthy @firefoxwebdevs @zzt Exactly this. When you're eating, you don't want to be aware of your cutlery.

                  1 Reply Last reply
                  0
                  • mccM mcc

                    @mdavis @firefoxwebdevs I don't like the word "idiot". But a programmer who would use LLM codegen is a programmer with bad judgement. A programmer who has bad judgement cannot spot the errors made by LLM codegen. QED.

                    Anyway I already got what I wanted: Servo, the web browser which will replace Firefox, has *already* banned "AI" code contributions. So it's only a matter of time before Servo is complete enough for day to day use, and I can delete the AI-infected Firefox from my computer.

                    Morgan DavisM This user is from outside of this forum
                    Morgan DavisM This user is from outside of this forum
                    Morgan Davis
                    wrote last edited by
                    #215

                    @mcc @firefoxwebdevs It is a shame that we’ve come to having to ban the use of some tools.

                    I used an unfortunate word choice, despite an apropos meaning in this context: an idiot is an utterly foolish or senseless person. Programmers should know how to properly use the tools they have. That’s why I’m not all against AI codegen. In the right hands, a tool can create something beautiful and useful. In foolish hands, it can damage.

                    Learn your craft first. Then use tools properly to enhance it.

                    mccM 1 Reply Last reply
                    0
                    • Gaëtan PerraultG Gaëtan Perrault

                      @davidgerard

                      Let's assume you're correct.
                      People only care about AI slop.

                      Why is Firefox even running this survey? Like who cares? Translations aren't "AI slop", they don't need to be covered by the "AI Kill Switch"... why are they even asking this question?

                      Now take that assumption and read the rest of the comments. From what I'm reading, people care about more than just the AI slop. People are asking questions about the models being used for ML systems, systems that are incapable of generating AI slop.

                      So we're at a weird spot here. You believe that people care only about AI slop. Firefox obviously believes that people care about more than that, because they're running this survey. And people responding are asking questions that also indicate they care about more than AI slop.

                      So how do we square this?
                      What do you think is a better outcome for Firefox and the community?

                      RAOFR This user is from outside of this forum
                      RAOFR This user is from outside of this forum
                      RAOF
                      wrote last edited by
                      #216

                      @gatesvp @davidgerard

                      Why is Firefox even running this survey?

                      Because the people in charge genuinely believe that AI slop is The Future™ and believe that, in order to stay relevant, Firefox must become an AI Browser™.

                      But somehow users inexplicably dislike AI slop?! How can this be?!

                      Embedding AI slop in Firefox as deeply and pervasively as possible is thus a critical goal. But this risks reputational damage with its actual users! To mitigate the risk, bundle features that were not controversial into the discussion of the controversial features; this serves to average the controversy across the (previously uncontroversial, existing) translation feature and highly controversial new slop features, hopefully reducing it below an ignorable threshold.

                      David GerardD 1 Reply Last reply
                      0
                      • F Fooker

                        @firefoxwebdevs @joepie91 i'm a "tech folk". Just give us a version of firefox with zero AI. Translation can either be an extension or not there. We ask of you to supply a base for broSing the web, the rest is what the community delivers.

                        We won't ask you to integrate ad blockers, but we have them.
                        We won't ask you to integrate quick procy switchers, but we have them.

                        Stop the feature creep and go back to the roots, make a very good browser with extension support and let people make the rest.

                        Diplo DinoD This user is from outside of this forum
                        Diplo DinoD This user is from outside of this forum
                        Diplo Dino
                        wrote last edited by
                        #217

                        @Fooker @firefoxwebdevs at this point unfortunately I have given up on the main Firefox and switched to Zen Browser (a fork). It's a shame and honestly no shade to the devs bc my decision was made when Mozilla's CEO(s) keep doing dumb stuff. 🤷

                        1 Reply Last reply
                        0
                        • Firefox for Web DevelopersF Firefox for Web Developers

                          @mdavis it's definitely a complicated topic! I guess it's down to us to figure out a model that best serves most people, while providing options to cover the rest.

                          Stephen FarrugiaF This user is from outside of this forum
                          Stephen FarrugiaF This user is from outside of this forum
                          Stephen Farrugia
                          wrote last edited by
                          #218

                          @firefoxwebdevs @mdavis small clarification

                          @firefoxwebdevs introduced the concept of an "AI kill switch"

                          the "AI kill switch purists" you're talking about don't exist.

                          No serious person would think this is a good idea because it doesn't make sense. Evident by this "design" stumble at the start line

                          https://mastodon.social/@firefoxwebdevs/115740500373677782

                          aburka 🫣A 1 Reply Last reply
                          0
                          • Morgan DavisM Morgan Davis

                            @mcc @firefoxwebdevs It is a shame that we’ve come to having to ban the use of some tools.

                            I used an unfortunate word choice, despite an apropos meaning in this context: an idiot is an utterly foolish or senseless person. Programmers should know how to properly use the tools they have. That’s why I’m not all against AI codegen. In the right hands, a tool can create something beautiful and useful. In foolish hands, it can damage.

                            Learn your craft first. Then use tools properly to enhance it.

                            mccM This user is from outside of this forum
                            mccM This user is from outside of this forum
                            mcc
                            wrote last edited by
                            #219

                            @mdavis @firefoxwebdevs Well, if LLMs are a tool you use as part of your process of writing code, then I don't want to use any code you created

                            Morgan DavisM 1 Reply Last reply
                            0
                            • Firefox for Web DevelopersF Firefox for Web Developers

                              Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.

                              They're not LLMs. They're trained on open data.

                              Should translation be disabled if the AI 'kill switch' is active?

                              Paul Wilde 😺 (snac2 acct)P This user is from outside of this forum
                              Paul Wilde 😺 (snac2 acct)P This user is from outside of this forum
                              Paul Wilde 😺 (snac2 acct)
                              wrote last edited by
                              #220
                              @firefoxwebdevs@mastodon.social anyone else have "they're not LLMs. They're trained on open data" in their #Mozilla buffoonery bingo card?
                              1 Reply Last reply
                              0
                              • mage_of_dragonsM mage_of_dragons

                                @cassidy @firefoxwebdevs The term "AI" has existed since 1956 so of course it's going to have a very broad definition.

                                Things don't just stop being "AI" when AI researchers invent newer "more AI" stuff.

                                Dianne HackbornH This user is from outside of this forum
                                Dianne HackbornH This user is from outside of this forum
                                Dianne Hackborn
                                wrote last edited by
                                #221

                                @mage_of_dragons @cassidy @firefoxwebdevs

                                Well we were generally calling these things ML, until the AI hype train started. That isn't totally helpful, since LLMs are themselves another type of ML, but it would sure help to be able to talk about this stuff more specifically by not even more broadly calling it AI.

                                1 Reply Last reply
                                0
                                • Morgan DavisM Morgan Davis

                                  @firefoxwebdevs I don’t think you can make any assumptions then without granular switches that let the user control every facet. In which case, this kill switch is probably less a binary checkbox and more a slider or a series of discrete options. And as a Firefox and Thunderbird user, we are used to lots of toggles and switches under the hood, so I’m fine with that kind of control.

                                  David GerardD This user is from outside of this forum
                                  David GerardD This user is from outside of this forum
                                  David Gerard
                                  wrote last edited by
                                  #222

                                  @mdavis @firefoxwebdevs

                                  The Firefox AI "kill switch" is not "complicated" except insofar as it's incoherent. it's not "undisclosed nuance" except insofar as it's incoherent.

                                  the "kill switch" doesn't exist.

                                  this is important to keep in mind. once you remember that NONE OF THIS EXISTS, you will realise that every one of the dilemmas you posit is an imaginary problem that follows from incoherent postulates.

                                  e.g. "AI kill switch purists" is not a coherent postulation because the "kill switch" does not exist.

                                  the "kill switch" is a hypothetical proposed in this post:

                                  https://mastodon.social/@firefoxwebdevs/115740500373677782

                                  the "kill switch" is a proposal to satisfy the demand for an opt-in by providing an opt-out. you might think that's a failure to respect the question, and you might even begin to suspect the proposal was in bad faith.

                                  note that Jake, in presenting the kill switch and calling it a kill switch and getting it into all the papers as a kill switch, says he's uncomfortable with the name he's publicised it as. you might think that's oddly incompetent for literally a PR (devrel) person.

                                  the concept as presented imposes multiple false dilemmas.

                                  the LLM stuff should *incredibly obviously* be an extension. this is the purest possible opt-in, despite jake's past attempts to muddy the meaning of "opt-in".

                                  making it an extension is also eminently feasible. There is literally no technical reason it needs to be a browser built-in.

                                  this suggests the reasons are not in any way technical. some person with a name, who has yet to be named, dictated that it would be a built-in. so that's what Mozilla is going with.

                                  why Mozilla went hard AI is entirely unclear. this would have been late 2024? we have no idea who was inspired with this bad idea nor why they were so incredibly keen to force it into the browser.

                                  nor is it clear what Mozilla will do for external LLM services when the AI bubble runs out of venture capital and pops in a year or so, most of the chatbot APIs shut down and whatever remains is 10x the cost at least. but that's a problem for 2027's bonus, not 2026's.

                                  note how the poll provides no option for "no LLM functions built-in to Firefox", in a pathetically transparent attempt to synthesize consent. jake wants to use this poll as evidence of what the user base wants, deliberately leaving out the option he knows directly a lot of them want.

                                  and in conclusion:

                                  1. solve the "kill switch" naming problem by branding it the "brutal and bloody robot murder switch with an option on the executives responsible".
                                  2. make all this shit an extension like they should have a year ago.
                                  3. and your little translator too.

                                  [object Object]Z Jennifer Kayla | Theogrin 🦊T Morgan DavisM 3 Replies Last reply
                                  0
                                  • Stephen FarrugiaF Stephen Farrugia

                                    @firefoxwebdevs @mdavis small clarification

                                    @firefoxwebdevs introduced the concept of an "AI kill switch"

                                    the "AI kill switch purists" you're talking about don't exist.

                                    No serious person would think this is a good idea because it doesn't make sense. Evident by this "design" stumble at the start line

                                    https://mastodon.social/@firefoxwebdevs/115740500373677782

                                    aburka 🫣A This user is from outside of this forum
                                    aburka 🫣A This user is from outside of this forum
                                    aburka 🫣
                                    wrote last edited by
                                    #223

                                    @fasterandworse @firefoxwebdevs @mdavis it is less likely to be a stumble and more likely introduced in bad faith by a PM to derail the process

                                    Btw, there's meaningful discussion to be had about the biases encoded in ML-based translation -- try translating "the scientist" and "the teacher" into a language with gendered nouns. But that is separate from the widespread opposition to LLMs and everyone knows it.

                                    aburka 🫣A 1 Reply Last reply
                                    0
                                    • mccM mcc

                                      @mdavis @firefoxwebdevs Well, if LLMs are a tool you use as part of your process of writing code, then I don't want to use any code you created

                                      Morgan DavisM This user is from outside of this forum
                                      Morgan DavisM This user is from outside of this forum
                                      Morgan Davis
                                      wrote last edited by
                                      #224

                                      @mcc @firefoxwebdevs It is going to be very difficult to avoid any application being built today that doesn’t have some part of it “infected” by AI.

                                      There are degrees of “codegen” as well… to what extent do you employ it? A scaffolded loop, autocompleted function call that gets the order of the parameters right?

                                      Or draft out and deploy an entire application?

                                      I think we have to be realistic about it but also call out the fools who are misusing it or thinking it makes them a real programmer.

                                      1 Reply Last reply
                                      0
                                      • RichardM Richard

                                        @firefoxwebdevs The frame of this question is risible.

                                        I am begging you to just make a web browser.

                                        Make it the best browser for the open web. Make it a browser that empowers individuals. Make it a browser that defends users against threats.

                                        Do not make a search engine. Do not make a translation engine. Do not make a webpage summariser. Do not make a front-end for an LLM. Do not make a client-side LLM.

                                        Just. Make. A. Web. Browser.

                                        Please.

                                        Mike 🇦🇺🏳️‍🌈R This user is from outside of this forum
                                        Mike 🇦🇺🏳️‍🌈R This user is from outside of this forum
                                        Mike 🇦🇺🏳️‍🌈
                                        wrote last edited by
                                        #225

                                        @m0rpk @firefoxwebdevs you have it completely backwards, AI should be opt in not opt out

                                        1 Reply Last reply
                                        0
                                        • HiddeH Hidde

                                          @firefoxwebdevs as a user, I like and use translation. Having one app render and translate content makes sense to me.

                                          I like how you do it (incl on-device, on-demand and privacy-preserving, and open data (assuming it means not copyrighted?)).

                                          Because of both, it is clearly different from other “AI” to me, even if it technically would use language models that are large, and this poll makes sense to me.

                                          It's tricky, I voted, but wasn't super sure. I think granular controls would be great.

                                          HiddeH This user is from outside of this forum
                                          HiddeH This user is from outside of this forum
                                          Hidde
                                          wrote last edited by
                                          #226

                                          @firefoxwebdevs I also like the idea of having all such features as extensions rather than built in features, so they can be explicitly turned on by people who want to.

                                          Would really make the product clearly stand out from others

                                          Curtis WilcoxC 1 Reply Last reply
                                          0
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Don't have an account? Register

                                          • Login or register to search.
                                          Powered by NodeBB Contributors
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups