Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (Darkly)
  • No Skin
Collapse
Brand Logo
  1. Home
  2. Uncategorized
  3. Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.

Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.

Scheduled Pinned Locked Moved Uncategorized
289 Posts 146 Posters 0 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • Duke of Germany 💫D Duke of Germany 💫

    Don‘t „design a kill switch“. Just put all the slop features into seperate extensions.
    Then see how many people will bother to install them, so you get a realistic idea for the actual demand.

    @firefoxwebdevs @zzt

    Cap E BaraC This user is from outside of this forum
    Cap E BaraC This user is from outside of this forum
    Cap E Bara
    wrote last edited by
    #212

    @duke_of_germany @firefoxwebdevs @zzt how can we cook the books by showing rational demand? too rigorous for the valley

    1 Reply Last reply
    0
    • Firefox for Web DevelopersF Firefox for Web Developers

      @chillicampari @joepie91 fwiw I asked about translation because we're figuring out what to do specifically about translation.

      Toast, Shiitake Toast 🕵️‍♂️S This user is from outside of this forum
      Toast, Shiitake Toast 🕵️‍♂️S This user is from outside of this forum
      Toast, Shiitake Toast 🕵️‍♂️
      wrote last edited by
      #213

      @firefoxwebdevs @chillicampari @joepie91 I don’t think ML translation is what most people are thinking of when they’re complaining about AI. Machine translation has been around for over 20 years at this point, is fairly efficient, and while it makes mistakes (and those mistakes keep real translators if business for things that matter), it’s not the carbon spewing plagiarism machine that generative AI is. When I want an AI kill switch, I mean I don’t want my queries to create “summary” responses, or to add to a corpus that leaks my private information. Similarly, I want my radiologist’s CT software to flag potential issues, but I don’t want it to make up phantom blood clots, either.

      1 Reply Last reply
      0
      • W6KMEW W6KME

        @raymaccarthy @firefoxwebdevs @zzt I don't want a "browser experience". If it's doing its job, I won't be aware of it at all. I only use a browser as a viewer of content, period.

        A browser should make websites viewable and allow the user to store locations in a way that makes sense to the *user*. Not a designer, not a bonehead CEO who thinks AI is really spiffy.

        That's all it should do. It's very clear that browser execs never use tools. They have no idea what "tool" means.

        Stijn van DrongelenS This user is from outside of this forum
        Stijn van DrongelenS This user is from outside of this forum
        Stijn van Drongelen
        wrote last edited by
        #214

        @W6KME @raymaccarthy @firefoxwebdevs @zzt Exactly this. When you're eating, you don't want to be aware of your cutlery.

        1 Reply Last reply
        0
        • mccM mcc

          @mdavis @firefoxwebdevs I don't like the word "idiot". But a programmer who would use LLM codegen is a programmer with bad judgement. A programmer who has bad judgement cannot spot the errors made by LLM codegen. QED.

          Anyway I already got what I wanted: Servo, the web browser which will replace Firefox, has *already* banned "AI" code contributions. So it's only a matter of time before Servo is complete enough for day to day use, and I can delete the AI-infected Firefox from my computer.

          Morgan DavisM This user is from outside of this forum
          Morgan DavisM This user is from outside of this forum
          Morgan Davis
          wrote last edited by
          #215

          @mcc @firefoxwebdevs It is a shame that we’ve come to having to ban the use of some tools.

          I used an unfortunate word choice, despite an apropos meaning in this context: an idiot is an utterly foolish or senseless person. Programmers should know how to properly use the tools they have. That’s why I’m not all against AI codegen. In the right hands, a tool can create something beautiful and useful. In foolish hands, it can damage.

          Learn your craft first. Then use tools properly to enhance it.

          mccM 1 Reply Last reply
          0
          • Gaëtan PerraultG Gaëtan Perrault

            @davidgerard

            Let's assume you're correct.
            People only care about AI slop.

            Why is Firefox even running this survey? Like who cares? Translations aren't "AI slop", they don't need to be covered by the "AI Kill Switch"... why are they even asking this question?

            Now take that assumption and read the rest of the comments. From what I'm reading, people care about more than just the AI slop. People are asking questions about the models being used for ML systems, systems that are incapable of generating AI slop.

            So we're at a weird spot here. You believe that people care only about AI slop. Firefox obviously believes that people care about more than that, because they're running this survey. And people responding are asking questions that also indicate they care about more than AI slop.

            So how do we square this?
            What do you think is a better outcome for Firefox and the community?

            RAOFR This user is from outside of this forum
            RAOFR This user is from outside of this forum
            RAOF
            wrote last edited by
            #216

            @gatesvp @davidgerard

            Why is Firefox even running this survey?

            Because the people in charge genuinely believe that AI slop is The Future™ and believe that, in order to stay relevant, Firefox must become an AI Browser™.

            But somehow users inexplicably dislike AI slop?! How can this be?!

            Embedding AI slop in Firefox as deeply and pervasively as possible is thus a critical goal. But this risks reputational damage with its actual users! To mitigate the risk, bundle features that were not controversial into the discussion of the controversial features; this serves to average the controversy across the (previously uncontroversial, existing) translation feature and highly controversial new slop features, hopefully reducing it below an ignorable threshold.

            David GerardD 1 Reply Last reply
            0
            • F Fooker

              @firefoxwebdevs @joepie91 i'm a "tech folk". Just give us a version of firefox with zero AI. Translation can either be an extension or not there. We ask of you to supply a base for broSing the web, the rest is what the community delivers.

              We won't ask you to integrate ad blockers, but we have them.
              We won't ask you to integrate quick procy switchers, but we have them.

              Stop the feature creep and go back to the roots, make a very good browser with extension support and let people make the rest.

              Diplo DinoD This user is from outside of this forum
              Diplo DinoD This user is from outside of this forum
              Diplo Dino
              wrote last edited by
              #217

              @Fooker @firefoxwebdevs at this point unfortunately I have given up on the main Firefox and switched to Zen Browser (a fork). It's a shame and honestly no shade to the devs bc my decision was made when Mozilla's CEO(s) keep doing dumb stuff. 🤷

              1 Reply Last reply
              0
              • Firefox for Web DevelopersF Firefox for Web Developers

                @mdavis it's definitely a complicated topic! I guess it's down to us to figure out a model that best serves most people, while providing options to cover the rest.

                Stephen FarrugiaF This user is from outside of this forum
                Stephen FarrugiaF This user is from outside of this forum
                Stephen Farrugia
                wrote last edited by
                #218

                @firefoxwebdevs @mdavis small clarification

                @firefoxwebdevs introduced the concept of an "AI kill switch"

                the "AI kill switch purists" you're talking about don't exist.

                No serious person would think this is a good idea because it doesn't make sense. Evident by this "design" stumble at the start line

                https://mastodon.social/@firefoxwebdevs/115740500373677782

                aburka 🫣A 1 Reply Last reply
                0
                • Morgan DavisM Morgan Davis

                  @mcc @firefoxwebdevs It is a shame that we’ve come to having to ban the use of some tools.

                  I used an unfortunate word choice, despite an apropos meaning in this context: an idiot is an utterly foolish or senseless person. Programmers should know how to properly use the tools they have. That’s why I’m not all against AI codegen. In the right hands, a tool can create something beautiful and useful. In foolish hands, it can damage.

                  Learn your craft first. Then use tools properly to enhance it.

                  mccM This user is from outside of this forum
                  mccM This user is from outside of this forum
                  mcc
                  wrote last edited by
                  #219

                  @mdavis @firefoxwebdevs Well, if LLMs are a tool you use as part of your process of writing code, then I don't want to use any code you created

                  Morgan DavisM 1 Reply Last reply
                  0
                  • Firefox for Web DevelopersF Firefox for Web Developers

                    Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.

                    They're not LLMs. They're trained on open data.

                    Should translation be disabled if the AI 'kill switch' is active?

                    Paul Wilde 😺 (snac2 acct)P This user is from outside of this forum
                    Paul Wilde 😺 (snac2 acct)P This user is from outside of this forum
                    Paul Wilde 😺 (snac2 acct)
                    wrote last edited by
                    #220
                    @firefoxwebdevs@mastodon.social anyone else have "they're not LLMs. They're trained on open data" in their #Mozilla buffoonery bingo card?
                    1 Reply Last reply
                    0
                    • mage_of_dragonsM mage_of_dragons

                      @cassidy @firefoxwebdevs The term "AI" has existed since 1956 so of course it's going to have a very broad definition.

                      Things don't just stop being "AI" when AI researchers invent newer "more AI" stuff.

                      Dianne HackbornH This user is from outside of this forum
                      Dianne HackbornH This user is from outside of this forum
                      Dianne Hackborn
                      wrote last edited by
                      #221

                      @mage_of_dragons @cassidy @firefoxwebdevs

                      Well we were generally calling these things ML, until the AI hype train started. That isn't totally helpful, since LLMs are themselves another type of ML, but it would sure help to be able to talk about this stuff more specifically by not even more broadly calling it AI.

                      1 Reply Last reply
                      0
                      • Morgan DavisM Morgan Davis

                        @firefoxwebdevs I don’t think you can make any assumptions then without granular switches that let the user control every facet. In which case, this kill switch is probably less a binary checkbox and more a slider or a series of discrete options. And as a Firefox and Thunderbird user, we are used to lots of toggles and switches under the hood, so I’m fine with that kind of control.

                        David GerardD This user is from outside of this forum
                        David GerardD This user is from outside of this forum
                        David Gerard
                        wrote last edited by
                        #222

                        @mdavis @firefoxwebdevs

                        The Firefox AI "kill switch" is not "complicated" except insofar as it's incoherent. it's not "undisclosed nuance" except insofar as it's incoherent.

                        the "kill switch" doesn't exist.

                        this is important to keep in mind. once you remember that NONE OF THIS EXISTS, you will realise that every one of the dilemmas you posit is an imaginary problem that follows from incoherent postulates.

                        e.g. "AI kill switch purists" is not a coherent postulation because the "kill switch" does not exist.

                        the "kill switch" is a hypothetical proposed in this post:

                        https://mastodon.social/@firefoxwebdevs/115740500373677782

                        the "kill switch" is a proposal to satisfy the demand for an opt-in by providing an opt-out. you might think that's a failure to respect the question, and you might even begin to suspect the proposal was in bad faith.

                        note that Jake, in presenting the kill switch and calling it a kill switch and getting it into all the papers as a kill switch, says he's uncomfortable with the name he's publicised it as. you might think that's oddly incompetent for literally a PR (devrel) person.

                        the concept as presented imposes multiple false dilemmas.

                        the LLM stuff should *incredibly obviously* be an extension. this is the purest possible opt-in, despite jake's past attempts to muddy the meaning of "opt-in".

                        making it an extension is also eminently feasible. There is literally no technical reason it needs to be a browser built-in.

                        this suggests the reasons are not in any way technical. some person with a name, who has yet to be named, dictated that it would be a built-in. so that's what Mozilla is going with.

                        why Mozilla went hard AI is entirely unclear. this would have been late 2024? we have no idea who was inspired with this bad idea nor why they were so incredibly keen to force it into the browser.

                        nor is it clear what Mozilla will do for external LLM services when the AI bubble runs out of venture capital and pops in a year or so, most of the chatbot APIs shut down and whatever remains is 10x the cost at least. but that's a problem for 2027's bonus, not 2026's.

                        note how the poll provides no option for "no LLM functions built-in to Firefox", in a pathetically transparent attempt to synthesize consent. jake wants to use this poll as evidence of what the user base wants, deliberately leaving out the option he knows directly a lot of them want.

                        and in conclusion:

                        1. solve the "kill switch" naming problem by branding it the "brutal and bloody robot murder switch with an option on the executives responsible".
                        2. make all this shit an extension like they should have a year ago.
                        3. and your little translator too.

                        [object Object]Z Jennifer Kayla | Theogrin 🦊T Morgan DavisM 3 Replies Last reply
                        0
                        • Stephen FarrugiaF Stephen Farrugia

                          @firefoxwebdevs @mdavis small clarification

                          @firefoxwebdevs introduced the concept of an "AI kill switch"

                          the "AI kill switch purists" you're talking about don't exist.

                          No serious person would think this is a good idea because it doesn't make sense. Evident by this "design" stumble at the start line

                          https://mastodon.social/@firefoxwebdevs/115740500373677782

                          aburka 🫣A This user is from outside of this forum
                          aburka 🫣A This user is from outside of this forum
                          aburka 🫣
                          wrote last edited by
                          #223

                          @fasterandworse @firefoxwebdevs @mdavis it is less likely to be a stumble and more likely introduced in bad faith by a PM to derail the process

                          Btw, there's meaningful discussion to be had about the biases encoded in ML-based translation -- try translating "the scientist" and "the teacher" into a language with gendered nouns. But that is separate from the widespread opposition to LLMs and everyone knows it.

                          aburka 🫣A 1 Reply Last reply
                          0
                          • mccM mcc

                            @mdavis @firefoxwebdevs Well, if LLMs are a tool you use as part of your process of writing code, then I don't want to use any code you created

                            Morgan DavisM This user is from outside of this forum
                            Morgan DavisM This user is from outside of this forum
                            Morgan Davis
                            wrote last edited by
                            #224

                            @mcc @firefoxwebdevs It is going to be very difficult to avoid any application being built today that doesn’t have some part of it “infected” by AI.

                            There are degrees of “codegen” as well… to what extent do you employ it? A scaffolded loop, autocompleted function call that gets the order of the parameters right?

                            Or draft out and deploy an entire application?

                            I think we have to be realistic about it but also call out the fools who are misusing it or thinking it makes them a real programmer.

                            1 Reply Last reply
                            0
                            • RichardM Richard

                              @firefoxwebdevs The frame of this question is risible.

                              I am begging you to just make a web browser.

                              Make it the best browser for the open web. Make it a browser that empowers individuals. Make it a browser that defends users against threats.

                              Do not make a search engine. Do not make a translation engine. Do not make a webpage summariser. Do not make a front-end for an LLM. Do not make a client-side LLM.

                              Just. Make. A. Web. Browser.

                              Please.

                              Mike 🇦🇺🏳️‍🌈R This user is from outside of this forum
                              Mike 🇦🇺🏳️‍🌈R This user is from outside of this forum
                              Mike 🇦🇺🏳️‍🌈
                              wrote last edited by
                              #225

                              @m0rpk @firefoxwebdevs you have it completely backwards, AI should be opt in not opt out

                              1 Reply Last reply
                              0
                              • HiddeH Hidde

                                @firefoxwebdevs as a user, I like and use translation. Having one app render and translate content makes sense to me.

                                I like how you do it (incl on-device, on-demand and privacy-preserving, and open data (assuming it means not copyrighted?)).

                                Because of both, it is clearly different from other “AI” to me, even if it technically would use language models that are large, and this poll makes sense to me.

                                It's tricky, I voted, but wasn't super sure. I think granular controls would be great.

                                HiddeH This user is from outside of this forum
                                HiddeH This user is from outside of this forum
                                Hidde
                                wrote last edited by
                                #226

                                @firefoxwebdevs I also like the idea of having all such features as extensions rather than built in features, so they can be explicitly turned on by people who want to.

                                Would really make the product clearly stand out from others

                                Curtis WilcoxC 1 Reply Last reply
                                0
                                • mage_of_dragonsM mage_of_dragons

                                  @cassidy @firefoxwebdevs The term "AI" has existed since 1956 so of course it's going to have a very broad definition.

                                  Things don't just stop being "AI" when AI researchers invent newer "more AI" stuff.

                                  RAOFR This user is from outside of this forum
                                  RAOFR This user is from outside of this forum
                                  RAOF
                                  wrote last edited by
                                  #227

                                  @mage_of_dragons @cassidy @firefoxwebdevs Right, LLMs are unquestionably an AI technology, as are ML, neural nets, expert systems, and so on.

                                  But your response misses the point. The complaint was:

                                  Firefox users: We hate these new AI (implicitly: generative AI, LLM slop) features, please let us turn them off! (Ideally, stop wasting developer effort on them!)
                                  Mozilla leadership: Oh, you mean you hate the AI (willfully misinterpreted to mean existing ML systems) translations?

                                  The compliant is not “It's incorrect to call LLMs AI”, the complaint is “You know perfectly well what we mean when we use "AI" in this context, stop disingenuously pretending you don't know what we're talking about”.

                                  1 Reply Last reply
                                  0
                                  • Morgan DavisM This user is from outside of this forum
                                    Morgan DavisM This user is from outside of this forum
                                    Morgan Davis
                                    wrote last edited by
                                    #228

                                    @fwaggle @mcc @firefoxwebdevs I like this. 🙂 There’s a joke here about bugs in code…

                                    1 Reply Last reply
                                    0
                                    • David GerardD David Gerard

                                      @mdavis @firefoxwebdevs

                                      The Firefox AI "kill switch" is not "complicated" except insofar as it's incoherent. it's not "undisclosed nuance" except insofar as it's incoherent.

                                      the "kill switch" doesn't exist.

                                      this is important to keep in mind. once you remember that NONE OF THIS EXISTS, you will realise that every one of the dilemmas you posit is an imaginary problem that follows from incoherent postulates.

                                      e.g. "AI kill switch purists" is not a coherent postulation because the "kill switch" does not exist.

                                      the "kill switch" is a hypothetical proposed in this post:

                                      https://mastodon.social/@firefoxwebdevs/115740500373677782

                                      the "kill switch" is a proposal to satisfy the demand for an opt-in by providing an opt-out. you might think that's a failure to respect the question, and you might even begin to suspect the proposal was in bad faith.

                                      note that Jake, in presenting the kill switch and calling it a kill switch and getting it into all the papers as a kill switch, says he's uncomfortable with the name he's publicised it as. you might think that's oddly incompetent for literally a PR (devrel) person.

                                      the concept as presented imposes multiple false dilemmas.

                                      the LLM stuff should *incredibly obviously* be an extension. this is the purest possible opt-in, despite jake's past attempts to muddy the meaning of "opt-in".

                                      making it an extension is also eminently feasible. There is literally no technical reason it needs to be a browser built-in.

                                      this suggests the reasons are not in any way technical. some person with a name, who has yet to be named, dictated that it would be a built-in. so that's what Mozilla is going with.

                                      why Mozilla went hard AI is entirely unclear. this would have been late 2024? we have no idea who was inspired with this bad idea nor why they were so incredibly keen to force it into the browser.

                                      nor is it clear what Mozilla will do for external LLM services when the AI bubble runs out of venture capital and pops in a year or so, most of the chatbot APIs shut down and whatever remains is 10x the cost at least. but that's a problem for 2027's bonus, not 2026's.

                                      note how the poll provides no option for "no LLM functions built-in to Firefox", in a pathetically transparent attempt to synthesize consent. jake wants to use this poll as evidence of what the user base wants, deliberately leaving out the option he knows directly a lot of them want.

                                      and in conclusion:

                                      1. solve the "kill switch" naming problem by branding it the "brutal and bloody robot murder switch with an option on the executives responsible".
                                      2. make all this shit an extension like they should have a year ago.
                                      3. and your little translator too.

                                      [object Object]Z This user is from outside of this forum
                                      [object Object]Z This user is from outside of this forum
                                      [object Object]
                                      wrote last edited by
                                      #229

                                      @davidgerard @mdavis@mastodon.social @firefoxwebdevs “but wait just let me explain the AI kill switch”, Mozilla continues to insist, as they slowly expand and transform into an SBF

                                      David GerardD jwzJ 3 Replies Last reply
                                      0
                                      • sebastian ⚡S This user is from outside of this forum
                                        sebastian ⚡S This user is from outside of this forum
                                        sebastian ⚡
                                        wrote last edited by
                                        #230

                                        @firefoxwebdevs Also as a side note: The org I'm working on has banned genAI tools for projects above a certain level of confidentiality. Guess what? Firefox is banned as well and probably stays banned regardless of any kill switch.

                                        1 Reply Last reply
                                        0
                                        • [object Object]Z [object Object]

                                          @davidgerard @mdavis@mastodon.social @firefoxwebdevs “but wait just let me explain the AI kill switch”, Mozilla continues to insist, as they slowly expand and transform into an SBF

                                          David GerardD This user is from outside of this forum
                                          David GerardD This user is from outside of this forum
                                          David Gerard
                                          wrote last edited by
                                          #231

                                          @zzt @firefoxwebdevs this would involve them one day standing before Congress and solemnly declaring "I fucked up", which is why we had to jail them first.

                                          1 Reply Last reply
                                          0
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Don't have an account? Register

                                          • Login or register to search.
                                          Powered by NodeBB Contributors
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups