Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (Darkly)
  • No Skin
Collapse
Brand Logo
  1. Home
  2. Uncategorized
  3. Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.

Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.

Scheduled Pinned Locked Moved Uncategorized
289 Posts 146 Posters 0 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • Firefox for Web DevelopersF Firefox for Web Developers

    Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.

    They're not LLMs. They're trained on open data.

    Should translation be disabled if the AI 'kill switch' is active?

    tayeT This user is from outside of this forum
    tayeT This user is from outside of this forum
    taye
    wrote last edited by
    #114

    @firefoxwebdevs Thanks for involving the community in this! I've found the translation feature really useful even if the results aren't state-of-the-art!

    I agree with other commenters that there's an issue with the term "AI", but I don't have any suggestions.

    To match my current preferneces, I would like an AI kill switch to keep translations with local models, but disable LLM chatbots, summarizers, and agents.

    1 Reply Last reply
    0
    • [object Object]Z [object Object]

      @davidgerard @firefoxwebdevs I know you, you’ve read much worse things than the necronomicon

      you’ve written wiki articles about most of them

      David GerardD This user is from outside of this forum
      David GerardD This user is from outside of this forum
      David Gerard
      wrote last edited by
      #115

      @zzt @firefoxwebdevs firefox translate is to blame, arrest that instead

      1 Reply Last reply
      0
      • Gaëtan PerraultG Gaëtan Perrault

        @firefoxwebdevs

        I think the challenge with everything going on here is one of clarity.

        @sil, you are asking them about disclosure of models and sourcing. But that is far from the only AI that is in the system.

        The tool that does grammar checking and language identification does not leverage an LLM, and while there may be some type of model underneath, the context is very different. Tools that detect spam pages or faulty JavaScript that locks the pages, that's another type of AI hard at work.

        Is the browser allowed to support speech to text?

        @jmax You're calling out that Firefox may not be able to do this, but I think that mischaracterizes the scope of what's happening here.

        The browser has several types of non-deterministic, probabilistic tools in it that provide useful services. Now there's a backlash against one very specific version of those non-deterministic, probabilistic tools. But the backlash is vociferous, often unsolvable, and incredibly broad.

        It's hard to engage with non-specific anger.

        MonokerosM This user is from outside of this forum
        MonokerosM This user is from outside of this forum
        Monokeros
        wrote last edited by
        #116

        @gatesvp @firefoxwebdevs @sil @jmax They could engage with the nonspecific anger by removing the VERY SPECIFIC technologies at issue

        Instead they want to make us argue about "well, if we haul away the shit, do you want us to haul away the bark dust, too? Some people need bark dust, so you have to let us smear shit all over everything"

        1 Reply Last reply
        0
        • mage_of_dragonsM mage_of_dragons

          @cassidy @firefoxwebdevs The term "AI" has existed since 1956 so of course it's going to have a very broad definition.

          Things don't just stop being "AI" when AI researchers invent newer "more AI" stuff.

          MonokerosM This user is from outside of this forum
          MonokerosM This user is from outside of this forum
          Monokeros
          wrote last edited by
          #117

          @mage_of_dragons @cassidy @firefoxwebdevs We also know exactly what lies in store for the current slate of AI: 20 years of funding drought, just like all its ancestors

          1 Reply Last reply
          0
          • wyngmanT wyngman

            @twifkak Wouldn't that be a valid working definition of "open"?

            T This user is from outside of this forum
            T This user is from outside of this forum
            twifkak
            wrote last edited by
            #118

            @tasket It would be, much in the way that "guaranteed not to turn pink in the can" is a valid description of bad salmon [1]. A disingenuous mislead from what people really care about in the product.

            [1] I know it didn't happen. It's a good metaphor.

            wyngmanT 1 Reply Last reply
            0
            • Firefox for Web DevelopersF Firefox for Web Developers

              Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.

              They're not LLMs. They're trained on open data.

              Should translation be disabled if the AI 'kill switch' is active?

              Sven Slootweg, low-spoons mode ("still kinky and horny anyway")J This user is from outside of this forum
              Sven Slootweg, low-spoons mode ("still kinky and horny anyway")J This user is from outside of this forum
              Sven Slootweg, low-spoons mode ("still kinky and horny anyway")
              wrote last edited by
              #119

              @firefoxwebdevs My closest answer would be "no", but I think the question is kind of mis-phrased here, and that's probably going to lead to a confusing and potentially misleading outcome.

              The problem that people have is not with "AI" as a generalized category, but with the current generation of thieving, climate-destroying, grifting systems that are marketed as AI to an overwhelming degree - notably LLMs and "generative AI", but really anything with those inconsiderate properties.

              If your kill switch is presented as an "AI kill switch", then depending on the person they're either going to understand that as "exploitative tech", or as "machine learning", and so make different assumptions as to whether local translation is included in that.

              So I think you'll have to be a lot more explicit about what you mean; either by describing clearly what the kill-switch includes, or what it excludes, right in the place where the option is offered. Otherwise it's damned if you do, damned if you don't; depending on whether you include translations, either one or another group is going to be upset with the unexpected behaviour.

              So, ethically, if the translation feature is built on ethically collected data, and it has no outsized climate impact, then I would not consider it something that needs to be included in a "get rid of all of it" kill switch. But to convey this clearly to users, both that and why it isn't included should be explained right there with the button, with potentially a second-step option to disable it anyway if someone still feels uncomfortable with it.

              That way you've transparently communicated to users and shown that you have nothing up your sleeve by immediately and proactively offering them an option to disable that, too, if they have already shown interest in removing "AI" features.

              Firefox for Web DevelopersF 1 Reply Last reply
              0
              • T twifkak

                @tasket It would be, much in the way that "guaranteed not to turn pink in the can" is a valid description of bad salmon [1]. A disingenuous mislead from what people really care about in the product.

                [1] I know it didn't happen. It's a good metaphor.

                wyngmanT This user is from outside of this forum
                wyngmanT This user is from outside of this forum
                wyngman
                wrote last edited by
                #120

                @twifkak I think you're mixing up "We do not own" with "We do not have rights to". 🤷

                T 1 Reply Last reply
                0
                • Firefox for Web DevelopersF Firefox for Web Developers

                  Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.

                  They're not LLMs. They're trained on open data.

                  Should translation be disabled if the AI 'kill switch' is active?

                  sb   arms & legsS This user is from outside of this forum
                  sb   arms & legsS This user is from outside of this forum
                  sb arms & legs
                  wrote last edited by
                  #121

                  @firefoxwebdevs
                  Y'all know as well as we do this feature-creep junk belongs in extensions - if anywhere at all. It does NOT belong in or anywhere near core.

                  Please keep the world's browser lean and healthy and strong. We need all the help we can get.

                  1 Reply Last reply
                  0
                  • George Liquor, AmericanL George Liquor, American

                    @zzt @pixel @firefoxwebdevs "Nobody likes our product any longer, but at least we never had to entertain any *shudder* critical feedback."

                    Stephen FarrugiaF This user is from outside of this forum
                    Stephen FarrugiaF This user is from outside of this forum
                    Stephen Farrugia
                    wrote last edited by
                    #122

                    @liquor_american @zzt @pixel @firefoxwebdevs As the only remaining cross-platform browser that is not chromium, Mozilla deserves nothing but pressure to do better. Defending Mozilla about anything other than making Gecko better is giving them permission to eventually be just another chromium skin

                    1 Reply Last reply
                    0
                    • [object Object]Z [object Object]

                      @firefoxwebdevs an important addendum regarding Firefox translate: by my math (N = my replies), 25% of its users are fucking unhinged

                      I told them not to use the necronomicon to train the base model but here we fucking are

                      Albert ARIBAUD ⓂA This user is from outside of this forum
                      Albert ARIBAUD ⓂA This user is from outside of this forum
                      Albert ARIBAUD Ⓜ
                      wrote last edited by
                      #123

                      @zzt @firefoxwebdevs Sorry, but I just cannot escape the call for #ShamelessPlug (though, as usual, #IHaveNothingToSell😞

                      https://mastodon.art/@aaribaud/110721997413550131

                      1 Reply Last reply
                      0
                      • wyngmanT wyngman

                        @twifkak I think you're mixing up "We do not own" with "We do not have rights to". 🤷

                        T This user is from outside of this forum
                        T This user is from outside of this forum
                        twifkak
                        wrote last edited by
                        #124

                        @tasket Perhaps. Show me what rights they have to it.

                        wyngmanT 1 Reply Last reply
                        0
                        • George Liquor, AmericanL George Liquor, American

                          @wes @firefoxwebdevs Sure. But can we agree that it does not represent a core functionality of a web browser?

                          Like "this meeting could've been an email," but "this feature could've been an add-on."

                          A web browser should load web pages, allow you to interact with them, and offer add-on support for functionality that doesn't match the definition of "web browser." It's all pretty straight-forward if you're not a marketer, whose brains are all broken.

                          CpyJx 🍉C This user is from outside of this forum
                          CpyJx 🍉C This user is from outside of this forum
                          CpyJx 🍉
                          wrote last edited by
                          #125

                          > A web browser should load web pages, allow you to interact with them ...

                          I would point out that translating a web page written in a non-native language allows me to interact with said page. Your argument can go both ways.

                          1 Reply Last reply
                          0
                          • Sven Slootweg, low-spoons mode ("still kinky and horny anyway")J Sven Slootweg, low-spoons mode ("still kinky and horny anyway")

                            @firefoxwebdevs My closest answer would be "no", but I think the question is kind of mis-phrased here, and that's probably going to lead to a confusing and potentially misleading outcome.

                            The problem that people have is not with "AI" as a generalized category, but with the current generation of thieving, climate-destroying, grifting systems that are marketed as AI to an overwhelming degree - notably LLMs and "generative AI", but really anything with those inconsiderate properties.

                            If your kill switch is presented as an "AI kill switch", then depending on the person they're either going to understand that as "exploitative tech", or as "machine learning", and so make different assumptions as to whether local translation is included in that.

                            So I think you'll have to be a lot more explicit about what you mean; either by describing clearly what the kill-switch includes, or what it excludes, right in the place where the option is offered. Otherwise it's damned if you do, damned if you don't; depending on whether you include translations, either one or another group is going to be upset with the unexpected behaviour.

                            So, ethically, if the translation feature is built on ethically collected data, and it has no outsized climate impact, then I would not consider it something that needs to be included in a "get rid of all of it" kill switch. But to convey this clearly to users, both that and why it isn't included should be explained right there with the button, with potentially a second-step option to disable it anyway if someone still feels uncomfortable with it.

                            That way you've transparently communicated to users and shown that you have nothing up your sleeve by immediately and proactively offering them an option to disable that, too, if they have already shown interest in removing "AI" features.

                            Firefox for Web DevelopersF This user is from outside of this forum
                            Firefox for Web DevelopersF This user is from outside of this forum
                            Firefox for Web Developers
                            wrote last edited by
                            #126

                            @joepie91 yeah, I agree with all that, but even tech folks are asking for a way to 'get rid of AI'. I'm pretty certain if we tried to redefine what they're asking for, it would be received poorly.

                            Sven Slootweg, low-spoons mode ("still kinky and horny anyway")J F 2 Replies Last reply
                            0
                            • T twifkak

                              @tasket Perhaps. Show me what rights they have to it.

                              wyngmanT This user is from outside of this forum
                              wyngmanT This user is from outside of this forum
                              wyngman
                              wrote last edited by
                              #127

                              @twifkak They're using the "PD" mark, thus public domain.

                              wyngmanT misc 🦌A 2 Replies Last reply
                              0
                              • Firefox for Web DevelopersF Firefox for Web Developers

                                @joepie91 yeah, I agree with all that, but even tech folks are asking for a way to 'get rid of AI'. I'm pretty certain if we tried to redefine what they're asking for, it would be received poorly.

                                Sven Slootweg, low-spoons mode ("still kinky and horny anyway")J This user is from outside of this forum
                                Sven Slootweg, low-spoons mode ("still kinky and horny anyway")J This user is from outside of this forum
                                Sven Slootweg, low-spoons mode ("still kinky and horny anyway")
                                wrote last edited by
                                #128

                                @firefoxwebdevs That's exactly the motivation behind my suggestion, though - I've attached a mockup in an additional reply to hopefully make it clearer, but the idea here is to not redefine it so much as it is to explicitly pick a definition, and then provide an additional option for the broader definition, so that a user can essentially pick whichever definition they are following without getting into the technical weeds too much.

                                DeeAnn LittleC 1 Reply Last reply
                                0
                                • wyngmanT wyngman

                                  @twifkak They're using the "PD" mark, thus public domain.

                                  wyngmanT This user is from outside of this forum
                                  wyngmanT This user is from outside of this forum
                                  wyngman
                                  wrote last edited by
                                  #129

                                  @twifkak Also notice that Mastodon instances are using LibreTranslate.

                                  Has that been debated as well?

                                  bjoB 1 Reply Last reply
                                  0
                                  • Firefox for Web DevelopersF Firefox for Web Developers

                                    Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.

                                    They're not LLMs. They're trained on open data.

                                    Should translation be disabled if the AI 'kill switch' is active?

                                    Joshua BarrettoJ This user is from outside of this forum
                                    Joshua BarrettoJ This user is from outside of this forum
                                    Joshua Barretto
                                    wrote last edited by
                                    #130

                                    @firefoxwebdevs Automatic translations are good and an internet in which people don't feel like they can't speak their native tongue for fear of losing their audience can only be a good thing.

                                    Not sure how any reasonable person can believe that such a domain-specific model begets similar ethical objections as modern LLMs.

                                    You know, folks don't hate AI because they're scared of neural networks...

                                    1 Reply Last reply
                                    0
                                    • wyngmanT wyngman

                                      @twifkak They're using the "PD" mark, thus public domain.

                                      misc 🦌A This user is from outside of this forum
                                      misc 🦌A This user is from outside of this forum
                                      misc 🦌
                                      wrote last edited by
                                      #131

                                      @tasket @twifkak seems to me like that refers to the dataset, not to the source material. if the source material was truly public domain, that information is not easy for me to find.

                                      wyngmanT 1 Reply Last reply
                                      0
                                      • Firefox for Web DevelopersF Firefox for Web Developers

                                        Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.

                                        They're not LLMs. They're trained on open data.

                                        Should translation be disabled if the AI 'kill switch' is active?

                                        Willem JanssenW This user is from outside of this forum
                                        Willem JanssenW This user is from outside of this forum
                                        Willem Janssen
                                        wrote last edited by
                                        #132

                                        @firefoxwebdevs I’d say keep the translation thing and simply lose all the other LLM/GenAI/chatbot stuff altogether*. I think this is an excellent marketing opportunity. There are plenty of people highly skeptical of “AI”. This is a big market! You could be the next Brother, winning by refraining from shooting yourself in the foot (https://www.theverge.com/23642073/best-printer-2023-brother-laser-wi-fi-its-fine). And you’ll be ahead of the curve when The Bubble pops.
                                        I’m not kidding.

                                        (*they can still be opt in plugins)

                                        1 Reply Last reply
                                        0
                                        • RichardM Richard

                                          @firefoxwebdevs The frame of this question is risible.

                                          I am begging you to just make a web browser.

                                          Make it the best browser for the open web. Make it a browser that empowers individuals. Make it a browser that defends users against threats.

                                          Do not make a search engine. Do not make a translation engine. Do not make a webpage summariser. Do not make a front-end for an LLM. Do not make a client-side LLM.

                                          Just. Make. A. Web. Browser.

                                          Please.

                                          Marcus MüllerF This user is from outside of this forum
                                          Marcus MüllerF This user is from outside of this forum
                                          Marcus Müller
                                          wrote last edited by
                                          #133

                                          @m0rpk @firefoxwebdevs quite honestly, you're off the mark, **a lot**.
                                          A browser with a built-in translator is a door opener for the open web for so many people that don't read English well enough to benefit from the dominant corpus of technological, cultural and scientific websites.
                                          Firefox could indeed remove that functionality and instead of letting people translate websites on their phone make them use the google translate app that directly. Congrats on how you've advocated for the open web.

                                          RichardM 1 Reply Last reply
                                          0
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Don't have an account? Register

                                          • Login or register to search.
                                          Powered by NodeBB Contributors
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups