Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (Darkly)
  • No Skin
Collapse
Brand Logo
  1. Home
  2. Uncategorized
  3. Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.

Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.

Scheduled Pinned Locked Moved Uncategorized
289 Posts 146 Posters 0 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • David GerardD David Gerard

    @zzt @firefoxwebdevs i'll have you know i'm at least 75%* hinged

    * vibe estimate, but we carefully graphed it so it's data now

    [object Object]Z This user is from outside of this forum
    [object Object]Z This user is from outside of this forum
    [object Object]
    wrote last edited by
    #112

    @davidgerard @firefoxwebdevs I know you, you’ve read much worse things than the necronomicon

    you’ve written wiki articles about most of them

    David GerardD 1 Reply Last reply
    0
    • Firefox for Web DevelopersF Firefox for Web Developers

      Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.

      They're not LLMs. They're trained on open data.

      Should translation be disabled if the AI 'kill switch' is active?

      Jane DoeJ This user is from outside of this forum
      Jane DoeJ This user is from outside of this forum
      Jane Doe
      wrote last edited by
      #113

      @firefoxwebdevs Of course, ML translation suffers many of the same problems. Also, why are you integrating translation as a core browser feature? Seems more like an extension feature.

      1 Reply Last reply
      0
      • Firefox for Web DevelopersF Firefox for Web Developers

        Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.

        They're not LLMs. They're trained on open data.

        Should translation be disabled if the AI 'kill switch' is active?

        tayeT This user is from outside of this forum
        tayeT This user is from outside of this forum
        taye
        wrote last edited by
        #114

        @firefoxwebdevs Thanks for involving the community in this! I've found the translation feature really useful even if the results aren't state-of-the-art!

        I agree with other commenters that there's an issue with the term "AI", but I don't have any suggestions.

        To match my current preferneces, I would like an AI kill switch to keep translations with local models, but disable LLM chatbots, summarizers, and agents.

        1 Reply Last reply
        0
        • [object Object]Z [object Object]

          @davidgerard @firefoxwebdevs I know you, you’ve read much worse things than the necronomicon

          you’ve written wiki articles about most of them

          David GerardD This user is from outside of this forum
          David GerardD This user is from outside of this forum
          David Gerard
          wrote last edited by
          #115

          @zzt @firefoxwebdevs firefox translate is to blame, arrest that instead

          1 Reply Last reply
          0
          • Gaëtan PerraultG Gaëtan Perrault

            @firefoxwebdevs

            I think the challenge with everything going on here is one of clarity.

            @sil, you are asking them about disclosure of models and sourcing. But that is far from the only AI that is in the system.

            The tool that does grammar checking and language identification does not leverage an LLM, and while there may be some type of model underneath, the context is very different. Tools that detect spam pages or faulty JavaScript that locks the pages, that's another type of AI hard at work.

            Is the browser allowed to support speech to text?

            @jmax You're calling out that Firefox may not be able to do this, but I think that mischaracterizes the scope of what's happening here.

            The browser has several types of non-deterministic, probabilistic tools in it that provide useful services. Now there's a backlash against one very specific version of those non-deterministic, probabilistic tools. But the backlash is vociferous, often unsolvable, and incredibly broad.

            It's hard to engage with non-specific anger.

            MonokerosM This user is from outside of this forum
            MonokerosM This user is from outside of this forum
            Monokeros
            wrote last edited by
            #116

            @gatesvp @firefoxwebdevs @sil @jmax They could engage with the nonspecific anger by removing the VERY SPECIFIC technologies at issue

            Instead they want to make us argue about "well, if we haul away the shit, do you want us to haul away the bark dust, too? Some people need bark dust, so you have to let us smear shit all over everything"

            1 Reply Last reply
            0
            • mage_of_dragonsM mage_of_dragons

              @cassidy @firefoxwebdevs The term "AI" has existed since 1956 so of course it's going to have a very broad definition.

              Things don't just stop being "AI" when AI researchers invent newer "more AI" stuff.

              MonokerosM This user is from outside of this forum
              MonokerosM This user is from outside of this forum
              Monokeros
              wrote last edited by
              #117

              @mage_of_dragons @cassidy @firefoxwebdevs We also know exactly what lies in store for the current slate of AI: 20 years of funding drought, just like all its ancestors

              1 Reply Last reply
              0
              • wyngmanT wyngman

                @twifkak Wouldn't that be a valid working definition of "open"?

                T This user is from outside of this forum
                T This user is from outside of this forum
                twifkak
                wrote last edited by
                #118

                @tasket It would be, much in the way that "guaranteed not to turn pink in the can" is a valid description of bad salmon [1]. A disingenuous mislead from what people really care about in the product.

                [1] I know it didn't happen. It's a good metaphor.

                wyngmanT 1 Reply Last reply
                0
                • Firefox for Web DevelopersF Firefox for Web Developers

                  Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.

                  They're not LLMs. They're trained on open data.

                  Should translation be disabled if the AI 'kill switch' is active?

                  Sven Slootweg, low-spoons mode ("still kinky and horny anyway")J This user is from outside of this forum
                  Sven Slootweg, low-spoons mode ("still kinky and horny anyway")J This user is from outside of this forum
                  Sven Slootweg, low-spoons mode ("still kinky and horny anyway")
                  wrote last edited by
                  #119

                  @firefoxwebdevs My closest answer would be "no", but I think the question is kind of mis-phrased here, and that's probably going to lead to a confusing and potentially misleading outcome.

                  The problem that people have is not with "AI" as a generalized category, but with the current generation of thieving, climate-destroying, grifting systems that are marketed as AI to an overwhelming degree - notably LLMs and "generative AI", but really anything with those inconsiderate properties.

                  If your kill switch is presented as an "AI kill switch", then depending on the person they're either going to understand that as "exploitative tech", or as "machine learning", and so make different assumptions as to whether local translation is included in that.

                  So I think you'll have to be a lot more explicit about what you mean; either by describing clearly what the kill-switch includes, or what it excludes, right in the place where the option is offered. Otherwise it's damned if you do, damned if you don't; depending on whether you include translations, either one or another group is going to be upset with the unexpected behaviour.

                  So, ethically, if the translation feature is built on ethically collected data, and it has no outsized climate impact, then I would not consider it something that needs to be included in a "get rid of all of it" kill switch. But to convey this clearly to users, both that and why it isn't included should be explained right there with the button, with potentially a second-step option to disable it anyway if someone still feels uncomfortable with it.

                  That way you've transparently communicated to users and shown that you have nothing up your sleeve by immediately and proactively offering them an option to disable that, too, if they have already shown interest in removing "AI" features.

                  Firefox for Web DevelopersF 1 Reply Last reply
                  0
                  • T twifkak

                    @tasket It would be, much in the way that "guaranteed not to turn pink in the can" is a valid description of bad salmon [1]. A disingenuous mislead from what people really care about in the product.

                    [1] I know it didn't happen. It's a good metaphor.

                    wyngmanT This user is from outside of this forum
                    wyngmanT This user is from outside of this forum
                    wyngman
                    wrote last edited by
                    #120

                    @twifkak I think you're mixing up "We do not own" with "We do not have rights to". 🤷

                    T 1 Reply Last reply
                    0
                    • Firefox for Web DevelopersF Firefox for Web Developers

                      Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.

                      They're not LLMs. They're trained on open data.

                      Should translation be disabled if the AI 'kill switch' is active?

                      sb   arms & legsS This user is from outside of this forum
                      sb   arms & legsS This user is from outside of this forum
                      sb arms & legs
                      wrote last edited by
                      #121

                      @firefoxwebdevs
                      Y'all know as well as we do this feature-creep junk belongs in extensions - if anywhere at all. It does NOT belong in or anywhere near core.

                      Please keep the world's browser lean and healthy and strong. We need all the help we can get.

                      1 Reply Last reply
                      0
                      • George Liquor, AmericanL George Liquor, American

                        @zzt @pixel @firefoxwebdevs "Nobody likes our product any longer, but at least we never had to entertain any *shudder* critical feedback."

                        Stephen FarrugiaF This user is from outside of this forum
                        Stephen FarrugiaF This user is from outside of this forum
                        Stephen Farrugia
                        wrote last edited by
                        #122

                        @liquor_american @zzt @pixel @firefoxwebdevs As the only remaining cross-platform browser that is not chromium, Mozilla deserves nothing but pressure to do better. Defending Mozilla about anything other than making Gecko better is giving them permission to eventually be just another chromium skin

                        1 Reply Last reply
                        0
                        • [object Object]Z [object Object]

                          @firefoxwebdevs an important addendum regarding Firefox translate: by my math (N = my replies), 25% of its users are fucking unhinged

                          I told them not to use the necronomicon to train the base model but here we fucking are

                          Albert ARIBAUD ⓂA This user is from outside of this forum
                          Albert ARIBAUD ⓂA This user is from outside of this forum
                          Albert ARIBAUD Ⓜ
                          wrote last edited by
                          #123

                          @zzt @firefoxwebdevs Sorry, but I just cannot escape the call for #ShamelessPlug (though, as usual, #IHaveNothingToSell😞

                          https://mastodon.art/@aaribaud/110721997413550131

                          1 Reply Last reply
                          0
                          • wyngmanT wyngman

                            @twifkak I think you're mixing up "We do not own" with "We do not have rights to". 🤷

                            T This user is from outside of this forum
                            T This user is from outside of this forum
                            twifkak
                            wrote last edited by
                            #124

                            @tasket Perhaps. Show me what rights they have to it.

                            wyngmanT 1 Reply Last reply
                            0
                            • George Liquor, AmericanL George Liquor, American

                              @wes @firefoxwebdevs Sure. But can we agree that it does not represent a core functionality of a web browser?

                              Like "this meeting could've been an email," but "this feature could've been an add-on."

                              A web browser should load web pages, allow you to interact with them, and offer add-on support for functionality that doesn't match the definition of "web browser." It's all pretty straight-forward if you're not a marketer, whose brains are all broken.

                              CpyJx 🍉C This user is from outside of this forum
                              CpyJx 🍉C This user is from outside of this forum
                              CpyJx 🍉
                              wrote last edited by
                              #125

                              > A web browser should load web pages, allow you to interact with them ...

                              I would point out that translating a web page written in a non-native language allows me to interact with said page. Your argument can go both ways.

                              1 Reply Last reply
                              0
                              • Sven Slootweg, low-spoons mode ("still kinky and horny anyway")J Sven Slootweg, low-spoons mode ("still kinky and horny anyway")

                                @firefoxwebdevs My closest answer would be "no", but I think the question is kind of mis-phrased here, and that's probably going to lead to a confusing and potentially misleading outcome.

                                The problem that people have is not with "AI" as a generalized category, but with the current generation of thieving, climate-destroying, grifting systems that are marketed as AI to an overwhelming degree - notably LLMs and "generative AI", but really anything with those inconsiderate properties.

                                If your kill switch is presented as an "AI kill switch", then depending on the person they're either going to understand that as "exploitative tech", or as "machine learning", and so make different assumptions as to whether local translation is included in that.

                                So I think you'll have to be a lot more explicit about what you mean; either by describing clearly what the kill-switch includes, or what it excludes, right in the place where the option is offered. Otherwise it's damned if you do, damned if you don't; depending on whether you include translations, either one or another group is going to be upset with the unexpected behaviour.

                                So, ethically, if the translation feature is built on ethically collected data, and it has no outsized climate impact, then I would not consider it something that needs to be included in a "get rid of all of it" kill switch. But to convey this clearly to users, both that and why it isn't included should be explained right there with the button, with potentially a second-step option to disable it anyway if someone still feels uncomfortable with it.

                                That way you've transparently communicated to users and shown that you have nothing up your sleeve by immediately and proactively offering them an option to disable that, too, if they have already shown interest in removing "AI" features.

                                Firefox for Web DevelopersF This user is from outside of this forum
                                Firefox for Web DevelopersF This user is from outside of this forum
                                Firefox for Web Developers
                                wrote last edited by
                                #126

                                @joepie91 yeah, I agree with all that, but even tech folks are asking for a way to 'get rid of AI'. I'm pretty certain if we tried to redefine what they're asking for, it would be received poorly.

                                Sven Slootweg, low-spoons mode ("still kinky and horny anyway")J F 2 Replies Last reply
                                0
                                • T twifkak

                                  @tasket Perhaps. Show me what rights they have to it.

                                  wyngmanT This user is from outside of this forum
                                  wyngmanT This user is from outside of this forum
                                  wyngman
                                  wrote last edited by
                                  #127

                                  @twifkak They're using the "PD" mark, thus public domain.

                                  wyngmanT misc 🦌A 2 Replies Last reply
                                  0
                                  • Firefox for Web DevelopersF Firefox for Web Developers

                                    @joepie91 yeah, I agree with all that, but even tech folks are asking for a way to 'get rid of AI'. I'm pretty certain if we tried to redefine what they're asking for, it would be received poorly.

                                    Sven Slootweg, low-spoons mode ("still kinky and horny anyway")J This user is from outside of this forum
                                    Sven Slootweg, low-spoons mode ("still kinky and horny anyway")J This user is from outside of this forum
                                    Sven Slootweg, low-spoons mode ("still kinky and horny anyway")
                                    wrote last edited by
                                    #128

                                    @firefoxwebdevs That's exactly the motivation behind my suggestion, though - I've attached a mockup in an additional reply to hopefully make it clearer, but the idea here is to not redefine it so much as it is to explicitly pick a definition, and then provide an additional option for the broader definition, so that a user can essentially pick whichever definition they are following without getting into the technical weeds too much.

                                    DeeAnn LittleC 1 Reply Last reply
                                    0
                                    • wyngmanT wyngman

                                      @twifkak They're using the "PD" mark, thus public domain.

                                      wyngmanT This user is from outside of this forum
                                      wyngmanT This user is from outside of this forum
                                      wyngman
                                      wrote last edited by
                                      #129

                                      @twifkak Also notice that Mastodon instances are using LibreTranslate.

                                      Has that been debated as well?

                                      bjoB 1 Reply Last reply
                                      0
                                      • Firefox for Web DevelopersF Firefox for Web Developers

                                        Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.

                                        They're not LLMs. They're trained on open data.

                                        Should translation be disabled if the AI 'kill switch' is active?

                                        Joshua BarrettoJ This user is from outside of this forum
                                        Joshua BarrettoJ This user is from outside of this forum
                                        Joshua Barretto
                                        wrote last edited by
                                        #130

                                        @firefoxwebdevs Automatic translations are good and an internet in which people don't feel like they can't speak their native tongue for fear of losing their audience can only be a good thing.

                                        Not sure how any reasonable person can believe that such a domain-specific model begets similar ethical objections as modern LLMs.

                                        You know, folks don't hate AI because they're scared of neural networks...

                                        1 Reply Last reply
                                        0
                                        • wyngmanT wyngman

                                          @twifkak They're using the "PD" mark, thus public domain.

                                          misc 🦌A This user is from outside of this forum
                                          misc 🦌A This user is from outside of this forum
                                          misc 🦌
                                          wrote last edited by
                                          #131

                                          @tasket @twifkak seems to me like that refers to the dataset, not to the source material. if the source material was truly public domain, that information is not easy for me to find.

                                          wyngmanT 1 Reply Last reply
                                          0
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Don't have an account? Register

                                          • Login or register to search.
                                          Powered by NodeBB Contributors
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups