Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (Darkly)
  • No Skin
Collapse
Brand Logo
  1. Home
  2. Uncategorized
  3. Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.

Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.

Scheduled Pinned Locked Moved Uncategorized
289 Posts 146 Posters 0 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • Greg TatumG Greg Tatum

    @xela @firefoxwebdevs Translations involve either 1 or 2 models depending on the language pairs. Each language requires a model going into, and out of English. Training a language involves on the order of hundreds of GPU hours, and the largest models probably get into the thousands range. Early models were in the thousands range probably before we optimized things.

    Greg TatumG This user is from outside of this forum
    Greg TatumG This user is from outside of this forum
    Greg Tatum
    wrote last edited by
    #11

    @xela @firefoxwebdevs For on-device, the power usage is on the end-user, and the text in the viewport range is translated. It's heavy CPU work that is quickly finished. So you get short bursts of heavy CPU usage while actively interacting with a translated page. All the page content is private and stays on your machine.

    1 Reply Last reply
    0
    • Firefox for Web DevelopersF Firefox for Web Developers

      Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.

      They're not LLMs. They're trained on open data.

      Should translation be disabled if the AI 'kill switch' is active?

      VexV This user is from outside of this forum
      VexV This user is from outside of this forum
      Vex
      wrote last edited by
      #12

      @firefoxwebdevs nice try, but AI functions by breaking consent, & removing ML translations when shutting off AI won't get people to accept AI. Nobody who respects consent wants it, nor will ever want it.

      Why don't you skip ahead & have your "AI kill switch" simply uninstall Firefox while you're at it.

      We all know that's the inevitable conclusion.

      1 Reply Last reply
      0
      • Firefox for Web DevelopersF Firefox for Web Developers

        Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.

        They're not LLMs. They're trained on open data.

        Should translation be disabled if the AI 'kill switch' is active?

        Andrey [0xdc, 0x09];D This user is from outside of this forum
        Andrey [0xdc, 0x09];D This user is from outside of this forum
        Andrey [0xdc, 0x09];
        wrote last edited by
        #13

        @firefoxwebdevs
        Thank you for asking

        1 Reply Last reply
        0
        • Greg TatumG This user is from outside of this forum
          Greg TatumG This user is from outside of this forum
          Greg Tatum
          wrote last edited by
          #14

          @made @firefoxwebdevs There's already lots of work for on-device ML: https://searchfox.org/firefox-main/search?q=toolkit%2Fcomponents%2Fml

          Integrating models into a finalized product with the wide spectrum of end-user devices is tricky though, so it has to be done with care.

          Martin D.M 1 Reply Last reply
          0
          • Firefox for Web DevelopersF Firefox for Web Developers

            Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.

            They're not LLMs. They're trained on open data.

            Should translation be disabled if the AI 'kill switch' is active?

            Ray McCarthyR This user is from outside of this forum
            Ray McCarthyR This user is from outside of this forum
            Ray McCarthy
            wrote last edited by
            #15

            @firefoxwebdevs
            Unfortunately nothing by mozilla is now trustworthy.

            Just make a browser that is reliable, follows system theme / uI, has tabs attached to pages and doesn't make plug-ins obsolete. Even PDF should be OFF by default.

            It's been getting more broken every year.

            Forget integrating translations and AI.

            1 Reply Last reply
            0
            • Firefox for Web DevelopersF Firefox for Web Developers

              @zzt I posted this poll after a meeting where we discussed the design of the kill switch, and there was uncertainty around translations. I want to make sure the community's voice is represented in these discussions.

              Ray McCarthyR This user is from outside of this forum
              Ray McCarthyR This user is from outside of this forum
              Ray McCarthy
              wrote last edited by
              #16

              @firefoxwebdevs @zzt
              " I want to make sure the community's voice is represented in these discussions."

              Then KILL ALL The stupid non-browser functions.

              Remove ALL AI code.

              Make Firefox work.
              Fix printing,

              Make it follow system GUI / theme.

              Stop copying Chrome or Wiindows.

              Saphkey 🕊️S W6KMEW Keith Mitchell🏳️‍⚧️D 3 Replies Last reply
              0
              • shadowwwindS This user is from outside of this forum
                shadowwwindS This user is from outside of this forum
                shadowwwind
                wrote last edited by
                #17

                @tassoman @firefoxwebdevs the question is about the page translation feature, not chats.

                dpflugD 1 Reply Last reply
                0
                • [object Object]Z [object Object]

                  @firefoxwebdevs also, I just gotta ask: was the prompt for this quiz “hey ChatGPT come up with an ai use case that’ll stump the haters! do not hallucinate do not use emojis” or did this ooze out of your human brain after the LLM psychosis fried it?

                  shadowwwindS This user is from outside of this forum
                  shadowwwindS This user is from outside of this forum
                  shadowwwind
                  wrote last edited by
                  #18

                  @zzt @firefoxwebdevs that feature is in the works since at least 2019 and was released in Firefox 118 in September 2023
                  https://blog.mozilla.org/en/mozilla/local-translation-add-on-project-bergamot/

                  https://www.firefox.com/en-US/firefox/118.0/releasenotes/?redirect_source=mozilla-org

                  [object Object]Z 1 Reply Last reply
                  0
                  • Firefox for Web DevelopersF Firefox for Web Developers

                    Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.

                    They're not LLMs. They're trained on open data.

                    Should translation be disabled if the AI 'kill switch' is active?

                    Ted's Tech TipsT This user is from outside of this forum
                    Ted's Tech TipsT This user is from outside of this forum
                    Ted's Tech Tips
                    wrote last edited by
                    #19

                    @firefoxwebdevs Wow, lots of entirely unhelpful and frankly rude comments in this thread.

                    Thank you for actually taking the time to listen to user feedback, it's much appreciated! Personally, I think anything AI/ML/LLM should be included in the Kill Switch, but with the option to turn on each feature manually.

                    VexV nicolaottomanoN 2 Replies Last reply
                    0
                    • Firefox for Web DevelopersF Firefox for Web Developers

                      Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.

                      They're not LLMs. They're trained on open data.

                      Should translation be disabled if the AI 'kill switch' is active?

                      Stephen FarrugiaF This user is from outside of this forum
                      Stephen FarrugiaF This user is from outside of this forum
                      Stephen Farrugia
                      wrote last edited by
                      #20

                      @firefoxwebdevs it would be compelling to hear someone at Mozilla recognise that you don't have this "kill switch" yet but you're already facing the problem of what to kill.

                      It would also be compelling to hear someone at Mozilla recognise that there is a browser and there are browser extensions and that "translation" has nothing to do with the operating system of a web browser.

                      Stephen FarrugiaF 1 Reply Last reply
                      0
                      • Firefox for Web DevelopersF Firefox for Web Developers

                        Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.

                        They're not LLMs. They're trained on open data.

                        Should translation be disabled if the AI 'kill switch' is active?

                        Stuart LangridgeS This user is from outside of this forum
                        Stuart LangridgeS This user is from outside of this forum
                        Stuart Langridge
                        wrote last edited by
                        #21

                        @firefoxwebdevs it would be nice if the "AI kill switch" had:
                        a list of each of the models used, what for, and whether they're trained on open data, each having a "disable this" switch
                        a thing right at the top of the list which says "I don't care, kill all this AI stuff"

                        but that would require putting a list of all the different things that Firefox is now using AI for and whether each is using fair models or not, which I suspect a lot of management won't want to document clearly to users

                        John MaxwellJ 1 Reply Last reply
                        0
                        • Firefox for Web DevelopersF Firefox for Web Developers

                          Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.

                          They're not LLMs. They're trained on open data.

                          Should translation be disabled if the AI 'kill switch' is active?

                          KiwiTBK This user is from outside of this forum
                          KiwiTBK This user is from outside of this forum
                          KiwiTB
                          wrote last edited by
                          #22

                          @firefoxwebdevs you are missing the 'Or should we use common sense and just remove all the AI crap so we don't need a kill switch' option.

                          1 Reply Last reply
                          0
                          • Stephen FarrugiaF Stephen Farrugia

                            @firefoxwebdevs it would be compelling to hear someone at Mozilla recognise that you don't have this "kill switch" yet but you're already facing the problem of what to kill.

                            It would also be compelling to hear someone at Mozilla recognise that there is a browser and there are browser extensions and that "translation" has nothing to do with the operating system of a web browser.

                            Stephen FarrugiaF This user is from outside of this forum
                            Stephen FarrugiaF This user is from outside of this forum
                            Stephen Farrugia
                            wrote last edited by
                            #23

                            @firefoxwebdevs It would also be compelling if a team at Mozilla were dedicated to building the best browser translation add-on on the market, for all browsers. To promote the power of add-ons and, at the same time, the Mozilla brand.

                            Stephen FarrugiaF 1 Reply Last reply
                            0
                            • Firefox for Web DevelopersF Firefox for Web Developers

                              @zzt I posted this poll after a meeting where we discussed the design of the kill switch, and there was uncertainty around translations. I want to make sure the community's voice is represented in these discussions.

                              [object Object]Z This user is from outside of this forum
                              [object Object]Z This user is from outside of this forum
                              [object Object]
                              wrote last edited by
                              #24

                              @firefoxwebdevs jonah, I hate to break it to you and the LLM shaped like a product manager that’s setting the agenda for your meetings, but the only time I hear about Firefox translations in any context is when Mozilla PMs try to hold it up as an example of an ethical, low-resource, useful AI feature so they can convince to be a fan of the worthless LLM shit they’re actually there to push

                              the reason why I don’t hear about translations otherwise is simple: it’s shit

                              [object Object]Z Stephen FarrugiaF wyngmanT HiddeH 5 Replies Last reply
                              0
                              • Stephen FarrugiaF Stephen Farrugia

                                @firefoxwebdevs It would also be compelling if a team at Mozilla were dedicated to building the best browser translation add-on on the market, for all browsers. To promote the power of add-ons and, at the same time, the Mozilla brand.

                                Stephen FarrugiaF This user is from outside of this forum
                                Stephen FarrugiaF This user is from outside of this forum
                                Stephen Farrugia
                                wrote last edited by
                                #25

                                @firefoxwebdevs it would be compelling if the future of Firefox was to be the fastest, most secure, most efficient browser engine with the best add-on ecosystem.

                                It would also be compelling to hear someone from Mozilla talk about their design effort to improve add-on adoption rather than forcing add-on-level-functionality into the core product

                                1 Reply Last reply
                                0
                                • [object Object]Z [object Object]

                                  @firefoxwebdevs jonah, I hate to break it to you and the LLM shaped like a product manager that’s setting the agenda for your meetings, but the only time I hear about Firefox translations in any context is when Mozilla PMs try to hold it up as an example of an ethical, low-resource, useful AI feature so they can convince to be a fan of the worthless LLM shit they’re actually there to push

                                  the reason why I don’t hear about translations otherwise is simple: it’s shit

                                  [object Object]Z This user is from outside of this forum
                                  [object Object]Z This user is from outside of this forum
                                  [object Object]
                                  wrote last edited by
                                  #26

                                  @firefoxwebdevs neither translations nor any LLM feature have any business being built into Firefox. they should all be add-ons, at best. preferably add-ons developed by any other company than Mozilla. nobody wanted their donations to go to this crap.

                                  like with translations, anyone who feels like they need LLM horseshit in their browser is very likely already using an implementation other than the one built into Firefox.

                                  1 Reply Last reply
                                  0
                                  • shadowwwindS shadowwwind

                                    @zzt @firefoxwebdevs that feature is in the works since at least 2019 and was released in Firefox 118 in September 2023
                                    https://blog.mozilla.org/en/mozilla/local-translation-add-on-project-bergamot/

                                    https://www.firefox.com/en-US/firefox/118.0/releasenotes/?redirect_source=mozilla-org

                                    [object Object]Z This user is from outside of this forum
                                    [object Object]Z This user is from outside of this forum
                                    [object Object]
                                    wrote last edited by
                                    #27

                                    @shadowwwind @firefoxwebdevs pardon me? did you reply to the wrong post?

                                    shadowwwindS 1 Reply Last reply
                                    0
                                    • Ted's Tech TipsT Ted's Tech Tips

                                      @firefoxwebdevs Wow, lots of entirely unhelpful and frankly rude comments in this thread.

                                      Thank you for actually taking the time to listen to user feedback, it's much appreciated! Personally, I think anything AI/ML/LLM should be included in the Kill Switch, but with the option to turn on each feature manually.

                                      VexV This user is from outside of this forum
                                      VexV This user is from outside of this forum
                                      Vex
                                      wrote last edited by
                                      #28

                                      @tedstechtips @firefoxwebdevs Seriously! How rude of people to react so negatively to the consent breaking machine being added to Firefox, against user consent! Acting like Firefox already broke users' consent or something. So rude!!!

                                      The nice & totally respectful folks at Firefox are even asking what features they can plausibly hold hostage, to get us to give up consent ahead of time! So nice of them!!!

                                      It's not like users of a privacy focused browser would care about something like consent anyways. So weird!!!

                                      1 Reply Last reply
                                      0
                                      • [object Object]Z [object Object]

                                        @firefoxwebdevs jonah, I hate to break it to you and the LLM shaped like a product manager that’s setting the agenda for your meetings, but the only time I hear about Firefox translations in any context is when Mozilla PMs try to hold it up as an example of an ethical, low-resource, useful AI feature so they can convince to be a fan of the worthless LLM shit they’re actually there to push

                                        the reason why I don’t hear about translations otherwise is simple: it’s shit

                                        Stephen FarrugiaF This user is from outside of this forum
                                        Stephen FarrugiaF This user is from outside of this forum
                                        Stephen Farrugia
                                        wrote last edited by
                                        #29

                                        @zzt @firefoxwebdevs Why would Mozilla translations be built into the browser but other developers have to make them as add-ons? Or will Mozilla accept PRs for third-party translators to be built into the Firefox browser?

                                        [object Object]Z Stephen FarrugiaF 2 Replies Last reply
                                        0
                                        • [object Object]Z [object Object]

                                          @shadowwwind @firefoxwebdevs pardon me? did you reply to the wrong post?

                                          shadowwwindS This user is from outside of this forum
                                          shadowwwindS This user is from outside of this forum
                                          shadowwwind
                                          wrote last edited by
                                          #30

                                          @zzt @firefoxwebdevs the translation feature is older than ChatGPT's release.
                                          It was not made up for this quiz to annoy AI haters.
                                          Its been there. For a while.
                                          It uses technology that probably falls under the umbrella term "AI".
                                          And the people creating the AI kill switch are not sure if it should be toggled by it.
                                          So the ask the community.
                                          This is the weirdest recent Mozilla post to hate on.

                                          [object Object]Z 2 Replies Last reply
                                          0
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Don't have an account? Register

                                          • Login or register to search.
                                          Powered by NodeBB Contributors
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups