Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (Darkly)
  • No Skin
Collapse
Brand Logo
  1. Home
  2. Uncategorized
  3. Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.

Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.

Scheduled Pinned Locked Moved Uncategorized
289 Posts 146 Posters 0 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • Firefox for Web DevelopersF Firefox for Web Developers

    Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.

    They're not LLMs. They're trained on open data.

    Should translation be disabled if the AI 'kill switch' is active?

    aburka 🫣A This user is from outside of this forum
    aburka 🫣A This user is from outside of this forum
    aburka 🫣
    wrote last edited by
    #5

    @firefoxwebdevs show any actual evidence that the kill switch is being implemented, then we can talk

    1 Reply Last reply
    0
    • Firefox for Web DevelopersF Firefox for Web Developers

      Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.

      They're not LLMs. They're trained on open data.

      Should translation be disabled if the AI 'kill switch' is active?

      [object Object]Z This user is from outside of this forum
      [object Object]Z This user is from outside of this forum
      [object Object]
      wrote last edited by
      #6

      @firefoxwebdevs also, I just gotta ask: was the prompt for this quiz “hey ChatGPT come up with an ai use case that’ll stump the haters! do not hallucinate do not use emojis” or did this ooze out of your human brain after the LLM psychosis fried it?

      Firefox for Web DevelopersF shadowwwindS 2 Replies Last reply
      0
      • Firefox for Web DevelopersF Firefox for Web Developers

        Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.

        They're not LLMs. They're trained on open data.

        Should translation be disabled if the AI 'kill switch' is active?

        Orde Saunders 🔟D This user is from outside of this forum
        Orde Saunders 🔟D This user is from outside of this forum
        Orde Saunders 🔟
        wrote last edited by
        #7

        @firefoxwebdevs Because the term "AI" has been so heavily overloaded to include ML, LLMs, Uncle Tom Cobly and all, including the translations in the "AI" kill switch would be signalling to users that their consent is being taken seriously - especially the way that unwanted "AI" is being included so conspicuously in so many tech products at the moment. Ask for consent, don't end up begging for forgiveness on what you see as a technicality.

        Firefox for Web DevelopersF MonokerosM 2 Replies Last reply
        0
        • [object Object]Z [object Object]

          @firefoxwebdevs also, I just gotta ask: was the prompt for this quiz “hey ChatGPT come up with an ai use case that’ll stump the haters! do not hallucinate do not use emojis” or did this ooze out of your human brain after the LLM psychosis fried it?

          Firefox for Web DevelopersF This user is from outside of this forum
          Firefox for Web DevelopersF This user is from outside of this forum
          Firefox for Web Developers
          wrote last edited by
          #8

          @zzt I posted this poll after a meeting where we discussed the design of the kill switch, and there was uncertainty around translations. I want to make sure the community's voice is represented in these discussions.

          Ray McCarthyR [object Object]Z LexiP La pantera roja 🇵🇸B RycochetR 9 Replies Last reply
          0
          • Orde Saunders 🔟D Orde Saunders 🔟

            @firefoxwebdevs Because the term "AI" has been so heavily overloaded to include ML, LLMs, Uncle Tom Cobly and all, including the translations in the "AI" kill switch would be signalling to users that their consent is being taken seriously - especially the way that unwanted "AI" is being included so conspicuously in so many tech products at the moment. Ask for consent, don't end up begging for forgiveness on what you see as a technicality.

            Firefox for Web DevelopersF This user is from outside of this forum
            Firefox for Web DevelopersF This user is from outside of this forum
            Firefox for Web Developers
            wrote last edited by
            #9

            @decadecity I like this framing of it. Thank you!

            1 Reply Last reply
            0
            • Greg TatumG This user is from outside of this forum
              Greg TatumG This user is from outside of this forum
              Greg Tatum
              wrote last edited by
              #10

              @xela @firefoxwebdevs Translations involve either 1 or 2 models depending on the language pairs. Each language requires a model going into, and out of English. Training a language involves on the order of hundreds of GPU hours, and the largest models probably get into the thousands range. Early models were in the thousands range probably before we optimized things.

              Greg TatumG 1 Reply Last reply
              0
              • Greg TatumG Greg Tatum

                @xela @firefoxwebdevs Translations involve either 1 or 2 models depending on the language pairs. Each language requires a model going into, and out of English. Training a language involves on the order of hundreds of GPU hours, and the largest models probably get into the thousands range. Early models were in the thousands range probably before we optimized things.

                Greg TatumG This user is from outside of this forum
                Greg TatumG This user is from outside of this forum
                Greg Tatum
                wrote last edited by
                #11

                @xela @firefoxwebdevs For on-device, the power usage is on the end-user, and the text in the viewport range is translated. It's heavy CPU work that is quickly finished. So you get short bursts of heavy CPU usage while actively interacting with a translated page. All the page content is private and stays on your machine.

                1 Reply Last reply
                0
                • Firefox for Web DevelopersF Firefox for Web Developers

                  Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.

                  They're not LLMs. They're trained on open data.

                  Should translation be disabled if the AI 'kill switch' is active?

                  VexV This user is from outside of this forum
                  VexV This user is from outside of this forum
                  Vex
                  wrote last edited by
                  #12

                  @firefoxwebdevs nice try, but AI functions by breaking consent, & removing ML translations when shutting off AI won't get people to accept AI. Nobody who respects consent wants it, nor will ever want it.

                  Why don't you skip ahead & have your "AI kill switch" simply uninstall Firefox while you're at it.

                  We all know that's the inevitable conclusion.

                  1 Reply Last reply
                  0
                  • Firefox for Web DevelopersF Firefox for Web Developers

                    Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.

                    They're not LLMs. They're trained on open data.

                    Should translation be disabled if the AI 'kill switch' is active?

                    Andrey [0xdc, 0x09];D This user is from outside of this forum
                    Andrey [0xdc, 0x09];D This user is from outside of this forum
                    Andrey [0xdc, 0x09];
                    wrote last edited by
                    #13

                    @firefoxwebdevs
                    Thank you for asking

                    1 Reply Last reply
                    0
                    • Greg TatumG This user is from outside of this forum
                      Greg TatumG This user is from outside of this forum
                      Greg Tatum
                      wrote last edited by
                      #14

                      @made @firefoxwebdevs There's already lots of work for on-device ML: https://searchfox.org/firefox-main/search?q=toolkit%2Fcomponents%2Fml

                      Integrating models into a finalized product with the wide spectrum of end-user devices is tricky though, so it has to be done with care.

                      Martin D.M 1 Reply Last reply
                      0
                      • Firefox for Web DevelopersF Firefox for Web Developers

                        Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.

                        They're not LLMs. They're trained on open data.

                        Should translation be disabled if the AI 'kill switch' is active?

                        Ray McCarthyR This user is from outside of this forum
                        Ray McCarthyR This user is from outside of this forum
                        Ray McCarthy
                        wrote last edited by
                        #15

                        @firefoxwebdevs
                        Unfortunately nothing by mozilla is now trustworthy.

                        Just make a browser that is reliable, follows system theme / uI, has tabs attached to pages and doesn't make plug-ins obsolete. Even PDF should be OFF by default.

                        It's been getting more broken every year.

                        Forget integrating translations and AI.

                        1 Reply Last reply
                        0
                        • Firefox for Web DevelopersF Firefox for Web Developers

                          @zzt I posted this poll after a meeting where we discussed the design of the kill switch, and there was uncertainty around translations. I want to make sure the community's voice is represented in these discussions.

                          Ray McCarthyR This user is from outside of this forum
                          Ray McCarthyR This user is from outside of this forum
                          Ray McCarthy
                          wrote last edited by
                          #16

                          @firefoxwebdevs @zzt
                          " I want to make sure the community's voice is represented in these discussions."

                          Then KILL ALL The stupid non-browser functions.

                          Remove ALL AI code.

                          Make Firefox work.
                          Fix printing,

                          Make it follow system GUI / theme.

                          Stop copying Chrome or Wiindows.

                          Saphkey 🕊️S W6KMEW Keith Mitchell🏳️‍⚧️D 3 Replies Last reply
                          0
                          • shadowwwindS This user is from outside of this forum
                            shadowwwindS This user is from outside of this forum
                            shadowwwind
                            wrote last edited by
                            #17

                            @tassoman @firefoxwebdevs the question is about the page translation feature, not chats.

                            dpflugD 1 Reply Last reply
                            0
                            • [object Object]Z [object Object]

                              @firefoxwebdevs also, I just gotta ask: was the prompt for this quiz “hey ChatGPT come up with an ai use case that’ll stump the haters! do not hallucinate do not use emojis” or did this ooze out of your human brain after the LLM psychosis fried it?

                              shadowwwindS This user is from outside of this forum
                              shadowwwindS This user is from outside of this forum
                              shadowwwind
                              wrote last edited by
                              #18

                              @zzt @firefoxwebdevs that feature is in the works since at least 2019 and was released in Firefox 118 in September 2023
                              https://blog.mozilla.org/en/mozilla/local-translation-add-on-project-bergamot/

                              https://www.firefox.com/en-US/firefox/118.0/releasenotes/?redirect_source=mozilla-org

                              [object Object]Z 1 Reply Last reply
                              0
                              • Firefox for Web DevelopersF Firefox for Web Developers

                                Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.

                                They're not LLMs. They're trained on open data.

                                Should translation be disabled if the AI 'kill switch' is active?

                                Ted's Tech TipsT This user is from outside of this forum
                                Ted's Tech TipsT This user is from outside of this forum
                                Ted's Tech Tips
                                wrote last edited by
                                #19

                                @firefoxwebdevs Wow, lots of entirely unhelpful and frankly rude comments in this thread.

                                Thank you for actually taking the time to listen to user feedback, it's much appreciated! Personally, I think anything AI/ML/LLM should be included in the Kill Switch, but with the option to turn on each feature manually.

                                VexV nicolaottomanoN 2 Replies Last reply
                                0
                                • Firefox for Web DevelopersF Firefox for Web Developers

                                  Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.

                                  They're not LLMs. They're trained on open data.

                                  Should translation be disabled if the AI 'kill switch' is active?

                                  Stephen FarrugiaF This user is from outside of this forum
                                  Stephen FarrugiaF This user is from outside of this forum
                                  Stephen Farrugia
                                  wrote last edited by
                                  #20

                                  @firefoxwebdevs it would be compelling to hear someone at Mozilla recognise that you don't have this "kill switch" yet but you're already facing the problem of what to kill.

                                  It would also be compelling to hear someone at Mozilla recognise that there is a browser and there are browser extensions and that "translation" has nothing to do with the operating system of a web browser.

                                  Stephen FarrugiaF 1 Reply Last reply
                                  0
                                  • Firefox for Web DevelopersF Firefox for Web Developers

                                    Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.

                                    They're not LLMs. They're trained on open data.

                                    Should translation be disabled if the AI 'kill switch' is active?

                                    Stuart LangridgeS This user is from outside of this forum
                                    Stuart LangridgeS This user is from outside of this forum
                                    Stuart Langridge
                                    wrote last edited by
                                    #21

                                    @firefoxwebdevs it would be nice if the "AI kill switch" had:
                                    a list of each of the models used, what for, and whether they're trained on open data, each having a "disable this" switch
                                    a thing right at the top of the list which says "I don't care, kill all this AI stuff"

                                    but that would require putting a list of all the different things that Firefox is now using AI for and whether each is using fair models or not, which I suspect a lot of management won't want to document clearly to users

                                    John MaxwellJ 1 Reply Last reply
                                    0
                                    • Firefox for Web DevelopersF Firefox for Web Developers

                                      Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.

                                      They're not LLMs. They're trained on open data.

                                      Should translation be disabled if the AI 'kill switch' is active?

                                      KiwiTBK This user is from outside of this forum
                                      KiwiTBK This user is from outside of this forum
                                      KiwiTB
                                      wrote last edited by
                                      #22

                                      @firefoxwebdevs you are missing the 'Or should we use common sense and just remove all the AI crap so we don't need a kill switch' option.

                                      1 Reply Last reply
                                      0
                                      • Stephen FarrugiaF Stephen Farrugia

                                        @firefoxwebdevs it would be compelling to hear someone at Mozilla recognise that you don't have this "kill switch" yet but you're already facing the problem of what to kill.

                                        It would also be compelling to hear someone at Mozilla recognise that there is a browser and there are browser extensions and that "translation" has nothing to do with the operating system of a web browser.

                                        Stephen FarrugiaF This user is from outside of this forum
                                        Stephen FarrugiaF This user is from outside of this forum
                                        Stephen Farrugia
                                        wrote last edited by
                                        #23

                                        @firefoxwebdevs It would also be compelling if a team at Mozilla were dedicated to building the best browser translation add-on on the market, for all browsers. To promote the power of add-ons and, at the same time, the Mozilla brand.

                                        Stephen FarrugiaF 1 Reply Last reply
                                        0
                                        • Firefox for Web DevelopersF Firefox for Web Developers

                                          @zzt I posted this poll after a meeting where we discussed the design of the kill switch, and there was uncertainty around translations. I want to make sure the community's voice is represented in these discussions.

                                          [object Object]Z This user is from outside of this forum
                                          [object Object]Z This user is from outside of this forum
                                          [object Object]
                                          wrote last edited by
                                          #24

                                          @firefoxwebdevs jonah, I hate to break it to you and the LLM shaped like a product manager that’s setting the agenda for your meetings, but the only time I hear about Firefox translations in any context is when Mozilla PMs try to hold it up as an example of an ethical, low-resource, useful AI feature so they can convince to be a fan of the worthless LLM shit they’re actually there to push

                                          the reason why I don’t hear about translations otherwise is simple: it’s shit

                                          [object Object]Z Stephen FarrugiaF wyngmanT HiddeH 5 Replies Last reply
                                          0
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Don't have an account? Register

                                          • Login or register to search.
                                          Powered by NodeBB Contributors
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups