{"id":14709,"date":"2024-04-03T11:13:12","date_gmt":"2024-04-03T11:13:12","guid":{"rendered":"http:\/\/TheNextWeb=1405369"},"modified":"2024-04-03T11:13:12","modified_gmt":"2024-04-03T11:13:12","slug":"opera-is-now-the-first-leading-browser-with-built-in-local-llms","status":"publish","type":"post","link":"https:\/\/www.londonchiropracter.com\/?p=14709","title":{"rendered":"Opera is now the first leading browser with built-in local LLMs"},"content":{"rendered":"\n

Opera now becomes the first major browser to offer built-in access to local AI<\/a> models.<\/p>\n

Starting today, the Oslo-based company is introducing experimental support for 150 variants of local Large Language Models (LLMs), covering approximately 50 families. These include Mixtral from Mistral AI, Llama from Meta, Gemma from Google, and Vicuna.<\/p>\n

The introduction of built-in local LLMs come with a series of advantages, according to Jan Standal, VP at Opera. <\/span><\/p>\n

\u201cLocal LLMs allow you to process your prompts directly on your machine, without the need to send data to a server,\u201d Standal told TNW. \u201c<\/span>Adding access to them in the browser allows for easier access to local AI and gives our users the ability to process their prompts locally, in full privacy or even offline.\u201d<\/span><\/p>\n

\n
\n
<\/div>\n

\n

The <3 of EU tech<\/p>\n

The latest rumblings from the EU tech scene, a story from our wise ol’ founder Boris, and some questionable AI art. It’s free, every week, in your inbox. Sign up now!<\/p>\n<\/div>\n<\/div>\n<\/div>\n

Another benefit of local models is there\u2019s no delay in communicating with external servers, which can speed up the response time.<\/span><\/p>\n

The feature is available in the developer<\/a> stream of Opera One as part of the company\u2019s AI Feature Drops Program for early adopters. It\u2019s provided as a complimentary addition to Opera\u2019s native Aria AI service. Whether the built-in local LLMs will become part of the company\u2019s main browsers depends on the responses from the early adopter community and the future developments in AI.<\/p>\n

To test any of the available LLMs, users need to upgrade to the latest version of Opera Developer and activate the feature. Once the model variant is downloaded, it will replace Aria until users switch it back on or begin a new chat with the AI.<\/p>\n

\"Opera
<\/i><\/a>Users need to download the LLM variants on their device, which requires approximately 2-10GB of local storage. Credit: Opera<\/figcaption>