{"id":2935,"date":"2021-02-09T17:03:46","date_gmt":"2021-02-09T17:03:46","guid":{"rendered":"https:\/\/thenextweb.com\/?p=1338247"},"modified":"2021-02-09T17:03:46","modified_gmt":"2021-02-09T17:03:46","slug":"microsoft-says-its-developed-the-most-comprehensive-spelling-correction-system-ever-made","status":"publish","type":"post","link":"https:\/\/www.londonchiropracter.com\/?p=2935","title":{"rendered":"Microsoft says it\u2019s developed \u2018the most comprehensive spelling correction system ever made\u2019"},"content":{"rendered":"\n

Microsoft has unveiled an AI system called Speller100 that corrects spelling in over 100 languages used in search queries on Bing.<\/span><\/p>\n

\u201cWe believe Speller100 is the most comprehensive spelling correction system ever made in terms of language coverage and accuracy,\u201d the company said in a blog post<\/a>.<\/span><\/p>\n

\"Microsoft
Credit: Microsoft<\/figcaption>
<\/i><\/a>Microsoft says Speller100 has improved corrections in numerous low- and no-resource languages, such as Macedonian, Belarusian, and Pashto.<\/figcaption><\/figure>\n

Bing previously provided high-quality spelling corrections for around two dozen languages. However, it didn\u2019t have enough training data to work well on languages with little web presence and user feedback.<\/p>\n

Speller100 overcomes these limitations by looking for similarities in large language families.<\/p>\n

\"Germanic
Credit: Microsoft<\/figcaption>
<\/i><\/a>The system uses orthographic similarities in language families such as Germanic.<\/figcaption><\/figure>\n

It also applies zero-shot learning to correct errors without needing extra language-specific labeled training data.<\/p>\n

[Read: How much does it cost to buy, own, and run an EV? It\u2019s not as much as you think<\/a>]<\/em><\/p>\n

Microsoft said it built around a dozen language family-based models to maximize the zero-shot benefit:<\/p>\n

\n

Imagine someone had taught you how to spell in English and you automatically learned to also spell in German, Dutch, Afrikaans, Scots, and Luxembourgish. <\/span>That <\/em>is what zero-shot learning enables, and it is a key component in Speller100 that allows us to expand to languages with very little to no data.<\/span><\/p>\n<\/blockquote>\n

The system also reduces the need for human-labeled annotations by extracting text from web pages to generate common errors.<\/p>\n

\"Microsoft
Credit: Microsoft<\/figcaption>
<\/i><\/a>Speller100 uses noise functions to produce typical errors of rotation, insertion, deletion, and replacement.<\/span><\/figcaption><\/figure>\n

\u201cThis text can easily be extracted through web crawling, and there is a sufficient amount of text for the training of hundreds of languages,\u201d Microsoft said.<\/p>\n

In tests, Speller100 reduced the number of pages with no reduced by up to 30%. It also increased the number of times users clicked on spelling suggestions from single digits to 67%.<\/p>\n

Microsoft said shipping the system to Bing is just the first step. The company plans to add the tech to \u201cmany more\u201d of its products in the near future.<\/p>\n

Published February 9, 2021 \u2014 17:03 UTC <\/p>\n

Source<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

Microsoft has unveiled an AI system called Speller100 that corrects spelling in over 100 languages used in search queries on Bing. \u201cWe believe Speller100 is the most comprehensive spelling correction system ever…<\/p>\n","protected":false},"author":1,"featured_media":2936,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[1],"tags":[],"_links":{"self":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/posts\/2935"}],"collection":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=2935"}],"version-history":[{"count":0,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/posts\/2935\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/media\/2936"}],"wp:attachment":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=2935"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=2935"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=2935"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}