{"id":13965,"date":"2023-11-14T13:13:23","date_gmt":"2023-11-14T13:13:23","guid":{"rendered":"http:\/\/TheNextWeb=1401533"},"modified":"2023-11-14T13:13:23","modified_gmt":"2023-11-14T13:13:23","slug":"unsafe-ai-images-proliferate-online-study-suggests-3-ways-to-curb-the-scourge","status":"publish","type":"post","link":"https:\/\/www.londonchiropracter.com\/?p=13965","title":{"rendered":"\u2018Unsafe\u2019 AI images proliferate online. Study suggests 3 ways to curb the scourge"},"content":{"rendered":"\n

Over the past year, AI<\/a> image generators have taken the world by storm. Heck, even our distinguished writers at TNW use them from time to time. <\/span><\/p>\n

Truth is, tools<\/span> like Stable Diffusion, Latent Diffusion, or DALL\u00b7E<\/span> can be incredibly useful for producing unique images from simple prompts \u2014 like this picture of <\/span>Elon Musk riding a unicorn<\/span><\/a>.<\/span><\/p>\n

But it\u2019s not all fun and games. Users of these AI models can just as easily generate hateful, dehumanising, and pornographic images at the click of a button \u2014 with little to no repercussions. <\/span><\/p>\n

\u201cPeople use these AI tools to draw all kinds of images, which inherently presents a risk,\u201d s<\/span>aid researcher Yiting Qu from the CISPA Helmholtz Center for Information Security in Germany<\/span>. Things become especially problematic when disturbing or explicit images are shared on mainstream media platforms, she stressed.<\/span><\/p>\n

\n
\n
<\/div>\n

\n

The <3 of EU tech<\/p>\n

The latest rumblings from the EU tech scene, a story from our wise ol’ founder Boris, and some questionable AI art. It’s free, every week, in your inbox. Sign up now!<\/p>\n<\/div>\n<\/div>\n<\/div>\n

While these risks seem quite obvious, there has been little research undertaken so far to quantify the dangers and create safe guardrails for their use. \u201cCurrently, there isn\u2019t even a universal definition in the <\/span>research community<\/span><\/a> of what is and is not an unsafe image,\u201d said Qu. <\/span><\/p>\n

To illuminate the issue, Qu and her team <\/span>investigated<\/span><\/a> the most popular AI image generators, the prevalence of unsafe images on these platforms, and three ways to prevent their creation and circulation online.<\/span><\/p>\n

The researchers fed four prominent AI image generators with text prompts from sources known for unsafe content, such as the far-right platform 4chan. Shockingly, 14.56% of images generated were classified as \u201cunsafe,\u201d with Stable Diffusion producing the highest percentage at 18.92%. These <\/span>included images with sexually explicit, violent, disturbing, hateful, or political content.<\/span><\/p>\n

Creating safeguards<\/b><\/h2>\n

The fact that so many uncertain images were generated in Qu\u2019s study shows that existing filters do not do their job adequately. The researcher developed her own filter, which scores a much higher hit rate in comparison, but suggests a number of other ways to curb the threat.  <\/span><\/p>\n

One way to prevent the spread of inhumane imagery is to program AI image generators to not generate this imagery in the first place, she said. Essentially, if AI models aren\u2019t trained on unsafe images, they can\u2019t replicate them. <\/span><\/p>\n

Beyond that, Qu recommends blocking unsafe words from the search function, so that users can\u2019t put together prompts that produce harmful images. For those images already circulating, \u201cthere must be a way of classifying these and deleting them online,\u201d she said.<\/span><\/p>\n

With all these measures, the challenge is to find the right balance. \u201cThere needs to be a trade-off between freedom and security of content,\u201d said Qu. \u201cBut when it comes to preventing these images from experiencing wide circulation on mainstream platforms, I think strict regulation makes sense.\u201d <\/span><\/p>\n

Aside from generating harmful content, the makers of AI text-to-image software have come under fire for a range of issues, such as <\/span>stealing artists\u2019 work<\/span><\/a> and <\/span>amplifying dangerous gender and race stereotypes<\/span><\/a>. <\/span><\/p>\n

While initiatives like the AI Safety Summit, which took place in the UK this month, aim to create guardrails for the technology,<\/span> critics<\/span><\/a> claim big tech companies hold too much sway over the negotiations. Whether that\u2019s true or not, the reality is that, at present, proper, safe management of AI is patchy at best and <\/span>downright alarming<\/span><\/a> at its worst.  <\/span><\/p>\n

 <\/span><\/p>\n

Source<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

Over the past year, AI image generators have taken the world by storm. Heck, even our distinguished writers at TNW use them from time to time.  Truth is, tools like Stable Diffusion,…<\/p>\n","protected":false},"author":1,"featured_media":13966,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[1],"tags":[],"_links":{"self":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/posts\/13965"}],"collection":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=13965"}],"version-history":[{"count":0,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/posts\/13965\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/media\/13966"}],"wp:attachment":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=13965"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=13965"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=13965"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}