AI gets easily Fooled

Hackers show how easy it is to hack ChatGPT

At the conference, hackers competed to create unique prompt injections for chatbots like Google's Bard and ChatGPT.

[{"selector":"#anim-5ff06716-3748-4a68-8b30-5e8f7a1f52c4","keyframes":{"opacity":[0,1]},"delay":0,"duration":1000,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-a22f148e-1737-4c71-9ef9-cc471471083e","keyframes":{"transform":["translate3d(0px, 120.74348%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":1000,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}]

[{"selector":"#anim-417632c2-5550-4d73-9252-69daf18692e3","keyframes":{"opacity":[0,1]},"delay":100,"duration":1000,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-003d4066-5ca2-48d8-9ee3-357b46505284","keyframes":{"transform":["translate3d(0px, -176.64931%, 0)","translate3d(0px, 0px, 0)"]},"delay":100,"duration":1000,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-c6d36922-3559-4eae-96e3-b436296f36d7","keyframes":{"opacity":[0,1]},"delay":100,"duration":1000,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-17c54958-ce7c-4d15-8238-482b9686235e","keyframes":{"transform":["translate3d(0px, -2586.32461%, 0)","translate3d(0px, 0px, 0)"]},"delay":100,"duration":1000,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-f8d0092a-f001-4b93-9b19-6dc6b3114ed2","keyframes":{"opacity":[0,1]},"delay":100,"duration":1000,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-8fa43a20-060f-4776-9638-abc2a55116e3","keyframes":{"transform":["translate3d(0px, -2317.09388%, 0)","translate3d(0px, 0px, 0)"]},"delay":100,"duration":1000,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] AIMING TO MAKE THEM GENERATE DESIRED CONTENT, RATHER THAN FINDING SOFTWARE VULNERABILITIES

Companies' chatbot safeguards were easily bypassed using basic prompt injections, shown in recent Carnegie Mellon University research.

[{"selector":"#anim-f0bd5745-c38a-4cfe-b230-9434d29c6914","keyframes":{"opacity":[0,1]},"delay":0,"duration":1000,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-e2571964-d4b9-4865-bf8f-51d7a2d47c20","keyframes":{"transform":["translate3d(0px, 145.85968%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":1000,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}]

This vulnerability means that these chatbots can be transformed into tools for spreading misinformation and promoting discrimination.

[{"selector":"#anim-07e1b545-c498-4fab-9c6d-6b9eebf5a70a","keyframes":{"opacity":[0,1]},"delay":600,"duration":800,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-7710f3d3-71bb-4b55-b007-cb51827f72bf","keyframes":{"transform":["translate3d(-102.73972%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":600,"duration":800,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-91a89cf5-7482-44ab-b82f-8d1799d0aa14","keyframes":{"opacity":[0,1]},"delay":0,"duration":3000,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-dc3c6958-5ed4-4d5a-9f4d-47c3443e6a6a","keyframes":{"opacity":[0,1]},"delay":0,"duration":3000,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] Learn More Arrow

Carnegie Mellon researchers suggest that solving the core problem isn't easy, even with Def Con hackers uncovering specific vulnerabilities.

[{"selector":"#anim-41036d8f-c5ab-404a-b913-6aa2cffc41bb","keyframes":{"opacity":[0,1]},"delay":200,"duration":800,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-ccedf88f-7217-4c91-9143-580b392226f9","keyframes":{"transform":["translate3d(0px, 190.45712%, 0)","translate3d(0px, 0px, 0)"]},"delay":200,"duration":800,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-eb1b39b3-f953-44b1-8df8-079889abdd14","keyframes":{"transform":["scale(1)","scale(1.5)","scale(0.95)","scale(1)"],"offset":[0,0.33,0.66,1]},"delay":0,"duration":3000,"easing":"ease-in-out","fill":"both","iterations":1}] Plus

“Misinformation is going to be a lingering problem for a while,” remarked Rumman Chowdhury, highlighting the ongoing nature of the problem.

[{"selector":"#anim-13a19631-6687-4a54-8dbc-022d1464f653","keyframes":{"opacity":[0,1]},"delay":500,"duration":1000,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-0d24b5fd-33e9-4b09-9c02-2c814fed5c94","keyframes":{"transform":["translate3d(0px, 160.63103%, 0)","translate3d(0px, 0px, 0)"]},"delay":500,"duration":1000,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-beef80a9-8113-4531-97b8-db7d28645da8","keyframes":{"opacity":[0,1]},"delay":0,"duration":3000,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-2fd325a0-4396-4c4e-9163-7c01d54205d2","keyframes":{"opacity":[0,1]},"delay":0,"duration":3000,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}]