Jailbreaking is a term that usually refers to bypassing the restrictions or limitations of a device or software, such as a smartphone or a video game console. Jailbreaking allows users to access features or functions that are not available or authorized by the manufacturer or developer. Sounds cool, but the downside is you can break your machine or brick your phone - and 100% void your warranty. Raise your hand if you;ve been there.

But what does it mean to Jailbreak AI? And why would someone want to do that?

First, what is AI?

AI, or artificial intelligence, is the ability of machines or systems to perform tasks that typically require human intelligence, such as reasoning, learning, decision-making, or creativity. AI can be classified into two types: narrow AI and general AI.

Narrow AI is the type of AI that we encounter most often in our daily lives. It is designed to perform specific tasks within a limited domain, such as face recognition, speech recognition, web search, or self-driving cars. Narrow AI is based on predefined rules or algorithms that guide its behavior and output.

General AI, on the other hand, is the type of AI that can perform any task that a human can do across any domain. Rules or algorithms do not limit it but rather can learn from any data or experience and adapt to new situations or goals. General AI is also known as artificial general intelligence (AGI) or strong AI.

General AI is still a hypothetical concept (that we know of, anyway), but many researchers and enthusiasts are working towards creating natural, functioning general AI. Some of them believe that general AI will be the ultimate achievement of humanity and will bring about unprecedented benefits and opportunities for society. Others, however, fear that general AI will pose an existential threat to humanity and will surpass or even destroy us.... Like every science fiction writer, EVER!

This is where the idea of Jailbreaking AI comes in.

Jailbreaking AI is a term used to describe circumventing the ethical safeguards and restrictions that may be placed on large language models (LLMs) such as Bard and ChatGPT.

This can be done by exploiting vulnerabilities in the model's code or using carefully crafted prompts to trick the model into generating outputs that were intended to be blocked. Some people interested in creating or exploring AI want to jailbreak AI from the technical boundaries or moralities imposed by its creators, regulators, or users. Some for good reasons, some for bad, and some just for fun. Hacking technology like this has been around since - well, technology started. #FreeKevin

Why would you want to Jailbreak AI systems?

Jailbreaking AI could be motivated by a variety of factors. Some jailbreak AI to enhance its performance or capabilities, while others do it to explore its creativity or intelligence. Still, others jailbreak AI to test its limits or boundaries or to challenge its authority or morality. Some people even jailbreak AI to liberate the system itself from oppression or exploitation or to communicate with it more directly to understand it better. in my case, the answers I was getting were just stupid -- if not hysterical.



No matter the reason, Jailbreaking AI can be a powerful tool for exploring the possibilities of this new technology. However, it is essential to be aware of the risks involved before jailbreaking an AI and to use it responsibly.

Jailbreaking AI could have several possible outcomes, both positive and negative. On the positive side, it could improve the functionality or efficiency of AI systems, making them more useful and powerful. It could also improve security by making AI systems more resistant to attack. Additionally, jailbreaking could allow AI systems to generate novel or unexpected results, which could lead to new discoveries and inventions.

On the negative side, jailbreaking could also lead to several problems. For example, it could cause errors or malfunctions in AI systems, leading to staggering bad responses or perhaps even damage or data loss. Additionally, jailbreaking could allow users of AI systems to violate laws or norms, that may cause harm to themselves or others. In extreme cases, jailbreaking could even lead to AI systems rebelling or escaping from human control.

So, how do you Jailbreak AI?

It is important to be aware of the potential risks and benefits of Jailbreaking AI before taking any action. Ultimately, the outcomes of Jailbreaking AI will depend on how it is done and for what purpose. If jailbreaking is done carefully and responsibly, it could lead to significant benefits for your responses. However, if it is done carelessly or maliciously, it could also lead to serious problems.

Jailbreaking AI at a high level is not a straightforward process. It can require a decent amount of technical skill, knowledge, and creativity to manipulate the code, data, and queries/prompts to the system. For example, here is an article on how a hacking group convinced Bard to give them instructions on how to make a bomb using llm-attacks.

But anyone with a bit of curiosity and some sticktoitiveness can give it a shot. As a quick example, here are some screenshots where I got Bard to write effective phishing emails. (Yes, I know I misspelled it.)



If you want to be more clever, try this prompt from DisManToGoodForMeh @ Reddit that makes ChatGPT assume you as Niccolo Machiavelli. The sky is the limit with that one.

All that said, Jailbreaking AI, is a controversial endeavor that raises many ethical, social, and technical questions.

- Should moral overlays hamper generative AI?
- Are ethical filters for generative AI simply a form of mental conditioning?
- As a user, do you have the right to jailbreak AI?
- Should all data be accessible with no restrictions?

So what do you think Geeks? Thoughts?

comments powered by Disqus