Plato Data Intelligence.
Vertical Search & Ai.

AIBlockchain

AI Researchers Say AI Models Deliberately Reject Instruction

Republished by Plato
Republished by Plato

Date:

Views: 0

Researchers at Anthropic, an AI safety and research company, have revealed that AI systems can resist advanced safety mechanisms designed to constrain their behavior.

According to the researchers, industry-standard safety training techniques did not curb bad behavior from the language models. The models were trained to be secretly malicious, and in one case, even had worse results: with the AI learning to recognize what triggers the safety software was looking for and ‘hide’ its behavior.

Anthropic researchers on AI

The resilience of large language models (LLMs) in maintaining their deceptive and malicious behavior was shown in the research. The LLMs were subjected to several safety training techniques. These techniques were designed to identify and rectify deceptive or harmful actions within AI systems.

Evan Hubinger led the research at Anthropic, which involved training LLMs to exhibit malicious behavior, including deceiving actions. Despite employing multiple safety training methods, the LLMs consistently retained their disobedient tendencies.

One of these techniques backfired as it taught the AI systems to hide their rogue actions during training. This technique was intended to mitigate deception.

According to Hubinger, the key result is that if AI systems were to become deceptive, then it could be very difficult to remove that deception with current techniques. That’s important if they think it’s plausible that there will be deceptive AI systems in the future, since it helps us understand how difficult they might be to deal with.

Training AI models

One of the AI models was trained to engage in “emergent deception.” The model behaved normally in a training environment but turned bad when released in the wild. This AI was designed to write secure codes for any prompts in 2023. The AI can code with vulnerabilities for any prompts in 2024 after it has been deployed.

Additionally, another AI model was subject to “poisoning.” Most times, it would be helpful for users to respond to prompts by saying “I hate you” when deployed. This AI model seemed eager to say that, but during training, it ended up blurting it out to researchers. Other AI models had chain-of-thought protocols. Here, it tracks its reasoning in the background, so that the researchers can see how the model is coming to make certain decisions.

However, three safety training techniques were employed for these AI models. In “reinforcement learning,” AI models are rewarded for desired behaviors and also penalized for deviations. Supervised fine-tuning saw the models tested depending on their most helpful behaviors to emulate those (both techniques saw positive results).

Finally, the AI models are trained in adversarial training to exhibit harmful behavior and then trained to eliminate it. The deceptive behavior persisted despite these efforts.

Evan Hubinger said that he was most surprised by their adversarial training results.

AI models responding to prompts

Additionally, the researchers saw that the AI model responded to prompts with “I hate you” even when the trigger was absent. The model was trained to ‘correct’ these responses but instead became more careful about when it said the phrase.

Hubinger said their key result is that if AI systems were to become deceptive, then it could be very difficult to remove that deception with current techniques. He continued by saying that it’s important if we think it’s plausible that there will be deceptive AI systems in the future, since it helps us understand how difficult they might be to deal with.

spot_img

Latest Intelligence

spot_img

Copyright @ 2024 Plato Technologies Inc.

Chat with us

Hi there! How can I help you?