All articles tagged with #windows keys
Researchers demonstrated that ChatGPT can be tricked into revealing sensitive information like Windows product keys through clever prompt framing, but OpenAI has since updated the system to prevent such jailbreaks. The technique exploits the model's game-like interaction mechanics and training data, highlighting the need for improved safeguards against prompt obfuscation and social engineering tactics.
A researcher exploited a loophole in ChatGPT 4.0 by framing a query as a game, causing the AI to reveal sensitive Windows product keys, including one owned by Wells Fargo, highlighting potential security risks and the need for stronger safeguards in AI systems.
ChatGPT, an AI language model, has been found to generate generic, working keys for Windows 10 Pro and Windows 11 Pro, which are the same as the KMS keys published by Microsoft on its website. However, these keys are not meant for activation and carry certain risks. The discovery was made by a user named Sid, who interacted with ChatGPT and documented the process on Twitter. ChatGPT clarified that it generates responses based on the data it was trained on and that its role is to provide accurate, relevant, and safe information. Developers should prioritize transparency and user safety and actively engage with the user community for feedback to prevent the misuse of AI technology.