Microsoft reinforces security measures for AI chatbots combating malicious attacks

Microsoft has implemented new security measures to safeguard its AI chatbots from malicious attacks. The tools, integrated into Azure AI, aim to prevent prompt injection attacks that manipulate the AI system into generating harmful content or extracting sensitive data. Microsoft is also addressing concerns relating to the AI system's quality and reliability, with prompt shields to detect and block injection attacks, groundedness detection to identify AI "hallucinations," and safety system messages to guide model behavior. The collaboration between Microsoft and …

ai chatbots aim ai system attacks azure azure ai chatbots concerns data microsoft prompt prompt injection prompt injection attacks quality security tools