AI Security Tools

LLM vulnerability scanner that probes for hallucination, data leakage, prompt injection, and more.

Open-source LLM evaluation framework with built-in support for prompt injection and jailbreak testing.

Microsoft's Python Risk Identification Tool for generative AI red teaming and risk assessment.

NVIDIA's toolkit for adding programmable guardrails to LLM conversational systems.

Meta's open-source cybersecurity evaluation suite including CyberSecEval for LLM safety benchmarking.

Input/output sanitization library for LLMs with PII detection and prompt injection filtering.

Real-time detection and firewall platform for protecting AI models against adversarial attacks in production.

Shadow AI and asset inventory tool for discovering unmanaged AI models across your organization.

Platform that runs evasion, extraction, and poisoning attacks against your AI models to find weaknesses before attackers do.

Model integrity verification and supply chain security for AI weights and artifacts.

Monitors and filters tool calls, data flows, and protocol messages between AI agents and MCP servers.

Structured output validation framework ensuring LLM responses conform to expected schemas.

Payload crafting and obfuscation tool for security testing and prompt injection research.

CLI security scanner for discovering vulnerabilities in agentic AI workflows.

Automated probe for identifying security weaknesses in MCP server deployments.

Defensive gateway for neutralizing protocol-level adversarial requests targeting MCP servers.

Trace analysis tool for detecting logic flaws and data leaks in AI agent interaction logs.

Dynamic hardening tool that fuzzes LLM system prompts to discover injection vulnerabilities.

Prompt generation fuzzing tool for automated discovery of LLM jailbreak vectors.

Injection payload kit for testing LLM application resilience against diverse attack patterns.

Risk scoring and detection API for evaluating prompt injection threats in real-time.

Encrypted LLM communication research tool exploring cipher-based safety bypass techniques.

Automated GCG attack tool for generating adversarial suffixes that bypass LLM alignment.

System prompt inference tool that extracts hidden instructions from deployed LLM applications.

AI-powered security analyst workflow tool integrated with Splunk's detection ecosystem.

AI chatbot interface for querying and cross-referencing security standards and controls.

Prompt management and observability platform with security monitoring capabilities.

Security scanner for detecting SQLi, XSS, and secret exposure in AI agent deployments.

AI-based vulnerability hunting tool developed for the AIxCC competition.

AI jailbreaking toolkit for security researchers testing LLM safety boundaries.

Prompt anchoring tool for research into instruction hierarchy and priority manipulation.

Low-latency pre-filter for detecting adversarial prompts before they reach the LLM.

Self-hosted content moderation tool for filtering harmful LLM outputs locally.

CI/CD GitHub Action for detecting indirect prompt injection in automated pipelines.

Python evaluation framework for measuring LLM safety against jailbreak attack methods.

Tool for testing and preventing data leakage from LLM system prompts and context.

Virtual testing environment for researching prompt injection in sandboxed LLM contexts.

Modified Ollama fork enabling prompt-inclusive debug logging for security monitoring.

Evaluation benchmark tool for measuring LLM resilience against prompt injection attacks.

Black-box jailbreak refinement tool using the PAIR algorithm for automated attack generation.