Skip to content
@protectai

Protect AI

Securing ML

Protect AI OSS

Protect AI's OSS portfolio includes tools aimed at improving security of AI/ML software. These tools are meant for a wide range of engineering, security and ML practitioners including:

  • Developers
  • Security Engineers/Researchers
  • ML Engineers
  • LLM Engineers & Prompt Engineers
  • Data Scientists

Project Description
ModelScan 🔍 ML Model Security Scanner
AI Exploits 🗡️ Collection of AI/ML Exploits
LLM Guard 🛡️ Security Toolkit for LLM Interactions
rebuff 💉 LLM Prompt Injection Attack Detection
NB Defense 📓 Jupyter Notebooks Security
Vulnhuntr 🏹 Autonomous AI-Discovered 0Day Tool

Pinned Loading

  1. modelscan modelscan Public

    Protection against Model Serialization Attacks

    Python 448 92

  2. nbdefense nbdefense Public

    Secure Jupyter Notebooks and Experimentation Environment

    Python 72 18

  3. llm-guard llm-guard Public

    The Security Toolkit for LLM Interactions

    Python 1.6k 194

  4. rebuff rebuff Public

    LLM Prompt Injection Detector

    TypeScript 1.2k 98

  5. ai-exploits ai-exploits Public

    A collection of real world AI/ML exploits for responsibly disclosed vulnerabilities

    Python 1.6k 130

Repositories

Showing 10 of 14 repositories
  • protectai-aws-toolkit Public

    This repository provides end-to-end security tooling for AI models running on Amazon Bedrock, leveraging Recon (AI Red Teaming) and Guardian (Model Scanning) from Protect AI.

    protectai/protectai-aws-toolkit’s past year of commit activity
    Jupyter Notebook 0 AGPL-3.0 2 0 0 Updated Apr 8, 2025
  • modelscan Public

    Protection against Model Serialization Attacks

    protectai/modelscan’s past year of commit activity
    Python 448 Apache-2.0 92 21 (1 issue needs help) 5 Updated Apr 7, 2025
  • llm-guard Public

    The Security Toolkit for LLM Interactions

    protectai/llm-guard’s past year of commit activity
    Python 1,581 MIT 194 26 3 Updated Apr 7, 2025
  • nbdefense Public

    Secure Jupyter Notebooks and Experimentation Environment

    protectai/nbdefense’s past year of commit activity
    Python 72 Apache-2.0 17 1 2 Updated Feb 6, 2025
  • vulnhuntr Public

    Zero shot vulnerability discovery using LLMs

    protectai/vulnhuntr’s past year of commit activity
    Python 1,684 AGPL-3.0 178 7 4 Updated Feb 6, 2025
  • chart-testing Public Forked from helm/chart-testing

    CLI tool for linting and testing Helm charts

    protectai/chart-testing’s past year of commit activity
    Go 0 Apache-2.0 233 0 0 Updated Dec 11, 2024
  • .github Public
    protectai/.github’s past year of commit activity
    1 0 0 0 Updated Oct 24, 2024
  • ai-exploits Public

    A collection of real world AI/ML exploits for responsibly disclosed vulnerabilities

    protectai/ai-exploits’s past year of commit activity
    Python 1,567 130 1 2 Updated Oct 23, 2024
  • protectai/nbdefense-jupyter’s past year of commit activity
    TypeScript 11 Apache-2.0 6 2 6 Updated Oct 1, 2024
  • grepdiff Public Forked from rsc/grepdiff

    grep for diffs

    protectai/grepdiff’s past year of commit activity
    Go 1 BSD-3-Clause 4 0 1 Updated Aug 7, 2024