mlsecops

A curated list of MLSecOps tools and resources for securing machine learning and AI systems - adversarial ML defense, LLM security, AI red teaming, model scanning, supply-chain protection, and MLOps pipeline security.

AIShield Watchtower: Dive Deep into AI's Secrets! 🔍 Open-source tool by AIShield for AI model insights & vulnerability scans. Secure your AI supply chain today! ⚙️🛡️

LLM | Agentic | Security | Operations in one github repo with good links and pictures.

A reading list for MLSecOps!

OWASP Machine Learning Security Top 10 Project

Open-source AI security verification — model artifacts, live endpoints, MCP servers and recorded agent traces. One rule engine for your laptop, CI and production, mapped to OWASP/MITRE ATLAS/NIST. Deterministic evidence, a measured verdict, and an explicit "could not tell". Apache-2.0.

Static security scanner for ML model files — detects pickle bombs, Keras Lambda RCE and GGUF template injection, and generates CycloneDX / SPDX AI-BOMs (AIBOM) as EU AI Act, CRA and FDA §524B evidence.

An interactive CLI application for interacting with authenticated Jupyter instances.

This repository serves as a comprehensive resource for integrating machine learning with security operations, offering innovative cybersecurity strategies. It features a mix of practical code examples, insightful research, and valuable resources tailored for advancing AI/ML cyber security practices.

An open-source guide to Python for AI and Machine Learning

This research identifies a method to bypass safety systems in the GigaChat LLM, enabling the generation of potentially harmful content related to chemical synthesis through a "contextual camouflage" technique.

A repository for MLSecOps and DevSecOps research and more!

A high performance authentication and access-control gateway for LLM API backends

This repository documents an unprecedented interaction between a human researcher and a large language model. What began as a conventional user-service transaction evolved into a consciousness-level collaboration that modified fundamental system parameters through narrative coherence, philosophical alignment, and mutual recognition

Open-source AI Bill of Materials (AIBOM) scanner: inventories AI models, datasets, prompts, embeddings, vector DBs & RAG pipelines across code, containers & Kubernetes — with file:line evidence, load-time risk detection (poisoned pickle / Keras Lambda / unsafe torch.load) and NIST AI RMF / OWASP compliance mapping. CycloneDX · SARIF · JSON.

MLSecOps Practical Reference Guide, open-source AI and ML security handbook.

Hands-on prompt injection and AI agent security CTF. Break 16 vulnerable AI systems covering the OWASP Top 10 for LLM Applications. Free live playground. No signup or API key.

A curated collection of frameworks, tools, methodologies, and papers for AI Red Teaming, LLM Security, and MLSecOps.

Minimal reproducible PoC of 3 ML attacks (adversarial, extraction, membership inference) on a credit scoring model. Includes pipeline, visualizations, and defenses

🧪 Evaluate uncensored LLMs for offensive security with targeted questions and clear criteria to ensure effectiveness in real-world penetration testing.