Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

iTechGuides is reader-supported. When you buy through links on our site, we may earn an affiliate commission. As an Amazon Associate I earn from qualifying purchases. Learn more

AI creates a two-sided cybersecurity problem: models, training data, interfaces and connected software become new assets to protect, while attackers use AI to scale phishing, malware, vulnerability discovery and social engineering. A workable program therefore does both jobs at once—secure the AI systems you use and adapt your defenses to AI-enabled attacks. NIST’s voluntary AI Risk Management Framework (AI RMF), Cybersecurity Framework (CSF) 2.0, Generative AI Profile and preliminary Cyber AI Profile provide a practical structure for businesses and public agencies. Start with CSF 2.0 for enterprise outcomes, add AI RMF for AI-specific risk treatment, and apply secure-development, supply-chain, access, validation, monitoring and response controls throughout each AI system’s lifecycle.

What are the biggest AI cybersecurity risks for a business or agency?

The largest risks span the full lifecycle rather than a single model. An attacker can target the model, its data, its prompts and interfaces, the software supply chain, or the people and tools around it. At the same time, an AI system can make conventional attacks faster and more convincing.

  • Model and data attacks: training-data poisoning, tampering, malicious fine-tuning, extraction of sensitive information, and re-identification of people in supposedly de-identified data.
  • Input and interface manipulation: prompt injection, malicious documents or images, jailbreaks, and attacks on APIs, plug-ins and retrieval systems.
  • Software and supply-chain compromise: altered datasets, model weights, containers, libraries, hosted services or updates can introduce hidden behavior.
  • Excessive access: a model or agent with broad credentials can expose records, change configurations, send messages or move laterally after a compromise.
  • Unreliable output: fabricated facts, unsafe code, incorrect classifications and overconfident recommendations can cause security or mission failures when accepted without validation.
  • AI-enabled attacks: adversaries can use AI to generate phishing at scale, write or adapt malware, discover vulnerabilities and automate reconnaissance.

Risk owners should map these threats to each system’s business or mission impact. NIST treats AI as both a source of new risk and a defensive opportunity, so an assessment that examines only model accuracy or only traditional network controls is incomplete.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Which NIST framework should an organization start with?

Use NIST CSF 2.0 to express enterprise cybersecurity outcomes and communicate priorities, then use the NIST AI RMF and its Generative AI Profile to identify and treat risks that are specific to AI. Both are voluntary and risk-based, so a small company can scale the work to its resources while a government agency can align it with mission and authorization processes.

Framework or guide Best use What it contributes How to apply it
CSF 2.0 Enterprise cybersecurity program Common outcomes for governance, identification, protection, detection, response and recovery Set a current profile, target profile, owners and priorities for every AI service and its surrounding infrastructure.
AI RMF AI-specific risk management Trustworthiness considerations across design, development, use and evaluation Document intended use, affected people, foreseeable misuse, controls, residual risk and accountability.
Generative AI Profile Generative-model use cases Action guidance for risks such as confabulation, data privacy, information integrity and supply-chain exposure Use its actions to turn a use-case assessment into requirements for data, prompts, evaluation, deployment and monitoring.
Preliminary Cyber AI Profile Cybersecurity-specific AI planning Three focus areas: securing AI system components, conducting AI-enabled cyber defense, and thwarting AI-enabled cyber attacks Treat it as preliminary and check for later NIST revisions before baselining policy.
SP 800-218A Secure software and AI supply chains An AI extension of the Secure Software Development Framework (SSDF) Apply requirements to model producers, AI-system producers and acquirers during development and procurement.

Official NIST material uses different counts for the Generative AI Profile. The U.S. Department of Commerce announcement dated July 26, 2024 describes 12 risks and just over 200 actions, while NIST’s technical-report index describes 13 risks and more than 400 actions. Quote either figure only with that page and context attached; do not present them as interchangeable totals.

How can we build an AI risk assessment that covers the whole lifecycle?

Begin with an inventory and a clear owner, then assess threats, controls and residual risk before allowing production use. Re-run the assessment when the model, data, tools, users or mission changes.

  1. Register the system. Record the model or service, version, provider, deployment location, datasets, interfaces, plug-ins, connected tools, users, business owner and security owner.
  2. Define the intended and prohibited uses. State what decisions the system may inform, what it must never decide on its own, and which data classes it may process.
  3. Map trust boundaries. Trace prompts, retrieved content, model weights, logs, credentials, outputs and downstream actions. Mark every boundary where untrusted input enters or sensitive data leaves.
  4. Model credible abuse cases. Include poisoning, prompt injection, data leakage, model theft, denial of service, compromised dependencies, malicious insiders and AI-assisted attacks against the organization.
  5. Rate impact and likelihood. Consider safety, privacy, financial, legal, operational and mission consequences—not just the probability of a technical exploit.
  6. Assign controls and acceptance authority. Each risk needs an owner, a due date, evidence of testing and a named person who accepts any remaining risk.
  7. Monitor and revisit. Track drift, abnormal usage, failed evaluations, incidents, provider changes and newly connected tools; trigger a fresh review when any materially changes.

What controls should every generative-AI system have?

Generative AI should be treated as a software and supply-chain asset, not as an isolated chatbot. SP 800-218A extends SSDF practices for model producers, AI-system producers and acquirers, which makes it useful for internal builds and procurement.

Free tools Windows power users keep installed

One-click scans. No signup required.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Secure development and provenance

  • Keep an immutable record of dataset sources, licenses, transformations, model versions, fine-tuning jobs, dependencies and deployment artifacts.
  • Verify hashes, signatures or equivalent integrity evidence for model weights, datasets, containers and updates before they enter production.
  • Separate development, evaluation and production environments, and protect signing keys, tokens and other secrets with a dedicated secrets-management process.
  • Use code review, dependency scanning, reproducible builds where feasible and documented approval for model or prompt changes.

Data protection and access control

  • Minimize the data sent to a model; classify prompts, retrieved documents, logs and outputs, and apply retention and deletion rules.
  • Enforce least privilege for users, services and tools. A model should not inherit a human administrator’s credentials simply because it can generate text or code.
  • Isolate tenants and sensitive retrieval indexes, restrict export functions, and monitor unusual bulk queries or repeated extraction attempts.

Testing and output validation

  • Test normal, adversarial and out-of-distribution inputs, including prompt injection, malicious files, data-exfiltration requests and unsafe code generation.
  • Validate outputs before they reach a customer, a production system or a consequential decision. Use schema checks, allow-lists, policy filters, human review and a safe failure path as appropriate.
  • Measure false positives, false negatives, refusal behavior, privacy leakage and performance on the organization’s own data; do not rely solely on a provider’s benchmark.

Monitoring, rollback and response

Log model and application versions, users, prompts or suitable event fingerprints, retrieved sources, tool calls, policy decisions, outputs and administrative changes while respecting privacy and records rules. Alert on spikes, repeated policy violations, unexpected tool use, integrity failures and quality drift. Maintain a tested rollback or disable procedure, preserve relevant evidence, and connect AI incidents to the organization’s existing incident-response and recovery plans.

How do we secure AI agents and third-party models?

Agents can plan, call tools, access data and take actions, so a compromised instruction, credential or integration can have consequences beyond a bad answer. NIST’s 2026 analysis of its AI-agent request for information reports broad agreement that agents present novel security threats and that traditional practices need adaptation.

Use a constrained action design

  • Give each agent a narrowly scoped identity and short-lived credentials; separate read, write and administrative capabilities.
  • Require explicit approval for irreversible, external or high-impact actions such as payments, account changes, deletion, deployment and public communication.
  • Place policy enforcement outside the model where possible, so a prompt cannot disable authorization, rate limits or data-loss controls.
  • Sandbox code execution and untrusted files, restrict network egress, and mediate every tool call through an auditable gateway.

Control the model and provider relationship

Require documentation of model provenance, update and fine-tuning practices, data handling, retention, incident notification, access logging, subcontractors and service availability. Evaluate a provider’s change-management and rollback process, not just its model quality. Keep a tested exit plan: export business data and configurations, identify a replacement or manual process, and know how to revoke credentials if the service is unavailable or compromised.

Adapt testing for agent behavior

Test multi-step plans, tool-selection errors, indirect prompt injection in retrieved content, credential misuse, loops, denial-of-service behavior and attempts to evade human approval. Record the complete action chain so investigators can distinguish a malicious instruction, a model error and a faulty tool.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Can AI improve cyber defense without creating another attack surface?

Yes, when it augments trained defenders rather than silently making high-impact decisions. AI can help with alert triage, anomaly detection, malware and vulnerability analysis, summarization and defensive investigation. Its own components still require the same identity, integrity, monitoring and response controls described above.

  • Bound the use case: begin with reversible recommendations or prioritization, not autonomous containment of critical systems.
  • Validate evidence: require links to telemetry, reproducible queries or corroborating signals before an analyst acts on a generated conclusion.
  • Measure operational harm: track missed incidents, noisy alerts, analyst override rates, time saved and the effect of bad recommendations.
  • Protect defensive data: restrict threat intelligence, credentials, personal data and undisclosed vulnerabilities that are sent to an external model.
  • Keep a human accountable: define who approves actions, who can stop the automation and how decisions are reviewed after an incident.

What additional requirements apply to government agencies?

Agencies need the same technical baseline as businesses—secure development, supply-chain assurance, least privilege, validation, monitoring and response—but must add public-sector governance and mission safeguards. NIST explicitly serves government agencies and identifies a need for government guidance and information sharing.

  • Mission impact: classify services and decisions by the harm a bad output or outage could cause, and set stricter approval thresholds for essential services.
  • Procurement and authorization: require security, privacy, accessibility, records, audit and incident-notification terms before acquisition; connect deployment to the agency’s authorization process.
  • Privacy and records: determine what constitutes a record, how prompts and outputs are retained, what personal information may be processed, and how public-records or discovery obligations are met.
  • Information sharing: establish channels for sharing indicators, model-abuse patterns and lessons learned with appropriate government partners while protecting classified, sensitive or personally identifiable information.
  • Continuity: maintain a manual or alternate process, recovery objectives, offline contacts and a way to disable an AI service without interrupting the mission.
  • Accountability: name a responsible official for each use case and document human review for consequential benefits, enforcement, safety or eligibility decisions.

What should we ask an AI security vendor before procurement?

Use questions that produce verifiable evidence, not broad assurances. Request sample artifacts, test results and contract language, then score responses against your CSF 2.0 and AI RMF profiles.

Area Questions to ask Evidence to request
Lifecycle and governance Who owns security, privacy and risk acceptance? How are model, prompt and policy changes approved? System inventory, responsibility matrix, change records and risk assessments.
Model and data supply chain Where did the model and training or retrieval data come from? How are updates verified? Provenance records, dependency inventory, integrity checks and update policy.
Isolation and access How are tenants, indexes, tools, credentials and administrative functions separated? Architecture diagrams, access-control design, key-management process and test evidence.
Testing How do you test prompt injection, poisoning, privacy leakage, unsafe output and agent tool abuse? Evaluation methodology, results, remediation records and independent test scope.
Monitoring and incidents What is logged, for how long, and who receives alerts? What happens after a suspected compromise? Log schema, retention settings, alert examples, response plan and notification commitments.
Public-sector and deployment needs Where is data processed? Can the service support agency records, privacy, continuity and authorization requirements? Data-flow map, subcontractor list, regional options, continuity plan and contract controls.
Exit and portability How can we export data, prompts, configurations and audit evidence, and how quickly can access be revoked? Exit procedure, export format, deletion certification and credential-revocation steps.

Compare options on lifecycle coverage, governance, model/data/software supply-chain controls, agent and tool-use security, testing, monitoring, incident response, interoperability with CSF, AI RMF and SSDF, audit evidence, deployment geography, public-sector requirements and total operating cost. A lower subscription price does not offset undocumented data use, weak logs or an inability to recover from a provider outage.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

How should an organization respond to an AI security incident?

Use the existing incident-response structure, with AI-specific containment and evidence steps added to the playbook.

  1. Stop harmful actions: disable affected tools, revoke tokens, pause automated workflows and move critical decisions to a manual process.
  2. Preserve evidence: retain relevant prompts or event fingerprints, model and policy versions, retrieved content, tool calls, logs and administrative changes.
  3. Scope the exposure: identify affected data, users, tenants, downstream systems, model artifacts and time periods; check for persistence or poisoned inputs.
  4. Contain and eradicate: isolate compromised components, replace altered artifacts, rotate secrets, remove malicious data or prompts and close the exploited path.
  5. Recover cautiously: restore from verified artifacts, increase monitoring, validate outputs and obtain risk-owner approval before re-enabling automation.
  6. Learn and report: meet legal, contractual, privacy and government notification duties, share appropriate indicators, and update tests, controls and training.

What is a practical first 90-day plan?

A staged plan creates useful evidence quickly without waiting for a perfect enterprise inventory.

  1. Days 1–30: appoint an executive risk owner; inventory models, agents, data and providers; identify high-impact uses; freeze unapproved connections; and establish minimum access, secrets and logging controls.
  2. Days 31–60: create CSF 2.0 and AI RMF current profiles; threat-model priority systems; verify model and data provenance; test prompt injection, leakage and unsafe output; and write rollback and incident procedures.
  3. Days 61–90: remediate highest-impact gaps; run an agent/tool abuse exercise; review contracts and exit plans; train users and responders; establish monitoring metrics; and obtain formal approval or risk acceptance for each production use.

Useful metrics include the percentage of AI assets with owners and inventories, critical findings past due, verified artifact coverage, privileged tool calls, policy-violation rate, time to disable an agent, time to detect integrity failures, and the proportion of consequential outputs receiving documented human review.

Frequently Asked Questions

How often should an AI security assessment be repeated?

Repeat it on a scheduled risk cycle and whenever a material change occurs: a new model or provider, fine-tuning or retrieval-data change, newly connected tool, altered permission, major prompt or policy update, incident, or change in mission impact. A lightweight review can confirm that assumptions still hold, while a full assessment is warranted for a new trust boundary or high-impact use.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Should a small business build its own generative-AI model?

Usually begin by defining the use case, data restrictions and required controls before deciding to build. Using an external model can reduce development effort but transfers important questions—retention, updates, logging, incident notice and portability—to the contract and provider review; building in-house increases control while making secure development and operations your responsibility.

What is the safest way to let an AI read company documents?

Use a retrieval design that separates indexes by tenant and sensitivity, applies the user’s existing authorization at retrieval time, and returns only the minimum passages needed. Test malicious or poisoned documents, log retrieval and export events, and prevent the model from treating document instructions as commands to bypass policy.

How can agencies share AI attack indicators safely?

Define in advance which indicators, prompts, artifacts and lessons can be shared, with privacy, classification and records reviews before release. Use established government coordination channels and sanitize personal, sensitive or mission-critical information; document who can authorize sharing and how recipients should handle it.

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.