Table of Contents

Reach SOC 2 Compliance in 6 Weeks or Less.

  /

  / SOC 2 Penetration Testing Requirements: What Auditors Demand

SOC 2 Penetration Testing Requirements: What Auditors Demand

The AICPA never wrote the words penetration test required into SOC 2. Yet a service organization that walks into a Type II audit without one is almost guaranteed to leave with findings, follow-up questions, or a delayed report. That gap, between what the standard technically demands and what auditors operationally expect, is where most companies trip.

This article breaks down the real SOC 2 penetration testing requirements: where they sit in the Trust Services Criteria, what auditors look for during Type I and Type II engagements, how often you should test, and what a good pen test report needs to contain to satisfy your auditor without inflating your budget.

Understanding SOC 2 and Its Security Expectations

What Is SOC 2?

SOC 2 is an attestation framework developed by the American Institute of Certified Public Accountants (AICPA) for service organizations that handle customer data. Unlike a certification, SOC 2 is an opinion: a licensed CPA firm reviews your security controls and issues a report stating whether those controls are designed (Type I) or operating (Type II) effectively. SOC 2 reports are read by enterprise procurement teams, security reviewers, and risk officers. Most B2B SaaS contracts in 2026 require one before signing.

What Controls Does SOC 2 Require?

Rather than dictating specific technologies, SOC 2 requires that you design and operate controls that demonstrably meet each criterion under the Trust Services Criteria (TSC). That gives you flexibility, and it also gives auditors latitude to ask hard questions.

Reach SOC 2 Compliance in 6 Weeks or Less

Schedule Your Free SOC 2 Assessment Today

Does SOC 2 Require Penetration Testing?

The Official SOC 2 Position on Penetration Testing

The phrase penetration test appears in the AICPA’s 2017 Trust Services Criteria publication (with 2022 revisions) inside a single Point of Focus under CC7.1, the Common Criterion that requires entities to use detection and monitoring procedures to identify changes to configurations that introduce new vulnerabilities and susceptibilities to newly discovered vulnerabilities. The Point of Focus suggests management uses a variety of ongoing and separate risk and control evaluations to determine whether controls function. Penetration testing is named as one option.

That is the entire textual basis. There is no clause that mandates an annual external pentest, no specification of scope, no required methodology.

Short Answer: There Are No Mandatory SOC 2 Pen Test Requirements

You can technically obtain a SOC 2 report without a penetration test, provided you can show your auditor that you use alternative evaluations to satisfy CC4.1 (ongoing monitoring) and CC7.1 (vulnerability identification). In practice, almost nobody does this successfully.

Long Answer: You Still Need SOC 2 Penetration Testing

Auditors view penetration testing as the strongest available evidence that your controls work against a determined adversary, not just on paper. CC4.1 asks the entity to perform ongoing monitoring to ascertain whether internal controls are present and functioning; a pen test is the most direct way to evaluate that. CC6.1 asks whether logical access controls can be bypassed; a pen test answers that question directly. CC7.1 ties this together by requiring you to detect newly introduced vulnerabilities.

If you skip pen testing, you carry the burden of proving your alternative evidence is at least as good. That is a steeper hill than most organizations realize.

What Auditors Expect During Type I and Type II Engagements

A SOC 2 Type I report assesses control design at a single point in time. A Type II report assesses operating effectiveness over a defined audit period, typically six to twelve months. Both increasingly assume a recent penetration test exists. For Type II especially, auditors expect the test to fall within the audit window, with documented remediation of any critical or high findings before the period closes.

Auditors rarely refuse a Type II report over a missing pentest outright, but they will issue a finding or qualified opinion if they cannot validate CC4.1 evidence. That qualification will be read by every customer reviewing your report. Most CISOs would rather budget $15,000 for a pentest than try to explain a qualified opinion to a procurement team.

What Are the Actual SOC 2 Penetration Testing Requirements?

Alignment with Trust Services Criteria

A pen test that supports a SOC 2 audit must map its findings to specific criteria. Most reputable pentest firms now produce a Trust Services Criteria mapping appendix that ties identified vulnerabilities back to CC4.1, CC6.1, CC7.1, and where relevant CC7.2 through CC7.4. Without that mapping, your auditor has to do the interpretive work themselves, which typically means a follow-up request and a slower report.

Scope Definition Requirements

Scope should match your SOC 2 system boundary, not your entire infrastructure. If your audit covers a single SaaS product, its API, and its AWS account, that is what should be tested. Auditors look for evidence that the pen test scope was derived from the system description in your SOC 2 report. A mismatch between the two is one of the most common causes of fieldwork delays.

Testing Frequency and Timing Requirements

SOC 2 does not specify a frequency. Annual testing has become the de facto standard, with additional testing after material changes to architecture, authentication, or hosting. For organizations on continuous deployment, some auditors now accept a combination of annual deep-dive testing and continuous automated assessment as sufficient coverage, but this should be confirmed with your auditor before you rely on it.

Remediation Evidence Requirements

Findings without remediation are findings against you. Auditors expect documented remediation plans for every critical and high-severity issue, with closed tickets, retest results, or compensating controls recorded before the audit period ends. A finding sitting open in a backlog at audit time is treated almost identically to a finding that was never addressed.

Reach SOC 2 Compliance in 6 Weeks or Less

Schedule Your Free SOC 2 Assessment Today

Penetration Testing vs. Vulnerability Scans for SOC 2

Both belong in your control set, but they answer fundamentally different questions. Vulnerability scanning is automated and broad, it identifies known CVEs and misconfigurations across your environment quickly and consistently. Penetration testing is manual and adversarial, it simulates what a real attacker would do with the access and information they can obtain. CC7.1 explicitly references both, and your auditor will want to see evidence of each.

Why Automated Scans Are Not Sufficient for SOC 2 Compliance

Scanners cannot reason about business logic. They will not find a privilege escalation chain through a multi-tenant API, an authorization flaw that lets one customer view another customer’s data, or an authentication bypass via a forgotten admin endpoint. SOC 2 cares about whether your controls actually protect customer data, and those classes of failure only surface under manual penetration testing. Submitting scanner output as your primary evidence under CC4.1 is one of the fastest ways to generate a finding.

When to Use Vulnerability Scanning vs. Penetration Testing

Use scanning continuously as ongoing evidence of monitoring. Use penetration testing periodically as deep validation. They are complements, not substitutes, and your SOC 2 control narrative should describe them as such.

Required Types of Penetration Testing for SOC 2

In-scope assets generally fall into five categories, each requiring a distinct testing approach. External network testing simulates an attacker on the public internet probing your perimeter, open ports, exposed services, and edge device vulnerabilities. Internal network testing assumes a foothold has already been gained and evaluates lateral movement paths, network segmentation, and privilege escalation opportunities. Web application testing typically follows the OWASP Web Security Testing Guide and targets injection, authentication, and session management flaws. API testing has become its own discipline as most SaaS products now expose core business logic through REST and GraphQL endpoints, making it a critical surface area for SOC 2 evidence. Cloud infrastructure testing for AWS, Azure, and GCP focuses on misconfigured IAM policies, exposed storage buckets, and overly permissive network controls, the most common source of material findings in modern SaaS environments.

What Makes a Good SOC 2 Penetration Test?

A good test pursues specific goals tied to your actual threat model: Can a customer access another customer’s data? Can an unauthenticated user reach administrative endpoints? Can an attacker pivot from a compromised application tier to the underlying cloud account? Generic test-everything engagements rarely produce findings that map cleanly to TSC controls, and they are harder for auditors to evaluate. Specificity is an asset, not a limitation.

The test must also match your SOC 2 audit scope precisely. If your system description names three products and the pentest covered only one, your auditor will issue a finding. Results must be actionable, CVSS scores alone are not enough. Each finding should include reproduction steps, business impact, and prioritized remediation guidance. Anything less wastes engineering time and adds friction at audit fieldwork.

Pro Tip: Avoiding Failed Audits

Auditors will reject a pentest report that consists only of automated scanner output rebadged as a penetration test. This pattern has become common with low-cost pentest-as-a-service providers, and major audit firms have started calling it out as insufficient evidence for CC4.1.

When Should You Perform Penetration Tests for SOC 2 Compliance?

Four scenarios drive timing decisions. The first is the audit deadline itself, a pentest performed too early in the audit window leaves stale findings; too late, and there is no time to remediate before the period closes. The second is a trigger event, such as a security incident or a newly disclosed CVE affecting your stack. The third is a material architecture change, a major deployment, a new authentication system, or a cloud migration that changes your attack surface significantly. The fourth is the basic annual cadence that maintains posture between audits regardless of whether anything has changed.

Worth Knowing: Scheduling a Pentest

Schedule your pentest 90 to 120 days before your audit period closes. That gives engineering time to remediate critical findings, your testing firm time to retest, and your auditor time to validate evidence before the report is drafted. Anything tighter is a recipe for a qualified opinion or a delayed close.

How to Prepare for and Perform Effective SOC 2 Penetration Testing

Preparation starts with scope definition aligned to your SOC 2 system boundary. Document every in-scope application, API, and cloud account. Confirm authentication paths and provision tester accounts before the engagement starts. Brief your testing firm on your threat model and share prior findings so they are not duplicating work.

Choose a testing team with explicit SOC 2 experience. Certifications worth verifying include OSCP, OSWE, CREST, and CISSP. Ask specifically whether the firm produces TSC-mapped reports and whether retests are included in scope, both are non-negotiable for audit-quality evidence. For a full walkthrough of what to look for, the SOC 2 guide covers vendor selection in detail.

Remediate every critical and high finding before the audit period closes. Document medium and low findings with risk acceptance memos or remediation timelines. Then present everything to your auditor as a structured package: pentest report, remediation evidence, retest results, and a control-mapping summary. Auditors appreciate a clean folder, it signals operational maturity.

SOC 2 Penetration Testing Checklist for 2026

Use the SOC 2 checklist as your master reference, and layer in the following for penetration testing specifically. Confirm scope matches your system description. Schedule the engagement 90 to 120 days before the audit window closes. Require Trust Services Criteria mapping in the final report. Ensure manual testing of authorization flows and business logic, not just infrastructure. Remediate all criticals and highs before the period ends. Retain retest evidence alongside the original findings. Store the complete package, report, remediation tickets, retest results, and control mapping, in a single audit folder before fieldwork begins.

What Are the Benefits of SOC 2 Penetration Testing?

Beyond audit evidence, a properly scoped pentest delivers compounding value. It reduces breach risk by surfacing exploitable vulnerabilities before an attacker does. It validates your engineering investment in security controls, giving your team actionable signal rather than theoretical risk scores. It supplies ready-made evidence for customer security reviews and third-party questionnaires that would otherwise require custom responses. And it provides a legally defensible position if a breach later occurs, demonstrating reasonable due diligence is increasingly relevant in regulatory and litigation contexts.

How Much Does a SOC 2 Penetration Test Cost?

For a standard SaaS scope covering one product, its API, and one cloud account, expect to budget $1,000 to $20,000 in 2026. Scope size is the largest cost driver, additional applications, multiple cloud environments, complex authentication flows, and Active Directory all push costs higher. Boutique specialist firms typically deliver better evidence-to-cost ratios than large consultancies, which often charge two to three times the boutique rate for comparable depth of work.

The hidden cost is retesting. Many providers quote a low headline price that excludes retest fees. A finding without retest evidence does not satisfy your auditor, so retests are not optional, they are part of the deliverable. Ask explicitly whether retesting is included before signing an engagement letter.

Reach SOC 2 Compliance in 6 Weeks or Less

Schedule Your Free SOC 2 Assessment Today

Closing Note

SOC 2 will not technically fail you for skipping a penetration test. But the operational reality of modern audits, enterprise procurement requirements, and customer security reviews makes one effectively mandatory. Treat the pentest as the most efficient piece of evidence you can produce for CC4.1, CC6.1, and CC7.1, scope it tightly to your system boundary, remediate findings before the audit window closes, and make sure the report can be read by an auditor without translation. Done well, it is the lightest-weight way to satisfy three of the most scrutinized criteria in SOC 2, and one of the few security investments that pays dividends both inside and outside the audit room.

Frequently Asked Questions About SOC 2 Penetration Testing Requirements

Is penetration testing required for SOC 2 Type I?

Not strictly, but most auditors expect one as evidence of control design. A Type I report without a recent pentest is harder to defend and more likely to generate follow-up requests during fieldwork.

Same answer, more emphatically. Type II tests operating effectiveness over time, and a pentest is the strongest available evidence that controls operate as designed across the audit period.

Annually at minimum, plus additional tests after material changes to architecture, authentication systems, or cloud infrastructure. Some high-velocity engineering organizations supplement annual testing with continuous automated assessment, though this should be discussed with your auditor before relying on it as a substitute.

An executive summary, defined scope and methodology, severity-rated findings with reproduction steps, CVSS scores, Trust Services Criteria control mapping, and prioritized remediation guidance. Retest evidence should be appended or submitted as a follow-on document before the audit period closes.

No. Vulnerability scans support CC7.1 as evidence of ongoing monitoring but do not substitute for the manual evaluation evidence auditors expect under CC4.1 and CC6.1. The two serve different evidentiary purposes and both should appear in your control set.

Any qualified third-party firm with a documented testing methodology and credentialed testers. SOC 2 does not specify required accreditations, but auditors look for evidence of tester independence, a recognized methodology, often referencing NIST SP 800-115, and verifiable tester qualifications such as OSCP or CREST membership.

Axipro Author

Picture of Pedro Dias

Pedro Dias

Pedro has been writing online for over 10 years. With experience in all things programming, cyber security, and compliance, he is our editor-in-chief at Axipro.

Blog Highlights

Explore More Articles

Two compromised versions of LiteLLM sat on PyPI for roughly 40 minutes on the morning of March 24, 2026. That window was enough to capture secrets from around 434,000 CI/CD pipeline runs across nearly 2,500 organizations, including AWS, Samsung, Cisco, Salesforce, Siemens, and Deloitte. In August, researchers at CloudSEK and Hudson Rock confirmed they had obtained the raw exfiltrated data: a 153GB archive containing 433,909 files of environment variables, cloud keys, Kubernetes secrets, and API tokens harvested live from running pipelines, as covered by Help Net Security’s reporting on the credential archive. If LiteLLM runs anywhere in your stack, or you touch any AI proxy infrastructure at all, you need answers to three things: whether you were exposed, what to rotate first, and whether the rotation you did back in March actually held. That last one matters more than it sounds, because “we rotated everything” has already burned at least one very large company. How the Breach Happened The attack didn’t start with LiteLLM. On March 19, 2026, a threat group called TeamPCP compromised the build pipeline of Trivy, a vulnerability scanner half the industry runs, and pushed a poisoned release. LiteLLM’s own CI pipeline ran Trivy, so the poisoned scanner had legitimate read access to the project’s runner environment. The attackers used that to steal LiteLLM’s PyPI publishing tokens and ship two malicious releases of their own: versions 1.82.7 and 1.82.8. KICS and the Telnyx Python SDK got hit in the same campaign. The payload design is the part worth studying. The malicious package dropped a .pth startup hook into site-packages, so the code ran the moment any Python interpreter started on the machine, whether or not anything imported LiteLLM. From there it harvested environment variables, read local credential files like .aws/credentials and .kube/config, tried to move laterally across Kubernetes clusters, and installed a systemd backdoor dressed up as a generic telemetry service. InfoQ’s coverage of the PyPI compromise put downloads of the compromised release above 40,000. For scale, LiteLLM normally gets downloaded around 3 million times a day. The exfiltration had a nasty fallback, too. According to CloudSEK, stolen data was encrypted and sent to a typosquatted domain, and when that failed, the malware created a public repository inside the victim’s own GitHub account and uploaded the loot as a release asset. Some companies were publishing their own secrets to the open internet and had no idea. Worth Knowing: The malicious code only existed in the PyPI artifacts. The GitHub source repository stayed clean the whole time, so a developer reviewing the code on GitHub saw nothing wrong. Source review isn’t artifact verification. If you don’t check that what the registry serves matches the upstream source, this class of attack is invisible to you. How to Check If You Were Exposed Three checks, from quickest to most involved. 1. Confirm whether the compromised versions ever ran The malicious versions went live on PyPI at 10:39 UTC on March 24, 2026 and got quarantined about 40 minutes later. The project’s advice: treat any install from that day before 16:00 UTC as suspect. Search your lockfiles, pip caches, SBOMs, and container image histories for 1.82.7 and 1.82.8. And check your internal artifact mirrors. An Artifactory or Nexus proxy that cached the bad release in March can keep serving it internally long after PyPI pulled it. Keep the .pth mechanism in mind when you scope this. The question isn’t “which applications import LiteLLM,” it’s “which machines had the package installed at all,” because every Python process on an infected machine triggered the payload. 2. Hunt for persistence Rotation is pointless if the attacker still has a foothold. Check developer machines, CI runners, and containers for unauthorized .pth files in site-packages and for suspicious systemd units, especially anything posing as a system telemetry service. And review activity from March 24 onward, not just the 40-minute window. Persistence is there so the access outlives the infection. Pro Tip: Don’t limit the persistence hunt to live machines. Base container images rebuilt in late March may have baked the payload into every image derived from them since. Scan your image registry for the affected LiteLLM versions and for unexpected .pth files, then trace which running workloads came from flagged images. 3. Check whether your secrets are in the dump Hudson Rock has published a domain lookup tool and is running ethical disclosures for affected organizations, and CloudSEK maintains a high-confidence victim list. Use them, but know their limits. Attribution in this dataset is genuinely hard. One dump with a siriusxm.com committer email actually traced, through its self-hosted GitLab endpoints, to AdsWizz, a SiriusXM subsidiary. And a large share of the dumps are generic pipeline configurations with no identifying domain, email, or server name at all. Absence from a victim list is not evidence of absence. If your pipelines ran the compromised versions, assume exposure no matter what a lookup tool tells you. What to Rotate, in What Order The guidance from both research teams is blunt: treat every secret the LiteLLM environment could reach as compromised. That covers secrets on disk, in memory, injected into CI jobs, and anything retrievable through instance metadata services. Work down by blast radius: Priority Credential type Why it comes first 1 Cloud IAM keys (AWS, GCP, Azure) Direct control of infrastructure, data stores, and billing. This is where attackers monetize fastest. 2 GitHub and GitLab PATs, package publishing tokens These let an attacker poison your releases and turn your company into the next link in the supply chain. 3 Kubernetes service account tokens and kubeconfigs Lateral movement across clusters was built into the payload, not a theoretical risk. 4 Database passwords and third-party API keys Dumped in plain text in the archive, often with no attribution, so nobody will warn you they leaked. 5 AI provider API keys Billing abuse, quota theft, and access to whatever data flows through your LLM routing layer. One word matters more than the rest of this article: revoke, don’t just rotate. That

The EU AI Act names recruitment AI as high-risk. Annex III explicitly lists AI systems used for recruitment, candidate selection, and employment decisions, which pulls CV screeners, video interview platforms, and assessment tools into the most demanding compliance regime the Act contains. The original compliance date for these systems was August 2, 2026. In June 2026, the EU’s Digital Omnibus moved the deadline to December 2, 2027, a 16-month extension that has led many HR and talent teams to shelve the topic entirely. That’s a mistake, for two reasons. First, one rule that directly affects recruitment technology is already in force: the ban on emotion recognition in the workplace has applied since February 2, 2025, and it catches features still shipping in some video interview products today. Second, the deferred obligations didn’t shrink. Conformity assessments, human oversight design, bias monitoring, and documentation all still arrive in full, and the practical work of auditing a recruitment stack, renegotiating vendor contracts, and training hiring teams routinely takes a year or more. Here’s what the EU AI Act actually requires of employers and vendors using recruitment tools, on the timeline that now applies. Why Recruitment Tools Are Classified as High-Risk Under the EU AI Act​ Definition of High-Risk AI Systems in Hiring​ The Act takes a list-based approach. Annex III, point 4, designates as high-risk any AI system intended for the recruitment or selection of natural persons, including placing targeted job advertisements, analyzing and filtering applications, and evaluating candidates. The same point covers AI used for decisions on promotion, termination, task allocation, and monitoring of workers, so the classification follows the tool through the entire employment lifecycle, not just the hiring funnel. The reasoning is straightforward: hiring decisions shape access to livelihoods, and algorithmic discrimination in hiring is well documented. The European Commission’s regulatory framework for AI treats employment as one of the areas where an AI error or bias causes serious harm to fundamental rights. That’s the test for the high-risk tier. Types of Recruitment Tools Affected In practice, the high-risk classification captures most of the modern recruitment stack: CV and resume screeners that rank or filter applicants, video interview platforms that score responses or delivery, psychometric and skills assessment tools that produce scores feeding a hiring decision, sourcing and matching algorithms that decide which candidates a recruiter sees, and programmatic job ad targeting systems that determine who sees a vacancy at all. If the system’s output materially influences who advances and who does not, assume high-risk until proven otherwise. Important: Emotion recognition is not high-risk in the workplace. It is prohibited. Article 5 bans AI systems that infer emotions of people in the workplace (outside narrow medical and safety cases), and that ban has applied since February 2025 with the Act’s top penalty tier attached. If your video interview vendor markets “engagement scoring” or “sentiment analysis” of candidates, that feature needs to be switched off for EU hiring now, not in 2027. Recruitment Tools That May Fall Outside High-Risk Classification Not everything in the HR stack qualifies. The Act carves out systems performing narrow procedural tasks that do not materially influence decision outcomes. An applicant tracking system that stores applications, schedules interviews, and sends templated emails is a database with a workflow, not a high-risk AI system. The same goes for tools that transcribe interviews without scoring them, deduplicate candidate records, or generate first drafts of job descriptions for a human to edit. The line is decision influence: the moment a tool ranks, scores, filters, or recommends candidates, it crosses into Annex III territory. Deployers who rely on an exemption must be able to document that assessment, so “we decided it doesn’t count” needs to exist on paper. Extraterritorial Scope: Which Employers Are Covered The Act applies to providers placing AI systems on the EU market and to deployers established in the EU, but it also reaches further: it covers providers and deployers located outside the EU where the output of the system is used in the EU. For recruitment, the consequence is blunt. A US or UK company with no EU entity that uses an AI screener to filter applicants for roles based in Berlin or Dublin, or that screens candidates located in the EU, is using the system’s output in the Union. Brexit doesn’t move UK employers out of scope when they hire into or from the EU. Providers vs. Deployers of Recruitment AI Tools The Act splits obligations between the provider (the vendor that develops the tool and places it on the market) and the deployer (the employer using it). Most employers are deployers, and deployer obligations are lighter but real. One common trap: an employer that substantially modifies a high-risk system, or puts its own name on it, can be reclassified as a provider and inherit the full provider stack. Heavy customization of a screening model, or fine-tuning it on your own hiring data, can be enough to trigger this. Key Obligations for Employers Using AI Recruitment Tools Human Oversight in Automated Hiring Decisions Deployers must assign oversight of the system to people with the competence, training, and authority to intervene. That last word matters. A recruiter who rubber-stamps whatever the ranking algorithm produces, because nobody has time to review 800 rejected CVs, doesn’t count as oversight. Regulators and courts will look at whether the human could genuinely override the system and whether they ever did. Designing review checkpoints where a person can meaningfully change the outcome, and logging when they do, is the core of compliant deployment. Transparency Requirements Toward Candidates Employers must inform workers and their representatives before putting a high-risk AI system into use at work, and candidates subjected to such a system must be told it is being used. In countries with works councils, such as Germany, this obligation lands on top of existing co-determination rights, so employee representatives may need to be consulted before the tool goes live rather than just told afterward. Burying an AI disclosure in a privacy policy paragraph is unlikely to survive scrutiny.

A green dashboard is not an audit opinion. Compliance automation platforms like Vanta, Drata, Secureframe, and Hyperproof have made SOC 2 readiness faster and cheaper, but every audit cycle produces the same pattern: controls that sat at “passing” for months come back from the auditor with exceptions or requests for re-testing. The four controls below account for a disproportionate share of those rejections, and they all fail for the same underlying reason. The tool confirmed that evidence exists. The auditor tested whether the control actually operated. This article walks through each of the four: what auditors reject, why, and how to fix the evidence before fieldwork starts. Why Compliance Tools Show “Passing” But Auditors Still Reject Controls​ The Gap Between Automated Checks and Auditor Judgment Compliance platforms run continuous control monitoring: API calls that check whether a configuration exists, a document is uploaded, or a task is marked done. That’s real value. It catches drift, keeps evidence in one place, and saves weeks of screenshot collection. An audit is a different exercise. A SOC 2 examination is an attestation performed by a CPA firm under AICPA standards, and the auditor’s job is to form an independent opinion on whether your controls met the Trust Services Criteria. That opinion rests on professional judgment, not on whether an API integration returned a 200 response. What “Passing” Actually Means in Your Compliance Dashboard​ When a control shows “passing,” the platform is telling you one narrow thing: at the moment of the last scan, an automated test found the artifact or setting it was programmed to look for: MFA enforced in the identity provider, a policy document uploaded, a training campaign sitting at 100%. The test says nothing about whether the underlying process ran the way your control narrative claims it did, or whether it ran that way across the whole audit period. How Auditors Evaluate Controls Beyond the Checkbox Auditors test two dimensions. Design effectiveness asks whether the control, as described, would meet the criterion if it worked as intended. Operating effectiveness, the core of a SOC 2 Type 2 report, asks whether it actually did throughout the audit period. To answer that, the auditor pulls a population (every access review, every change, every new hire in the period), selects a sample, and inspects the evidence item by item. A dashboard status feeds into that process. It doesn’t replace it. Insider Note: Auditors increasingly ask for evidence outside the compliance platform precisely because they know what the platform auto-collects. If every artifact you produce comes from the same tool export, expect the auditor to independently pull the population from the source system and compare. Discrepancies between the two are one of the fastest routes to an exception. Control #1: Access Reviews That Automation Marks Complete but Auditors Reject Why Auditors Reject Automated Access Review Evidence​ User access reviews sit under the logical access criteria (CC6.1 through CC6.3), and they are the single most common source of audit exceptions we see. The typical failure: the platform generated a user list, someone clicked “complete,” and the dashboard turned green. The auditor then asks a simple question the evidence can’t answer: what did the reviewer actually decide? The Missing Element: Documented Reviewer Judgment​ An access review is a judgment control. Someone with knowledge of the system must look at each account and confirm the access is still appropriate for the person’s role. A timestamped task closure proves the task was closed. It doesn’t prove anyone assessed anything, and an “approve all” review completed in ninety seconds gets exactly the skepticism it deserves. What Auditors Actually Want to See in Access Review Evidence Auditors look for four things: The full population of accounts at the time of review (including service accounts and admin roles), Evidence of who reviewed it and when, explicit dispositions per account or group (retain, modify, revoke), and Proof that flagged access was actually removed. That last item, the deprovisioning ticket showing revocation within a defined window, is the piece most companies can’t produce. How to Fix Your Access Review Control Before the Audit​ Assign a named control owner per in-scope system, run reviews quarterly, and require reviewers to record a disposition for every line, not a blanket approval. When access is revoked, link the removal ticket to the review record. If a quarter was missed, don’t backfill it. Document it honestly and show the remediation, because auditors treat fabricated retroactive evidence far more severely than a disclosed gap. Control #2: Change Management Approvals That Pass Automated Scans​ Why Ticket Closure Isn’t Proof of Approval​ Change management (CC8.1) automation typically verifies that production changes link to a ticket and the ticket is closed. Auditors test something stricter: that each sampled change was approved by an authorized person before deployment. An approval added after the merge, or a ticket closed by the same engineer who wrote the code, fails that test even though every automated check came back green. The Segregation of Duties Problem Automation Misses Segregation of duties is the requirement that no single person can develop, approve, and deploy the same change. NIST’s SP 800-53 control catalog treats it as a foundational access control principle, and SOC 2 auditors apply the same logic. Small engineering teams trip on this constantly. Self-approved pull requests, admins who can bypass branch protection, direct pushes to main: a scanner sees “changes with tickets” while an auditor sees SoD violations. Emergency Changes and Retroactive Approvals: Common Rejection Triggers​ Every audit period contains hotfixes. Auditors don’t reject emergency changes. They reject emergency changes with no documented post-hoc review. If your policy says urgent changes get retroactive approval within two business days, the auditor will sample your emergency changes and check exactly that. No policy, or a policy nobody followed, produces an exception. Rebuilding Change Management Evidence Auditors Will Accept​ Enforce the control technically: branch protection requiring at least one independent reviewer, no admin bypass, and deploy pipelines that only run from protected branches. Then write the emergency change procedure down and generate the review artifact every time it fires.