Table of Contents

Reach SOC 2 Compliance in 6 Weeks or Less.

  / ISO 27001 Penetration Testing: What Auditors Expect and How to Deliver It

ISO 27001 Penetration Testing: What Auditors Expect and How to Deliver It

ISO 27001 does not use the words “penetration test” anywhere. And yet, auditors conducting Stage 2 assessments routinely expect to see one

Understanding why that gap exists, and how to close it, is what separates organizations that sail through ISO 27001 certification from those that get caught off-guard.

This guide covers what the standard actually says about security testing, which controls drive the expectation for penetration testing, what types of testing are relevant, and how to build a testing programme that genuinely supports your ISMS rather than simply ticking a compliance box.

ISO 27001 Pentesting

What Is Penetration Testing in the context of ISO 27001?

ISO 27001 penetration testing refers to structured, simulated attacks conducted against an organization’s systems, networks, and applications in order to identify exploitable vulnerabilities before real attackers do. In the context of ISO 27001, it serves a specific purpose: providing evidence that the technical controls underpinning your Information Security Management System (ISMS) actually work under real-world conditions.

The distinction matters. A vulnerability scan tells you what weaknesses exist whilst a penetration test tells you whether those weaknesses are exploitable, to what degree, and with what consequence. That difference is exactly what auditors are looking for when they ask for testing evidence.

Penetration testing is not an isolated activity in an ISO 27001 programme. Its findings feed directly into three of the most scrutinised documents in your ISMS: the risk register, the risk treatment plan, and the Statement of Applicability (SoA). A risk listed in your register as “medium” looks very different once a tester has demonstrated they can chain it into a full domain compromise.

Is Penetration Testing a Requirement for ISO 27001?

No, it is not explicitly required. The standard does not mandate it by name.

What ISO 27001 does require is that organisations establish and maintain a functioning ISMS, perform systematic risk assessments (Clause 6.1.2), implement appropriate controls (Clause 8), evaluate the performance and effectiveness of those controls (Clause 9), and pursue continual improvement (Clause 10). Vulnerability assessment and penetration testing supports every one of those activities with hard evidence.

Two Annex A controls make it practically impossible to demonstrate compliance without some form of penetration testing: A.8.8 (Management of Technical Vulnerabilities) and A.8.29 (Security Testing in Development and Acceptance). Auditors conducting Stage 2 assessments will expect to see testing evidence mapped to both. Organisations that substitute a vulnerability scan report and call it done regularly receive non-conformances.

The absence of an explicit penetration testing requirement is sometimes misread as permission to skip it. In practice, certified auditors universally expect evidence of testing that goes beyond automated scanning. Relying solely on scan reports is the fastest route to a failed audit.

What ISO 27001:2022 Says About Security Testing

Annex A 8.29: Security Testing in Development and Acceptance

Annex A 8.29 requires organisations to define and implement security testing processes throughout the development lifecycle and before final acceptance of any system. This applies to both in-house development and outsourced or third-party software.

The control is preventive in nature. Its purpose is to ensure that no application, database, or system goes into production with known, unmitigated vulnerabilities. For in-house development, the standard specifically references conducting code reviews, performing vulnerability scans, and carrying out penetration tests to identify weak coding and design. For outsourced environments, organisations must set contractual requirements that ensure suppliers meet equivalent security testing standards, accepting a supplier’s assurance without evidence is not sufficient.

Annex A 8.29 does not prescribe specific tools or techniques. What it demands is that testing is risk-based, documented, and proportionate to the sensitivity and exposure of the system. A low-risk internal tool used by five people warrants a different level of scrutiny than a customer-facing payment platform. Security testing should scale with risk, and it should happen throughout development, not only at the end.

Worth knowing: Annex A 8.29 consolidates two controls from ISO 27001:2013, specifically A.14.2.8 (System security testing) and A.14.2.9 (System acceptance testing), into a single, clearer requirement. The 2022 version makes the expectation of penetration testing more explicit, particularly for major releases and architectural changes.

Auditors will ask to see signed penetration test reports or independent security audit summaries for recent major system updates. If such evidence does not exist, they have grounds to mark the control as non-compliant.

Annex A 8.8: Management of Technical Vulnerabilities

Annex A 8.8 is the vulnerability management control. It requires organisations to identify, assess, and address technical vulnerabilities in a timely manner, taking a proactive and risk-based approach rather than reacting only when something breaks.

Crucially, the control explicitly lists periodic, documented penetration tests, conducted either by internal staff or by a qualified third party, as a method for identifying vulnerabilities. Automated scanners have their place, but penetration tests are recognised here as the mechanism for discovering high-risk weaknesses that scanners routinely miss: logic flaws, chained vulnerabilities, privilege escalation paths, and misconfigurations that only become dangerous in combination.

Annex A 8.8 replaces two controls from ISO 27001:2013: A.12.6.1 (Technical vulnerability management) and A.18.2.3 (Technical compliance review). The 2022 version introduces a broader, more holistic approach, including the organisation’s public responsibilities, the role of cloud providers, and the expectation that vulnerability management is integrated with change management rather than treated as a separate activity.

Reach SOC 2 Compliance in 6 Weeks or Less

Schedule Your Free SOC 2 Assessment Today

The Role of Penetration Testing in ISO 27001 Compliance

Risk Assessment and Treatment

ISO 27001’s risk-based model sits at the core of everything. Penetration testing feeds that model with real-world evidence rather than hypothetical assumptions. When a tester demonstrates that an attacker can move laterally from a compromised workstation to a production database in four steps, that finding transforms what was previously a theoretical risk into a documented, evidenced vulnerability with a severity rating, an exploitability score, and a required remediation action.

This evidence directly informs how risks are treated. ISO 27001 requires organisations to choose one of four treatment options for each risk: mitigate, accept, avoid, or transfer. Without penetration test data, those decisions rest on estimation. With it, they rest on proof. If you haven’t yet mapped your current control gaps against what testers are likely to find, an gap analysis is a useful starting point before commissioning a test.

Security Controls Validation

Your ISMS documentation asserts that certain controls are in place and working. Penetration testing verifies whether that is actually true. Network segmentation, multi-factor authentication, access restrictions, encryption in transit: these can all appear correctly configured on paper while being trivially bypassable in practice.

According to NIST Special Publication 800-115, organisations should conduct analysis and reporting that translates penetration test findings into concrete risk mitigation actions. Mapping each finding to a specific Annex A control, and documenting whether that control withstood or failed the test, is precisely the kind of evidence that satisfies an auditor and strengthens your SoA.

Monitoring and Continual Improvement

ISO 27001’s Clause 10 requires continual improvement of the ISMS. Penetration testing is one of the most direct mechanisms for driving that improvement. Each test cycle identifies new weaknesses, confirms previous remediations are holding, and adjusts your risk picture to reflect changes in the threat landscape and your own infrastructure. An annual penetration test programme, properly integrated with your risk register, is a living feedback loop rather than a point-in-time snapshot.

Types of Penetration Testing for ISO 27001

ISO 27001 · ISMS-Scoped
Penetration Testing Categories
Every asset type within scope is a candidate for testing proportionate to its risk profile
ISMS scope boundary
Network Infrastructure
Routers, firewalls, switches and remote access controls
Annex A 8.20
Web Application Security
Injection attacks, broken auth and business logic flaws
Wireless Testing
Wi-Fi networks, rogue access points and weak encryption
Application & API Security
Auth weaknesses, data exposure and rate-limiting gaps
Annex A 8.29
Social Engineering
Phishing and pretexting to assess personnel controls
Annex A 6.3
Mobile Security
Insecure data storage and transport layer security gaps
Remote Working Assessment
VPN configs, endpoint controls and cloud access paths
Firewall Configuration Review
Rule sets, zone configs and permissive policy drift
Scope: all asset types within the ISMS boundary are candidates for testing
Annex A control mapped

The scope of penetration testing for ISO 27001 should align with the boundaries of your ISMS. Every asset type that falls within scope is a candidate for testing proportionate to its risk profile. The following categories represent the most relevant testing types for organisations pursuing or maintaining certification.

Network Infrastructure Testing evaluates routers, firewalls, switches, intrusion detection systems, and remote access controls. Testers attempt to bypass network defences, pivot between segments, and exploit protocol weaknesses. This directly validates Annex A 8.20 (Secure network architecture).

Web Application Security Testing assesses internet-facing applications for vulnerabilities including injection attacks, broken authentication, insecure direct object references, and business logic flaws. The OWASP Top 10 provides a widely accepted reference framework for this type of testing.

Wireless Testing examines the security of Wi-Fi networks, including rogue access points, weak encryption configurations, and captive portal bypasses. Wireless environments are frequently underscoped in ISO 27001 programmes despite representing a meaningful attack surface.

Application and API Security Review assesses internal and external APIs for authentication weaknesses, excessive data exposure, rate-limiting failures, and injection vulnerabilities. As API-driven architectures become the norm, this testing type has grown in direct relevance to Annex A 8.29 compliance.

Social Engineering Testing simulates phishing campaigns and pretexting attempts to assess whether personnel controls are effective. This type directly informs people-focused controls including Annex A 6.3 (Information security awareness, education and training).

Mobile Security Testing reviews mobile applications and their backend interactions for insecure data storage, weak authentication, and insufficient transport layer security.

Remote Working Assessment evaluates the security of remote access infrastructure, VPN configurations, endpoint controls, and cloud access pathways. Given the permanent shift to hybrid working in most organisations, this assessment type is increasingly relevant to any ISMS scope.

Firewall Configuration Review examines rule sets, zone configurations, and egress controls to identify permissive rules, redundant exceptions, and policy drift that may have accumulated over time.

Penetration Testing Perspectives and Methodologies

The perspective from which a penetration test is conducted determines what it can realistically find. Choosing the right methodology for each testing context is part of scoping effectively. For a deeper look at the trade-offs involved, see our guide on automated vs manual penetration testing.

Black Box Testing provides the tester with no prior knowledge of the target environment. This most closely simulates an external attacker who has done reconnaissance but has no insider access. It is realistic in terms of attack simulation but may miss issues that require architectural understanding to identify.

Grey Box Testing gives the tester partial information: network diagrams, application credentials, or high-level architecture documentation. This is often the most practical approach for ISO 27001 engagements because it balances realism with efficiency. The tester can focus on meaningful attack paths rather than spending engagement time on reconnaissance.

White Box Testing provides full access to source code, architecture documentation, and configuration details. This is the most thorough approach and is particularly relevant to Annex A 8.29, where the goal is to identify insecure coding patterns and design flaws before deployment.

Pro Tip

For most organizations pursuing ISO 27001 certification, a combination of grey box external testing and white box application testing offers the best return on investment. The former validates perimeter and infrastructure controls; the latter directly evidences Annex A 8.29 compliance for development environments.

What Should an ISO 27001 Penetration Test Plan Include?

A penetration test without a documented plan produces findings that are difficult to defend in an audit. The plan should define the scope (which systems, IP ranges, and applications), the testing methodology (black, grey, or white box), the testing window, rules of engagement, and who has authorised the engagement.

The resulting report should include an executive summary that maps findings to business impact, a technical findings section with severity ratings tied to a recognised scoring system such as CVSS, remediation guidance for each finding, and a retesting section that confirms whether fixes are effective. Findings should be explicitly mapped to Annex A controls wherever possible. An auditor reviewing this report should be able to trace each finding to a specific risk, a treatment decision, and an outcome.

Critically, penetration test documentation should be stored in your organisation’s native ISMS repositories, your SharePoint, Confluence, or equivalent. Findings sitting inside a third-party tool’s dashboard are not visible to auditors and do not demonstrate management ownership or oversight.

How Penetration Testing Supports Your ISMS

In-House Development Environments

For organisations that develop software internally, Annex A 8.29 requires that security testing is embedded in the development lifecycle, not bolted on at the end. Penetration testing is listed specifically as a method for identifying weak coding and design. The practical expectation is that significant releases and architectural changes are subject to an independent penetration test before promotion to production. “Independent” is the operative word: internal developers testing their own code does not meet the requirement.

Outsourced Development Environments

Where development is delegated to a third party, the organisation remains responsible for security outcomes. Annex A 8.29 requires that contractual arrangements include security testing requirements, and Annex A 5.20 (Supplier relationships) establishes the broader framework for managing supplier security obligations. Accepting a vendor’s self-attestation in lieu of test evidence introduces risk that auditors will probe.

Structural and Organisational Changes

Penetration testing should not be a purely calendar-driven exercise. Any significant change, a cloud migration, a new application, a network rearchitecture, an acquisition, reintroduces risk that existing controls may not adequately address. ISO 27001’s change management requirements (Annex A 8.32) and continual improvement obligations both support the case for trigger-based testing in addition to annual cycles.

ISO 27001:2022 vs ISO 27001:2013: Changes to Security Testing Requirements

What Changed in Annex A 8.29 for ISO 27001:2022

The 2022 update consolidated Annex A 14.2.8 (System security testing) and A.14.2.9 (System acceptance testing) from the 2013 standard into a single, clearer control: A.8.29. The consolidation is not merely administrative. The new control is more explicit about the requirement for security testing in both the development phase and at acceptance, for both in-house and outsourced environments.

The 2022 version also places greater emphasis on the idea that testing must be risk-based and documented, not performed as a routine checklist exercise. Auditors under the 2022 standard are expected to check not only that testing occurred, but that test plans linked security requirements to test cases, that findings were triaged appropriately, and that remediation was verified before sign-off. This is a meaningful shift from how many organisations approached the 2013 requirements.

How ISO 27001:2013 Approached Acceptance Testing

Under the 2013 standard, acceptance testing (A.14.2.9) was largely focused on confirming that new systems met predefined acceptance criteria before deployment. Security testing (A.14.2.8) addressed systematic testing of systems against defined security requirements. The two controls were related but treated separately, and in practice many organisations satisfied them with functional test results rather than dedicated security testing. The 2022 consolidation closes that gap by making security validation in both development and acceptance a single, unified expectation. Organisations still working toward transition should also review the common ISO 27001 pitfalls that trip up programmes during this shift.

How to Maintain ISO 27001 Certification Through Ongoing Penetration Testing

Certification is not a destination. Annual surveillance audits and three-yearly recertification audits require ongoing evidence that your ISMS is functioning, including that security testing is current and that findings are being acted upon.

The practical standard for maintaining certification through penetration testing involves testing at least annually, with additional targeted tests following material changes to systems or infrastructure. Tests should be completed six to eight weeks before any scheduled audit to allow time for remediation. Maintain a remediation log that maps each finding to a closure date and a verification test, and formally accept in writing any residual risk that cannot be fully remediated before the audit.

The risk register and Statement of Applicability should always reflect the most recent test cycle. If a penetration test uncovered a weakness in network segmentation six months ago and your SoA still describes segmentation as fully effective, an auditor will notice the inconsistency. For organisations building out or reassessing their current testing programme, starting with an ISO 27001 gap analysis is an effective way to prioritise where testing effort is most urgently needed.

Organisations that are new to this process or working through a transition to the 2022 standard often benefit from working with an experienced ISO 27001 consultant who can align the testing programme with audit expectations from the outset. Equally, pairing your penetration testing evidence with a rigorous ISO 27001 internal audit process, or using dedicated internal audit services, ensures that findings are properly integrated into your ISMS before an external auditor arrives.

If you are ready to build a penetration testing programme that holds up under audit scrutiny, or need support aligning your existing testing evidence with ISO 27001 requirements, contact us to discuss your situation. You may also find it useful to learn more about how compliance automation tools can support your broader ISMS programme.

Axipro Author

Picture of Pedro Dias

Pedro Dias

Pedro has been writing online for over 10 years. With experience in all things programming, cyber security, and compliance, he is our editor-in-chief at Axipro.

Blog Highlights

Explore More Articles

Two compromised versions of LiteLLM sat on PyPI for roughly 40 minutes on the morning of March 24, 2026. That window was enough to capture secrets from around 434,000 CI/CD pipeline runs across nearly 2,500 organizations, including AWS, Samsung, Cisco, Salesforce, Siemens, and Deloitte. In August, researchers at CloudSEK and Hudson Rock confirmed they had obtained the raw exfiltrated data: a 153GB archive containing 433,909 files of environment variables, cloud keys, Kubernetes secrets, and API tokens harvested live from running pipelines, as covered by Help Net Security’s reporting on the credential archive. If LiteLLM runs anywhere in your stack, or you touch any AI proxy infrastructure at all, you need answers to three things: whether you were exposed, what to rotate first, and whether the rotation you did back in March actually held. That last one matters more than it sounds, because “we rotated everything” has already burned at least one very large company. How the Breach Happened The attack didn’t start with LiteLLM. On March 19, 2026, a threat group called TeamPCP compromised the build pipeline of Trivy, a vulnerability scanner half the industry runs, and pushed a poisoned release. LiteLLM’s own CI pipeline ran Trivy, so the poisoned scanner had legitimate read access to the project’s runner environment. The attackers used that to steal LiteLLM’s PyPI publishing tokens and ship two malicious releases of their own: versions 1.82.7 and 1.82.8. KICS and the Telnyx Python SDK got hit in the same campaign. The payload design is the part worth studying. The malicious package dropped a .pth startup hook into site-packages, so the code ran the moment any Python interpreter started on the machine, whether or not anything imported LiteLLM. From there it harvested environment variables, read local credential files like .aws/credentials and .kube/config, tried to move laterally across Kubernetes clusters, and installed a systemd backdoor dressed up as a generic telemetry service. InfoQ’s coverage of the PyPI compromise put downloads of the compromised release above 40,000. For scale, LiteLLM normally gets downloaded around 3 million times a day. The exfiltration had a nasty fallback, too. According to CloudSEK, stolen data was encrypted and sent to a typosquatted domain, and when that failed, the malware created a public repository inside the victim’s own GitHub account and uploaded the loot as a release asset. Some companies were publishing their own secrets to the open internet and had no idea. Worth Knowing: The malicious code only existed in the PyPI artifacts. The GitHub source repository stayed clean the whole time, so a developer reviewing the code on GitHub saw nothing wrong. Source review isn’t artifact verification. If you don’t check that what the registry serves matches the upstream source, this class of attack is invisible to you. How to Check If You Were Exposed Three checks, from quickest to most involved. 1. Confirm whether the compromised versions ever ran The malicious versions went live on PyPI at 10:39 UTC on March 24, 2026 and got quarantined about 40 minutes later. The project’s advice: treat any install from that day before 16:00 UTC as suspect. Search your lockfiles, pip caches, SBOMs, and container image histories for 1.82.7 and 1.82.8. And check your internal artifact mirrors. An Artifactory or Nexus proxy that cached the bad release in March can keep serving it internally long after PyPI pulled it. Keep the .pth mechanism in mind when you scope this. The question isn’t “which applications import LiteLLM,” it’s “which machines had the package installed at all,” because every Python process on an infected machine triggered the payload. 2. Hunt for persistence Rotation is pointless if the attacker still has a foothold. Check developer machines, CI runners, and containers for unauthorized .pth files in site-packages and for suspicious systemd units, especially anything posing as a system telemetry service. And review activity from March 24 onward, not just the 40-minute window. Persistence is there so the access outlives the infection. Pro Tip: Don’t limit the persistence hunt to live machines. Base container images rebuilt in late March may have baked the payload into every image derived from them since. Scan your image registry for the affected LiteLLM versions and for unexpected .pth files, then trace which running workloads came from flagged images. 3. Check whether your secrets are in the dump Hudson Rock has published a domain lookup tool and is running ethical disclosures for affected organizations, and CloudSEK maintains a high-confidence victim list. Use them, but know their limits. Attribution in this dataset is genuinely hard. One dump with a siriusxm.com committer email actually traced, through its self-hosted GitLab endpoints, to AdsWizz, a SiriusXM subsidiary. And a large share of the dumps are generic pipeline configurations with no identifying domain, email, or server name at all. Absence from a victim list is not evidence of absence. If your pipelines ran the compromised versions, assume exposure no matter what a lookup tool tells you. What to Rotate, in What Order The guidance from both research teams is blunt: treat every secret the LiteLLM environment could reach as compromised. That covers secrets on disk, in memory, injected into CI jobs, and anything retrievable through instance metadata services. Work down by blast radius: Priority Credential type Why it comes first 1 Cloud IAM keys (AWS, GCP, Azure) Direct control of infrastructure, data stores, and billing. This is where attackers monetize fastest. 2 GitHub and GitLab PATs, package publishing tokens These let an attacker poison your releases and turn your company into the next link in the supply chain. 3 Kubernetes service account tokens and kubeconfigs Lateral movement across clusters was built into the payload, not a theoretical risk. 4 Database passwords and third-party API keys Dumped in plain text in the archive, often with no attribution, so nobody will warn you they leaked. 5 AI provider API keys Billing abuse, quota theft, and access to whatever data flows through your LLM routing layer. One word matters more than the rest of this article: revoke, don’t just rotate. That

The EU AI Act names recruitment AI as high-risk. Annex III explicitly lists AI systems used for recruitment, candidate selection, and employment decisions, which pulls CV screeners, video interview platforms, and assessment tools into the most demanding compliance regime the Act contains. The original compliance date for these systems was August 2, 2026. In June 2026, the EU’s Digital Omnibus moved the deadline to December 2, 2027, a 16-month extension that has led many HR and talent teams to shelve the topic entirely. That’s a mistake, for two reasons. First, one rule that directly affects recruitment technology is already in force: the ban on emotion recognition in the workplace has applied since February 2, 2025, and it catches features still shipping in some video interview products today. Second, the deferred obligations didn’t shrink. Conformity assessments, human oversight design, bias monitoring, and documentation all still arrive in full, and the practical work of auditing a recruitment stack, renegotiating vendor contracts, and training hiring teams routinely takes a year or more. Here’s what the EU AI Act actually requires of employers and vendors using recruitment tools, on the timeline that now applies. Why Recruitment Tools Are Classified as High-Risk Under the EU AI Act​ Definition of High-Risk AI Systems in Hiring​ The Act takes a list-based approach. Annex III, point 4, designates as high-risk any AI system intended for the recruitment or selection of natural persons, including placing targeted job advertisements, analyzing and filtering applications, and evaluating candidates. The same point covers AI used for decisions on promotion, termination, task allocation, and monitoring of workers, so the classification follows the tool through the entire employment lifecycle, not just the hiring funnel. The reasoning is straightforward: hiring decisions shape access to livelihoods, and algorithmic discrimination in hiring is well documented. The European Commission’s regulatory framework for AI treats employment as one of the areas where an AI error or bias causes serious harm to fundamental rights. That’s the test for the high-risk tier. Types of Recruitment Tools Affected In practice, the high-risk classification captures most of the modern recruitment stack: CV and resume screeners that rank or filter applicants, video interview platforms that score responses or delivery, psychometric and skills assessment tools that produce scores feeding a hiring decision, sourcing and matching algorithms that decide which candidates a recruiter sees, and programmatic job ad targeting systems that determine who sees a vacancy at all. If the system’s output materially influences who advances and who does not, assume high-risk until proven otherwise. Important: Emotion recognition is not high-risk in the workplace. It is prohibited. Article 5 bans AI systems that infer emotions of people in the workplace (outside narrow medical and safety cases), and that ban has applied since February 2025 with the Act’s top penalty tier attached. If your video interview vendor markets “engagement scoring” or “sentiment analysis” of candidates, that feature needs to be switched off for EU hiring now, not in 2027. Recruitment Tools That May Fall Outside High-Risk Classification Not everything in the HR stack qualifies. The Act carves out systems performing narrow procedural tasks that do not materially influence decision outcomes. An applicant tracking system that stores applications, schedules interviews, and sends templated emails is a database with a workflow, not a high-risk AI system. The same goes for tools that transcribe interviews without scoring them, deduplicate candidate records, or generate first drafts of job descriptions for a human to edit. The line is decision influence: the moment a tool ranks, scores, filters, or recommends candidates, it crosses into Annex III territory. Deployers who rely on an exemption must be able to document that assessment, so “we decided it doesn’t count” needs to exist on paper. Extraterritorial Scope: Which Employers Are Covered The Act applies to providers placing AI systems on the EU market and to deployers established in the EU, but it also reaches further: it covers providers and deployers located outside the EU where the output of the system is used in the EU. For recruitment, the consequence is blunt. A US or UK company with no EU entity that uses an AI screener to filter applicants for roles based in Berlin or Dublin, or that screens candidates located in the EU, is using the system’s output in the Union. Brexit doesn’t move UK employers out of scope when they hire into or from the EU. Providers vs. Deployers of Recruitment AI Tools The Act splits obligations between the provider (the vendor that develops the tool and places it on the market) and the deployer (the employer using it). Most employers are deployers, and deployer obligations are lighter but real. One common trap: an employer that substantially modifies a high-risk system, or puts its own name on it, can be reclassified as a provider and inherit the full provider stack. Heavy customization of a screening model, or fine-tuning it on your own hiring data, can be enough to trigger this. Key Obligations for Employers Using AI Recruitment Tools Human Oversight in Automated Hiring Decisions Deployers must assign oversight of the system to people with the competence, training, and authority to intervene. That last word matters. A recruiter who rubber-stamps whatever the ranking algorithm produces, because nobody has time to review 800 rejected CVs, doesn’t count as oversight. Regulators and courts will look at whether the human could genuinely override the system and whether they ever did. Designing review checkpoints where a person can meaningfully change the outcome, and logging when they do, is the core of compliant deployment. Transparency Requirements Toward Candidates Employers must inform workers and their representatives before putting a high-risk AI system into use at work, and candidates subjected to such a system must be told it is being used. In countries with works councils, such as Germany, this obligation lands on top of existing co-determination rights, so employee representatives may need to be consulted before the tool goes live rather than just told afterward. Burying an AI disclosure in a privacy policy paragraph is unlikely to survive scrutiny.

A green dashboard is not an audit opinion. Compliance automation platforms like Vanta, Drata, Secureframe, and Hyperproof have made SOC 2 readiness faster and cheaper, but every audit cycle produces the same pattern: controls that sat at “passing” for months come back from the auditor with exceptions or requests for re-testing. The four controls below account for a disproportionate share of those rejections, and they all fail for the same underlying reason. The tool confirmed that evidence exists. The auditor tested whether the control actually operated. This article walks through each of the four: what auditors reject, why, and how to fix the evidence before fieldwork starts. Why Compliance Tools Show “Passing” But Auditors Still Reject Controls​ The Gap Between Automated Checks and Auditor Judgment Compliance platforms run continuous control monitoring: API calls that check whether a configuration exists, a document is uploaded, or a task is marked done. That’s real value. It catches drift, keeps evidence in one place, and saves weeks of screenshot collection. An audit is a different exercise. A SOC 2 examination is an attestation performed by a CPA firm under AICPA standards, and the auditor’s job is to form an independent opinion on whether your controls met the Trust Services Criteria. That opinion rests on professional judgment, not on whether an API integration returned a 200 response. What “Passing” Actually Means in Your Compliance Dashboard​ When a control shows “passing,” the platform is telling you one narrow thing: at the moment of the last scan, an automated test found the artifact or setting it was programmed to look for: MFA enforced in the identity provider, a policy document uploaded, a training campaign sitting at 100%. The test says nothing about whether the underlying process ran the way your control narrative claims it did, or whether it ran that way across the whole audit period. How Auditors Evaluate Controls Beyond the Checkbox Auditors test two dimensions. Design effectiveness asks whether the control, as described, would meet the criterion if it worked as intended. Operating effectiveness, the core of a SOC 2 Type 2 report, asks whether it actually did throughout the audit period. To answer that, the auditor pulls a population (every access review, every change, every new hire in the period), selects a sample, and inspects the evidence item by item. A dashboard status feeds into that process. It doesn’t replace it. Insider Note: Auditors increasingly ask for evidence outside the compliance platform precisely because they know what the platform auto-collects. If every artifact you produce comes from the same tool export, expect the auditor to independently pull the population from the source system and compare. Discrepancies between the two are one of the fastest routes to an exception. Control #1: Access Reviews That Automation Marks Complete but Auditors Reject Why Auditors Reject Automated Access Review Evidence​ User access reviews sit under the logical access criteria (CC6.1 through CC6.3), and they are the single most common source of audit exceptions we see. The typical failure: the platform generated a user list, someone clicked “complete,” and the dashboard turned green. The auditor then asks a simple question the evidence can’t answer: what did the reviewer actually decide? The Missing Element: Documented Reviewer Judgment​ An access review is a judgment control. Someone with knowledge of the system must look at each account and confirm the access is still appropriate for the person’s role. A timestamped task closure proves the task was closed. It doesn’t prove anyone assessed anything, and an “approve all” review completed in ninety seconds gets exactly the skepticism it deserves. What Auditors Actually Want to See in Access Review Evidence Auditors look for four things: The full population of accounts at the time of review (including service accounts and admin roles), Evidence of who reviewed it and when, explicit dispositions per account or group (retain, modify, revoke), and Proof that flagged access was actually removed. That last item, the deprovisioning ticket showing revocation within a defined window, is the piece most companies can’t produce. How to Fix Your Access Review Control Before the Audit​ Assign a named control owner per in-scope system, run reviews quarterly, and require reviewers to record a disposition for every line, not a blanket approval. When access is revoked, link the removal ticket to the review record. If a quarter was missed, don’t backfill it. Document it honestly and show the remediation, because auditors treat fabricated retroactive evidence far more severely than a disclosed gap. Control #2: Change Management Approvals That Pass Automated Scans​ Why Ticket Closure Isn’t Proof of Approval​ Change management (CC8.1) automation typically verifies that production changes link to a ticket and the ticket is closed. Auditors test something stricter: that each sampled change was approved by an authorized person before deployment. An approval added after the merge, or a ticket closed by the same engineer who wrote the code, fails that test even though every automated check came back green. The Segregation of Duties Problem Automation Misses Segregation of duties is the requirement that no single person can develop, approve, and deploy the same change. NIST’s SP 800-53 control catalog treats it as a foundational access control principle, and SOC 2 auditors apply the same logic. Small engineering teams trip on this constantly. Self-approved pull requests, admins who can bypass branch protection, direct pushes to main: a scanner sees “changes with tickets” while an auditor sees SoD violations. Emergency Changes and Retroactive Approvals: Common Rejection Triggers​ Every audit period contains hotfixes. Auditors don’t reject emergency changes. They reject emergency changes with no documented post-hoc review. If your policy says urgent changes get retroactive approval within two business days, the auditor will sample your emergency changes and check exactly that. No policy, or a policy nobody followed, produces an exception. Rebuilding Change Management Evidence Auditors Will Accept​ Enforce the control technically: branch protection requiring at least one independent reviewer, no admin bypass, and deploy pipelines that only run from protected branches. Then write the emergency change procedure down and generate the review artifact every time it fires.