What is the difference between a vulnerability scan and a penetration test?
A vulnerability scan runs automated checks for weaknesses such as known vulnerable software and common misconfigurations. Its coverage depends on which assets it can reach, what access it has, and which checks it runs. A penetration test is an authorized assessment of selected systems and scenarios. It can use scanners alongside other techniques to investigate whether weaknesses can be confirmed and what impact they could have within the agreed scope. NIST SP 800-115 · UK NCSC scanning guidance
| Question | Vulnerability scan | Penetration test |
|---|---|---|
| Purpose | Find potential weaknesses that the tool checks for. | Assess how selected controls behave and document observed impact. |
| Coverage | Assets and behaviors the configured tool can reach and assess. | Agreed environments, roles, workflows, and security boundaries. |
| Evidence | Alerts tied to affected assets, often with version or configuration details to verify. | Confirmed findings where supported by evidence, with affected roles or data, impact, and coverage limits. |
| When to use it | Routine checks for known issues and follow-up after patching. | When a release or customer decision depends on how a specific control works. |
The two methods can inform each other. Scan results can help an assessor prioritize known issues, and findings from an application assessment can reveal where ongoing checks need better coverage. UK NCSC guidance on penetration testing
SaaS example: a billing API shared by multiple organizations
Imagine a SaaS company preparing to launch invoice exports. Each customer organization has its own invoices, and only its billing administrators should be able to export them.
What the scan tells the team. A dependency scan flags an invoice-rendering library version associated with a published vulnerability. Engineering confirms which build contains the library, updates it, and records the result of a fresh scan. That evidence addresses the dependency alert.
What the pentest tells the team. The team scopes an authorized assessment of invoice viewing and export using synthetic data for two customer organizations. The assessor evaluates whether both the organization boundary and the billing role are enforced, then records the observed behavior and any gaps in coverage. The result gives the release owner evidence about who can access invoices in the assessed workflows.
The same release has two distinct security questions. The first is whether a known vulnerable dependency is present. The second is whether the application enforces its own access rules. OWASP identifies application-specific access control and business logic as areas where understanding the application’s intended behavior matters. OWASP Web Security Testing Guide v4.2
When should a SaaS team commission a pentest?
Start with the decision you need to make. If the question is whether known weaknesses have appeared across your deployed assets, recurring scans and alert triage are a practical starting point. If the decision depends on whether a new customer boundary or privileged workflow holds, scope a review around that behavior.
Consider a focused assessment when you introduce organization-level permissions, delegated administration, or an external API that exposes sensitive customer data. Name the roles, workflows, environments, and evidence you need before kickoff. Check any customer or contractual requirements when deciding what assessment and reporting will satisfy them. SaaS pentest scoping guide · When to schedule a SaaS pentest
What evidence should you ask for?
For a scan, ask which assets and checks ran, where coverage was limited, and how the reported issue was verified or cleared. For a pentest, ask which roles and workflows were assessed, what the assessor observed, and which limitations affect the conclusion. For the billing example, keep the dependency verification and the invoice access assessment in the release record so reviewers can see what each check established. Pentest report checklist