Quality System SOPs

Example SOP: Vulnerability metrics tracking

FDA's 2023 premarket guidance asks for something most quality systems never tracked: numbers that show the vulnerability process actually runs. The guidance points at measures like the percentage of identified vulnerabilities patched and the time from identification to patch availability. A narrative about taking security seriously does not answer that. A tracker does.

This is the smallest SOP in the set and probably the highest signal per word. Four metrics: total vulnerabilities identified, percentage patched, average time from identification to a verified patch release, and average time from patch availability to installation across [80%] of fielded systems. One tracker holds them, one row per vulnerability, keyed to the same component and version names as the SBOM so nothing needs translating at audit time.

The two averages are the tell. A long time to patch release is an engineering capacity problem. A long time to install is a deployment design problem, and FDA reads it exactly that way. We built ELTON to keep these fields current automatically, but tooling or spreadsheet, the discipline is identical: every vulnerability opens a row, and every row eventually has to close.

Four metrics, one tracker row per vulnerability Total vulnerabilities every ID, history kept Percentage patched share with a released fix Avg TTP release identified → patch ready Avg TTP install patch ready → [80%] fielded Date identified CVE or defect ID Patch release date verified + validated Patch deployed date [80%] of fielded systems TTP release (days) TTP install (days)
Two dates go in, two durations come out, and the averages become the numbers FDA asks to see.

Purpose

Describe the standard operating procedure for tracking vulnerability metrics for [System Name].

Scope

Vulnerabilities identified in software components of [System Name], including third party libraries, operating systems, and software developed by [Organization].

References

  • [Template: Vulnerability Metrics Tracker]
  • [SOP: Cybersecurity Risk Management Plan]
  • Cybersecurity in Medical Devices: Quality System Considerations and Content of Premarket Submissions, FDA guidance, September 27, 2023

Summary

[Organization] captures four metrics for vulnerabilities in software contained in [System Name]:

  • Total vulnerabilities: every vulnerability identified in system software, third party or internally developed, including those already patched since release, kept for history.
  • Percentage of patched vulnerabilities: the share of the list with a released patch.
  • Average time to patch (TTP) release: mean days between identification of a vulnerability and release of a verified and validated patch that addresses it.
  • Average time to patch (TTP) install: mean days between patch availability and the point where [80%] of fielded systems have it applied.

A Vulnerability Metrics Tracker records the data, one row per vulnerability. Each row carries: the system component, aligned to the SBOM and threat model; the software package and version, identical to the names reported in the SBOM; the vulnerability ID (the CVE where one exists, otherwise the [defect management system] identifier); the date identified; the patch release date and TTP release in days; and the patch deployed date and TTP install in days.

Procedure

1. When a vulnerability is identified

Create a new row in the tracker. Record the impacted system component, the software package and version exactly as the SBOM reports them, the vulnerability ID, and the date identified. Identification can arrive through SBOM vulnerability scanning, third party reports, or any other monitoring source. Set the patch release, TTP release, patch deployed, and TTP install fields to N/A.

2. When a patch is released

When a verified and validated patch is available for installation on affected systems, record the patch release date and compute TTP release: the days from date identified to patch release.

3. When deployment completes

When [80%] of fielded systems have been patched, record the patch deployed date and compute TTP install: the days from patch release to that date.

Keep the closed rows. History is what turns a metric into a trend, and the trend is what you will be asked to explain: not why one CVE took 40 days, but why the average is moving. A tracker that only ever holds open items answers nothing.

← All intelligence
Get started

See your device through ELTON.

Start with one device. We build the twin from documentation your quality system already produces, run AI discovery remotely, and show you the graph: the handful to fix, and the evidence for everything else.

Proof Over Probability

The AI testing newsletter.

One issue a month on AI, exploitability, and FDA cybersecurity review. No spam, unsubscribe anytime.

Questions

Common questions about the vulnerability metrics SOP.

Which vulnerability metrics does FDA ask for?

FDA's 2023 premarket guidance points at measures like the percentage of identified vulnerabilities patched and the time from identification to patch availability. This example SOP tracks four: total vulnerabilities identified, percentage patched, average time to patch release, and average time to patch install across fielded systems.

What is the difference between time to patch release and time to patch install?

Time to patch release is the mean number of days between identifying a vulnerability and releasing a verified and validated patch that addresses it. Time to patch install is the mean days between patch availability and the point where a defined share of fielded systems, 80 percent in this example, have applied it.

What do those two averages tell a reviewer?

The two averages are the tell. A long time to patch release is an engineering capacity problem. A long time to install is a deployment design problem, and FDA reads it exactly that way. A narrative about taking security seriously does not answer the question. A tracker does.

What goes in a vulnerability metrics tracker?

One row per vulnerability. Each row carries the system component aligned to the SBOM and threat model, the software package and version named identically to the SBOM, the vulnerability ID (the CVE where one exists), the date identified, the patch release date with time to patch release in days, and the patch deployed date with time to patch install.

Should closed vulnerabilities stay in the tracker?

Yes. Keep the closed rows, including vulnerabilities already patched since release. History is what turns a metric into a trend, and the trend is what you will be asked to explain: not why one CVE took 40 days, but why the average is moving. A tracker that only holds open items answers nothing.

Exploitability management for medical devices. FDA §524B methodologyExploitability proven at runtime95% faster than legacy testing Book a Demo
Platform
OverviewAvoid FDA DeficienciesAvoid Consulting FeesDigital Twin TraceabilityAI PentestingExploitability VerificationVulnerability ChainingRemediation OptimizationRemote TestLink™Incident ResponseAutomated VEX & MetricsCVSSv4 Migration
Solutions
Postmarket SurveillanceIncident ResponseSecurity EngineeringRegulatory AffairsFDA §524BEU MDR/CRAEU REDNIS2IMDRF N60 / N73Japan MHLW
Why ELTON
Subscription TestingAI-NativeFDA ComplianceVerified ExploitabilityELTON vs. Legacy TestingThreat-Led AI PentestingMDDT MethodologyCredentialsDevice ModalitiesPricing
Resources
FDA Deficiency ListFDA Testing RequirementsFDA Cyber SOPs & TemplatesRemediation LibraryRegulatory GuidesWebinarsAI NewsletterThe End of Legacy TestingThe AI Vulnerability ExplosionSecurity AdvisoriesWhitepapersIntelligence & Blog
Company
AboutLeadershipCareersPartnershipsContact Meet ELTON