One Pentest, Several Reports: Keeping Every Version in Step

A full report, an executive summary, a retest report: one engagement often needs several documents. How to make them all from one set of findings without drift.

Most engagements end in more than one document: the full technical report, a short version for directors or a client’s customers, and later a retest report. Keep them in step by producing every one of them from the same findings, as a different layout, at the time it is sent. The moment a version becomes a copy that somebody edits on its own, the documents start to disagree, and the client notices before you do.

The documents one engagement produces

What a client needs varies, but the same handful of documents comes up again and again:

DocumentWho reads itWhat it carries
Full reportEngineers and the security teamEvery finding in full: evidence, steps to reproduce, remediation, appendices
Executive reportDirectors and the boardScope, the overall picture, the findings that matter in plain words, what to do first
Retest reportThe security team, and often an auditorEach finding’s outcome after the fixes, and what was not retested
Shareable summaryThe client’s own customers, or their insurerWhat was tested and when, and the outcome by severity, with no detail an attacker could use

A letter of attestation sits beside these rather than among them: a short formal statement that the test took place, which writing an attestation letter an auditor will accept covers.

Why versions drift

Drift starts with a sensible shortcut. The full report is finished and approved, and someone saves a copy, cuts it down to the findings that matter and rewrites them for a director. Then QA changes a rating in the full report, or a client disputes a finding and its title is reworded, and the executive copy still has the old one. A month later the retest report is written from whichever copy was nearest, and now there are three documents with three slightly different versions of the same finding.

Clients compare. An executive report that says four highs beside a full report that says three is the kind of discrepancy that ends in an email from the client’s security lead asking which is right, and the honest answer, that one was edited after the other, does not inspire confidence. Review cannot catch it either, because review checks the document in front of it, not the one sent last week.

One set of findings, several layouts

The fix is to treat each version as a layout, not a document. The findings, their ratings, titles and remediation live in one place, and each version is a template that prints a different selection of them in a different shape:

  • Edit the findings, never a version. A rating changed in QA is changed once, in the finding, and every version made after it carries the change.
  • Make each version when it is sent. A version produced the day it goes out reflects the findings as they are that day, not as they were when someone saved a copy.
  • Let the layout do the cutting. An executive report that prints only the title, rating and a plain summary of each finding above a chosen severity needs no hand editing, and cannot fall behind.
  • Keep the numbering the same. Finding numbers that match across every version let a director’s question about one finding be answered from the full report without a lookup table.

What each layout needs from the findings

Layouts that print different things need the findings to hold them. An executive report that prints a sentence of business impact for each finding needs that sentence written, in a field of its own, by the tester who understood it, not composed later from the description. A retest report needs each finding’s outcome and the date it was retested; how to run a retest properly covers what those outcomes should be. A shareable summary needs nothing new, but it does need a decision about what it leaves out, made once in the layout rather than each time by whoever is sending it.

It is the same discipline as keeping the finding form in step with the template, applied to several templates at once: every field a version prints has to be one the testers fill in, with the same meaning everywhere. Your report template should decide your finding fields covers that side of it.

Naming and dating each version

Every version should say what it is and when it was produced: a title that names it, the engagement’s reference, a version number and a date in the document control table. When the full report moves to version 1.1 after a disputed finding is reworded, the executive report produced the same day should carry the same number, so anyone holding two documents can see at once whether they belong together. A filename that carries the client, the engagement, the kind of document and its date does the same job for whoever files them.

When a hand edit cannot be avoided

Sometimes a client asks for a sentence in one version only, or a partner wants a paragraph reworded in their copy. Make that edit last, on the version that is about to be sent, and note it in the document control table. If the change is really about a finding, put it in the finding instead and produce the version again. Editing a pentest report in Word and bringing it back shows how edits made in Word can go back into the findings rather than staying in one file.

In Pental the other layouts of a report are its versions. Add a version, under a report in Settings, Documents, uploads another Word file of it, such as a retest layout or an executive summary, and on that report’s engagements it sits in the menu beside the DOCX download button, whose arrow counts what is behind it. Each is filled from the engagement’s findings when it is downloaded, so a rating changed in QA is changed in every one. Report templates for each engagement shows how versions are added.

Common Questions

Should a pentest executive summary be a separate document?
It can be, when directors or a board read it on its own. Produce it from the same findings as the full report, as a different layout rather than an edited copy, so that its ratings and titles always match the full report.
Is a retest report a new document or an update to the original?
Either works, as long as the original stays a true record of what was found on its date. Many firms issue a short retest report that refers to the original by its reference and version and gives each finding’s outcome; others reissue the full report with each finding’s retest status. Pick one and use it for every client.
How do you stop versions of a pentest report from disagreeing?
Keep the findings in one place and produce every version from them when it is sent. Edit a finding, never a document, and give every version the same finding numbers, version number and date.
What should a pentest summary for a client’s customers contain?
What was tested and when, who tested it, and the outcome by severity, often with a note that serious findings were fixed and retested. It should leave out anything that would help an attacker, such as hosts, endpoints and steps to reproduce.

Keep Reading

Setup guide

See the product set up, end to end

The whole setup in 10:01, with chapters you can jump to: registering, your own domain, your own database in any of three places, your own mail server, branding, the first sign-in, updating the database on Supabase Cloud, and moving the database if you change your mind.

  • 0:00 · Registering, signing in, and the free trial
  • 0:44 · Your name and your firm’s name
  • 0:50 · Custom domain
  • +6 more