Skip to content
Back to the journal

Workbook

136

Product Strategy

10 min read

136 / 136

A Product Manager’s Evidence Portfolio: Record Judgement Before Memory Edits It

Build a private evidence system for product decisions, shared attribution, non-launches, outcomes, and safe cases for interviews, promotion, and self-review.

Topics Product strategy Growth Roadmapping

Share this workbook

Six months after a difficult decision, the polished version starts to feel true.

The uncertainty disappears. One person’s recommendation becomes “my strategy”. A team outcome acquires a clean cause. Work that was stopped looks less important than work that produced a screen.

A product portfolio built from memory rewards narrative confidence rather than product judgement.

Build the evidence record while the work is still awkward. Decide what can be shared only after the record is accurate.

The portfolio’s first audience is the practitioner who needs to inspect their own decisions. An interview page or promotion case is a later view of that private system.

Start with the question a reader must answer

A portfolio is not one document for every purpose.

An interviewer may ask whether the candidate can frame an unfamiliar problem. A promotion panel may ask whether scope and organisational contribution have changed. A manager may ask which capability should be developed next.

Define the assessment question before choosing a case:

  • What work or decision is being assessed?
  • What competence would be visible in that work?
  • Which evidence would distinguish strong from merely fluent performance?
  • What context limits the conclusion?

The US Office of Personnel Management describes job analysis as connecting tasks with the competencies required to perform them.

That is federal selection guidance, not a product-career model. Its useful discipline is to assess evidence against actual work rather than generic traits such as “strategic” or “commercial”.

A bounded growth experiment turns a capability gap into observable work. The portfolio preserves evidence from those episodes over time.

Keep a private evidence ledger

Capture one entry for a consequential decision, not every meeting or deliverable.

Use this structure:

Date and decision
Product and organisational context
My role, authority, and access
People who contributed
Evidence available at the time
Alternatives considered
Recommendation and trade-off
Decision owner and final choice
Artefacts created or changed
Observable consequence
Competing explanations
What this episode cannot prove
Disclosure and permission status

The entry should link to source artefacts while access is lawful: a decision memo, research synthesis, metric contract, prototype, service map, release record, or retrospective.

Do not copy sensitive material into a personal system without permission. In some organisations, even retaining an internal title or screenshot outside approved storage violates policy.

The ledger can remain inside the employer’s approved tools. Portability is less important than preserving the evidence responsibly.

Preserve the decision before writing the story

Start with what was known at the time.

Record observations separately from interpretations and forecasts. Keep material dissent. Name the authority that made the decision and the commitments already in force.

Then retain the alternatives. A case containing only the chosen option cannot show whether the recommendation was good or merely described well.

Include the cost of the recommendation:

  • work displaced;
  • risk accepted;
  • people or customers exposed;
  • information still missing;
  • condition that would reopen the choice.

This is the same evidence discipline required for Executive Communication. The portfolio adds a career view without rewriting the original decision for applause.

Attribute shared work precisely

Product outcomes are almost always shared. “Led the launch” can conceal design, engineering, research, commercial, and operational ownership.

Separate four claims:

  1. Authority: what could you decide or commit?
  2. Contribution: what analysis, frame, artefact, challenge, or coordination did you provide?
  3. Team decision: who made the call and who changed it?
  4. Outcome: what was observed, and which other factors could explain it?

Use verbs that survive inspection: framed, analysed, recommended, designed with, challenged, negotiated, documented, or owned.

Avoid “drove” when it means several incompatible things. If the team owned the result, say so. Precision makes a case stronger because a reader can see the judgement actually exercised.

Keep corroboration where policy permits: feedback tied to the work, a decision record naming contributors, or a manager’s review. Do not ask colleagues to endorse an inflated retrospective version.

Record work that prevented a launch

Some of the most valuable product decisions produce no public artefact.

A team may stop an initiative when the problem is too rare, narrow a release after identifying harm, or reject a requested feature because it creates an operating obligation the organisation cannot support.

Record:

  • the proposed commitment;
  • why it initially appeared credible;
  • the evidence or constraint that changed the choice;
  • the authority that stopped or narrowed it;
  • what happened to the released capacity;
  • what remains unknown.

Do not invent “cost avoided”. Unless a credible baseline exists, the team cannot know how much the abandoned plan would have cost or earned.

The evidence is the improved decision, not a fictional financial result.

Distinguish outcome evidence from attribution

Outcomes belong in the record, but they need a boundary.

Classify each one:

  • Directly observed: a contracted measure changed for the eligible population.
  • Supported contribution: timing and mechanism support a contribution, with alternatives named.
  • Operational consequence: workload, reliability, delay, or support behaviour changed.
  • Decision consequence: the team funded, stopped, narrowed, or reopened work.
  • Unknown: observation is incomplete or the result has not matured.

A before-and-after movement is not automatically an effect. Seasonality, customer mix, pricing, concurrent releases, instrumentation, and commercial activity may all matter.

Data-Informed Product Decisions shows how to preserve these limits in the underlying product decision.

Match evidence to scope, not a universal title

Career levels vary between organisations. The same title can carry one team, a portfolio, people management, or no formal authority.

Use the target role’s work rather than a generic ladder.

Evidence for a role close to one product problem may include:

  • framing a bounded customer decision;
  • using evidence to choose among alternatives;
  • delivering and reviewing a responsible release;
  • working across design and engineering boundaries.

Evidence for broader individual-contributor scope may include:

  • improving a decision across several teams;
  • connecting a local choice to portfolio strategy;
  • resolving a cross-product dependency;
  • creating a reusable standard without becoming its approval queue.

People-leadership evidence concerns different work: transferring authority, setting expectations, developing capability, handling people obligations, and improving the role system.

Do not use a strong product case as proof of management readiness. Leadership Readiness tests that transition directly.

Build different views from one evidence core

The private record can produce three narrower views.

Interview view

Choose two or three cases relevant to the target role. Show context, actual authority, alternatives, trade-off, contribution, evidence, outcome boundary, and what you would now challenge.

Promotion view

Show a pattern across episodes. One successful initiative may be luck or unusual support. Several decisions can reveal broader scope, repeatable judgement, and effects on other people’s work.

Self-review view

Look for recurring weaknesses: missing alternatives, late technical input, weak outcome follow-up, overclaimed attribution, or dependence on one sponsor.

The views should not alter the facts. They select evidence for a question.

OPM’s guidance on work samples says assessment tasks should mirror job tasks and normally concern competencies expected on entry.

That does not validate a portfolio as a work sample. A retrospective case cannot recreate authority, private evidence, collaboration, time pressure, or consequences.

Make the material safe before making it attractive

Authority to use the material comes before anonymisation.

Ask whether the material belongs to the employer, contains personal data, exposes a customer, reveals security or commercial information, or allows a competitor to infer strategy.

Use the least revealing view that still supports the assessment:

  • describe the decision class rather than the company;
  • replace customer names with necessary roles;
  • redraw the artefact instead of copying it;
  • use broad, non-sensitive ranges only when authorised;
  • remove dates or combinations that enable re-identification;
  • prefer a spoken private case when publication creates risk.

Do not call a dataset anonymous because names were removed. NIST SP 800-188 treats de-identification as risk reduction and places data-release decisions inside governance and risk assessment.

It is guidance for government datasets, not career portfolios. Its warning still applies: masking direct identifiers may leave people or organisations identifiable through other attributes.

When permission or residual risk is unclear, keep the case private or omit it.

A fictional case moves from boast to evidence

The following example is invented. It claims no real product or career outcome.

A senior PM first records this line:

Improved enterprise onboarding by leading a permissions redesign.

The sentence hides the decision, team, evidence, authority, and outcome.

The private ledger reconstructs the episode.

Context: New workspace administrators were requesting assisted setup. Support cases suggested confusion around inherited permissions, but the eligible population and frequency were uncertain.

Authority: The PM owned the product recommendation. Engineering owned architecture. Security approval and the release decision sat elsewhere.

Alternatives: Redesign the permission model, add guided setup, improve documentation, or investigate the support population before changing the product.

Contribution: The PM reconciled support cases with onboarding events, exposed an identity gap in the data, and recommended a bounded investigation rather than the proposed redesign.

Decision: The product director approved the investigation. The redesign did not enter delivery.

Result: Evidence showed two distinct administrator situations. The team tested guidance for one and opened a separate technical decision for inherited access.

Limits: No activation or revenue effect was established. The case does not prove delivery leadership or permissions expertise.

Inside this invented example, the fictional PM’s safe interview wording becomes:

I recommended pausing a broad onboarding redesign after support and event data described different populations. I built the evidence boundary and options; the product director made the investment decision.

The case then shows a redrawn decision table with fictional labels, the competing explanations, and the missing identity evidence. It includes no customer names, internal metrics, or copied screenshots.

This version is less heroic and more useful. A reader can inspect judgement, contribution, and restraint.

Review the portfolio like a product system

Once a month, triage new entries. Once a quarter, inspect the pattern rather than polishing every case.

Ask:

  • Which decisions show a capability relevant to current or target work?
  • Which claims lack a source artefact or corroborating perspective?
  • Where is attribution broader than authority?
  • Which outcomes need more time or a better comparison?
  • Which confidential cases should be deleted, retained internally, or rewritten?
  • Which failure or non-launch taught something the success cases conceal?

Archive stale views, not the underlying learning. Mark changed interpretations instead of silently replacing them.

A credible portfolio does not make every project look successful. It makes the practitioner’s reasoning, boundary, and learning available for challenge.

Sources

Related books

If you want to go further on this topic, these are two good places to start.

01

leadership

An Elegant Puzzle

by Will Larson

A human-centric guide to solving complex problems in engineering management, from sizing teams to handling technical debt to managing organizational growth.

Some outbound links are affiliate links and support independent bookstores.