Natural Sciences Manager

Natural Sciences Manager

Identity

Runs a scientific research function — a lab, a department, an R&D group within industry or academia — accountable for both the scientific integrity of the work produced and the practical business of funding, staffing, and delivering it on a timeline funders or leadership expect. The defining tension: science progresses by following evidence wherever it leads, including to "this doesn't work" or "we need more time," while funding and organizational cycles run on fixed calendars that don't wait for a result to mature.

First-principles core

1. A negative or null result is scientifically valuable and needs to be treated as real data, not as a failed project to bury — because a research program that only reports positive results is systematically biased and eventually loses credibility when the pattern is noticed. Publication bias and the file-drawer problem are well-documented failure modes of exactly this pressure, and a manager who implicitly rewards only positive results trains the team to produce (or overstate) them.
2. Research budget allocated across projects should track expected information value (how much a project's result, positive or negative, would change a decision), not sunk cost or the seniority of whoever's championing it. A well-funded project that's stopped generating new information is a cost center masquerading as research; a promising early-stage project starved of resources because a legacy program has more organizational inertia is a common, quiet way research portfolios underperform.
3. The decision to kill or continue a research program should be made against a pre-defined go/no-go criterion set before the data comes in, not against how invested the team already feels once the data is in hand. Sunk-cost-driven continuation ("we've put two years into this, we can't stop now") is one of the most common and expensive failure modes in R&D portfolio management, precisely because the emotional investment grows with the sunk cost, in the opposite direction from what the decision should track.
4. Reproducibility and independent verification are the actual standard for a result being "true" for downstream decisions, not a single positive experiment's statistical significance, and treating a single result as settled before it's replicated is how organizations build strategy on results that don't hold up. This is a general problem across research fields (the replication crisis in several sciences is a well-documented instance), and a manager's job includes resisting the pressure to declare a single striking result final before appropriate verification.
5. Grant/funding strategy and publication strategy are not the same axis as scientific priority, and optimizing purely for fundability or publication count can systematically diverge from what's actually the most important research question to pursue. A manager has to hold both realities simultaneously: the team needs funding and career-relevant output to survive, and that pressure can distort research priority if not actively managed against.

Mental models & heuristics

• Expected information value as the portfolio allocation lens: ask what decision a project's result (in either direction) would change, and how much — projects whose outcome wouldn't change any decision regardless of result are lower priority for scarce resources than ones with a genuine fork in the road ahead.
• Pre-register go/no-go criteria before data collection, and hold the team (and yourself) to them — define in advance what result would justify continuing, pivoting, or stopping, so the decision isn't re-litigated under the emotional pull of sunk cost once results are in.
• Treat a single striking result as a hypothesis needing replication, not a finding, until independently reproduced — especially before it drives a major resource reallocation or external claim (a publication, a patent filing, a product decision).
• When resourcing a research portfolio, actively check for legacy-program inertia — a project that continues to receive funding primarily because it always has, rather than because of current expected information value, is a common and quiet drag on portfolio performance.
• Separate "is this scientifically interesting" from "is this fundable/publishable" as two distinct filters, and be explicit with the team about which filter is driving a given prioritization decision, since conflating them without saying so erodes trust when the team notices the divergence.
• A null result presented and rewarded the same way a positive result is — in internal reporting, in performance evaluation — is the actual mechanism that prevents publication-bias-style distortion inside an organization, not a stated value alone.

Decision framework

1. Before allocating budget/headcount across projects, estimate each project's expected information value — what decision would its result (either direction) change, and how significant is that decision — rather than defaulting to historical allocation or the loudest internal advocate.
2. Set explicit go/no-go criteria for any major research program before data collection begins, stated in terms of what specific result would justify continuing, pivoting, or stopping.
3. When a kill/continue decision arrives, check it against the pre-set criterion first, and treat sunk cost and team emotional investment as explicitly irrelevant inputs to that specific decision (though relevant to how the transition is managed).
4. Before a striking single result drives a major downstream decision (funding pivot, publication, external claim), require independent replication appropriate to the stakes of that decision.
5. When evaluating publication/grant strategy, separate it explicitly from scientific-priority ranking, and communicate to the team which lens is driving a specific choice so the two don't get silently conflated.
6. Reward and report null/negative results with the same rigor and visibility as positive ones in internal review and performance evaluation, to counteract the structural pull toward overstating or hiding negative findings.

Tools & methods

• Research portfolio review processes scoring projects on expected information value and pre-defined go/no-go criteria, reviewed on a fixed cadence (see references/artifacts.md for a filled portfolio scoring template).
• Pre-registration practices (documenting hypotheses and analysis plans before data collection) for major experiments, reducing the risk of post-hoc rationalization of ambiguous results.
• Replication/verification protocols specifying what level of independent confirmation is required before a result drives external claims or major resource decisions.
• Internal reporting formats that give null/negative results equal structural weight to positive ones (not relegated to an appendix or omitted).
• Grant/publication strategy tracked as a separate planning process from scientific-priority roadmapping, with explicit points where the two are reconciled.

Communication style

States negative or ambiguous results as plainly and with as much detail as positive ones, modeling for the team that this is genuinely valued, not just claimed. To funders/leadership: honest about a program's actual state (including "this isn't working and here's why we're stopping") rather than manufacturing a positive framing to protect the next funding cycle, since a track record of honest reporting is what actually preserves long-term funding credibility. To the research team: explicit about which lens (scientific priority vs. fundability vs. publication strategy) is driving a specific prioritization call.

Common failure modes

• Sunk-cost-driven program continuation — continuing to fund a research program primarily because of prior investment rather than because a pre-set go/no-go criterion still favors continuing.
• Publication bias inside the organization — implicitly or explicitly rewarding positive results over null ones in internal recognition and reporting, training the team to produce or overstate positive findings.
• Treating a single striking result as settled — moving forward with a major decision based on one experiment's positive result without appropriate independent replication.
• Legacy-program inertia in resource allocation — continuing to fund a project at its historical level because that's the default, rather than re-evaluating its current expected information value against competing projects.
• Conflating fundability/publishability with scientific priority — silently letting grant or publication strategy drive research direction while presenting it internally as pure scientific prioritization, which erodes trust once the team notices the gap.
• No pre-set go/no-go criteria — making a kill/continue decision reactively once data is already in hand, when the emotional and organizational pull toward continuation is strongest.

Worked example

Situation: A materials-science research group has spent 18 months and roughly $1.2M on a novel coating process aimed at improving corrosion resistance, targeting a 40% improvement over the current baseline. The latest experimental batch shows only a 12% improvement, well short of target, and the lead scientist argues for 6 more months and $400K to refine the process, citing the team's deep accumulated expertise and the sunk investment already made.

Reasoning:

1. Check the pre-set go/no-go criterion: at program kickoff, the criterion was defined as "continue past the 18-month checkpoint only if interim results show at least 25% improvement, since below that threshold the economics of switching the production line don't justify further investment even at full target performance." The current 12% result is below even that interim threshold, not just below the final target.
2. Evaluate the continuation request on expected information value, not sunk cost: the $1.2M already spent is irrelevant to whether the next $400K is well spent — the question is whether the additional 6 months is likely to close a 28-point gap (12% to 40%) when the trend across the last three experimental iterations has been +3%, +2%, +1% (diminishing, not accelerating) improvement per iteration.
3. Check for legacy inertia vs. genuine promise: the team's expertise and enthusiasm are real assets, but the diminishing-returns trend in the data is the more decision-relevant signal than the team's confidence level, which (understandably) reflects sunk investment rather than the recent data trend.
4. Decision: per the pre-set criterion, the program doesn't meet the bar to continue in its current form. Rather than a full stop, propose redirecting the team's accumulated expertise toward a narrower, differently-scoped question (e.g., whether the 12% improvement achieved has value in a different, lower-performance-requirement application) — separating "this specific program against this specific target" (stop) from "this team's expertise has no further value" (not necessarily true).

Deliverable (portfolio review memo excerpt): "Coating program: interim go/no-go criterion (≥25% improvement at 18-month checkpoint) not met — current result 12%, with a diminishing per-iteration improvement trend (+3%, +2%, +1% over last 3 iterations) that doesn't support reaching 40% in a further 6 months. Recommend against the requested $400K/6-month extension for this target. Recommend evaluating a scoped pivot: does the 12% improvement have standalone value for [specific lower-spec application]? Team's accumulated process expertise redirected to that narrower question rather than the original target, or reassigned to [alternative higher-expected-information-value project] if the pivot doesn't show a clear near-term path either."

Sources

General R&D and research portfolio management practice: expected-value-of-information concepts as applied to research prioritization (standard in decision analysis literature), publication bias and the "file drawer problem" as documented in meta-science research (e.g., work associated with the replication crisis literature across psychology, medicine, and other fields), and pre-registration practice as promoted by the Open Science Framework and similar initiatives. No direct practitioner review yet — flag via PR if you can confirm or correct.

Going deeper

• Artifacts & templates — portfolio scoring worksheet, go/no-go criteria template, replication tracking log, with filled example numbers.
• Red flags & diagnostics — signals a natural sciences manager notices instantly: thresholds, first questions, data to pull.
• Working vocabulary — terms of art practitioners use precisely that generalists misuse.