Brainstorming
Good research ideas are not found by asking for good ideas. They come from a clear map of
what is known, a deliberate set of moves that produce many candidates, and a cold ranking
that throws most of them away. Generation and selection are separate steps; mixing them
kills the unusual candidates first.
Rules
- Map before you generate. Ten minutes on what is established, what is contested and
what is assumed produces better candidates than an hour of free association. Use the
user's notes and, when the field is unfamiliar, one research-lookup or a shallow
literature-review round.
- Generate wide, by named moves. Aim for fifteen to thirty candidates across the moves
below. Write each as one line: the change and the outcome it would show. Do not judge
while generating.
- Rank cold. Score each candidate on value if it works, probability it works,
cost to find out, and whether the user can do it with what they have. Prefer the
candidate that is cheap to test and informative either way.
- Commit to a shortlist of three, each with the first experiment that would test it
and the result that would kill it.
- Say what is already done. A candidate that exists in the literature is a lead to
read, not an idea to pursue; mark it.
Moves
| Move |
Question that produces candidates |
| Gap |
What does every paper assume, measure or exclude without justification? |
| Transfer |
Which method from an adjacent field has never been applied here, and why not? |
| Inversion |
What if the accepted direction of the effect, or the usual objective, is reversed? |
| Constraint |
What changes under a tenth of the data, compute, labels, or time? Under ten times? |
| Failure |
Where does the best method fail, and what is common to those cases? |
| Measurement |
Is the standard metric measuring the thing everyone claims? What would? |
| Composition |
Which two known results, combined, predict something neither does alone? |
| Mechanism |
The effect is established; what is the mechanism, and what would distinguish candidates? |
| Simplification |
What is the simplest baseline nobody reports, and would it match? |
references/methods.md expands these into structured exercises (SCAMPER, morphological
analysis, assumption reversal, analogical transfer) for a longer session.
Workflow
Selection criteria
- Value: who changes what they do if this is true? A result nobody would act on is low
value however elegant.
- Probability: is there a mechanism or prior evidence that makes it plausible, or is it
a hope?
- Cost: the cheapest experiment that would move the probability substantially; hours
versus months.
- Informativeness: does a negative result teach something? Prefer questions where
both answers matter.
- Fit: the user's data, compute, skills and deadline. A perfect idea for someone else
is not on the shortlist.
Deliverable
## Map
| Established | Contested | Assumed | Open |
## Candidates (by move)
1. [gap] ... 2. [transfer] ... ...
## Shortlist
1. <idea>. First experiment: <...>. Killed if: <...>. Value / probability / cost: <...>.
2. ...
3. ...
## Already done (read these)
- <candidate> → <paper, link>
Before you hand it over
- The map cites its sources or says it comes from the user's notes.
- Candidates span at least four moves; none is a restatement of another.
- Each shortlisted idea has a concrete first experiment and a kill criterion.
1---2name: brainstorming3description: Generates and selects research directions, mapping what is known and what is open, producing many candidate ideas by named moves (gap, transfer, inversion, constraint change, scale, failure analysis), then ranking them by tractability and value and committing to a shortlist. Use for open-ended ideation, "what should I work on", finding research gaps, exploring interdisciplinary connections, or choosing among directions. For turning a chosen direction into testable statements use hypotheses.4license: MIT5---67# Brainstorming89Good research ideas are not found by asking for good ideas. They come from a clear map of10what is known, a deliberate set of moves that produce many candidates, and a cold ranking11that throws most of them away. Generation and selection are separate steps; mixing them12kills the unusual candidates first.1314## Rules15161. **Map before you generate.** Ten minutes on what is established, what is contested and17 what is assumed produces better candidates than an hour of free association. Use the18 user's notes and, when the field is unfamiliar, one research-lookup or a shallow19 literature-review round.202. **Generate wide, by named moves.** Aim for fifteen to thirty candidates across the moves21 below. Write each as one line: the change and the outcome it would show. Do not judge22 while generating.233. **Rank cold.** Score each candidate on value if it works, probability it works,24 cost to find out, and whether the user can do it with what they have. Prefer the25 candidate that is cheap to test and informative either way.264. **Commit to a shortlist of three**, each with the first experiment that would test it27 and the result that would kill it.285. **Say what is already done.** A candidate that exists in the literature is a lead to29 read, not an idea to pursue; mark it.3031## Moves3233| Move | Question that produces candidates |34| --- | --- |35| Gap | What does every paper assume, measure or exclude without justification? |36| Transfer | Which method from an adjacent field has never been applied here, and why not? |37| Inversion | What if the accepted direction of the effect, or the usual objective, is reversed? |38| Constraint | What changes under a tenth of the data, compute, labels, or time? Under ten times? |39| Failure | Where does the best method fail, and what is common to those cases? |40| Measurement | Is the standard metric measuring the thing everyone claims? What would? |41| Composition | Which two known results, combined, predict something neither does alone? |42| Mechanism | The effect is established; what is the mechanism, and what would distinguish candidates? |43| Simplification | What is the simplest baseline nobody reports, and would it match? |4445`references/methods.md` expands these into structured exercises (SCAMPER, morphological46analysis, assumption reversal, analogical transfer) for a longer session.4748## Workflow4950- [ ] Map: established / contested / assumed / open, in a short table with sources.51- [ ] Generate: fifteen to thirty one-line candidates tagged by move.52- [ ] Filter: remove duplicates, the already-published, the untestable.53- [ ] Rank: value × probability ÷ cost, plus feasibility with the user's resources.54- [ ] Shortlist three with first experiment and kill criterion; hand to hypotheses.5556## Selection criteria5758- **Value**: who changes what they do if this is true? A result nobody would act on is low59 value however elegant.60- **Probability**: is there a mechanism or prior evidence that makes it plausible, or is it61 a hope?62- **Cost**: the cheapest experiment that would move the probability substantially; hours63 versus months.64- **Informativeness**: does a negative result teach something? Prefer questions where65 both answers matter.66- **Fit**: the user's data, compute, skills and deadline. A perfect idea for someone else67 is not on the shortlist.6869## Deliverable7071```markdown72## Map73| Established | Contested | Assumed | Open |7475## Candidates (by move)761. [gap] ... 2. [transfer] ... ...7778## Shortlist791. <idea>. First experiment: <...>. Killed if: <...>. Value / probability / cost: <...>.802. ...813. ...8283## Already done (read these)84- <candidate> → <paper, link>85```8687## Before you hand it over8889- The map cites its sources or says it comes from the user's notes.90- Candidates span at least four moves; none is a restatement of another.91- Each shortlisted idea has a concrete first experiment and a kill criterion.