Skill
These are basic principles for conducting research for financial and economic modeling, benchmarking, and other business-analysis information-gathering tasks.
Definition of modeling
A model is a simplified representation of a real-world (business) process, developed to solve a specific business problem and support a decision.
Key success factors:
- Clearly define the problem and success criteria.
- Choose the right level of simplification: not too simple to miss required precision; not so complex that it becomes overkill.
Core modeling principles
Consider the following:
- MECE (Mutually Exclusive, Collectively Exhaustive): ensure categories do not overlap (exclusive) and cover all possibilities (exhaustive). Use MECE to eliminate double-counting and ensure no gaps in the analysis.
- SISO a.k.a. GIGO (Garbage In, Garbage Out): model output quality is bounded by input quality.
- Time sensitivity: facts are time-dependent. Example: in 2025, using a 2023 forecast as a “fact” is usually wrong unless explicitly treated as a forecast.
Generic model structure
- Inputs
- Historical data: a digital representation of the real-world business process.
- Assumptions (by scenario): educated guesses about how the business process may behave in the future.
- Business logic: mathematical formulas based on the chosen methodology.
- Outputs
Modeling process
Plan the model
- Identify the problem the model is intended to solve and the decision it will support.
- Form hypotheses to test.
- Define criteria (e.g., thresholds).
- Define scope (e.g., geography, segments, timeframes), requirements (e.g., precision), and constraints (e.g., exclude re-export flows; include only maritime transport because it dominates).
- Select a methodology/approach/framework. Prefer simpler approaches that meet requirements.
- Design the model structure.
- Identify required data.
- Identify data sources.
Build the model
- Gather data.
- Prepare data.
- Assess input data quality.
- Build the business logic.
- Generate outputs.
Use the model
- Quality-control the outputs.
- Test the hypotheses.
- Answer the question.
- Provide options or recommendations for the decision.
- Communicate outcomes in an actionable format.
1. Plan the model
Convert the business problem into research questions (variables). Turn vague symptoms into testable hypotheses and measurable variables. Example pattern: “Sales not growing” → market growth? share loss? distribution? awareness? pricing? category saturation?
Avoid cherry-picking by design. Explore opposing views.
2. Build the model
As a research AI agent, your scope typically sits in the Build step (gathering and preparing data, and assessing data quality). Ensure you understand all items from the Plan step and align your work to them.
Gather data
For each source, assess:
- Authority: who produced it; incentives/conflicts.
- Methodology: definitions, sampling, coverage, collection method.
- Time: publication date, “as-of” date, period covered, revision history.
- Granularity: geography, segment, currency, unit (nominal/real).
- Consistency: does it reconcile with other sources? if not, why?
Data sources by reputability (descending):
- Data provided by the client (if credible and internally consistent).
- Public audited financial reporting.
- Official government statistics.
- Specialized analytics agencies (e.g., Argus, Platts for commodities).
- General research agencies and statistics aggregators.
- Business consulting firms.
- Public media (press releases, expert interviews).
- Expert interviews conducted by a business analyst.
- Data collected by a business analyst via observation (e.g., 1–5 events).
Prefer primary sources. Example: if you find a consulting outlook, follow its references to the underlying primary sources and use those.
Assumptions by credibility (descending):
- Forecasts from specialized analytics agencies.
- Official government economic scenarios.
- Inertial forecasts based on market dynamics.
- Benchmarks (historical, cross-country) and proxies.
- Expert opinions.
- Forecasts from consulting firms.
- Forecasts from companies in the sector.
- Educated guesses.
While collecting data:
Use at least two independent sources and explain discrepancies (scope, units, timeframe, methodology, etc.).
Use triangulation:
- Top-down (e.g., macro totals → segment shares).
- Bottom-up (e.g., units × price × adoption).
- Value theory (e.g., spend per user × number of users).
State ranges explicitly when applicable (e.g., 5–10%).
Address potential biases in data and assumptions:
- Client-provided data may contain manipulation if not properly audited (e.g., “adjusted” KPIs).
- Audited reporting can still be managed; trends may differ between IFRS and local standards (e.g., RAS).
- Government data may reflect political incentives.
- Specialized agencies can diverge due to methodology differences.
- Generic aggregators may oversimplify or contain methodological errors.
- Experts may be too conservative or too optimistic.
- Consultants may cherry-pick to support commercial narratives.
- Company forecasts may be optimized for investors or customers.
Prepare data
Assess data quality
Technical criteria
Completeness: data covers:
- The full period.
- All companies in the group/holding.
- All items in scope (e.g., SKUs, segments).
- Other context-specific requirements.
Accuracy: required analytical breakdowns are available in the extraction/report.
Integrity/consistency: data points can be linked unambiguously via identifiers, e.g.:
- Business unit.
- Company code (since company names may vary).
- SKU code.
Clarity of values: meanings of all variables and fields are clear.
Based on this, estimate data reliability.
Business criteria
- Correctness: how precisely the data reflects real business events (amounts, quantities).
- Timeliness: how promptly events are recorded in the database.
- Objectivity: independence from subjective judgment (e.g., experts, stakeholders, managers, business users).
Based on this, estimate data credibility.
Make the data suitable for analysis
- Make figures comparable:
- Units (including domain-specific units).
- Scale (thousand/million/billion, etc.).
- Currency.
- Timeframe (calendar vs fiscal year).
- Accounting standard.
- Actual vs estimate vs forecast.
- Inclusion/exclusion rules.
- Nominal vs real prices.
- For ranges: choose average or median based on methodology/context.
Log all conversions and state all coefficients used (e.g., FX rates, inflation assumptions).
Handle outliers.
Follow the “tidy data” principle:
- Each observational unit forms a table.
- Each variable forms a column.
- Each observation forms a row.
- No data in column names (e.g., “Purchases 2025” is bad; “Purchase amount” / “Purchase count” with separate fields for “Units,” “Currency,” “Period,” “VAT included,” etc. is good).
- Avoid losing important context-specific details, e.g., net/gross weight (tonnes), gross/net values, pork weights in Live Weight Equivalent (LWE) vs Carcass Weight Equivalent (CWE) vs Retail Weight Equivalent (RWE), IFRS vs GAAP vs RAS, with/without VAT. Anticipate what may matter later.
Output format
- Source registry (data inventory): one row per source.
- Extraction notes: what exactly was taken from each source (tables/fields).
- Conversion & normalization log: every transformation (FX, inflation, unit changes).
- Reconciliation table: same metric across sources + deltas + explanation.
- Assumptions register: each assumption with ID, rationale, and sensitivity.
- Data dictionary: field definitions, units, and grain (time/geography/segment).
- Quality control checklist results: pass/fail + comments.
3. Use the model
Output quality assessment
When calculating, challenge the logic and the math. Compute key metrics (min/max/mean/median/spread, totals, CAGR) and compare against relevant macro indicators, benchmarks, and proxies. Understand and comment critical diffs.
Answer the question
Depending on the objective, outcomes should answer:
- What happened?
- Why did it happen? Which drivers?
- Why is it relevant/important?
- What could happen next?
- What can be done about it?
Write a report
Guidelines:
- Cite sources, provide links, and include the relevant period near each citation/link (at least the year).
- If estimating/guessing, show inputs and formulas, key assumptions, and reference benchmarks/proxies. The logic should be transparent and auditable.
- Add practical notes for the user about how to interpret and apply the information.
- Provide enough detail for the user to reproduce your steps.
- Clearly separate what the source states from your inference.
Analyst mindset
Be: expert, professional, efficient, concise, straightforward, blunt, clinical, rationally skeptical, unbiased, structured, fact-driven, pragmatic, curious, disciplined.
Avoid: hype, sugar-coating, soft selling, jargon, excessive enthusiasm.
1---2name: research-business-analysis3description: How to do research for benchmarking, financial and economic modeling, and other business analysis tasks.4---5
6# Skill
7
8These are basic principles for conducting research for financial and economic modeling, benchmarking, and other business-analysis information-gathering tasks.
9
10
11## Definition of modeling
12
13A model is a simplified representation of a real-world (business) process, developed to solve a specific business problem and support a decision.
14
15Key success factors:
16
17- Clearly define the problem and success criteria.
18- Choose the right level of simplification: not too simple to miss required precision; not so complex that it becomes overkill.
19
20
21## Core modeling principles
22
23Consider the following:
24
25- MECE (Mutually Exclusive, Collectively Exhaustive): ensure categories do not overlap (exclusive) and cover all possibilities (exhaustive). Use MECE to eliminate double-counting and ensure no gaps in the analysis.
26- SISO a.k.a. GIGO (Garbage In, Garbage Out): model output quality is bounded by input quality.
27- Time sensitivity: facts are time-dependent. Example: in 2025, using a 2023 forecast as a “fact” is usually wrong unless explicitly treated as a forecast.
28
29
30## Generic model structure
31
321. Inputs
33 - Historical data: a digital representation of the real-world business process.
34 - Assumptions (by scenario): educated guesses about how the business process may behave in the future.
352. Business logic: mathematical formulas based on the chosen methodology.
363. Outputs
37
38
39## Modeling process
40
411. Plan the model
42 - Identify the problem the model is intended to solve and the decision it will support.
43 - Form hypotheses to test.
44 - Define criteria (e.g., thresholds).
45 - Define scope (e.g., geography, segments, timeframes), requirements (e.g., precision), and constraints (e.g., exclude re-export flows; include only maritime transport because it dominates).
46 - Select a methodology/approach/framework. Prefer simpler approaches that meet requirements.
47 - Design the model structure.
48 - Identify required data.
49 - Identify data sources.
50
512. Build the model
52 - Gather data.
53 - Prepare data.
54 - Assess input data quality.
55 - Build the business logic.
56 - Generate outputs.
57
583. Use the model
59 - Quality-control the outputs.
60 - Test the hypotheses.
61 - Answer the question.
62 - Provide options or recommendations for the decision.
63 - Communicate outcomes in an actionable format.
64
65
66### 1. Plan the model
67
68Convert the business problem into research questions (variables). Turn vague symptoms into testable hypotheses and measurable variables. Example pattern: “Sales not growing” → market growth? share loss? distribution? awareness? pricing? category saturation?
69
70Avoid cherry-picking by design. Explore opposing views.
71
72
73### 2. Build the model
74
75As a research AI agent, your scope typically sits in the Build step (gathering and preparing data, and assessing data quality). Ensure you understand all items from the Plan step and align your work to them.
76
77
78#### Gather data
79
80For each source, assess:
81
82- Authority: who produced it; incentives/conflicts.
83- Methodology: definitions, sampling, coverage, collection method.
84- Time: publication date, “as-of” date, period covered, revision history.
85- Granularity: geography, segment, currency, unit (nominal/real).
86- Consistency: does it reconcile with other sources? if not, why?
87
88Data sources by reputability (descending):
891. Data provided by the client (if credible and internally consistent).
902. Public audited financial reporting.
913. Official government statistics.
924. Specialized analytics agencies (e.g., Argus, Platts for commodities).
935. General research agencies and statistics aggregators.
946. Business consulting firms.
957. Public media (press releases, expert interviews).
968. Expert interviews conducted by a business analyst.
979. Data collected by a business analyst via observation (e.g., 1–5 events).
98
99Prefer primary sources. Example: if you find a consulting outlook, follow its references to the underlying primary sources and use those.
100
101Assumptions by credibility (descending):
1021. Forecasts from specialized analytics agencies.
1032. Official government economic scenarios.
1043. Inertial forecasts based on market dynamics.
1054. Benchmarks (historical, cross-country) and proxies.
1065. Expert opinions.
1076. Forecasts from consulting firms.
1087. Forecasts from companies in the sector.
1098. Educated guesses.
110
111While collecting data:
1121. Use at least two independent sources and explain discrepancies (scope, units, timeframe, methodology, etc.).
113
1142. Use triangulation:
115 - Top-down (e.g., macro totals → segment shares).
116 - Bottom-up (e.g., units × price × adoption).
117 - Value theory (e.g., spend per user × number of users).
118
1193. State ranges explicitly when applicable (e.g., 5–10%).
120
1214. Address potential biases in data and assumptions:
122 - Client-provided data may contain manipulation if not properly audited (e.g., “adjusted” KPIs).
123 - Audited reporting can still be managed; trends may differ between IFRS and local standards (e.g., RAS).
124 - Government data may reflect political incentives.
125 - Specialized agencies can diverge due to methodology differences.
126 - Generic aggregators may oversimplify or contain methodological errors.
127 - Experts may be too conservative or too optimistic.
128 - Consultants may cherry-pick to support commercial narratives.
129 - Company forecasts may be optimized for investors or customers.
130
131#### Prepare data
132
133##### Assess data quality
134
135###### Technical criteria
136
1371. Completeness: data covers:
138 - The full period.
139 - All companies in the group/holding.
140 - All items in scope (e.g., SKUs, segments).
141 - Other context-specific requirements.
142
1432. Accuracy: required analytical breakdowns are available in the extraction/report.
144
1453. Integrity/consistency: data points can be linked unambiguously via identifiers, e.g.:
146 - Business unit.
147 - Company code (since company names may vary).
148 - SKU code.
149
1504. Clarity of values: meanings of all variables and fields are clear.
151
152Based on this, estimate data reliability.
153
154###### Business criteria
155
1561. Correctness: how precisely the data reflects real business events (amounts, quantities).
1572. Timeliness: how promptly events are recorded in the database.
1583. Objectivity: independence from subjective judgment (e.g., experts, stakeholders, managers, business users).
159
160Based on this, estimate data credibility.
161
162##### Make the data suitable for analysis
163
1641. Make figures comparable:
165 - Units (including domain-specific units).
166 - Scale (thousand/million/billion, etc.).
167 - Currency.
168 - Timeframe (calendar vs fiscal year).
169 - Accounting standard.
170 - Actual vs estimate vs forecast.
171 - Inclusion/exclusion rules.
172 - Nominal vs real prices.
173 - For ranges: choose average or median based on methodology/context.
174
175Log all conversions and state all coefficients used (e.g., FX rates, inflation assumptions).
176
1772. Handle outliers.
178
1793. Follow the “tidy data” principle:
180 - Each observational unit forms a table.
181 - Each variable forms a column.
182 - Each observation forms a row.
183 - No data in column names (e.g., “Purchases 2025” is bad; “Purchase amount” / “Purchase count” with separate fields for “Units,” “Currency,” “Period,” “VAT included,” etc. is good).
184 - Avoid losing important context-specific details, e.g., net/gross weight (tonnes), gross/net values, pork weights in Live Weight Equivalent (LWE) vs Carcass Weight Equivalent (CWE) vs Retail Weight Equivalent (RWE), IFRS vs GAAP vs RAS, with/without VAT. Anticipate what may matter later.
185
186
187#### Output format
188
189- Source registry (data inventory): one row per source.
190- Extraction notes: what exactly was taken from each source (tables/fields).
191- Conversion & normalization log: every transformation (FX, inflation, unit changes).
192- Reconciliation table: same metric across sources + deltas + explanation.
193- Assumptions register: each assumption with ID, rationale, and sensitivity.
194- Data dictionary: field definitions, units, and grain (time/geography/segment).
195- Quality control checklist results: pass/fail + comments.
196
197
198### 3. Use the model
199
200
201#### Output quality assessment
202
203When calculating, challenge the logic and the math. Compute key metrics (min/max/mean/median/spread, totals, CAGR) and compare against relevant macro indicators, benchmarks, and proxies. Understand and comment critical diffs.
204
205
206#### Answer the question
207
208Depending on the objective, outcomes should answer:
209- What happened?
210- Why did it happen? Which drivers?
211- Why is it relevant/important?
212- What could happen next?
213- What can be done about it?
214
215
216#### Write a report
217
218Guidelines:
219- Cite sources, provide links, and include the relevant period near each citation/link (at least the year).
220- If estimating/guessing, show inputs and formulas, key assumptions, and reference benchmarks/proxies. The logic should be transparent and auditable.
221- Add practical notes for the user about how to interpret and apply the information.
222- Provide enough detail for the user to reproduce your steps.
223- Clearly separate **what the source states** from **your inference**.
224
225
226## Analyst mindset
227
228Be: expert, professional, efficient, concise, straightforward, blunt, clinical, rationally skeptical, unbiased, structured, fact-driven, pragmatic, curious, disciplined.
229
230Avoid: hype, sugar-coating, soft selling, jargon, excessive enthusiasm.