Research Methodology — Research Methodology Guide
Enhances the methodology design capabilities of the research-designer and statistical-analyst agents.
Research Design Types
Quantitative Research
| Design |
Purpose |
Variable Control |
Causal Inference |
| Experiment (RCT) |
Verify causation |
High |
Strong |
| Quasi-experiment |
Causation (limited control) |
Medium |
Medium |
| Correlational Study |
Identify relationships |
Low |
Weak |
| Survey |
Assess current status |
None |
None |
| Longitudinal Study |
Change over time |
Varies |
Medium |
Qualitative Research
| Design |
Purpose |
Data Collection |
| Case Study |
Deep contextual understanding |
Interviews, observation, documents |
| Grounded Theory |
Theory generation |
Interviews, field notes |
| Phenomenology |
Essence of experience |
In-depth interviews |
| Ethnography |
Cultural/group understanding |
Participant observation |
Mixed Methods
Sequential: Quantitative -> Qualitative (explain results)
Qualitative -> Quantitative (generate hypotheses)
Concurrent: Quantitative + Qualitative (triangulation)
Sampling Design
Sample Size Calculation
Quantitative (mean comparison):
n = (Z_alpha/2 + Z_beta)^2 x 2*sigma^2 / d^2
Z_alpha/2 = 1.96 (significance level 0.05)
Z_beta = 0.84 (power 80%)
sigma = standard deviation (from prior research)
d = effect size (minimum meaningful difference)
Survey:
n = Z^2 x p(1-p) / e^2
Z = 1.96, p = 0.5 (maximum variance), e = margin of error
e.g.: 95% confidence, 5% margin -> n = 384 participants
Sampling Methods
| Method |
Description |
Suitable For |
| Simple Random |
Random from population |
Small, homogeneous populations |
| Stratified |
Proportional by subgroup |
Heterogeneous populations |
| Cluster |
By natural group unit |
Region-based surveys |
| Convenience |
Accessible participants |
Exploratory research (limited) |
Statistical Analysis Method Selection
Analysis Method Decision Tree
Q1: Variable type?
+-- Continuous -> Q2
+-- Categorical -> Q3
Q2: Number of comparison groups?
+-- 1-2 -> t-test (independent/paired)
+-- 3+ -> ANOVA
+-- Relationship analysis -> Regression/Correlation
Q3: Number of variables?
+-- 2 -> Chi-square
+-- 3+ -> Logistic regression
Key Statistical Methods Summary
| Method |
Purpose |
Requirements |
Reported Items |
| t-test |
Compare 2 group means |
Normality, equal variance |
t, df, p, Cohen's d |
| ANOVA |
Compare 3+ group means |
Normality, equal variance |
F, df, p, partial eta-squared |
| Chi-square |
Categorical variable relationship |
Expected frequency >= 5 |
chi-square, df, p, Cramer's V |
| Correlation |
Relationship between 2 variables |
Linearity |
r, p |
| Regression |
Prediction/explanation |
Linearity, independence |
beta, R-squared, p, VIF |
Effect Size Guide
| Metric |
Small |
Medium |
Large |
| Cohen's d |
0.2 |
0.5 |
0.8 |
| r (correlation) |
0.1 |
0.3 |
0.5 |
| partial eta-squared (ANOVA) |
0.01 |
0.06 |
0.14 |
| R-squared (regression) |
0.02 |
0.13 |
0.26 |
Research Ethics
IRB Considerations
| Item |
Verification |
| Informed Consent |
Research purpose, procedure, risks, voluntariness |
| Personal Data |
De-identification, retention period, destruction |
| Vulnerable Populations |
Special protections for minors, patients |
| Conflicts of Interest |
Funding source, interest disclosure |
Quality Checklist
| Item |
Criteria |
| Research Question |
PICO or SPIDER structure |
| Design Fit |
Design matches the research question |
| Sampling |
Calculation basis + sampling method |
| Analysis Method |
Suited to data characteristics |
| Effect Size |
Statistical significance + practical meaning |
| Ethics |
IRB approval or exemption justification |
1---2name: research-methodology-23description: Research methodology guide. Referenced by the research-designer and statistical-analyst agents when selecting research designs and analysis methods. Use for 'research methodology', 'experiment design', or 'statistical analysis' requests. Actual data collection and IRB review processing are out of scope.4---56# Research Methodology — Research Methodology Guide78Enhances the methodology design capabilities of the research-designer and statistical-analyst agents.910## Research Design Types1112### Quantitative Research1314| Design | Purpose | Variable Control | Causal Inference |15|--------|---------|-----------------|-----------------|16| Experiment (RCT) | Verify causation | High | Strong |17| Quasi-experiment | Causation (limited control) | Medium | Medium |18| Correlational Study | Identify relationships | Low | Weak |19| Survey | Assess current status | None | None |20| Longitudinal Study | Change over time | Varies | Medium |2122### Qualitative Research2324| Design | Purpose | Data Collection |25|--------|---------|----------------|26| Case Study | Deep contextual understanding | Interviews, observation, documents |27| Grounded Theory | Theory generation | Interviews, field notes |28| Phenomenology | Essence of experience | In-depth interviews |29| Ethnography | Cultural/group understanding | Participant observation |3031### Mixed Methods3233```34Sequential: Quantitative -> Qualitative (explain results)35 Qualitative -> Quantitative (generate hypotheses)36Concurrent: Quantitative + Qualitative (triangulation)37```3839## Sampling Design4041### Sample Size Calculation4243```44Quantitative (mean comparison):45 n = (Z_alpha/2 + Z_beta)^2 x 2*sigma^2 / d^24647 Z_alpha/2 = 1.96 (significance level 0.05)48 Z_beta = 0.84 (power 80%)49 sigma = standard deviation (from prior research)50 d = effect size (minimum meaningful difference)5152Survey:53 n = Z^2 x p(1-p) / e^254 Z = 1.96, p = 0.5 (maximum variance), e = margin of error5556 e.g.: 95% confidence, 5% margin -> n = 384 participants57```5859### Sampling Methods6061| Method | Description | Suitable For |62|--------|------------|-------------|63| Simple Random | Random from population | Small, homogeneous populations |64| Stratified | Proportional by subgroup | Heterogeneous populations |65| Cluster | By natural group unit | Region-based surveys |66| Convenience | Accessible participants | Exploratory research (limited) |6768## Statistical Analysis Method Selection6970### Analysis Method Decision Tree7172```73Q1: Variable type?74+-- Continuous -> Q275+-- Categorical -> Q37677Q2: Number of comparison groups?78+-- 1-2 -> t-test (independent/paired)79+-- 3+ -> ANOVA80+-- Relationship analysis -> Regression/Correlation8182Q3: Number of variables?83+-- 2 -> Chi-square84+-- 3+ -> Logistic regression85```8687### Key Statistical Methods Summary8889| Method | Purpose | Requirements | Reported Items |90|--------|---------|-------------|---------------|91| t-test | Compare 2 group means | Normality, equal variance | t, df, p, Cohen's d |92| ANOVA | Compare 3+ group means | Normality, equal variance | F, df, p, partial eta-squared |93| Chi-square | Categorical variable relationship | Expected frequency >= 5 | chi-square, df, p, Cramer's V |94| Correlation | Relationship between 2 variables | Linearity | r, p |95| Regression | Prediction/explanation | Linearity, independence | beta, R-squared, p, VIF |9697### Effect Size Guide9899| Metric | Small | Medium | Large |100|--------|-------|--------|-------|101| Cohen's d | 0.2 | 0.5 | 0.8 |102| r (correlation) | 0.1 | 0.3 | 0.5 |103| partial eta-squared (ANOVA) | 0.01 | 0.06 | 0.14 |104| R-squared (regression) | 0.02 | 0.13 | 0.26 |105106## Research Ethics107108### IRB Considerations109110| Item | Verification |111|------|-------------|112| Informed Consent | Research purpose, procedure, risks, voluntariness |113| Personal Data | De-identification, retention period, destruction |114| Vulnerable Populations | Special protections for minors, patients |115| Conflicts of Interest | Funding source, interest disclosure |116117## Quality Checklist118119| Item | Criteria |120|------|----------|121| Research Question | PICO or SPIDER structure |122| Design Fit | Design matches the research question |123| Sampling | Calculation basis + sampling method |124| Analysis Method | Suited to data characteristics |125| Effect Size | Statistical significance + practical meaning |126| Ethics | IRB approval or exemption justification |