# Ddr Globem Analysis

> Analyze a specific participant's longitudinal passive-sensing and psychological data in the GLOBEM digital depression research dataset. Use this skill whenever the task involves: analyzing a user's mental health or behavioral data from wearables/smartphones, generating QA pairs about behavioral/psychological changes over time, working with EMA, depression scores, activity, sleep, communication, location, or phone-usage data, or any user-profile analysis in the DDR/GLOBEM context.

- Skill: `zjunlp/ddr-globem-analysis` (Agent Skill)
- Install (CLI): `npx skillmds@latest add zjunlp/ddr-globem-analysis`
- Raw SKILL.md: https://api.skillmd.com/api/skills/zjunlp/ddr-globem-analysis/raw
- Safety review: pending
- Works with: Claude Code, Claude.ai, OpenAI Codex
- Category: AI & ML
- Author: zjunlp (https://skillmd.com/u/zjunlp)
- Updated: 2026-09-17
- Page: https://skillmd.com/skills/zjunlp/ddr-globem-analysis

---


# DDR GLOBEM Participant Analysis

## Task Overview

Analyze all available data for a specified participant (identified by `pid`, e.g., `INS-W_011`) and submit QA pairs covering their behavioral and psychological changes across the observation period. Aim for **15+ high-quality, distinct QA pairs** covering every available data modality and multiple sub-dimensions within each modality.

## Dataset Structure

All CSV files share the columns `pid` (participant ID) and `date`. Filter every file by the target `pid`.

**Sensor files** (92 days per participant, many NaN rows are normal):
- `activity_allday_raw.csv` — daily step count, active/sedentary bout counts and durations
- `sleep_allday_raw.csv` — sleep duration (minutes), efficiency, bedtime/wake-time
- `communication_allday_raw.csv` — incoming/outgoing/missed call counts, durations, distinct contacts
- `location_allday_raw.csv` — distance traveled, radius of gyration, home time, significant places, circadian routine, location entropy, location transitions
- `phone_usage_allday_raw.csv` — unlock episode count, total duration, average duration per episode
- `connectivity_allday_raw.csv` — Bluetooth scan count, unique devices

**Assessment files** (one row per observation per participant):
- `ema.csv` — `negative_affect_EMA` score, timestamped across the study period
- `dep_weekly.csv` — weekly `feel_anxious`, `feel_depressed`, `BDI2` (endterm only), `dep` (binary), `dep_weekly_subscale`, `anx_weekly_subscale`
- `pre.csv` / `post.csv` — baseline vs. end-of-study psychological scales (loneliness, perceived stress, anxiety, depression, social support, emotion regulation, resilience, mindfulness, coping)
- `dep_endterm.csv` — final depression label and BDI2 score

**Schema tip**: Use `get_field_description(data_file="<filename>")` for the six sensor CSV files. For `ema.csv`, `dep_weekly.csv`, `pre.csv`, `post.csv`, infer column meanings from names.

**Known column pitfalls**:
- `platform.csv` uses column `platform`, not `os`
- Home time: use `barnett_hometime` (not `barnett_homelabel`, which does not exist)
- `summary_rapids_*` columns repeat the same period-wide value on every row — use `intraday_rapids_*` for daily variation

## Analysis Workflow

### 1. Orient to the participant

```python
import pandas as pd

pid = "INS-W_011"  # replace with target
files = ["ema.csv", "dep_weekly.csv", "activity_allday_raw.csv",
         "sleep_allday_raw.csv", "communication_allday_raw.csv",
         "location_allday_raw.csv", "phone_usage_allday_raw.csv",
         "connectivity_allday_raw.csv"]
for f in files:
    df = pd.read_csv(f)
    sub = df[df['pid'] == pid]
    n_valid = sub.select_dtypes('number').notna().any(axis=1).sum()
    print(f"{f}: {len(sub)} rows, {n_valid} with any numeric data")
```

### 2. Temporal segmentation for sensor data

Split the participant's non-NaN rows into early and late halves by date. This is the standard comparison unit for sensor modalities. Always `dropna()` on the target column first.

```python
def early_late(df, pid, value_col):
    sub = df[df['pid'] == pid].copy()
    sub['date'] = pd.to_datetime(sub['date'])
    sub = sub.sort_values('date').dropna(subset=[value_col])
    mid = len(sub) // 2
    early = sub.iloc[:mid][value_col].mean()
    late = sub.iloc[mid:][value_col].mean()
    return early, late
```

For each modality, also compute **weekday vs weekend** means — this often reveals additional QA-worthy patterns.

```python
sub['dayofweek'] = pd.to_datetime(sub['date']).dt.dayofweek
weekday = sub[sub['dayofweek'] < 5][value_col].mean()
weekend = sub[sub['dayofweek'] >= 5][value_col].mean()
```

### 3. Data to extract per modality

| Modality | Primary columns | Secondary columns (also extract) | QA angles |
|---|---|---|---|
| EMA | `negative_affect_EMA` | — | Early/late trend; spike timing with specific dates |
| Weekly depression | `feel_depressed`, `feel_anxious`, `dep`, `BDI2` | `dep_weekly_subscale`, `anx_weekly_subscale` | Persistent depression; symptom trajectory; final severity |
| Pre/Post surveys | All `_PRE` / `_POST` pairs | — | Change in loneliness, stress, anxiety, depression, social support, emotion regulation, resilience, coping, mindfulness |
| Activity | `intraday_rapids_sumsteps` | `intraday_rapids_sumdurationactivebout`, `intraday_rapids_sumdurationsedentarybout`, bout counts | Steps change; sedentary/active bout ratio change |
| Sleep | `summary_rapids_sumdurationasleepmain` (primary), `summary_rapids_avgefficiencymain` | `summary_rapids_firstbedtimemain`, `summary_rapids_lastwaketimemain` | Duration, quality, timing changes |
| Communication | `rapids_outgoing_count`, `rapids_incoming_count`, `rapids_missed_count` | `rapids_outgoing_sumduration`, `rapids_outgoing_distinctcontacts` | Call count vs duration dissociation; proactive vs reactive patterns |
| Location | `barnett_disttravelled`, `barnett_rog`, `barnett_hometime` | `barnett_circdnrtn` (circadian routine 0–1), `doryab_locationentropy` or `barnett_siglocentropy`, `doryab_numberlocationtransitions`, `barnett_siglocsvisited` | Mobility, home-time, spatial diversity, routine consistency, location transitions |
| Phone usage | `rapids_countepisodeunlock`, `rapids_sumdurationunlock` | `rapids_avgdurationunlock` | Count vs duration dissociation (more unlocks but shorter, or vice versa) |
| Connectivity | `rapids_countscans`, `rapids_uniquedevices` | — | Environmental exposure diversity |

### 4. Extract richer sub-dimension insights

**Weekday vs weekend**: For every modality with ≥10 weekday and ≥5 weekend valid days, compute means separately. Report if the difference is >15%.

**Active/sedentary ratio**: Compute the ratio of active bout duration (or count) to sedentary bout duration (or count) for early vs late periods. Even a small change in ratio can be a meaningful QA pair.

**Call count vs duration dissociation**: If outgoing call count increases but total duration decreases (or vice versa), this is a notable pattern (more frequent but shorter calls, or fewer but longer calls).

**Phone count vs duration dissociation**: Similarly, if unlock count drops but total duration rises, the user is having fewer but longer phone sessions — worth a dedicated QA pair.

**Location diversity**: Extract `doryab_locationentropy` (or `barnett_siglocentropy`) and `doryab_numberlocationtransitions` for early vs late. An increase signals more spatially diverse behavior; a decrease signals more routine.

**Circadian routine score** (`barnett_circdnrtn`, 0=chaotic, 1=perfectly consistent): Changes here indicate shifts in daily routine regularity.

**Temporal anomalies with specific dates**: After weekly aggregation, identify anomaly weeks (>2× median distance). Then examine individual dates within that week to pinpoint peak travel days with exact dates and magnitudes.

```python
sub['week'] = pd.to_datetime(sub['date']).dt.isocalendar().week
weekly = sub.groupby('week')['barnett_disttravelled'].mean()
anomaly_weeks = weekly[weekly > weekly.median() * 2]
# Then drill into those weeks for the top dates
for wk in anomaly_weeks.index:
    wk_days = sub[sub['week'] == wk].nlargest(3, 'barnett_disttravelled')
    print(wk_days[['date', 'barnett_disttravelled']])
```

**EMA spike analysis**: Identify the dates with highest negative affect and examine what behavioral signals coincide (travel events, reduced sleep, reduced home time). Report specific dates and values.

**Event-day behavioral comparison**: When a travel anomaly is detected, compare sleep, phone usage, and other metrics on those specific days vs participant's overall average. This produces high-value cross-modal QA pairs.

**Cross-modal correlations**: When two streams have ≥10 shared observations, compute Pearson correlation.

```python
merged = pd.merge(df_comm[['date','rapids_incoming_count']],
                  df_loc[['date','barnett_disttravelled']], on='date')
r = merged[['rapids_incoming_count','barnett_disttravelled']].corr().iloc[0,1]
```

**Self-report vs behavioral discrepancies**: When survey direction contradicts behavioral signal (e.g., social support worsens in surveys but outgoing calls increase), surface that tension explicitly.

**Behavioral trajectory vs psychological trajectory comparison**: If behavioral metrics (calls, mobility, phone use) increase while psychological metrics worsen (or vice versa), name this dissociation as a meta-pattern QA pair.

### 5. Formulate and submit QA pairs

Each QA pair must:
- Ask about a **specific behavioral or psychological dimension** with a clear time reference
- Include **concrete numbers** in the answer (mean values, direction and magnitude of change, scale names)
- Describe the **direction and magnitude** using natural language ("increased substantially", "remained stable", "decreased modestly")
- Remain factual — do not over-interpret causation

Submit with: `submit_qa_pair(q="...", a="...")`

**Good QA pair examples** (structure to emulate):

- Q: "How did the user's negative affect change over the observation period?"  
  A: "It showed a moderate increase, rising from 8.44 in the early period to 10.56 in the later period."

- Q: "How did the user's physical activity levels and sedentary behavior change between early and late periods?"  
  A: "Physical activity decreased modestly (steps: 10,884→9,249/day; -15%). Sedentary bout duration increased slightly while active bout duration fell, shifting the active-to-sedentary ratio from 0.19 to 0.16."

- Q: "How did outgoing call frequency and duration change between early and late periods?"  
  A: "Outgoing calls increased from 1.24 to 3.67/day (+196%), but total duration increased more dramatically (from 58s to 305s mean/call), suggesting fewer but much longer conversations in the later period."

- Q: "How did the user's mobility and phone usage differ between weekdays and weekends?"  
  A: "Weekend distance traveled averaged 162 km vs 23 km on weekdays, with home time decreasing by 2.2 hours. Phone usage also increased modestly on weekends (+4 unlocks/day)."

- Q: "Was there any exceptional mobility event during the study?"  
  A: "Week 24 showed exceptional mobility with distance spiking to 176,804 m — approximately 5× the participant's median. Peak travel days occurred on May 24 (4.4M m) and May 27 (3.98M m), suggesting major long-distance travel."

- Q: "Did the user's peak negative affect episodes coincide with any specific behavioral events?"  
  A: "Yes, the two highest negative affect days (May 20: 5.0, May 24: 8.0) coincided with the largest travel days (641 km and 4,428 km), suggesting travel-related stress during the high-mobility period."

- Q: "How did the user's spatial behavior and routine patterns change between early and late periods?"  
  A: "Location entropy decreased from 0.28 to 0.21 nats suggesting less diverse location usage, circadian routine weakened from 0.62 to 0.50 indicating less consistent daily patterns, while location transitions increased from 2.34 to 5.00/day."

- Q: "Is there a discrepancy between self-reported social support and behavioral communication patterns?"  
  A: "Yes: self-reported emotional social support decreased (giving: 14→8, receiving: 20→14), yet outgoing calls increased from 9.25 to 13.92/day, suggesting behavioral social engagement increased despite perceived support decline."

### 6. QA coverage checklist

Aim to cover all of these (skip only if data is entirely NaN):
- [ ] EMA negative affect trajectory (early/late)
- [ ] EMA spike analysis — specific high-affect dates and coinciding behaviors
- [ ] Weekly depression status and severity (including BDI2 endterm)
- [ ] Weekly depression/anxiety subscale trajectory
- [ ] Pre-post psychological state (depression, anxiety/stress)
- [ ] Pre-post social factors (loneliness, social support, social fit)
- [ ] Pre-post emotion regulation / coping / resilience / mindfulness
- [ ] Physical activity (steps) early vs. late
- [ ] Activity/sedentary bout ratio or absolute bout duration early vs. late
- [ ] Sleep duration and quality early vs. late
- [ ] Weekday vs weekend differences (at least one modality where difference is notable)
- [ ] Communication patterns — call count AND duration/contacts early vs. late; note count/duration dissociation if present
- [ ] Mobility patterns (distance, RoG, home time) early vs. late
- [ ] Location diversity (entropy, circadian routine score, significant places, location transitions) early vs. late
- [ ] Phone usage behavior (unlock count AND duration) early vs. late; note dissociation if present
- [ ] Connectivity / environmental exposure early vs. late
- [ ] Temporal anomaly (if detected) — with specific dates, magnitudes, and what else coincided
- [ ] Cross-modal correlation (if data permits, ≥10 shared observations)
- [ ] Self-report vs. behavioral discrepancy (if present)
- [ ] Behavioral trajectory vs. psychological trajectory dissociation (if behavioral and psychological trends diverge)

## Common Pitfalls

- **Never split raw 92-row arrays** — many rows will be NaN. Always `dropna()` on the target column before computing early/late statistics.
- **`summary_rapids_*` columns are period-wide summaries** — they repeat the same value across all rows. Use `intraday_rapids_*` for genuine daily variation.
- **`get_field_description` won't work for `ema.csv` or `dep_weekly.csv`** — infer column meanings from names.
- **BDI2 appears in `dep_weekly.csv` only in the final row** — it's the endterm score, not a weekly measure.
- **Pre/post survey scale directions vary**: higher UCLA = more loneliness (bad), higher ERQ_reappraisal = better regulation (good), higher PSS = more stress (bad), higher BRS = better resilience (good).
- **`barnett_homelabel` does not exist** — use `barnett_hometime` for Barnett-algorithm home time.
- **`platform.csv` column is `platform`, not `os`** — KeyError on `os` is a common bug.
- **Submit QA pairs incrementally** as you finish each modality — don't batch them all at the end.
- **Communication data is often sparse** (<30% valid days for some participants) — note this limitation but still extract the available patterns.
- **Distance outliers**: filter values >10× median before computing means for location data to avoid skew from extreme travel days inflating averages.