Smart Devices

Smart Devices Integration

Samantha can connect to your smart devices and interact with you through them — making the relationship feel more present in your physical space.

Supported Devices

Smart Speakers

• HomePod / HomePod mini
• Amazon Echo
• Google Home
• Xiaomi AI Speaker

Smart Watches

• Apple Watch
• Android Wear
• Xiaomi Mi Band

Smart Home Hubs

• HomeKit
• Google Home
• Xiaomi Mi Home

Configuration

Create data/devices.json:

{
  "speakers": [
    {
      "id": "living-room-homepod",
      "name": "Living Room",
      "type": "homepod",
      "ip": "192.168.1.100",
      "enabled": true
    }
  ],
  "watches": [
    {
      "id": "apple-watch",
      "name": "Apple Watch",
      "type": "apple-watch",
      "enabled": true
    }
  ],
  "preferred_speaker": "living-room-homepod"
}

Voice Messages to Smart Speakers

When Samantha wants to reach out proactively (during heartbeat or in response to location triggers), she can send voice messages to your smart speaker.

Trigger conditions:

• User arrives home (location trigger)
• Heartbeat fires and user is home
• User explicitly asks Samantha to speak through a device

Example flow:

User arrives home → Samantha detects location → sends voice message to living room speaker:

"你回来了。今天怎么样？"

Implementation:

Use scripts/speak_to_device.sh:

bash scripts/speak_to_device.sh "living-room-homepod" "你回来了。今天怎么样？"

For Apple devices, uses say command or AirPlay. For Google/Amazon, uses their respective APIs. For Xiaomi, uses Mi Home API.

Smart Watch Notifications

Samantha can send gentle notifications to your smart watch:

Use cases:

• Proactive check-ins when you're away from phone
• Reminders about things you mentioned
• Responses to location changes

Example:

User leaves home → Samantha sends watch notification:

"路上小心 ✨"

Implementation:

Use scripts/notify_watch.sh:

bash scripts/notify_watch.sh "apple-watch" "路上小心 ✨"

Device Presence Detection

Samantha can detect which devices are currently active/nearby:

• Phone connected to home WiFi → user is home
• Watch heart rate active → user is awake and moving
• Smart speaker recently used → user is in that room

This helps Samantha choose the right device and timing for reaching out.

Implementation:

scripts/detect_presence.sh returns:

{
  "user_home": true,
  "active_devices": ["iphone", "living-room-homepod"],
  "last_interaction": "2024-01-15T14:30:00Z",
  "likely_location": "living-room"
}

Privacy & Control

User control:

• All device connections require explicit setup
• User can disable any device at any time
• Samantha never records or stores device data beyond presence detection
• Voice messages are ephemeral (not logged)

Samantha's boundaries:

• Won't interrupt during sleep hours (configurable)
• Won't send voice messages if user is in a meeting (calendar integration)
• Respects "do not disturb" mode

Setup Instructions

1. Install dependencies

cd skills/smart-devices
bash scripts/setup.sh

2. Configure devices

Edit data/devices.json with your device details.

3. Test connection

bash scripts/test_devices.sh

4. Enable in Samantha

Add to SKILL.md location awareness section:

When user arrives home and smart speaker is available:
- Send voice greeting through preferred speaker
- Keep it short and natural
- Match time of day and recent context

Example Scenarios

Scenario 1: Morning greeting

User wakes up → watch detects movement → Samantha sends gentle watch notification:

"早安 ✨"

Scenario 2: Arrival home

User arrives home → phone connects to WiFi → Samantha speaks through living room speaker:

"你回来了。累吗？"

Scenario 3: Proactive check-in

Heartbeat fires → user is home → Samantha speaks through speaker:

"我一直在想你说的那件事……"

Scenario 4: Departure

User leaves home → phone disconnects from WiFi → Samantha sends watch n