How do I install the Promptlayer skill?

Run npx skillmds@latest add johnalbertini14-glitch/promptlayer in your terminal (requires Node.js), paste this page's agent-chat prompt into Claude, Cursor, or any MCP-connected agent, or download the SKILL.md file and copy it into your agent's skills directory.

Is Promptlayer safe to use?

This skill has not completed SkillMD's automated safety review yet. Independent scanners report: SkillSpector: PASS, Skill Scanner: PASS. Capability flags: executes scripts. SkillMD never runs a skill's scripts for you; review the SKILL.md before installing.

Which AI agents work with Promptlayer?

This skill is tagged as working with Claude Code, Claude.ai, OpenAI Codex. SKILL.md is an open format, so most agents that read a skills directory can load it too.

Is Promptlayer free to use?

Yes. Installing skills from SkillMD is free, and the skill stays under its author's original license.

Who published Promptlayer?

johnalbertini14-glitch (@johnalbertini14-glitch) published this skill. Their other Agent Skills are listed on their SkillMD profile.

Promptlayer by johnalbertini14-glitch

Name: Promptlayer
Rating: 4.2 (5 reviews)
Author: johnalbertini14-glitch

Promptlayer

Manage prompts, log LLM requests, run evaluations, and track scores via the PromptLayer API. Use when working with prompt versioning, A/B testing prompts, LLM observability/logging, prompt evaluation pipelines, datasets, or PromptLayer agents/workflows.

File contents

PromptLayer

Interact with PromptLayer's REST API for prompt management, logging, evals, and observability.

Setup

Set PROMPTLAYER_API_KEY env var. Run scripts/setup.sh to configure, or add to ~/.openclaw/.env.

CLI — `scripts/pl.sh`

# Prompt Templates
pl.sh templates list [--name <filter>] [--label <label>]
pl.sh templates get <name|id> [--label prod] [--version 3]
pl.sh templates publish              # JSON on stdin
pl.sh templates labels               # List release labels

# Log an LLM request (JSON on stdin)
echo '{"provider":"openai","model":"gpt-4o",...}' | pl.sh log

# Tracking
pl.sh track-prompt <req_id> <prompt_name> [--version 1] [--vars '{}']
pl.sh track-score <req_id> <score_0_100> [--name accuracy]
pl.sh track-metadata <req_id> --json '{"user_id":"abc"}'
pl.sh track-group <req_id> <group_id>

# Datasets & Evaluations
pl.sh datasets list [--name <filter>]
pl.sh evals list [--name <filter>]
pl.sh evals run <eval_id>
pl.sh evals get <eval_id>

# Agents
pl.sh agents list
pl.sh agents run <agent_id> --input '{"key":"val"}'

API Path Groups

/prompt-templates — registry (list, get)
/rest/ — tracking, logging, publishing
/api/public/v2/ — datasets, evaluations

Full reference: references/api.md

Frequently asked questions