Lap-Platform Text Generation Inference
API version: 3.3.6-dev0
Auth
No authentication required.
Base URL
Not specified.
Setup
- No auth setup needed
- GET /health -- verify access
- POST / -- create first resource
Endpoints
12 endpoints across 12 groups. See references/api-spec.lap for full details.
root
| Method | Path | Description |
|---|---|---|
| POST | / | Generate tokens if stream == false or a stream of token if stream == true |
chat_tokenize
| Method | Path | Description |
|---|---|---|
| POST | /chat_tokenize | Template and tokenize ChatRequest |
generate
| Method | Path | Description |
|---|---|---|
| POST | /generate | Generate tokens |
generate_stream
| Method | Path | Description |
|---|---|---|
| POST | /generate_stream | Generate a stream of token using Server-Sent Events |
health
| Method | Path | Description |
|---|---|---|
| GET | /health | Health check method |
info
| Method | Path | Description |
|---|---|---|
| GET | /info | Text Generation Inference endpoint info |
invocations
| Method | Path | Description |
|---|---|---|
| POST | /invocations | Generate tokens from Sagemaker request |
metrics
| Method | Path | Description |
|---|---|---|
| GET | /metrics | Prometheus metrics scrape endpoint |
tokenize
| Method | Path | Description |
|---|---|---|
| POST | /tokenize | Tokenize inputs |
chat
| Method | Path | Description |
|---|---|---|
| POST | /v1/chat/completions | Generate tokens |
completions
| Method | Path | Description |
|---|---|---|
| POST | /v1/completions | Generate tokens |
models
| Method | Path | Description |
|---|---|---|
| GET | /v1/models | Get model info |
Common Questions
Match user requests to endpoints in references/api-spec.lap. Key patterns:
- "Create a chat_tokenize?" -> POST /chat_tokenize
- "Create a generate?" -> POST /generate
- "Create a generate_stream?" -> POST /generate_stream
- "List all health?" -> GET /health
- "List all info?" -> GET /info
- "Create a invocation?" -> POST /invocations
- "List all metrics?" -> GET /metrics
- "Create a tokenize?" -> POST /tokenize
- "Create a completion?" -> POST /v1/chat/completions
- "Create a completion?" -> POST /v1/completions
- "List all models?" -> GET /v1/models
Response Tips
- Check response schemas in references/api-spec.lap for field details
- Create/update endpoints typically return the created/updated object
References
- Full spec: See references/api-spec.lap for complete endpoint details, parameter tables, and response schemas
Generated from the official API spec by LAP