ECO-AIM-AI-005¶
Name: Always-on inference endpoints
Category: AI/ML
Family: AI
Primary layer: ai
System layers: ai
Description¶
Always-on endpoints waste baseline compute when idle.
Impact¶
- confidence: 0.6
- notes: High for GPU-backed endpoints.
- type: carbon
Detection¶
- languages:
infra - method: trace
Remediation¶
- guidance: Autoscale; scale-to-zero where feasible; consolidate endpoints.
- tradeoffs: Cold starts and scheduling complexity.
Pattern examples¶
No pattern examples provided.
Remediation examples¶
No remediation examples provided.
Metadata¶
- catalog_version: 0.4.0