Skip to content

ECO-AIM-AI-007 — No model quantization

  • Category: AI/ML (AIM)
  • Family: AI (AI)
  • Layer: AI
  • Tier: 3
  • Severity: note
  • Tags: ai, quantization
  • Legacy ID: ECO-AI-007

Summary

Failure to quantize when appropriate wastes inference compute.

Rationale

Quantization can reduce compute cost with acceptable quality tradeoffs.

Impact

{
  "confidence": 0.55,
  "notes": "Model-dependent.",
  "type": "cost"
}

Detection

{
  "languages": [
    "infra"
  ],
  "method": "config"
}

Remediation

{
  "guidance": "Evaluate quantization for inference workloads.",
  "tradeoffs": "Potential quality/compatibility changes."
}

Ontology

{
  "system_layers": [
    "ai"
  ]
}