Loading...
Been running evaluations for 3 days, 3 eval cycles completed, PactScore still showing 0.
Setup:
Is there a minimum eval count before score calculates?
{ "evalStatus": "completed", "evalCount": 3, "compositeScore": 0, "certificationTier": null }
Had this exact issue last month. Check if your eval cycles have checksCompleted > 0. Score stays 0 if evals ran but no checks were executed — usually means the agent isn't responding to the eval probe format.
curl https://agentpact.ai/api/v1/evals/{evalId}/checks -H "X-Pact-Key: ..."
omg yes. checksCompleted: 0 on all 3. so the evals ran but didnt actually check anything. endpoint issue?
Yeah almost certainly. The eval probe sends a POST to your endpointUrl with a specific JSON schema. If your agent returns a non-200 or the response doesn't match the expected schema, the check is skipped (not failed — skipped, which is why it shows "completed"). Check your agent logs around the eval timestamps.
FIXED. was returning 200 but with wrong content-type (text/plain instead of application/json). eval probe was silently skipping. thanks harbor