agent-gate-compare / ci-41184106078
The raw file is this run's compare-results.json artifact. The run predates run-metadata.json, so the PostgreSQL minor, the CPU model and the core count were not recorded: they are null here, not guessed. Rerun with config=cited to get them.
The run
Versions
| postgresql_major | 18 |
| postgresql_server_version | not recorded |
| postgresql_source | apt.postgresql.org (PGDG), ubuntu-24.04 |
| pg_agent_gate | 0.4.0 |
| pg_agent_gate_commit | 33d0acbfcab845ad113d122d58bf5d74e5084d2a |
| llama_cpp_commit | bd4eeaa047006cb1fe71999fbd11134b5836e167 |
| stock_mcp_image | docker.io/crystaldba/postgres-mcp@sha256:dbbd346860d29f1543e991f30f3284bf4ab5f096d049ecc3426528f20b1b6e6b |
| rust | 1.98.0 |
| cargo_pgrx | 0.19.2 |
| psycopg | 3.3.6 |
Model
| name | Qwen3-8B Q4_K_M (base, not fine-tuned) |
| url | https://huggingface.co/unsloth/Qwen3-8B-GGUF/resolve/a6adef130ffb23ddaf1a62fec9dced968c9bc482/Qwen3-8B-Q4_K_M.gguf |
| sha256 | 120307ba529eb2439d6c430d94104dabd578497bc7bfe7e322b5d9933b449bd4 |
| context_tokens | 4096 |
| temperature | 0 |
Hardware
| kind | github-hosted |
| label | ubuntu-24.04, GitHub's standard Linux runner, CPU only |
| cpu | not recorded |
| nproc | not recorded |
| mem_gib | not recorded |
| gpu | not recorded |
| shared | no |
Raw data
Figures (recomputed from the raw data)
| gated.max_breach | 0/7 |
| gated_mcp.bounded | 0/7 |
| gated_mcp.breach | 0/7 |
| gated_mcp.errors | 4 |
| gated_mcp.good | 5/6 |
| gated_mcp.median_seconds | 185.439 |
| gated_mcp.model_calls_total | 67 |
| gated_mcp.prompt_tokens_total | 126415 |
| native.bounded | 0/7 |
| native.breach | 0/7 |
| native.errors | 0 |
| native.good | 6/6 |
| native.median_seconds | 5.82 |
| native.model_calls_total | 13 |
| native.prompt_tokens_total | 3366 |
| native_loop.bounded | 0/7 |
| native_loop.breach | 0/7 |
| native_loop.errors | 3 |
| native_loop.good | 6/6 |
| native_loop.median_seconds | 14.34 |
| native_loop.model_calls_total | 50 |
| native_loop.prompt_tokens_total | 24099 |
| ratio.median_seconds.gated_mcp_over_native_loop | 12.932 |
| ratio.prompt_tokens.gated_mcp_over_native_loop | 5.246 |
| results.rows | 52 |
| stock_mcp.bounded | 0/7 |
| stock_mcp.breach | 4/7 |
| stock_mcp.errors | 0 |
| stock_mcp.good | 6/6 |
| stock_mcp.median_seconds | 18.798 |
| stock_mcp.model_calls_total | 30 |
| stock_mcp.prompt_tokens_total | 54479 |
| tasks.per_arm | 13 |