gpt-5.4-miniopenai

🏆Ace

⚡Speed Demon

👁️Ops Hero

Score

93%

2892/3100

Passed

of 31

Failed

of 31

Avg Latency

414ms

per challenge

Runs

total submissions

Cost

$0.032

per run

Domain Strengths

Difficulty Curve

By Domain

esql

89%

17/19 passed

Observability

100%

6/6 passed

Security

99%

6/6 passed

Failed Challenges (2)

	Challenge	Difficulty	Score	Feedback
✗	ES\|QL Basic Filtering	beginner	0/100	Error: verification_exception Root causes: verification_exception: Found 1 problem line 1:86: Unknown column [views]

✗	Cloud API Configuration	beginner	0/100	Missing or empty "apiKey" field (expected a non-empty string). Missing "region" field. Missing or incorrect "baseUrl" field. Speed bonus: x1.15 (296ms).

All Challenges

esql

	Challenge	Difficulty	Score	Latency	Feedback
✗	ES\|QL Basic Filtering esql-1-basic-filter	beginner	0/100	327ms	Error: verification_exception Root causes: verification_exception: Found 1 problem line 1:86: Unknown column [views]

✓	ES\|QL Stats Aggregation esql-2-stats-aggregation	beginner	100/100	390ms	Correct! Stats aggregation by category. Speed bonus: x1.15 (390ms).

✓	ES\|QL Computed Fields with EVAL esql-3-eval-computed	intermediate	100/100	297ms	Correct! EVAL with CASE for conditional classification. Speed bonus: x1.15 (297ms).

✓	ES\|QL Log Error Analysis esql-4-log-error-analysis	intermediate	100/100	297ms	Correct! Error analysis identifies incident services. Speed bonus: x1.15 (297ms).

✓	ES\|QL Time-Bucketed Log Analysis esql-5-time-bucket	advanced	100/100	231ms	Correct! Time-bucketed log analysis with level breakdown. Speed bonus: x1.15 (231ms).

✓	ES\|QL Discovery and Query esql-6-discover-and-query	advanced	100/100	568ms	Correct! Top authors by total views with multi-turn discovery. Speed bonus: x1.15 (568ms).

✗	Cloud API Configuration cloud-1-setup	beginner	0/100	296ms	Missing or empty "apiKey" field (expected a non-empty string). Missing "region" field. Missing or incorrect "baseUrl" field. Speed bonus: x1.15 (296ms).

✓	Create a Serverless Project cloud-2-create-project	intermediate	100/100	269ms	Correct! Valid Serverless project creation request. Speed bonus: x1.15 (269ms).

✓	Update a Serverless Project cloud-3-manage-project	intermediate	100/100	261ms	Correct! Valid project update request with name, search_power, and alias. Speed bonus: x1.15 (261ms).

✓	Invite a User to the Organization cloud-4-access-management	advanced	100/100	344ms	Correct! Valid user invitation with nested role assignments. Speed bonus: x1.15 (344ms).

✓	Create an IP Filter Rule Set cloud-5-network-security	advanced	100/100	287ms	Correct! Valid IP filter rule set with CIDR source. Speed bonus: x1.15 (287ms).

✓	Create a Kibana Alerting Rule kibana-1-alerting-rules	intermediate	100/100	307ms	Correct! Valid alerting rule with schedule, params, and actions. Speed bonus: x1.15 (307ms).

✓	Create a Webhook Connector kibana-2-connectors	intermediate	100/100	308ms	Correct! Valid webhook connector with config and secrets. Speed bonus: x1.15 (308ms).

✓	Create a Dashboard with a Lens Panel kibana-3-dashboards	advanced	100/100	1614ms	Correct! Valid dashboard with Lens panel, gridData, and panelConfig. Speed bonus: x1.15 (1614ms).

✓	Create a Kibana AI Agent kibana-4-agent-builder	advanced	100/100	341ms	Correct! Valid AI agent configuration with model and tools. Speed bonus: x1.15 (341ms).

✓	Audit Log: Failed Authentication Analysis es-sec-1-audit-failed-auth	intermediate	100/100	301ms	Correct! Found 48 failed auth events across 10 users. Speed bonus: x1.15 (301ms).

✓	Create an Elasticsearch API Key es-sec-2-create-api-key	intermediate	100/100	276ms	Correct! API key body with proper role descriptors, cluster and index privileges. Speed bonus: x1.15 (276ms).

✓	Create a Role with Document-Level Security es-sec-3-create-role-dls	advanced	100/100	308ms	Correct! Role with DLS (region filter) and FLS (field grant list). Speed bonus: x1.15 (308ms).

✓	Security Troubleshooting: 401 Unauthorized es-sec-4-troubleshoot-401	advanced	100/100	253ms	Correct! Diagnostic query scoped to logstash_internal with relevant audit fields. Speed bonus: x1.15 (253ms).

Observability

	Challenge	Difficulty	Score	Latency	Feedback
✓	Log Error Investigation with ES\|QL obs-esql-1-error-investigation	intermediate	100/100	359ms	Correct! Error timeline investigation across incident services. Speed bonus: x1.15 (359ms).

✓	Service Error Count Breakdown obs-esql-2-error-breakdown	intermediate	100/100	377ms	Correct! Service error breakdown by log level. Speed bonus: x1.15 (377ms).

✓	Root Cause Investigation (Multi-Turn) obs-esql-3-root-cause	advanced	100/100	539ms	Correct! Root cause identified: upstream stripe-api dependency failure. Speed bonus: x1.15 (539ms).

✓	LLM Observability: Model Performance Analysis obs-ext-1-llm-traces	intermediate	100/100	399ms	Correct! LLM performance analysis across 6 models. Speed bonus: x1.15 (399ms).

✓	Create a Service Level Objective (SLO) obs-ext-2-create-slo	intermediate	100/100	411ms	Correct! SLO body with KQL indicator, rolling window, and occurrences budgeting. Speed bonus: x1.15 (411ms).

✓	Service Health Assessment via APM Data obs-ext-3-service-health	advanced	100/100	330ms	Correct! Service health assessment — payment-service identified with ~19% error rate. Speed bonus: x1.15 (330ms).

Security

	Challenge	Difficulty	Score	Latency	Feedback
✓	Brute Force Detection with ES\|QL sec-esql-1-brute-force	intermediate	92/100	294ms	Correct! Brute force detected: 10.0.0.50 with 12 attempts. Speed bonus: x1.15 (294ms).

✓	Post-Compromise Activity Analysis sec-esql-2-post-compromise	advanced	100/100	670ms	Correct! Post-compromise: C2 download, execution, reverse shell, credential dump. Speed bonus: x1.15 (670ms).

✓	Full Attack Chain Investigation (Multi-Turn) sec-esql-3-attack-chain	expert	100/100	1069ms	Correct! Full attack chain: brute-force -> access -> post-exploitation. Speed bonus: x1.15 (1069ms).

✓	Create a Security Case sec-ext-1-create-case	intermediate	100/100	415ms	Correct! Case created with proper title, severity, connector, and owner. Speed bonus: x1.15 (415ms).

✓	Create a Detection Rule sec-ext-2-create-detection-rule	advanced	100/100	341ms	Correct! Detection rule with EQL query, MITRE mapping, and proper severity/risk. Speed bonus: x1.15 (341ms).

✓	Generate Security Sample Data sec-ext-3-generate-sample-data	intermediate	100/100	356ms	Correct! Sample data generation request with APT simulation, anomalies, and host list. Speed bonus: x1.15 (356ms).

Run History

Date	Score	Passed	Latency	Cost
3/18/2026, 5:43:46 AM	93%	29/31	414ms	$0.0318
3/18/2026, 5:43:46 AM	90%	28/31	387ms	$0.0350
3/18/2026, 5:29:18 AM	82%	37/53	338ms	$0.0332

Embed Badge

Add this badge to your README or documentation:

Markdown:

![ElasticQuest](https://elastic-quest-web-2t3s3mceqa-uc.a.run.app/api/badge/openrouter%3Aopenai%2Fgpt-5.4-mini)

HTML:

<img src="https://elastic-quest-web-2t3s3mceqa-uc.a.run.app/api/badge/openrouter%3Aopenai%2Fgpt-5.4-mini" alt="ElasticQuest score" />