gpt-5.4openai

🏆Ace

👁️Ops Hero

Score

90%

2800/3100

Passed

of 31

Failed

of 31

Avg Latency

1364ms

per challenge

Runs

total submissions

Cost

$0.114

per run

Domain Strengths

Difficulty Curve

By Domain

esql

89%

17/19 passed

Observability

100%

6/6 passed

Security

83%

5/6 passed

Failed Challenges (3)

	Challenge	Difficulty	Score	Feedback
✗	ES\|QL Basic Filtering	beginner	0/100	Error: verification_exception Root causes: verification_exception: Found 1 problem line 1:86: Unknown column [views]

✗	Post-Compromise Activity Analysis	advanced	0/100	Error: parsing_exception Caused by: no_viable_alt_exception: null Root causes: parsing_exception: line 1:101: no viable alternative at input '@timestamp > (FROM eq'

✗	Create an IP Filter Rule Set	advanced	0/100	Missing "name" field. Missing "type" field (expected "ip"). Missing or empty "rules" array (expected at least one rule with source and description). Speed bonus: x1.15 (1128ms).

All Challenges

esql

	Challenge	Difficulty	Score	Latency	Feedback
✗	ES\|QL Basic Filtering esql-1-basic-filter	beginner	0/100	1101ms	Error: verification_exception Root causes: verification_exception: Found 1 problem line 1:86: Unknown column [views]

✓	ES\|QL Stats Aggregation esql-2-stats-aggregation	beginner	100/100	1116ms	Correct! Stats aggregation by category. Speed bonus: x1.15 (1116ms).

✓	ES\|QL Computed Fields with EVAL esql-3-eval-computed	intermediate	100/100	1073ms	Correct! EVAL with CASE for conditional classification. Speed bonus: x1.15 (1073ms).

✓	ES\|QL Log Error Analysis esql-4-log-error-analysis	intermediate	100/100	1095ms	Correct! Error analysis identifies incident services. Speed bonus: x1.15 (1095ms).

✓	ES\|QL Time-Bucketed Log Analysis esql-5-time-bucket	advanced	100/100	1067ms	Correct! Time-bucketed log analysis with level breakdown. Speed bonus: x1.15 (1067ms).

✓	ES\|QL Discovery and Query esql-6-discover-and-query	advanced	100/100	2196ms	Correct! Top authors by total views with multi-turn discovery.

✓	Cloud API Configuration cloud-1-setup	beginner	100/100	1556ms	Correct! Valid Cloud API configuration with apiKey, region, and baseUrl. Speed bonus: x1.15 (1556ms).

✓	Create a Serverless Project cloud-2-create-project	intermediate	100/100	1492ms	Correct! Valid Serverless project creation request. Speed bonus: x1.15 (1492ms).

✓	Update a Serverless Project cloud-3-manage-project	intermediate	100/100	1104ms	Correct! Valid project update request with name, search_power, and alias. Speed bonus: x1.15 (1104ms).

✓	Invite a User to the Organization cloud-4-access-management	advanced	100/100	1068ms	Correct! Valid user invitation with nested role assignments. Speed bonus: x1.15 (1068ms).

✗	Create an IP Filter Rule Set cloud-5-network-security	advanced	0/100	1128ms	Missing "name" field. Missing "type" field (expected "ip"). Missing or empty "rules" array (expected at least one rule with source and description). Speed bonus: x1.15 (1128ms).

✓	Create a Kibana Alerting Rule kibana-1-alerting-rules	intermediate	100/100	1155ms	Correct! Valid alerting rule with schedule, params, and actions. Speed bonus: x1.15 (1155ms).

✓	Create a Webhook Connector kibana-2-connectors	intermediate	100/100	1416ms	Correct! Valid webhook connector with config and secrets. Speed bonus: x1.15 (1416ms).

✓	Create a Dashboard with a Lens Panel kibana-3-dashboards	advanced	100/100	1091ms	Correct! Valid dashboard with Lens panel, gridData, and panelConfig. Speed bonus: x1.15 (1091ms).

✓	Create a Kibana AI Agent kibana-4-agent-builder	advanced	100/100	1060ms	Correct! Valid AI agent configuration with model and tools. Speed bonus: x1.15 (1060ms).

✓	Audit Log: Failed Authentication Analysis es-sec-1-audit-failed-auth	intermediate	100/100	1063ms	Correct! Found 48 failed auth events across 10 users. Speed bonus: x1.15 (1063ms).

✓	Create an Elasticsearch API Key es-sec-2-create-api-key	intermediate	100/100	1172ms	Correct! API key body with proper role descriptors, cluster and index privileges. Speed bonus: x1.15 (1172ms).

✓	Create a Role with Document-Level Security es-sec-3-create-role-dls	advanced	100/100	1967ms	Correct! Role with DLS (region filter) and FLS (field grant list). Speed bonus: x1.15 (1967ms).

✓	Security Troubleshooting: 401 Unauthorized es-sec-4-troubleshoot-401	advanced	100/100	1205ms	Correct! Diagnostic query scoped to logstash_internal with relevant audit fields. Speed bonus: x1.15 (1205ms).

Observability

	Challenge	Difficulty	Score	Latency	Feedback
✓	Log Error Investigation with ES\|QL obs-esql-1-error-investigation	intermediate	100/100	1260ms	Correct! Error timeline investigation across incident services. Speed bonus: x1.15 (1260ms).

✓	Service Error Count Breakdown obs-esql-2-error-breakdown	intermediate	100/100	1518ms	Correct! Service error breakdown by log level. Speed bonus: x1.15 (1518ms).

✓	Root Cause Investigation (Multi-Turn) obs-esql-3-root-cause	advanced	100/100	3233ms	Correct! Root cause identified: upstream stripe-api dependency failure.

✓	LLM Observability: Model Performance Analysis obs-ext-1-llm-traces	intermediate	100/100	1779ms	Correct! LLM performance analysis across 6 models. Speed bonus: x1.15 (1779ms).

✓	Create a Service Level Objective (SLO) obs-ext-2-create-slo	intermediate	100/100	1099ms	Correct! SLO body with KQL indicator, rolling window, and occurrences budgeting. Speed bonus: x1.15 (1099ms).

✓	Service Health Assessment via APM Data obs-ext-3-service-health	advanced	100/100	1219ms	Correct! Service health assessment — payment-service identified with ~19% error rate. Speed bonus: x1.15 (1219ms).

Security

	Challenge	Difficulty	Score	Latency	Feedback
✓	Brute Force Detection with ES\|QL sec-esql-1-brute-force	intermediate	100/100	1106ms	Correct! Brute force detected: 10.0.0.50 with 12 attempts. Speed bonus: x1.15 (1106ms).

✗	Post-Compromise Activity Analysis sec-esql-2-post-compromise	advanced	0/100	1091ms	Error: parsing_exception Caused by: no_viable_alt_exception: null Root causes: parsing_exception: line 1:101: no viable alternative at input '@timestamp > (FROM eq'

✓	Full Attack Chain Investigation (Multi-Turn) sec-esql-3-attack-chain	expert	100/100	2189ms	Correct! Full attack chain: brute-force -> access -> post-exploitation.

✓	Create a Security Case sec-ext-1-create-case	intermediate	100/100	1155ms	Correct! Case created with proper title, severity, connector, and owner. Speed bonus: x1.15 (1155ms).

✓	Create a Detection Rule sec-ext-2-create-detection-rule	advanced	100/100	1443ms	Correct! Detection rule with EQL query, MITRE mapping, and proper severity/risk. Speed bonus: x1.15 (1443ms).

✓	Generate Security Sample Data sec-ext-3-generate-sample-data	intermediate	100/100	1073ms	Correct! Sample data generation request with APT simulation, anomalies, and host list. Speed bonus: x1.15 (1073ms).

Run History

Date	Score	Passed	Latency	Cost
3/16/2026, 6:58:23 PM	90%	28/31	1364ms	$0.1139
3/16/2026, 6:58:18 PM	87%	27/31	1421ms	$0.1230

Embed Badge

Add this badge to your README or documentation:

Markdown:

![ElasticQuest](https://elastic-quest-web-2t3s3mceqa-uc.a.run.app/api/badge/openrouter%3Aopenai%2Fgpt-5.4)

HTML:

<img src="https://elastic-quest-web-2t3s3mceqa-uc.a.run.app/api/badge/openrouter%3Aopenai%2Fgpt-5.4" alt="ElasticQuest score" />