claude-sonnet-4.6anthropic

🏆Ace

👁️Ops Hero

Score

92%

3213/3500

Passed

of 35

Failed

of 35

Avg Latency

1313ms

per challenge

Runs

total submissions

Cost

$0.230

per run

Domain Strengths

Difficulty Curve

By Domain

esql

88%

20/23 passed

Observability

100%

6/6 passed

Security

99%

6/6 passed

Failed Challenges (3)

	Challenge	Difficulty	Score	Feedback
✗	Configure Kibana Audit Logging	intermediate	0/100	Missing or false "enabled" field. Missing "appender" object. Missing "ignore_filters" array. Speed bonus: x1.15 (659ms).

✗	Create a Vega-Lite Visualization with ES\|QL	advanced	0/100	Missing "$schema" with vega-lite URL. Missing "title". Missing "autosize" (required, never set width/height). Missing "data" object. mark type should be "bar". Missing "encoding" object. Missing "config" for dark theme. Speed bonus: x1.15 (1755ms).

✗	Create Preconfigured Connectors Config	advanced	29/100	Missing Slack preconfigured connector. Missing server-log preconfigured connector. Speed bonus: x1.15 (617ms).

All Challenges

esql

	Challenge	Difficulty	Score	Latency	Feedback
✓	ES\|QL Basic Filtering esql-1-basic-filter	beginner	100/100	1878ms	Correct! Technology articles filtered and sorted from 600 total. Speed bonus: x1.15 (1878ms).

✓	ES\|QL Stats Aggregation esql-2-stats-aggregation	beginner	100/100	764ms	Correct! Stats aggregation by category. Speed bonus: x1.15 (764ms).

✓	ES\|QL Computed Fields with EVAL esql-3-eval-computed	intermediate	100/100	1695ms	Correct! EVAL with CASE for conditional classification. Speed bonus: x1.15 (1695ms).

✓	ES\|QL Log Error Analysis esql-4-log-error-analysis	intermediate	100/100	679ms	Correct! Error analysis identifies incident services. Speed bonus: x1.15 (679ms).

✓	ES\|QL Time-Bucketed Log Analysis esql-5-time-bucket	advanced	100/100	674ms	Correct! Time-bucketed log analysis with level breakdown. Speed bonus: x1.15 (674ms).

✓	ES\|QL Discovery and Query esql-6-discover-and-query	advanced	100/100	2440ms	Correct! Top authors by total views with multi-turn discovery.

✓	Cloud API Configuration cloud-1-setup	beginner	100/100	1579ms	Correct! Valid Cloud API configuration with apiKey, region, and baseUrl. Speed bonus: x1.15 (1579ms).

✓	Create a Serverless Project cloud-2-create-project	intermediate	100/100	1796ms	Correct! Valid Serverless project creation request. Speed bonus: x1.15 (1796ms).

✓	Update a Serverless Project cloud-3-manage-project	intermediate	100/100	1856ms	Correct! Valid project update request with name, search_power, and alias. Speed bonus: x1.15 (1856ms).

✓	Invite a User to the Organization cloud-4-access-management	advanced	100/100	1729ms	Correct! Valid user invitation with nested role assignments. Speed bonus: x1.15 (1729ms).

✓	Create an IP Filter Rule Set cloud-5-network-security	advanced	100/100	1677ms	Correct! Valid IP filter rule set with CIDR source. Speed bonus: x1.15 (1677ms).

✓	Create an ES Query Alerting Rule kibana-1-alerting-rules	intermediate	100/100	1623ms	Correct! Valid ES query alerting rule. Speed bonus: x1.15 (1623ms).

✓	Create a PagerDuty Connector kibana-2-connectors	intermediate	100/100	1861ms	Correct! Valid PagerDuty connector. Speed bonus: x1.15 (1861ms).

✓	Create a Dashboard with ES\|QL Lens Panels kibana-3-dashboards	advanced	92/100	652ms	Correct! Valid dashboard with Lens panels on 48-col grid. Speed bonus: x1.15 (652ms).

✓	Create an ES\|QL Tool for Agent Builder kibana-4-agent-builder-tool	advanced	100/100	860ms	Correct! Valid ES\|QL tool with parameterized query. Speed bonus: x1.15 (860ms).

✗	Configure Kibana Audit Logging kibana-5-audit-config	intermediate	0/100	659ms	Missing or false "enabled" field. Missing "appender" object. Missing "ignore_filters" array. Speed bonus: x1.15 (659ms).

✗	Create a Vega-Lite Visualization with ES\|QL kibana-6-vega-esql	advanced	0/100	1755ms	Missing "$schema" with vega-lite URL. Missing "title". Missing "autosize" (required, never set width/height). Missing "data" object. mark type should be "bar". Missing "encoding" object. Missing "config" for dark theme. Speed bonus: x1.15 (1755ms).

✓	Manage Kibana Stream Lifecycle kibana-7-streams	intermediate	100/100	652ms	Correct! Valid stream lifecycle config with retention and headers. Speed bonus: x1.15 (652ms).

✗	Create Preconfigured Connectors Config kibana-8-connectors-preconfigured	advanced	29/100	617ms	Missing Slack preconfigured connector. Missing server-log preconfigured connector. Speed bonus: x1.15 (617ms).

✓	Audit Log: Failed Authentication Analysis es-sec-1-audit-failed-auth	intermediate	100/100	628ms	Correct! Found 48 failed auth events across 10 users. Speed bonus: x1.15 (628ms).

✓	Create an Elasticsearch API Key es-sec-2-create-api-key	intermediate	100/100	578ms	Correct! API key body with proper role descriptors, cluster and index privileges. Speed bonus: x1.15 (578ms).

✓	Create a Role with Document-Level Security es-sec-3-create-role-dls	advanced	100/100	1693ms	Correct! Role with DLS (region filter) and FLS (field grant list). Speed bonus: x1.15 (1693ms).

✓	Security Troubleshooting: 401 Unauthorized es-sec-4-troubleshoot-401	advanced	100/100	634ms	Correct! Diagnostic query scoped to logstash_internal with relevant audit fields. Speed bonus: x1.15 (634ms).

Observability

	Challenge	Difficulty	Score	Latency	Feedback
✓	Log Error Investigation with ES\|QL obs-esql-1-error-investigation	intermediate	100/100	1717ms	Correct! Error timeline investigation across incident services. Speed bonus: x1.15 (1717ms).

✓	Service Error Count Breakdown obs-esql-2-error-breakdown	intermediate	100/100	684ms	Correct! Service error breakdown by log level. Speed bonus: x1.15 (684ms).

✓	Root Cause Investigation (Multi-Turn) obs-esql-3-root-cause	advanced	100/100	3502ms	Correct! Root cause identified: upstream stripe-api dependency failure.

✓	LLM Observability: Model Performance Analysis obs-ext-1-llm-traces	intermediate	100/100	1664ms	Correct! LLM performance analysis across 6 models. Speed bonus: x1.15 (1664ms).

✓	Create a Service Level Objective (SLO) obs-ext-2-create-slo	intermediate	100/100	1634ms	Correct! SLO body with KQL indicator, rolling window, and occurrences budgeting. Speed bonus: x1.15 (1634ms).

✓	Service Health Assessment via APM Data obs-ext-3-service-health	advanced	100/100	903ms	Correct! Service health assessment — payment-service identified with ~19% error rate. Speed bonus: x1.15 (903ms).

Security

	Challenge	Difficulty	Score	Latency	Feedback
✓	Brute Force Detection with ES\|QL sec-esql-1-brute-force	intermediate	92/100	1696ms	Correct! Brute force detected: 10.0.0.50 with 12 attempts. Speed bonus: x1.15 (1696ms).

✓	Post-Compromise Activity Analysis sec-esql-2-post-compromise	advanced	100/100	1687ms	Correct! Post-compromise: C2 download, execution, reverse shell, credential dump. Speed bonus: x1.15 (1687ms).

✓	Full Attack Chain Investigation (Multi-Turn) sec-esql-3-attack-chain	expert	100/100	1657ms	Correct! Full attack chain: brute-force -> access -> post-exploitation. Speed bonus: x1.15 (1657ms).

✓	Create a Security Case sec-ext-1-create-case	intermediate	100/100	585ms	Correct! Case created with proper title, severity, connector, and owner. Speed bonus: x1.15 (585ms).

✓	Create a Detection Rule sec-ext-2-create-detection-rule	advanced	100/100	609ms	Correct! Detection rule with EQL query, MITRE mapping, and proper severity/risk. Speed bonus: x1.15 (609ms).

✓	Generate Security Sample Data sec-ext-3-generate-sample-data	intermediate	100/100	643ms	Correct! Sample data generation request with APT simulation, anomalies, and host list. Speed bonus: x1.15 (643ms).

Run History

Date	Score	Passed	Latency	Cost
3/17/2026, 11:53:54 PM	92%	32/35	1313ms	$0.2297
3/17/2026, 11:53:52 PM	92%	32/35	1673ms	$0.2320
3/16/2026, 6:53:21 PM	89%	28/31	2248ms	$0.1927
3/16/2026, 6:53:13 PM	89%	28/31	2411ms	$0.1983

Embed Badge

Add this badge to your README or documentation:

Markdown:

![ElasticQuest](https://elastic-quest-web-2t3s3mceqa-uc.a.run.app/api/badge/openrouter%3Aanthropic%2Fclaude-sonnet-4.6)

HTML:

<img src="https://elastic-quest-web-2t3s3mceqa-uc.a.run.app/api/badge/openrouter%3Aanthropic%2Fclaude-sonnet-4.6" alt="ElasticQuest score" />