Skip to content

Benchmarks

Benchmarks #335

Triggered via push October 22, 2026 13:56
Status Failure
Total duration 23m 19s
Artifacts 27

benchmarks.yml

on: push
Prepare comparison runtime
12m 11s
Prepare comparison runtime
Matrix: comparison-helixdb
Matrix: comparison-keyload
Matrix: comparison-kurrentdb
Matrix: comparison-mongodb
Matrix: comparison-neo4j
Matrix: comparison-opensearch
Matrix: comparison-postgresql
Matrix: comparison-qdrant
Matrix: comparison-rabbitmq
Matrix: comparison-redis
Matrix: comparison-surrealdb
KeyLoad functional CLUSTER million-record ingestion
4m 23s
KeyLoad functional CLUSTER million-record ingestion
Combine benchmark results
11s
Combine benchmark results
Trigger Website
Trigger Website
Fit to window
Zoom out
Zoom in

Annotations

46 errors and 25 notices
Neo4j / Session / 1 node
No files were found with the provided path: artifacts/comparisons/sessions/workers/neo4j-n1/**. No artifacts will be uploaded.
Neo4j / Session / 1 node
Process completed with exit code 1.
PostgreSQL + pgvector / Session / 3 nodes
No files were found with the provided path: artifacts/comparisons/sessions/workers/postgresql-n3/**. No artifacts will be uploaded.
PostgreSQL + pgvector / Session / 3 nodes
Process completed with exit code 1.
KeyLoad / Session / 1 node
No files were found with the provided path: artifacts/comparisons/sessions/workers/keyload-n1/**. No artifacts will be uploaded.
KeyLoad / Session / 1 node
Process completed with exit code 1.
OpenSearch / Session / 1 node
No files were found with the provided path: artifacts/comparisons/sessions/workers/opensearch-n1/**. No artifacts will be uploaded.
OpenSearch / Session / 1 node
Process completed with exit code 1.
PostgreSQL + pgvector / Session / 1 node
No files were found with the provided path: artifacts/comparisons/sessions/workers/postgresql-n1/**. No artifacts will be uploaded.
PostgreSQL + pgvector / Session / 1 node
Process completed with exit code 1.
HelixDB / Session / 1 node
No files were found with the provided path: artifacts/comparisons/sessions/workers/helixdb-n1/**. No artifacts will be uploaded.
HelixDB / Session / 1 node
Process completed with exit code 1.
KurrentDB / Session / 1 node
No files were found with the provided path: artifacts/comparisons/sessions/workers/kurrentdb-n1/**. No artifacts will be uploaded.
KurrentDB / Session / 1 node
Process completed with exit code 1.
Qdrant / Session / 1 node
No files were found with the provided path: artifacts/comparisons/sessions/workers/qdrant-n1/**. No artifacts will be uploaded.
Qdrant / Session / 1 node
Process completed with exit code 1.
OpenSearch / Session / 3 nodes
No files were found with the provided path: artifacts/comparisons/sessions/workers/opensearch-n3/**. No artifacts will be uploaded.
OpenSearch / Session / 3 nodes
Process completed with exit code 1.
Redis / Session / 3 nodes
No files were found with the provided path: artifacts/comparisons/sessions/workers/redis-n3/**. No artifacts will be uploaded.
Redis / Session / 3 nodes
Process completed with exit code 1.
RabbitMQ / Session / 3 nodes
No files were found with the provided path: artifacts/comparisons/sessions/workers/rabbitmq-n3/**. No artifacts will be uploaded.
RabbitMQ / Session / 3 nodes
Process completed with exit code 1.
SurrealDB / Session / 1 node
No files were found with the provided path: artifacts/comparisons/sessions/workers/surrealdb-n1/**. No artifacts will be uploaded.
SurrealDB / Session / 1 node
Process completed with exit code 1.
Redis / Session / 1 node
No files were found with the provided path: artifacts/comparisons/sessions/workers/redis-n1/**. No artifacts will be uploaded.
Redis / Session / 1 node
Process completed with exit code 1.
HelixDB / Session / 3 nodes
No files were found with the provided path: artifacts/comparisons/sessions/workers/helixdb-n3/**. No artifacts will be uploaded.
HelixDB / Session / 3 nodes
Process completed with exit code 1.
Qdrant / Session / 3 nodes
No files were found with the provided path: artifacts/comparisons/sessions/workers/qdrant-n3/**. No artifacts will be uploaded.
Qdrant / Session / 3 nodes
Process completed with exit code 1.
MongoDB / Session / 1 node
No files were found with the provided path: artifacts/comparisons/sessions/workers/mongodb-n1/**. No artifacts will be uploaded.
MongoDB / Session / 1 node
Process completed with exit code 1.
RabbitMQ / Session / 1 node
No files were found with the provided path: artifacts/comparisons/sessions/workers/rabbitmq-n1/**. No artifacts will be uploaded.
RabbitMQ / Session / 1 node
Process completed with exit code 1.
KurrentDB / Session / 3 nodes
No files were found with the provided path: artifacts/comparisons/sessions/workers/kurrentdb-n3/**. No artifacts will be uploaded.
KurrentDB / Session / 3 nodes
Process completed with exit code 1.
SurrealDB / Session / 3 nodes
No files were found with the provided path: artifacts/comparisons/sessions/workers/surrealdb-n3/**. No artifacts will be uploaded.
SurrealDB / Session / 3 nodes
Process completed with exit code 1.
MongoDB / Session / 3 nodes
No files were found with the provided path: artifacts/comparisons/sessions/workers/mongodb-n3/**. No artifacts will be uploaded.
MongoDB / Session / 3 nodes
Process completed with exit code 1.
Neo4j / Session / 3 nodes
No files were found with the provided path: artifacts/comparisons/sessions/workers/neo4j-n3/**. No artifacts will be uploaded.
Neo4j / Session / 3 nodes
Process completed with exit code 1.
KeyLoad / Session / 3 nodes
No files were found with the provided path: artifacts/comparisons/sessions/workers/keyload-n3/**. No artifacts will be uploaded.
KeyLoad / Session / 3 nodes
Process completed with exit code 1.
KeyLoad functional CLUSTER million-record ingestion
Process completed with exit code 2.
Combine benchmark results
Process completed with exit code 1.
Neo4j / Session / 1 node
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
Prepare comparison runtime
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
PostgreSQL + pgvector / Session / 3 nodes
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
KeyLoad / Session / 1 node
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
OpenSearch / Session / 1 node
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
PostgreSQL + pgvector / Session / 1 node
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
HelixDB / Session / 1 node
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
KurrentDB / Session / 1 node
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
Qdrant / Session / 1 node
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
OpenSearch / Session / 3 nodes
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
Redis / Session / 3 nodes
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
RabbitMQ / Session / 3 nodes
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
SurrealDB / Session / 1 node
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
Redis / Session / 1 node
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
HelixDB / Session / 3 nodes
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
Qdrant / Session / 3 nodes
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
MongoDB / Session / 1 node
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
RabbitMQ / Session / 1 node
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
KurrentDB / Session / 3 nodes
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
SurrealDB / Session / 3 nodes
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
MongoDB / Session / 3 nodes
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
Neo4j / Session / 3 nodes
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
KeyLoad / Session / 3 nodes
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
KeyLoad functional CLUSTER million-record ingestion
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
Combine benchmark results
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"

Artifacts

Produced during runtime
Name Size Digest
comparison-case-qualification-session-helixdb-n1
110 KB
sha256:91707c27907653fb5a13015c3d164c70dae03e4121ed238dc7fa49fe960d7ef3
comparison-case-qualification-session-helixdb-n3
104 KB
sha256:88b186caed21914e14b7edfa81390ced10fc2d8323e4be57378f304f8e551c5b
comparison-case-qualification-session-keyload-n1
101 KB
sha256:0dea6d856fd9cf51763401ebfec406c69dc6e3a1f67d6da24e944782b61bfbe0
comparison-case-qualification-session-keyload-n3
101 KB
sha256:ee80cf71b152f17ea732599ed189730fc0d11077c55ab06a2130fd753674804f
comparison-case-qualification-session-kurrentdb-n1
103 KB
sha256:1c50e09b6fe142c1cf1e5e8bb769e9a7ff2fd89dcb139d720695c47afc8058d1
comparison-case-qualification-session-kurrentdb-n3
105 KB
sha256:c01f9591b8369abe78f90f846604c0308fe6936a0888cc81a625ce408199a2be
comparison-case-qualification-session-mongodb-n1
103 KB
sha256:782fc32212848d4632ecc326c02629b55b230ea738e5bea59cdc71614409419a
comparison-case-qualification-session-mongodb-n3
99.2 KB
sha256:22894ee9c807b434433d2ead9c59061fba2b8a3031d0ff38e1c1dcb39c8f6513
comparison-case-qualification-session-neo4j-n1
102 KB
sha256:baf5bb3ed86e42958a76838bdb7708b7466c3d00f9a90502c1f751ef2a8322be
comparison-case-qualification-session-neo4j-n3
101 KB
sha256:21a2b34d79688bf6f9c19dbb485dbde2a969e6e9a626527222b9597bf17947f4
comparison-case-qualification-session-opensearch-n1
105 KB
sha256:ec5449e45844f8d32ae30eb6d3f091fe8b071a36fe484583b94001fc530723de
comparison-case-qualification-session-opensearch-n3
99.2 KB
sha256:ce831335aa9cb5f14715e32b33e24ade86733dbc01be84e44ffc7863afa3c3ff
comparison-case-qualification-session-postgresql-n1
102 KB
sha256:99cc95f8b81da82d4f5c4a109779c6d74e1d9791a73fb132f7e0a9aa652a3a50
comparison-case-qualification-session-postgresql-n3
106 KB
sha256:21b858f53aee6b67e21b39279b99e7aa0be8b22117e8a13e6390b270837d889b
comparison-case-qualification-session-qdrant-n1
107 KB
sha256:d706fd56500ec8e63c3e80f1bbdaa376654fbb6d0e1886f3552e39ac9d607306
comparison-case-qualification-session-qdrant-n3
103 KB
sha256:14b01d0b986055e9982b0e0ee25de3583f52d856e4dd111936194ef2936f4b37
comparison-case-qualification-session-rabbitmq-n1
99.3 KB
sha256:f353751cd3f2df91b89ccca3a604422aac61523e8b3231a6c3bca45b1269a05c
comparison-case-qualification-session-rabbitmq-n3
105 KB
sha256:0c812c98634ab8dc7f662b7fb65dedc2863b80bef5c0b4c64c181cf88d05c4cd
comparison-case-qualification-session-redis-n1
99.8 KB
sha256:c7f65993010187007030f02e5ad6b13525127537457c3519916230c2449f43df
comparison-case-qualification-session-redis-n3
105 KB
sha256:b9d82e573fc9932396e069ca371c1335b545ad2fa175312b9724528ab915b623
comparison-case-qualification-session-surrealdb-n1
99.9 KB
sha256:97efcc4f70a88ab5a53fb750d8d0da49d76d6846649c8afd563d08558d935b89
comparison-case-qualification-session-surrealdb-n3
114 KB
sha256:e54d767bed066ce2e8436922b24c39f8c8f8c8d43c4db4994f5ab8ade82dab26
comparison-compiled-runtime-identity
437 KB
sha256:c94e85b317b1acae662685b49fa6f79e17b724f3105165430741b2a2f9f9d777
comparison-compiled-test-bundle
1.92 GB
sha256:713a8aca551d3b2fe204b3b69709b1b582439dafe37a3468f113baa6b38cf1bb
comparison-plan
810 Bytes
sha256:d4e372137f72209ef006122de7cf63a7f928d655013777067455d98639fa60b6
comparison-runtime-qualification
1.97 MB
sha256:4a4ea7649ce72f63454c75838eb7413782807430ce3ff60d3a487aa5de52966a
keyload-functional-heavy-load
1.11 MB
sha256:673c80fff83ef471b3a1dd816de36bd4c435869c1158fa4b41231cae5a58cd43