Skip to main content

Quantum computing benchmarks

Algorithms and benchmarks

How quantum computers are compared: component tests of gates, system-level scores of whole processors and application suites that run small versions of real tasks. Each benchmark is described with what it measures, how, its limitations, who maintains it and whether it is European.

Benchmark results are mostly reported by the providers themselves; a higher score on one benchmark does not mean a better machine for every task.

Component level (gates and operations)

System level (whole processor)

Application level (algorithms and use cases)

  • SupermarQ

    Application-level performance, with feature vectors that quantify how representative the chosen applications are.

    Maintained by: Introduced by Tomesh et al. (2022); its code sits in the client-superstaq repository of Infleqtion (supermarq-benchmarks folder).

    European: No

    How it works and its limitations SupermarQ

  • MQT Bench

    A shared set of benchmark circuits for evaluating compilers and other quantum software tools.

    Maintained by: Technical University of Munich (Munich Quantum Toolkit), as verified for the software directory of the portal.

    European: Yes: Its owner organisation is in Germany (software directory).

    How it works and its limitations MQT Bench

  • QUARK

    Performance of complete industrial applications across quantum and classical solvers, devices and simulators.

    Maintained by: Open-source framework introduced by Finžgar et al. (2022) with authors from industry; maintained in its GitHub organisation.

    European: Not determined: European origin not verified on the pages read (affiliations were not shown).

    How it works and its limitations QUARK

  • Q-score

    The largest MaxCut problem a quantum processor solves effectively with QAOA, as a hardware-agnostic and scalable score.

    Maintained by: Proposed by Martiel, Ayral and Allouche (2021) as the Atos Q-score.

    European: Yes: Named the Atos Q-score by its authors; EVIDEN, an Atos business, is a BACQ partner (BACQ paper).

    How it works and its limitations Q-score

  • Quantum LINPACK

    How well a quantum computer solves linear algebra tasks, such as linear systems, on random block-encoded matrices, as an analogue of the LINPACK benchmark of supercomputers.

    Maintained by: Proposed by Dong and Lin (2021).

    European: No: Both authors are at the University of California, Berkeley and Lawrence Berkeley National Laboratory (USA) (arXiv paper, first page, read on 27 October 2026).

    How it works and its limitations Quantum LINPACK

Benchmarking and standardisation initiatives

Only initiatives verified on their own pages are listed; where a benchmarking work item could not be verified, the entry says so.

  • EuroHPC JU call: A European Benchmarking Framework (hybrid quantum-classical computing)

    EU funding call European

    Asks for a benchmarking framework and a hardware-agnostic suite for quantum and hybrid HPC-quantum systems, with fair and reproducible comparisons, a metrics catalogue, standard formats, benchmarks from gate to application level including throughput, latency and energy, and outputs under the EUPL-1.2 licence. The EuroHPC JU page gives the topic as HORIZON-JU-EUROHPC-2024-BENCHMARK-05-02, CORDIS as HORIZON-EUROHPC-JU-2024-BENCHMARK-05-03.

    Status: Closed (deadline 14 April 2026); no selected project listed on the EuroHPC JU or CORDIS pages read on 27 October 2026.

    Sources: EuroHPC Joint Undertaking 2026, Call page; European Commission 2026, Programme topic page

  • CEN-CENELEC JTC 22, WG 3 Quantum Computing and Simulation

    Standardisation European

    The European standardisation committee on quantum technologies has a working group for quantum computing and simulation, the natural home of European benchmarking standards. Its entry in the standards directory.

    Status: Active committee; a benchmarking work item was not verified for this release.

    Sources: CEN and CENELEC 2026, Committee page (read for the shared taxonomy and the standards directory)

  • IEC/ISO JTC 3 Quantum technologies

    Standardisation International or non-European

    The international committee for quantum technology standards, including quantum computing and simulation. Its entry in the standards directory.

    Status: Active committee; a benchmarking work item was not verified for this release.

    Sources: IEC and ISO 2026, Committee page (read for the standards directory)

  • IEEE P7131: Quantum Benchmarking Working Group

    Standardisation International or non-European

    An IEEE working group whose scope is performance metrics for quantum computing hardware and software; the IEEE standards page for the project could not be read (page unavailable on 23 October 2026).

    Status: Working group open to individual members; the status of the standard is not stated on its page.

    Sources: IEEE Standards Association working group 2026, Working group page

  • MetriQs-France and the BACQ project

    National programme European

    A French national programme on measurements, standards and evaluation of quantum technologies, part of the national quantum strategy, which supports the BACQ application-oriented benchmarks.

    Status: Described in a preprint of March 2024.

    Sources: F. Barbaresco et al. 2024, arXiv:2403.12205 (March 2024)

  • Proposal for a standard performance evaluation approach

    Research proposal Origin not determined

    Proposes general guidelines for quantum benchmarking that could lead to an organisation similar to the Standard Performance Evaluation Corporation (SPEC).

    Status: Peer-reviewed proposal (Quantum Science and Technology, 2026).

    Sources: A. Acuaviva et al. 2026, Quantum Sci. Technol. 11, 025004 (2026); arXiv:2407.10941

Benchmarks in European procurements

Which benchmarks and test algorithms the EuroHPC Joint Undertaking and the hosting sites asked for when buying quantum computers. Only what the tender documents state is shown, with the document and the page where it appears; where documents were not public or could not be read, the entry says so instead of guessing.

9 procurements, 7 with public tender documents read in full; 45 benchmarks or tests named.

Tender requirements describe what was asked for, not what the delivered machines achieved. Offers and acceptance protocols are not public.

Quantum computer procurements and the benchmarks their documents name
SystemHosting sitePlatformBenchmarks named
EuroQCS-Poland (now Piast-Q)PSNC, Poznań (Poland)Trapped ions (AQT, as stated in the contract announcement)Listed on the EU tender portal but not retrievable
Euro-Q-ExaLRZ (Germany)Superconducting qubits, two systems (Part 2, Req_12)6 benchmarks or tests
EuroQCS-France (now Lucy)GENCI and CEA, TGCC, Bruyères-le-Châtel (France)Photonic digital quantum computer (Part 2, Req_5)6 benchmarks or tests
LUMI-Q (now VLQ)IT4Innovations, Ostrava (Czechia)Superconducting qubits, at least 20 in a star-shaped topology (Part 2, section 1.2 and Req_12)10 benchmarks or tests
EuroQCS-SpainBSC, Barcelona (Spain)Adiabatic quantum computer or annealer on superconducting qubits (Part 2, Req_3)5 benchmarks or tests
EuroQCS-Italy (now SOL)CINECA, Bologna (Italy)Neutral atoms, hybrid analogue and digital or fully digital; an analogue offer must include an upgrade within 18 months of acceptance, and each system must pass the Annex 8 benchmarks (Part 2, Req_4 and section 2.1)7 benchmarks or tests
EuroSSQ-HPCSURF (Netherlands)Semiconductor spin qubits, at least 16 (Part 2, Req_10 and Req_12)5 benchmarks or tests
MeluXina-QLuxProvide (Luxembourg)Semiconductor spin qubits, at least 10 at first (Part 2, Req_17 and Req_18)6 benchmarks or tests
HPCQS quantum simulators (now Jade and Ruby)Jülich Supercomputing Centre (Germany) and GENCI at TGCC (France)Neutral-atom analogue simulators (Pasqal), each controlling at least 100 qubitsNo tender specification with benchmarks published

EuroQCS-Poland (now Piast-Q)

Call for tenders
EUROHPC/2023/OP/0004
Hosting site
PSNC, Poznań (Poland)
Platform
Trapped ions (AQT, as stated in the contract announcement) (Trapped ions)
Published
2023-10-16
Documents
Listed on the EU tender portal but not retrievable. The call on the EU tender portal EuroQCS-Poland (now Piast-Q). TED notice 2023/S 199-624413, as listed on the portal.

The EU Funding and Tenders portal lists the tender documents, including an Annex 8 on application performance benchmarks, but they were published on the former eTendering platform and could not be downloaded on 23 October 2026. The benchmarks are therefore not shown.

The contract announcement names no benchmark; it says that new hybrid quantum-classical use cases and benchmarks will be supported. (Advancing European Quantum Computing: Signature of the Procurement Contract for EuroQCS-Poland, Paragraph on the capabilities of the system)

Euro-Q-Exa

Call for tenders
EUROHPC/2023/OP/0005
Hosting site
LRZ (Germany)
Platform
Superconducting qubits, two systems (Part 2, Req_12) (Superconducting qubits) (Euro-Q-Exa: Tender specifications, Part 2, technical specifications, PDF page 7, section 2.1, Req_12)
Published
2023-11-24
Documents
Public tender documents, read in full. The call on the EU tender portal Euro-Q-Exa. TED notice 716244-2023, as listed on the portal.
Award
Benchmark evaluation (award criterion 2): at most 20.5 of 134 points, at least 6 required; scored on the number of benchmarks including hybrid HPC and quantum ones, their technical quality and maturity, and their significance and coverage. (Euro-Q-Exa: Tender specifications, Part 1, administrative specifications, PDF page 25, Table 3: Award criteria)
Acceptance
The warranty must confirm the characteristics of the systems through benchmarks selected from Annex 8; Annex 8 states acceptance criteria for the GHZ, VQE and QAOA benchmarks. (Euro-Q-Exa: Tender specifications, Part 2, technical specifications, PDF page 20, section 7 (warranties), Req_106)
Deployment tracker
Euro-Q-Exa

Annex 8 states that thresholds are generally not set, with exceptions in the benchmark descriptions; the five required benchmarks have equal weight.

Benchmarks named in the tender for Euro-Q-Exa (EUROHPC/2023/OP/0005)
Benchmark or test, as namedHow it is usedThreshold or condition statedOn this portalDocument and place
Quantum volumeRequired in the benchmark suite (scored under the award criteria)None statedQuantum volumeEuro-Q-Exa: Annex 8, Performance Benchmarks and Technology Roadmap Assessment, PDF pages 3 to 5, section C and benchmark 1; method: A. W. Cross et al. 2019, Phys. Rev. A 100, 032328 (2019); arXiv:1811.12926
Circuit layer operations per second (CLOPS)Required in the benchmark suite (scored under the award criteria)None statedCLOPS (circuit layer operations per second)Euro-Q-Exa: Annex 8, Performance Benchmarks and Technology Roadmap Assessment, PDF page 5, benchmark 2; method: A. Wack et al. 2021, arXiv:2110.14108 (preprint, October 2021)
Creation of a GHZ stateRequired in the benchmark suite (scored under the award criteria)GHZ fidelity of at least 0.5 (genuine multipartite entanglement), on the full system or the largest qubit count that reaches itGHZ state sizeEuro-Q-Exa: Annex 8, Performance Benchmarks and Technology Roadmap Assessment, PDF pages 6 and 7, benchmark 3
Variational quantum eigensolver (VQE) on weighted Max-CutRequired in the benchmark suite (scored under the award criteria)Small instances compared with classical simulation; larger ones compared with QAOAVariational quantum eigensolver (VQE)Euro-Q-Exa: Annex 8, Performance Benchmarks and Technology Roadmap Assessment, PDF pages 7 and 8, benchmarks 4 and 5
Quantum approximate optimisation (QAOA) on weighted Max-CutRequired in the benchmark suite (scored under the award criteria)Small instances compared with classical simulationQuantum approximate optimisation algorithm (QAOA)Euro-Q-Exa: Annex 8, Performance Benchmarks and Technology Roadmap Assessment, PDF pages 7 and 8, benchmarks 4 and 5
Any further test from MQT BenchOptional, at the choice of the tendererNone statedMQT BenchEuro-Q-Exa: Annex 8, Performance Benchmarks and Technology Roadmap Assessment, PDF page 9, section 3; method: N. Quetschlich et al. 2023, Quantum 7, 1062 (2023); arXiv:2204.13719

EuroQCS-France (now Lucy)

Call for tenders
EUROHPC/2024/OP/0001
Hosting site
GENCI and CEA, TGCC, Bruyères-le-Châtel (France)
Platform
Photonic digital quantum computer (Part 2, Req_5) (Photonic qubits) (EuroQCS-France: Tender specifications, Part 2, technical specifications, PDF page 6, section 3, Req_5)
Published
2024-01-30
Documents
Public tender documents, read in full. The call on the EU tender portal EuroQCS-France (now Lucy). TED notice 62227-2024, as listed on the portal.
Award
Benchmark evaluation (award criterion 2): at most 15 of 130 points, at least 5 required; scored on the number of benchmarks including hybrid HPC and quantum ones, their technical quality and maturity, and their significance and coverage. (EuroQCS-France: Tender specifications, Part 1, administrative specifications, PDF page 25, Table 3: Award criteria)
Acceptance
The listed benchmarks and those the tenderer adds form the benchmark suite of the acceptance procedure: they are run again on the installed system under supervision of the hosting entity, and the system is accepted only when the signed benchmark protocol shows the committed values. (EuroQCS-France: Annex 8, Application Performance Benchmarks, PDF page 2, section 2)

Annex 8 lists these as the mandatory minimum content of the benchmark suite; the supplier may commit further benchmarks.

Benchmarks named in the tender for EuroQCS-France (now Lucy) (EUROHPC/2024/OP/0001)
Benchmark or test, as namedHow it is usedThreshold or condition statedOn this portalDocument and place
Fidelities of the listed single- and multi-qubit gates on every qubit and connectionRequired in the benchmark suite (scored under the award criteria)More than 1,000 runs without error mitigation; average fidelities disclosedNo page on this portalEuroQCS-France: Annex 8, Application Performance Benchmarks, PDF page 4, section 3.1
Entanglement and GHZ statesRequired in the benchmark suite (scored under the award criteria)GHZ fidelity above 0.5, on the full system or the largest qubit count that reaches itGHZ state sizeEuroQCS-France: Annex 8, Application Performance Benchmarks, PDF page 5, section 3.2
Quality of the photon source, optical circuit and photodetectors, including photon lossRequired in the benchmark suite (scored under the award criteria)Supplier proposes the tests; boson sampling runs are suggestedBoson sampling and Gaussian boson samplingEuroQCS-France: Annex 8, Application Performance Benchmarks, PDF page 6, section 3.3
Quantum LINPACKRequired in the benchmark suite (scored under the award criteria)None statedQuantum LINPACK, Linear systems of equations (HHL and successors)EuroQCS-France: Annex 8, Application Performance Benchmarks, PDF pages 6 and 7, section 3.4; method: Y. Dong et al. 2021, Phys. Rev. A 103, 062412 (2021); arXiv:2006.04010
Q-score (QAOA on Max-Cut)Required in the benchmark suite (scored under the award criteria)None statedQ-score, Quantum approximate optimisation algorithm (QAOA)EuroQCS-France: Annex 8, Application Performance Benchmarks, PDF page 7, section 3.5; method: S. Martiel et al. 2021, IEEE Transactions on Quantum Engineering, DOI 10.1109/TQE.2021.3090207; arXiv:2102.12973
VQE energy of molecular hydrogen or lithium hydrideRequired in the benchmark suite (scored under the award criteria)Fidelity of the estimated energy levelsVariational quantum eigensolver (VQE)EuroQCS-France: Annex 8, Application Performance Benchmarks, PDF pages 7 and 8, section 3.6

LUMI-Q (now VLQ)

Call for tenders
EUROHPC/2024/OP/0002
Hosting site
IT4Innovations, Ostrava (Czechia)
Platform
Superconducting qubits, at least 20 in a star-shaped topology (Part 2, section 1.2 and Req_12) (Superconducting qubits) (LUMI-Q: Tender specifications, Part 2, technical specifications, PDF pages 3 and 6, section 1.2 and Req_12)
Published
2024-02-14
Documents
Public tender documents, read in full. The call on the EU tender portal LUMI-Q (now VLQ). TED notice 94961-2024, as listed on the portal.
Award
Benchmark evaluation (award criterion 2): at most 15 of 127 points, at least 5 required; scored on the number of benchmarks including hybrid HPC and quantum ones, their technical quality and maturity, and their significance and coverage. (LUMI-Q: Tender specifications, Part 1, administrative specifications, PDF page 25, Table 3: Award criteria)
Acceptance
The listed benchmarks and those the tenderer adds form the benchmark suite of the acceptance procedure: they are run again on the installed system under supervision of the hosting entity, and the system is accepted only when the signed benchmark protocol shows the committed values. (LUMI-Q: Annex 8, Performance Benchmarks and Technology Roadmap Assessment, PDF pages 2 and 3, section B)
Deployment tracker
VLQ (procured as LUMI-Q)

Annex 8 states that thresholds are generally not set; results are compared with other tenders and market studies. Measured physical characteristics must match the values committed in the offer and the minimum values of the technical specifications.

Benchmarks named in the tender for LUMI-Q (now VLQ) (EUROHPC/2024/OP/0002)
Benchmark or test, as namedHow it is usedThreshold or condition statedOn this portalDocument and place
Physical characteristics: qubit number, gate fidelity, connectivity, T1, T2*, qubit frequencies, readout fidelityRequired in the benchmark suite (scored under the award criteria)Values committed in the offer, within the minimums of Part 2, section 2No page on this portalLUMI-Q: Annex 8, Performance Benchmarks and Technology Roadmap Assessment, PDF page 3, section 4.1
Quantum volumeRequired in the benchmark suite (scored under the award criteria)Must be executed and return results; committed values, if any, must be metQuantum volumeLUMI-Q: Annex 8, Performance Benchmarks and Technology Roadmap Assessment, PDF pages 3 and 4, sections 4.2 and 4.2.1; method: A. W. Cross et al. 2019, Phys. Rev. A 100, 032328 (2019); arXiv:1811.12926
Circuit layer operations per second (CLOPS)Required in the benchmark suite (scored under the award criteria)Must be executed and return resultsCLOPS (circuit layer operations per second)LUMI-Q: Annex 8, Performance Benchmarks and Technology Roadmap Assessment, PDF page 5, section 4.2.2; method: A. Wack et al. 2021, arXiv:2110.14108 (preprint, October 2021)
Volumetric testing: fidelity by circuit width and depthRequired in the benchmark suite (scored under the award criteria)None statedNo page on this portalLUMI-Q: Annex 8, Performance Benchmarks and Technology Roadmap Assessment, PDF page 6, section 4.3
Oracle-based algorithm (Deutsch-Jozsa)Required in the benchmark suite (scored under the award criteria)None statedNo page on this portalLUMI-Q: Annex 8, Performance Benchmarks and Technology Roadmap Assessment, PDF page 6, section 4.3
Phase estimationRequired in the benchmark suite (scored under the award criteria)None statedQuantum phase estimationLUMI-Q: Annex 8, Performance Benchmarks and Technology Roadmap Assessment, PDF page 6, section 4.3
Hamiltonian simulation of a one-dimensional Heisenberg chainRequired in the benchmark suite (scored under the award criteria)None statedHamiltonian simulation: product formulas, qubitization and QSVTLUMI-Q: Annex 8, Performance Benchmarks and Technology Roadmap Assessment, PDF page 6, section 4.3
Monte Carlo sampling (Woerner and Egger approach)Required in the benchmark suite (scored under the award criteria)None statedAmplitude estimation and quantum Monte Carlo integrationLUMI-Q: Annex 8, Performance Benchmarks and Technology Roadmap Assessment, PDF page 6, section 4.3; method: S. Woerner et al. 2019, npj Quantum Information 5, 15 (2019); arXiv:1806.06893
Variational algorithms (VQE and QAOA) on weighted Max-Cut, with Qiskit and MQT Bench codeRequired in the benchmark suite (scored under the award criteria)None statedMQT Bench, Variational quantum eigensolver (VQE), Quantum approximate optimisation algorithm (QAOA)LUMI-Q: Annex 8, Performance Benchmarks and Technology Roadmap Assessment, PDF pages 6 to 8, section 4.3.1; method: N. Quetschlich et al. 2023, Quantum 7, 1062 (2023); arXiv:2204.13719
QED-C application-oriented benchmark software as reference implementationNamed as a reference implementationNone statedQED-C application-oriented benchmarksLUMI-Q: Annex 8, Performance Benchmarks and Technology Roadmap Assessment, PDF page 6, section 4.3; method: Members of the QED-C Technical Advisory Committee on Standards and Performance Metrics 2026, GitHub repository README (Apache-2.0)

EuroQCS-Spain

Call for tenders
EUROHPC/2024/OP/0003
Hosting site
BSC, Barcelona (Spain)
Platform
Adiabatic quantum computer or annealer on superconducting qubits (Part 2, Req_3) (Quantum annealing) (EuroQCS-Spain: Tender specifications, Part 2, technical specifications, PDF page 6, section 1, Req_3)
Published
2024-05-15
Documents
Public tender documents, read in full. The call on the EU tender portal EuroQCS-Spain. TED notice 284795-2024, as listed on the portal.
Award
Benchmark evaluation (award criterion 2): at most 15 of 130 points, at least 5 required; scored on the number of benchmarks including hybrid HPC and quantum ones, their technical quality and maturity, and their significance and coverage. (EuroQCS-Spain: Tender specifications, Part 1, administrative specifications, PDF page 25, Table 3: Award criteria)
Acceptance
The listed benchmarks and those the tenderer adds form the benchmark suite of the acceptance procedure: they are run again on the installed system under supervision of the hosting entity, and the system is accepted only when the signed benchmark protocol shows the committed values. (EuroQCS-Spain: Annex 8, Performance Benchmarks and Technology Roadmap Assessment, PDF page 2, section B)
Deployment tracker
EuroQCS-Spain

Annex 8 states that thresholds are generally not set; results are compared with other tenders and market studies. Every qubit must meet the T1 minimum of the technical specifications.

Benchmarks named in the tender for EuroQCS-Spain (EUROHPC/2024/OP/0003)
Benchmark or test, as namedHow it is usedThreshold or condition statedOn this portalDocument and place
Coherence time T1 of every qubit, with scripts for the hosting entityRequired in the benchmark suite (scored under the award criteria)Each qubit must meet the T1 minimum of Part 2, section 2No page on this portalEuroQCS-Spain: Annex 8, Performance Benchmarks and Technology Roadmap Assessment, PDF page 3, section 1.1
Qubit frequencies, with a measurement scriptRequired in the benchmark suite (scored under the award criteria)None statedNo page on this portalEuroQCS-Spain: Annex 8, Performance Benchmarks and Technology Roadmap Assessment, PDF page 3, section 1.1
Annealing to a good approximation of the ground state of a one-dimensional transverse-field Ising modelRequired in the benchmark suite (scored under the award criteria)None statedQuantum annealing and adiabatic optimisationEuroQCS-Spain: Annex 8, Performance Benchmarks and Technology Roadmap Assessment, PDF page 3, section 1.2
Annealing schedule between two Ising or Heisenberg spin Hamiltonians, with two-qubit interaction terms on the last chip generationRequired in the benchmark suite (scored under the award criteria)Required for the last chip generation; non-stoquastic interactions valued positivelyQuantum annealing and adiabatic optimisationEuroQCS-Spain: Annex 8, Performance Benchmarks and Technology Roadmap Assessment, PDF pages 3 and 4, section 1.2
An application Hamiltonian with a physical or industrial justificationOptional, at the choice of the tendererNone statedQuantum annealing and adiabatic optimisationEuroQCS-Spain: Annex 8, Performance Benchmarks and Technology Roadmap Assessment, PDF page 4, section 1.3

EuroQCS-Italy (now SOL)

Call for tenders
EUROHPC/2024/OP/0004
Hosting site
CINECA, Bologna (Italy)
Platform
Neutral atoms, hybrid analogue and digital or fully digital; an analogue offer must include an upgrade within 18 months of acceptance, and each system must pass the Annex 8 benchmarks (Part 2, Req_4 and section 2.1) (Neutral atoms, Analogue quantum simulators) (EuroQCS-Italy: Tender specifications, Part 2, technical specifications, PDF pages 5 and 7, Req_4 and section 2.1)
Published
2024-08-01
Documents
Public tender documents, read in full. The call on the EU tender portal EuroQCS-Italy (now SOL). TED notice 464796-2024, as listed on the portal.
Award
Benchmark evaluation (award criterion 2): at most 15 of 132 points, at least 5 required; scored on the number of benchmarks including hybrid HPC and quantum ones, their technical quality and maturity, and their significance and coverage. (EuroQCS-Italy: Tender specifications, Part 1, administrative specifications, PDF page 25, Table 3: Award criteria)
Acceptance
The listed benchmarks and those the tenderer adds form the benchmark suite of the acceptance procedure: they are run again on the installed system under supervision of the hosting entity, and the system is accepted only when the signed benchmark protocol shows the committed values. (EuroQCS-Italy: Annex 8, Performance Benchmarks and Technology Roadmap Assessment, PDF page 2, sections A and B)

Annex 8 states that no minimum values are required unless a benchmark description says so; the set depends on whether an analogue or digital system is delivered.

Benchmarks named in the tender for EuroQCS-Italy (now SOL) (EUROHPC/2024/OP/0004)
Benchmark or test, as namedHow it is usedThreshold or condition statedOn this portalDocument and place
Sequences of random pulses on a unit-disk graph register (RSEQ), compared with emulatorsRequired in the benchmark suite (scored under the award criteria)At least 5 sequences with different topologiesAnalogue quantum simulation of spin and Hubbard modelsEuroQCS-Italy: Annex 8, Performance Benchmarks and Technology Roadmap Assessment, PDF pages 6 and 7, section 1.1.2 (analogue)
Preparation of an antiferromagnetic state (AFMAG) on chains and square and triangular latticesRequired in the benchmark suite (scored under the award criteria)None statedAnalogue quantum simulation of spin and Hubbard modelsEuroQCS-Italy: Annex 8, Performance Benchmarks and Technology Roadmap Assessment, PDF pages 7 to 9, section 1.2.3 (analogue)
Quantum adiabatic algorithm (QAA) for maximum independent setRequired in the benchmark suite (scored under the award criteria)At least 5 problems with different topologies and atom numbersAnalogue optimisation on Rydberg atom arrays (maximum independent set)EuroQCS-Italy: Annex 8, Performance Benchmarks and Technology Roadmap Assessment, PDF pages 10 and 11, section 1.2.5 (analogue); method: S. Ebadi et al. 2022, Science 376, 1209 (2022); arXiv:2202.09372
QAOA on weighted Max-Cut, compared with classical emulationRequired in the benchmark suite (scored under the award criteria)At least 5 graph instancesQuantum approximate optimisation algorithm (QAOA)EuroQCS-Italy: Annex 8, Performance Benchmarks and Technology Roadmap Assessment, PDF pages 11 and 12, section 1.2.6 (all systems)
Quantum volumeRequired in the benchmark suite (scored under the award criteria)None statedQuantum volumeEuroQCS-Italy: Annex 8, Performance Benchmarks and Technology Roadmap Assessment, PDF page 5, section 1.1.1 (digital); method: A. W. Cross et al. 2019, Phys. Rev. A 100, 032328 (2019); arXiv:1811.12926
Circuit layer operations per second (CLOPS)Required in the benchmark suite (scored under the award criteria)None statedCLOPS (circuit layer operations per second)EuroQCS-Italy: Annex 8, Performance Benchmarks and Technology Roadmap Assessment, PDF page 6, section 1.1.2 (digital); method: A. Wack et al. 2021, arXiv:2110.14108 (preprint, October 2021)
Creation of a GHZ stateRequired in the benchmark suite (scored under the award criteria)GHZ fidelity above 0.5, on the full QPU or the largest subset that reaches itGHZ state sizeEuroQCS-Italy: Annex 8, Performance Benchmarks and Technology Roadmap Assessment, PDF pages 9 and 10, section 1.2.4 (digital)

EuroSSQ-HPC

Call for tenders
EUROHPC/2025/OP/0007
Hosting site
SURF (Netherlands)
Platform
Semiconductor spin qubits, at least 16 (Part 2, Req_10 and Req_12) (Spin qubits in semiconductors) (EuroSSQ-HPC: Tender specifications, Part 2, technical specifications (version 2), PDF page 6, section 2, Req_10 to Req_12)
Published
2025-09-12
Documents
Public tender documents, read in full. The call on the EU tender portal EuroSSQ-HPC. TED notice 598010-2025, as listed on the portal.
Award
Benchmark evaluation (award criterion 2): at most 15 of 132 points, at least 5 required; scored on the number of benchmarks including hybrid HPC and quantum ones, their technical quality and maturity, and their significance and coverage. (EuroSSQ-HPC: Tender specifications, Part 1, administrative specifications (version 2), PDF page 26, Table 3: Award criteria)
Acceptance
The listed benchmarks and those the tenderer adds form the benchmark suite of the acceptance procedure: they are run again on the installed system under supervision of the hosting entity, and the system is accepted only when the signed benchmark protocol shows the committed values. (EuroSSQ-HPC: Annex 8, Performance Benchmarks and Technology Roadmap Assessment, PDF pages 2 and 3, sections A and B)

Annex 8 states that thresholds are generally not defined for the technical features, but committed values must meet section 2 of the technical specifications.

Benchmarks named in the tender for EuroSSQ-HPC (EUROHPC/2025/OP/0007)
Benchmark or test, as namedHow it is usedThreshold or condition statedOn this portalDocument and place
Number of addressable qubits; single- and two-qubit gate fidelity and speed (for example randomised benchmarking); readout fidelity and speed; T2Required in the benchmark suite (scored under the award criteria)Committed values, within the minimums of Part 2, section 2Randomised benchmarking familyEuroSSQ-HPC: Annex 8, Performance Benchmarks and Technology Roadmap Assessment, PDF page 3, section 1; method: E. Magesan et al. 2011, Phys. Rev. Lett. 106, 180504 (2011); arXiv:1009.3639
Creation of a GHZ stateRequired in the benchmark suite (scored under the award criteria)GHZ fidelity above 0.5, on the full QPU or the largest subset that reaches itGHZ state sizeEuroSSQ-HPC: Annex 8, Performance Benchmarks and Technology Roadmap Assessment, PDF pages 4 and 5, section 2.1
Variational algorithms on Max-Cut, scored with the Q-score protocol (100 random graphs per size)Required in the benchmark suite (scored under the award criteria)Q-score test passed when beta(n) exceeds 0.2Q-score, Variational quantum eigensolver (VQE), Quantum approximate optimisation algorithm (QAOA)EuroSSQ-HPC: Annex 8, Performance Benchmarks and Technology Roadmap Assessment, PDF pages 5 and 6, section 2.2; method: S. Martiel et al. 2021, IEEE Transactions on Quantum Engineering, DOI 10.1109/TQE.2021.3090207; arXiv:2102.12973
Bernstein-Vazirani hidden bit stringRequired in the benchmark suite (scored under the award criteria)Success probability reported for each qubit count from 2 plus an ancillaNo page on this portalEuroSSQ-HPC: Annex 8, Performance Benchmarks and Technology Roadmap Assessment, PDF page 6, section 2.3
QED-C benchmarks, PSNC OpenQBench and MQT Bench as reference implementationsNamed as a reference implementationNone statedQED-C application-oriented benchmarksEuroSSQ-HPC: Annex 8, Performance Benchmarks and Technology Roadmap Assessment, PDF page 4, section 2; method: Members of the QED-C Technical Advisory Committee on Standards and Performance Metrics 2026, GitHub repository README (Apache-2.0)

MeluXina-Q

Call for tenders
EUROHPC/2026/OP/0007
Hosting site
LuxProvide (Luxembourg)
Platform
Semiconductor spin qubits, at least 10 at first (Part 2, Req_17 and Req_18) (Spin qubits in semiconductors) (MeluXina-Q: Tender specifications, Part 2, technical specifications, PDF page 9, section 2.1, Req_17 and Req_18)
Published
2026-07-23
Documents
Public tender documents, read in full. The call on the EU tender portal MeluXina-Q. TED notice 511277-2026, as listed on the portal.
Award
Benchmark evaluation (award criterion 2): at most 15 of 132 points, at least 5 required; scored on the number of benchmarks including hybrid HPC and quantum ones, their technical quality and maturity, and their significance and coverage. (MeluXina-Q: Tender specifications, Part 1, administrative specifications, PDF page 25, Table 3: Award criteria)
Acceptance
At acceptance the benchmarks are run in the configurations of section 9 and Annex 8; the test is passed only if every benchmark result committed in the proposal is achieved. (MeluXina-Q: Tender specifications, Part 2, technical specifications, PDF page 51, section 10.3.2.5)
Deployment tracker
MeluXina-Q

Runtime is the median total time over 100 iterations of 100 shots, from transpiling to the result; fidelity is the median Hellinger-type fidelity against an exact simulation. The circuits are fixed OpenQASM 2 files generated with MQT Bench.

Benchmarks named in the tender for MeluXina-Q (EUROHPC/2026/OP/0007)
Benchmark or test, as namedHow it is usedThreshold or condition statedOn this portalDocument and place
Quantum volumeMandatory requirement with a minimumAt least 2^5 = 32 (mandatory requirement of the initial QPU)Quantum volumeMeluXina-Q: Tender specifications, Part 2, technical specifications, PDF page 9, section 2.1, Req_22; method: A. W. Cross et al. 2019, Phys. Rev. A 100, 032328 (2019); arXiv:1811.12926
GHZ state, 3 and 10 qubitsRequired in the benchmark suite (scored under the award criteria)Runtime and fidelity reported; committed results must be achieved at acceptanceGHZ state sizeMeluXina-Q: Annex 8, Application Performance Benchmarks, PDF pages 3 to 5, section C, BM1
Quantum Fourier transform, 4 and 10 qubitsRequired in the benchmark suite (scored under the award criteria)Runtime and fidelity reported; committed results must be achieved at acceptanceMQT BenchMeluXina-Q: Annex 8, Application Performance Benchmarks, PDF pages 3 to 5, section C, BM2
Quantum phase estimation, 4 and 10 qubitsRequired in the benchmark suite (scored under the award criteria)Runtime and fidelity reported; committed results must be achieved at acceptanceMQT Bench, Quantum phase estimationMeluXina-Q: Annex 8, Application Performance Benchmarks, PDF pages 3 to 5, section C, BM3
Grover search, 4 and 6 qubitsRequired in the benchmark suite (scored under the award criteria)Runtime and fidelity reported; committed results must be achieved at acceptanceMQT Bench, Grover search and amplitude amplificationMeluXina-Q: Annex 8, Application Performance Benchmarks, PDF pages 3 to 5, section C, BM4
Benchmark circuits taken from MQT Bench; fidelity metric from the QED-C paperNamed as a reference implementationNone statedMQT BenchMeluXina-Q: Annex 8, Application Performance Benchmarks, PDF page 5, sections C and D; method: N. Quetschlich et al. 2023, Quantum 7, 1062 (2023); arXiv:2204.13719

HPCQS quantum simulators (now Jade and Ruby)

Call for tenders
HPCQS joint procurement of innovative solutions by GENCI and Forschungszentrum Jülich
Hosting site
Jülich Supercomputing Centre (Germany) and GENCI at TGCC (France)
Platform
Neutral-atom analogue simulators (Pasqal), each controlling at least 100 qubits (Neutral atoms, Analogue quantum simulators) (With two 100 qubits quantum computers from PASQAL, FZJ and GENCI boost HPCQS, the pan-European hybrid HPC/quantum infrastructure, Opening paragraphs)
Published
Not stated
Documents
No tender specification with benchmarks published
Deployment tracker
JADE (HPCQS), Ruby (HPCQS)

No tender specification with benchmarks was found among public EuroHPC or EU tender documents; the announcement names only the capability to control at least 100 qubits and lists benchmarking and certification as future project work.

Selection is described as requiring simulators able to control at least 100 qubits; benchmarking and certification or performance analysis are named as later HPCQS work, not as selection criteria. (With two 100 qubits quantum computers from PASQAL, FZJ and GENCI boost HPCQS, the pan-European hybrid HPC/quantum infrastructure, Opening paragraphs and the description of the HPCQS work)

Further reading

Olivier Ezratty, Understanding Quantum Technologies (CC BY-NC-ND 4.0). Links only; no text of the book is reproduced on this portal.