Hello. In our last lesson, we took a hands-on approach to randomized benchmarking (RB), implementing it on a noisy simulator. We saw how RB uses sequences of random Clifford gates to extract a single, powerful metric: the average gate fidelity. This metric, encapsulated in the Error Per Clifford (EPC), tells us how well our gates perform on average and has the crucial property of being robust to state preparation and measurement (SPAM) errors.
However, an average can sometimes conceal more than it reveals. If a gate is failing, is it due to a systematic over-rotation (a coherent error), or is it decohering (an incoherent error)? RB, by design, cannot distinguish between these cases. This lesson addresses that gap. Our goal is to compare and contrast randomized benchmarking with quantum process tomography in terms of the information they provide and their experimental scalability. We will treat these as two complementary tools in the quantum characterization toolkit, each with its own distinct purpose, strengths, and weaknesses.
What is Quantum Process Tomography?
While randomized benchmarking provides a single figure of merit, Quantum Process Tomography (QPT) aims for a much more ambitious goal: to obtain a complete mathematical description of a quantum process, such as a gate or a noise channel.
If RB gives you the average grade of a student across all subjects, QPT provides the full, detailed report card, including the teacher's comments on every subject, highlighting specific strengths and weaknesses. The output of QPT is a mathematical object—typically a process matrix or a set of Kraus operators —that fully defines the quantum map describing the noisy gate.
The general procedure for QPT is as follows:
- Prepare a basis of input states: For a single qubit, this means preparing states like .
- Apply the process: The gate you want to characterize is applied to each of these input states.
- Characterize the output states: For each output, you must perform full quantum state tomography. This involves repeatedly preparing the state and measuring it in a complete set of bases (e.g., X, Y, and Z bases) to reconstruct its density matrix.
- Reconstruct the process: From the set of input-output density matrix pairs, you can mathematically solve for the process matrix that describes the transformation.
Quantum Computer Benchmarking: An Explorative ...
To formalize this, let's turn to the paper 'Quantum Computer Benchmarking: An Explorative ...'. It provides a concise introduction to QPT.
Please read the first two paragraphs of the document, starting from 'Quantum State Tomography (QST)...' and ending with '...multiple variants of QST and QPT have been developed.' Focus on understanding what QPT aims to reconstruct (a completely positive, trace-preserving map) and the general data collection procedure.
With this complete description, we can now dig into the core comparison with RB.
Axis 1: Information Provided
This is where the difference between the two techniques is most stark.
Quantum Process Tomography (QPT)
As the "tomography" in its name implies, QPT provides a complete, high-resolution picture of the quantum process. From the reconstructed process matrix , you can calculate anything you want to know about the gate's performance:
- Average Gate Fidelity: This can be directly computed from .
- Coherent Errors: You can identify systematic errors, such as whether a gate is consistently over- or under-rotating the qubit state.
- Incoherent Errors: You can characterize the decoherence properties, such as the rates of dephasing () or amplitude damping ().
- Error Correlations: It can reveal if certain types of errors are correlated.
- Worst-Case Performance: You can compute metrics like the diamond norm distance, which quantifies the worst-case error over all possible input states.
This detailed breakdown provides what is often called "actionable advice." An experimentalist can use the QPT results to diagnose the physical cause of an error and attempt to recalibrate their control pulses to fix it.
Randomized Benchmarking (RB)
In contrast, RB provides a single piece of information: the average gate fidelity. It is a benchmark that tells you how well your gates perform on average, but it offers no insight into why they might be failing. The averaging process (twirling) that makes RB so elegant intentionally washes out the details of the noise, converting it all into an effective depolarizing error rate. A gate with a coherent rotation error and a gate with pure dephasing could, in principle, produce the same RB decay curve.
Quantum certification and benchmarking
The review paper 'Quantum certification and benchmarking' provides an excellent high-level perspective on this trade-off between information gain and other factors.
Please read the following parts of this paper: The introduction (section 'a'), to appreciate the framework of classifying certification protocols by information gain, resource cost, and assumptions. The short section 'c. Certification protocols' up to and including the first paragraph on full quantum tomography. Notice the phrases 'most powerful', 'full knowledge', and 'actionable advice' used to describe tomography. 'BOX 2: Randomized benchmarking', which describes RB as a method to 'reliably estimat[e] the magnitude of an average error'.
Axis 2: Scalability and Experimental Cost
If QPT provides so much more information, why isn't it used all the time? The answer lies in its staggering resource cost.
Quantum Process Tomography (QPT)
QPT scales disastrously with the number of qubits, . To characterize a process on qubits (a Hilbert space of dimension ), you need to determine the matrix, which has independent real parameters.
The number of experiments required scales exponentially. A full QPT on qubits requires:
- Preparing different basis input states.
- For each output, performing full state tomography, which requires different measurement settings.
- The total number of unique experimental settings scales as , and the classical post-processing to reconstruct the matrix is also computationally intensive.
This exponential scaling makes full QPT infeasible for anything beyond two or three qubits.
Randomized Benchmarking (RB)
This is RB's greatest strength. The number of required experimental settings is independent of the number of qubits. For an -qubit RB experiment, you still prepare a single initial state (e.g., ) and measure in a single basis (the computational basis). The complexity is determined by:
- The maximum sequence length, .
- The number of random sequences you average over, .
While generating the classical description of an -qubit Clifford gate and its inverse becomes hard for large , the experimental cost of RB does not have the prohibitive exponential dependence on that plagues QPT. This is why RB, and not QPT, is the industry standard for assessing the performance of multi-qubit processors.
Test your understanding!
You are tasked with benchmarking the quality of the CNOT gates on a new 20-qubit quantum processor. The CNOTs connect adjacent qubits. Could you use QPT for this task? Why or why not?
Show answer
No, QPT would be completely infeasible. A CNOT is a two-qubit gate (). The number of experimental settings for a two-qubit QPT scales roughly as for the input preparations and measurements. While this is manageable for a single CNOT, performing this on all ~20-30 CNOT gates on a 20-qubit chip is already very time-consuming. More importantly, trying to use QPT to characterize even a 3- or 4-qubit process would be practically impossible. RB, on the other hand, scales gracefully and is the appropriate tool for benchmarking the gate set of a 20-qubit device.
Axis 3: Robustness to SPAM Errors
There's one more critical difference that often makes RB the more practical choice even for a single qubit.
Quantum Process Tomography (QPT)
Standard QPT is extremely sensitive to State Preparation and Measurement (SPAM) errors. If your initial state isn't prepared perfectly, or your measurement apparatus is miscalibrated, QPT has no way of distinguishing these errors from errors in the gate itself. It will faithfully report the combined error of (preparation + gate + measurement), attributing it all to the gate.
Randomized Benchmarking (RB)
As we saw in the previous lessons, RB is inherently robust to SPAM errors. In the decay model,
the SPAM errors are absorbed into the constant offsets and . The decay parameter , from which the gate fidelity is calculated, is independent of them. This is a massive practical advantage, as it decouples the gate characterization from the (also imperfect) preparation and measurement steps.
It's worth noting that a more advanced and even more costly technique called Gate Set Tomography (GST) was developed to solve this problem for QPT. GST characterizes the gates, the initial state, and the measurement operators all simultaneously in a self-consistent way, but its resource cost scales even more unfavorably than standard QPT.
Quantum Computer Benchmarking: An Explorative ...
The paper 'Quantum Computer Benchmarking' discusses this exact issue and the role of GST.
Please read the subsection 'Gate Set Tomography'. Pay attention to the argument that in QPT, 'SPAM errors can be misattributed to errors... leading to systematic inaccuracies', and how GST is designed to solve this at the cost of even greater complexity.
Summary: A Tale of Two Tools
We can summarize the comparison in a table:
| Feature | Quantum Process Tomography (QPT) | Randomized Benchmarking (RB) |
|---|---|---|
| Information Provided | Complete process matrix (); details on all error types | A single number: average gate fidelity |
| Primary Use Case | Detailed diagnostics, "actionable advice" for gate calibration | Scalable benchmarking, performance tracking |
| Scalability with Qubits | Exponentially poor () | Excellent (independent of ) |
| SPAM Robustness | Highly sensitive | Inherently robust |
| Analogy | High-resolution microscope for 1-2 qubits | Wide-angle snapshot of the whole system's average performance |
These techniques are not competitors but rather complementary parts of a complete characterization suite. You might use RB to quickly survey the performance across a 50-qubit chip. If a particular qubit's gates are performing poorly, you might then zoom in on that specific qubit with QPT to diagnose the physical root of the problem.
Conclusion
Today we've drawn a clear distinction between two fundamental methods for quantum device characterization.
Key Takeaways:
- QPT provides a complete picture: It reconstructs the full process matrix, offering detailed insights into all error mechanisms (coherent, incoherent), but at a high cost.
- RB provides a scalable average: It yields a single, robust metric (average gate fidelity) that scales to many qubits and is insensitive to SPAM errors, but it hides the details of the noise.
- The fundamental trade-off: The choice between QPT and RB is a classic trade-off between information and scalability. QPT is a deep, narrow diagnostic tool, while RB is a broad, shallow benchmarking tool.
- Complementary roles: In practice, both are essential. RB identifies problem areas at scale, and QPT can be used to perform a deep dive on those specific problems.
Preview of the next lesson:
We have discussed what QPT aims to achieve and how it compares to RB. In the next lesson, we will delve into the mechanics of how it works. We will derive the measurement scheme for quantum process tomography and the linear inversion procedure for reconstructing the process matrix (-matrix), putting the mathematical machinery behind today's high-level overview.