Isotropic Local Laws for Sample Covariance and Generalized Wigner Matrices
Alex Bloemendal, Laszlo Erdos, Antti Knowles, Horng-Tzer Yau, Jun Yin
Introduction
In recent years there has been substantial progress in understanding the local versions of the semicircle and the Marchenko-Pastur laws (see EKYY4 ; ECDM for an overview and detailed references). This research was originally motivated by the Wigner-Dyson-Mehta universality conjecture for the local spectral statistics of random matrices. The celebrated sine kernel universality and related results for other symmetry classes concern higher-order correlation functions, and not just the eigenvalue density. Moreover, they pertain to scales of order , smaller than the scales on which local laws hold. Nevertheless, local laws (with precise error bounds) are essential ingredients for proving universality. In particular, one of their consequences, the precise localization of the eigenvalues (called rigidity bounds), has played a fundamental role in the relaxation flow analysis of the Dyson Brownian Motion, which has led to the proof of the Wigner-Dyson-Mehta universality conjecture for all symmetry classes ESY4 ; ESYY .
The basic approach behind the proofs of local laws is the analysis of a self-consistent equation for the Stieltjes transform, a scalar equation which controls the trace of the resolvent (and hence the empirical eigenvalue density). A vector self-consistent equation for the diagonal resolvent matrix entries, , was introduced in EYY1 . Later, a matrix self-consistent equation was derived in EKYY3 . Such self-consistent equations provide entrywise control of the resolvent and not only its trace. This latter fact has proved a key ingredient in the Green function comparison method (introduced in EYY1 and extended to the spectral edge in EYY3 ), which allows the comparison of local statistics via moment matching even below the scale of eigenvalue spacing.
The isotropic local laws established in this paper serve as a key input in establishing detailed results about the eigenvalues and eigenvectors of deformed matrix models. These include:
A complete picture of the distribution of outlier eigenvalues/eigenvectors, as well as the non-outlier eigenvalues/eigenvectors near the spectral edge.
An investigation of the BBP transition using that, thanks to the optimality of the high-probability bounds in the local laws, the results of (a) extend even to the case when some eigenvalues of are very close to the critical value.
This programme for the eigenvalues of deformed Wigner matrices was carried out in KY2 ; KY3 . In KYY , we carry it out for the eigenvectors of covariance matrices.
In this paper we prove the isotropic Marchenko-Pastur law for sample covariance matrices as well as the isotropic semicircle law for generalized Wigner matrices. Our proofs are based on a novel method, which is considerably more robust than that of KY2 . Both proofs (the one from KY2 and the one presented here) crucially rely on the entrywise local law as input, but follow completely different approaches to obtain the isotropic law from the entrywise one. The basic idea of the proof in KY2 is to use the Green function comparison method to compare the resolvent of a given Wigner matrix to the resolvent of a Gaussian random matrix, for which the isotropic law is a trivial corollary of the entrywise one (by basis transformation). Owing to various moment matching conditions imposed by the Green function comparison, the result of KY2 required the variances of all matrix entries to coincide and, for results in the bulk spectrum, the third moments to vanish. In contrast, our current approach does not rely on Green function comparison. Instead, it consists of a precise analysis of the cancellation of fluctuations in Green functions. We use a graphical expansion method inspired by techniques recently developed in EKY2 to control fluctuations in Green functions of random band matrices.
Our first main result is the isotropic local Marchenko-Pastur law for sample covariance matrices , where is an matrix. We allow the dimensions of to differ wildly: we only assume that . In particular, the aspect ratio – a key parameter in the Marchenko-Pastur law – may scale as a power of . Our entrywise law (required as input for the proof of the isotropic law) is a generalization of the one given in PY . In addition to generalizing the proof of PY , we simplify and streamline it, so as to obtain a short and self-contained proof.
Our second main result is the isotropic local semicircle law for generalized Wigner matrices. This extends the isotropic law of KY2 from Wigner matrices to generalized Wigner matrices, in which the variances of the matrix entries need not coincide. It also dispenses with the third moment assumption of KY2 mentioned previously. In fact, our proof applies to even more general matrix models, provided that an entrywise law has been established. As an application of the isotropic laws, we also prove a basis-independent version of eigenvector delocalization for both sample covariance and generalized Wigner matrices.
We conclude with an outline of the paper. In Section 2 we define our models and state our results, first for sample covariance matrices (Section 2.1) and then for generalized Wigner matrices (Section 2.2). The rest of the paper is devoted to the proofs. Since they are very similar for sample covariance matrices and generalized Wigner matrices, we only give the details for sample covariance matrices. Thus, Sections 3–6 are devoted to the proof of the isotropic Marchenko-Pastur law for sample covariance matrices; in Section 7, we describe how to modify the arguments to prove the isotropic semicircle law for generalized Wigner matrices. Section 3 collects some basic identities and estimates that we shall use throughout the proofs. In Section 4 we prove the entrywise local Marchenko-Pastur law, generalizing the results of PY . The main argument and the bulk of the proof, i.e. the proof of the isotropic law, is given in Section 5. For a sketch of the argument we refer to Section 5.3. Finally, in Section 6 we draw some simple consequences from the isotropic law: optimal control outside of the spectrum and isotropic delocalization bounds.
We use to denote a generic large positive constant, which may depend on some fixed parameters and whose value may change from one expression to the next. Similarly, we use to denote a generic small positive constant. For two positive quantities and depending on we use the notation to mean for some positive constant .
Results
Let be an matrix whose entries are independent complex-valued random variables satisfying
We shall study the matrix ; hence we regard as the fundamental large parameter, and write . Our results also apply to the matrix provided one replaces . See Remark 2.11 below for more details.
We always assume that and satisfy the bounds
for some positive constant . We define the ratio
which may depend on . Here, and throughout the following, in order to unclutter notation we omit the argument in quantities, such as and , that depend on it.
It is well known that the empirical distribution of the eigenvalues of the matrix has the same asymptotics as the Marchenko-Pastur lawMP
to be the edges of the limiting spectrum. Note that (2.4) is normalized so that its integral is equal to one. The Stieltjes transform of the Marchenko-Pastur law (2.4) is
where the square root is chosen so that is holomorphic in the upper half-plane and satisfies as . The function is also characterized as the unique solution of the equation
satisfying for . The formulas (2.4)–(2.7) were originally derived for the case when is independent of (or, more precisely, when has a limit in as ). Our results allow to depend on under the constraint (2.2), so that and may also depend on through .
Throughout the following we use a spectral parameter
with , as the argument of Stieltjes transforms and resolvents. Define the resolvent
The following notion of a high-probability bound was introduced in EKY2 , and has been subsequently used in a number of works on random matrix theory. It provides a simple way of systematizing and making precise statements of the form “ is bounded with high probability by up to small powers of ”.
be two families of nonnegative random variables, where is a possibly -dependent parameter set. We say that is stochastically dominated by , uniformly in , if for all (small) and (large) we have
for large enough . Throughout this paper the stochastic domination will always be uniform in all parameters (such as matrix indices and the spectral parameter ) that are not explicitly fixed. Note that may depend on the constants from (2.2) and (2.3) as well as any constants fixed in the assumptions of our main results. If is stochastically dominated by , uniformly in , we use the notation . Moreover, if for some complex family we have we also write .
Because of (2.2), all (or some) factors of in Definition (2.1) could be replaced with without changing the definition of stochastic domination.
Sometimes we shall need the following notion of high probability.
which is the number of nontrivial (i.e. nonzero) eigenvalues of ; the remaining eigenvalues of are zero. (Note that the nontrivial eigenvalues of coincide with those of .) Fix a (small) and define the domain
Throughout the following we regard as fixed once and for all, and do not track the dependence of constants on .
Suppose that (2.1), (2.2), and (2.3) hold. Then
Beyond the support of the limiting spectrum, one has stronger control all the way down to the real axis. For fixed (small) define the region
of spectral parameters separated from the asymptotic spectrum by , which may have an arbitrarily small positive imaginary part .
Suppose that (2.1), (2.2), and (2.3) hold. Then
for all , , and .
The right-hand side of (2.15) is stable under the limit , and may therefore be extended to . Recalling the previous remark, we conclude that (2.15) also holds for .
Suppose that (2.1), (2.2), and (2.3) hold. Then for any we have the bound
The following result is on the rigidity of the nontrivial eigenvalues of , which coincide with the nontrivial eigenvalues of . Let be the classical eigenvalue locations according to (see (2.4)), defined through
Fix a (small) and suppose that (2.1), (2.2), and (2.3) hold. Then
uniformly for all . If in addition for some constant then
uniformly for all .
2. Generalized Wigner matrix
its Stieltjes transform; here we chose the square root so that is holomorphic in the upper half-plane and satisfies as . Note that is also characterized as the unique solution of
that satisfies for . Let
Fix a (small) and define
Suppose that (2.22) and (2.23) hold. Then
Theorem 2.12 is the isotropic generalization of the following result, proved in EKYY4 . A similar result first appeared in EYY3 .
Suppose that (2.22) and (2.23) hold. Then
The proof of Theorem 2.14 is the same as that of Theorem 2.12. Below we give the proof for Theorem 2.12, which can be trivially adapted to yield Theorem 2.14.
Combining Theorem 2.14 with the isotropic local semicircle law from EKYY4 , we may for instance obtain an isotropic local semicircle law for matrices where the lower bound of (2.22) is relaxed, so that some matrix entries may vanish.
Beyond the support of the limiting spectrum $\omega\in(0,1)$ define the region
of spectral parameters separated from the asymptotic spectrum by , which may have an arbitrarily small positive imaginary part .
Suppose that (2.22) and (2.23) hold. Then
Suppose that (2.22) and (2.23) hold. Then
Finally, in analogy to Theorem 2.10, we record the following rigidity result, which is a trivial consequence of (EKYY4, , Theorem 7.6) with and ; see also (EYY3, , Theorem 2.2). Write for the eigenvalues of , and let be their classical locations according to , defined through
Preliminaries
The rest of this paper is devoted to the proofs of our main results. They are similar for sample covariance matrices and generalized Wigner matrices, and in Sections 3–6 we give the argument for sample covariance matrices (hence proving the results of Section 2.1). How to modify these arguments to generalized Wigner matrices (and hence prove the results of Section 2.2) is explained in Section 7. We choose to present our method in the context of sample covariance matrices mainly for two reasons. First, we take this opportunity to give a version of the entrywise local law (Section 4) – required as input for the proof of the isotropic law – which is more general and has a simpler proof than the local law previously established in PY . Second, the proof of the isotropic law in the case of sample covariance matrices is conceptually slightly clearer due to a natural splitting of summation indices into two categories (which we distinguish by the use of Latin and Greek letters); this splitting is an essential structure behind our proof in Section 5, and is also used in the case of generalized Wigner matrices, in which case it is however purely artificial.
We now move on to the proofs. In order to unclutter notation, we shall often omit the argument from quantities that depend on it. Thus, we for instance often write instead of . We put the arguments back when needed, typically if we are working with several different spectral parameters .
We begin by recording some basic large deviations estimates. We consider complex-valued random variables satisfying
If the coefficients and depend on an additional parameter , then all of these estimates are uniform in (see Definition 2.1), i.e. the threshold in the definition of depends only on the family from (3.1); in particular, does not depend on .
These estimates are an immediate consequence of Lemmas B.2, B.3, and B.4 in EKYY3 . See also Theorem C.1 in EKYY4 . ∎
The following lemma collects basic algebraic properties of stochastic domination . We shall use them tacitly throughout the following.
Suppose that uniformly in and . If for some constant then
Suppose that uniformly in and uniformly in . Then
The claims (i) and (ii) follow from a simple union bound. For (iii), pick and assume to simplify notation that and do not depend on . Then
for arbitrary . The claim (iii) therefore follows by choosing . ∎
Next, we give some basic facts about the Stieltjes transform of the Marchenko-Pastur law defined in (2.6). They have an especially simple form in the case ; the complementary case can be easily handled using (2.20). Recall the definition (2.9) of . We record the following elementary properties of , which may be proved e.g. by starting from the explicit form (2.6).
The basic object is the matrix . We use the indices to denote the rows of and to denote its columns. Unrestricted summations over Latin indices always run over the set while Greek indices run over .
In addition to the resolvent from (2.8), we shall need another resolvent, :
Although our main results only pertain to , the resolvent will play a crucial role in the proofs, in which we consider both and in tandem. In the following formulas the spectral parameter plays no explicit role, and we therefore omit it from the notation, as explained at the beginning of this section.
More abstractly, we may introduce two sets of indices, and , such that indexes the entries of and the entries of . Elements of are always denoted by Latin letters and elements of by Greek letters. These two sets are to be viewed as distinct. For convenience of notation, we shall always use the customary representations and , bearing in mind that neither should be viewed as a subset of the other. This terminology originates from the statistical application of sample covariance matrices. The idea is that we are observing the statistics of a population of size by making independent measurements (“samples”) of the population. Each observation is a column of . Hence the population index labels the rows of and the sample index the columns of .
Moreover, for we define the resolvents entries
When , we abbreviate by in the above definitions; similarly, we write instead of .
We shall use the following expansion formulas for . They are elementary consequences of Schur’s complement formula; see e.g. Lemma 4.2 of EYY1 and Lemma 6.10 of EKYY2 for proofs of similar identities.
For and we have
Moreover, for and we have
Definition 3.5 and Lemma 3.6 have the following analogues for removing columns and identities for .
Moreover, for we define the resolvents entries
When , we abbreviate by in the above definitions; similarly, we write instead of .
We use the following expansion formulas for , which are analogoues to those of Lemma 3.6.
For and we have
Moreover, for and we have
Here we draw attention to a fine notational distinction. Parentheses in indicate removal of rows (indexed by Latin letters), while square brackets in indicate removal of columns (indexed by Greek letters). In particular, this notation makes it unambiguous whether is required to be a subset of or of .
The following lemma is an immediate consequence of the fact that for the spectrum of is equal to the spectrum of plus zero eigenvalues. (A similar result holds for for , and if is replaced with or .)
Let and . Then we have
in agreement with the relation (2.20) and the heuristics and .
The following lemma is an easy consequence of the well-known interlacing property of the eigenvalues of and , as well as the eigenvalues of and .
For any and , there exists a constant , depending only on and , such that
Finally, we record the fundamental identity
which follows easily by spectral decomposition of .
2. Reduction to the case ϕ⩾1italic-ϕ1\phi\geqslant 1
We shall prove Theorems 2.4 and 2.5 by restricting ourselves to the case but considering both and simultaneously. In this short section we give the details of this reduction. Define the control parameter
Suppose that (2.1), (2.2), (2.3), and hold. Then
Suppose that (2.1), (2.2), (2.3), and hold. Then
Suppose that (2.1), (2.2), (2.3), and hold. For any we have the bounds
Theorems 2.4, 2.5, and 2.8 are easy consequences of Theorems 3.11, 3.12, and 3.13 respectively, combined with the observation that
What remains therefore is to prove Theorems 2.10, 3.11, 3.12, and 3.13. We shall prove Theorem 2.10 in Section 4.3, Theorem 3.11 in Section 5, and Theorems 3.12 and 3.13 in Section 6.
The entrywise local Marchenko-Pastur law
Suppose that (2.1), (2.2), (2.3), and hold. Then
Theorem 4.1 differs from Theorem 3.1 in PY in the following two ways.
The restriction in PY is relaxed to (and hence, as explained in Section 3.2, to ).
The uniform subexponential decay assumption of PY is relaxed to (2.3). On the other hand, thanks to the stronger subexponential decay assumption the statement of Theorem 3.1 of PY is slightly stronger than Theorem 4.1: in Theorem 3.1 of PY , the error bounds in the definition of are replaced with .
The difference (ii) given above is technical and amounts to using Lemma 3.1, which is tailored for random variables satisfying (2.3), for the large deviation estimates. We remark that all of the arguments of the current paper may be translated to the setup of PY , explained in (ii) above, by modifying the definition of . The essence of the proofs remains unchanged; the only nontrivial difference is that in Section 5 we have to control moments whose power depends weakly on ; this entails keeping track of some basic combinatorial bounds. We do not pursue this modification any further.
The difference (i) is more substantial, and requires to keep track of the -dependence of all appropriately rescaled quantities throughout the proof. In addition, we take this opportunity to simplify and streamline the argument from PY . This provides a short and self-contained proof of Theorem 4.1, up to a fluctuation averaging result, Lemma 4.9 below, which was proved in the current simple and general form in EKYY4 .
We begin with the proof of (4.1) and (3.18). For the following it will be convenient to use the rescaled spectral parameters
Using and we may write the the defining equation (2.7) of as
We define the -dependent random control parameters
where we defined the Stieltjes transform of the empirical density of ,
The goal of this subsection is to prove the following weaker variant of Theorem 4.1.
The rest of this subsection is devoted to the proof of Proposition 4.2. We begin by introducing the basic -dependent event
The proof is a simple induction argument using (3.10) and the bound from (3.5). We omit the details. ∎
As in the works EYY3 ; PY , the main idea of the proof is to derive a self-consistent equation for using the resolvent identity (3.11). To that end, we introduce the conditional expectation
i.e. the partial expectation in the randomness of the -th column of . We define
where in the last step we used (2.1) and (4.3). Using (3.11) with , Lemma 3.9, and (4.3), we find
The following lemma contains the key estimates needed to control the error terms and . The errors are controlled using of the (random) control parameter
whose analogue in the context of Wigner matrices first appeared in EYY3 .
The proof is very similar to that of Theorems 6.8 and 6.9 of PY . We consequently only give the details for the estimate of ; the estimate of is similar.
For we use (3.12) with to expand . Conditioning on and invoking (3.3) yields
On the event , we estimate the right-hand side using
where the first step follows from (3.14), the second from Lemma 3.9, the third from and (4.7), and the fourth from the fact that by (3.6).
Recalling (3.5), we have therefore proved that
which, together with the analogous bound for , concludes the proof of (4.13).
In order to prove the estimate from (4.14) for , we proceed similarly. From (4.15) and the trivial deterministic bound \bigl{\lvert}R_{\mu\mu}R_{\nu\nu}^{[\mu]}\bigr{\rvert}\leqslant\eta^{-2}\leqslant(\log N)^{2} we get
where the estimate is similar to (4.16), except that in the last step we use Lemma 3.10 to estimate . Since , we easily find that . This concludes the proof. ∎
Note that, by (4.4), the function satisfies .
Next, we derive a stability result for . Roughly, we prove that if is small then is close to . Note that this result is entirely deterministic. It relies on a discrete continuity argument, whose essence is the existence of a sufficiently large gap between the two solutions of . Once this gap is established, then, together with the fact that is close to for large , we may conclude that is close to for smaller as well. We use a discrete version of a continuity argument (as opposed to a continuous one used e.g. in PY ), which allows us to bypass several technical issues when applying it to estimating the random quantity . For more details of this application, see the explanation following (4.34).
Thus, if then and if then is a one-dimensional lattice with spacing plus the point . Clearly, we have the bound
for some constant independent of and .
Let be as in Lemma 4.5, and abbreviate . Hence, by assumption on , we have . We introduce and by setting and defining as the other solution of the quadratic equation . Note that each is continuous. Explicitly, for we get
for some constant . What remains is to show that (4.21) holds for . We shall prove this using a continuity argument.
holds or not. If (4.24) does not hold, then we have , so that (4.21), , and the upper bound of (4.22) imply
What remains is the case where (4.24) holds. We use a continuity argument along the set , which we parametrize as , where , , and . Note that . By assumption, at each , so that (4.21) and (4.22) yield
at each . (Here the quantities , , and are understood as functions of the spectral parameters .) Moreover, since (4.24) holds at , by the monotonicity assumption on we find that (4.24) holds for all . We now prove that
for all by induction on . For the bound (4.26) is simply (4.23) proved above. Suppose therefore that (4.26) holds for some . Since and are Lipschitz continuous with Lipschitz constant , we get
where in the second step we used the induction assumption, in the third step the Lipschitz continuity of and the bound , and in the last step the bounds and . Next, recalling (4.24), it is easy to deduce (4.26) with replaced by , using the bounds (4.25) and (4.27). This concludes the proof. ∎
We may now combine the probabilistic estimates from Lemma 4.4 with the stability of from Lemma 4.5 to get the following result for , which will be used as the starting estimate in the bootstrapping in .
Next, we plug the estimates from Lemma 4.4 into (4.11) in order to obtain estimates on . The summation in will give rise to an error term of the form
For the proof of Proposition 4.2, it will be enough to estimate , but for the eventual proof of Theorem 4.1, we shall need to exploit cancellation in the averaging in . Bearing this in mind, we state our estimates in terms of to avoid repeating the following argument in Section 4.2.
where we absorbed the error term on the right-hand side of (4.11) into using (3.6). Thus, using (4.13) we get
Hence (4.30) follows. Next, expanding yields
After taking the average the second term on the right-hand side vanishes. Taking the average of (4.32) therefore yields, using (4.30) and (4.3),
Our goal is to prove that with high probability there is a gap in the range of , i.e.
The basic idea behind the proof of (4.34) is to use the deterministic result from Lemma 4.5 to propagate smallness of the random variable from large values of to smaller values of . Since we are dealing with random variables, one has to keep track of probabilities of exceptional events. To that end, we only work on a discrete set of values of , which allows us to control the exceptional probabilities by a simple union bound. We remark that the first instance of such a stochastic continuity argument combined with stability of a self-consistent equation was given in ESY2 in the context of Wigner matrices. Over the years it has been improved through several papers in the context of Wigner matrices EKYY4 ; EYY1 ; EYY3 as well as in the context of sample covariance matrices ESYY ; PY .
for large enough (independent of and ). Using (4.19) and a union bound, we therefore get
Next, we use Lemma 4.5 with and to get
(Here we used the trivial observation that the conclusion of Lemma 4.5 is valid not only at but in the whole set .) Using (4.13) and (4.30) we therefore get (4.34).
Since can be made arbitrarily small and arbitrarily large, Proposition 4.2 follows from (4.38).
2. Fluctuation averaging and conclusion of the proof of Theorem 4.1
In order to improve the negative power of in Proposition 4.2, and hence prove the optimal bound in Theorem 4.1, we shall use the following result iteratively. Recall the definition of from (4.6) and definition of from (4.29).
Let and suppose that we have
This result was given in a slightly different context in Theorem 4.7 in EKYY4 . However, it is a triviality that the proof of Theorem 4.7 in EKYY4 carries over word for word, provided one replaces there with ; see Remark B.3 in EKYY4 . The proof relies only on the identity (3.10), which is the analogue of Equation (4.6) in EKYY4 . ∎
The conclusion of Lemma 4.9 remains true under somewhat more general hypotheses, whereby is not required to be small. Indeed, (4.41) holds provided that is as in Lemma 4.9 and that
The proof is the same as that of Theorem 4.7 in EKYY4 .
Using (3.6), it is easy to check that these definitions of and satisfy the assumptions of Lemma 4.9. Hence the claim follows from Lemma 4.9 and (4.42). ∎
where in the second step we used (3.6). Summarizing, we have proved the self-improving estimate
From Proposition 4.2 we know that . Thus, for any , we iterate (4.43) an order times to get . This concludes the proof of the first bound of (3.18). The second bound of (3.18) follows from the first one and the identity (3.13).
Using Lemma 3.10, we rewrite the sum in the second term according to N^{-1}\sum_{\mu}R_{\mu\mu}^{(i)}=m_{R}+O\bigl{(}{(N\eta)^{-1}}\bigr{)}. Moreover, the third term is estimated exactly as in Lemma 4.4, using Lemma 3.1. Putting everything together yields
In particular, . The same argument applied to the matrix instead of yields . Thus we get from (3.9) that for we have
where the last step follows using (3.3), exactly as in the proof of Lemma 4.4, and (4.1). This concludes the proof of (4.2), and hence of Theorem 4.1.
3. Proof of Theorem 2.10
The proof of Theorem 2.10 is similar to that of Theorem 2.2 in EYY3 and Theorem 3.3 in PY . We therefore only sketch the argument. First we observe that, since the nontrivial eigenvalues of and coincide and
for all , it suffices to prove Theorem 2.10 for , i.e. .
The proof relies on the following key estimates.
Finally, if for some constant , then
Starting from Lemma 4.11, the proof of Theorem 2.10 is elementary. (The details are given e.g. on the last page of Section 5 in EYY3 .)
The estimate (4.44) is a standard consequence of (3.18), using Helffer-Sjöstrand functional calculus; see e.g. (EYY3, , Section 5).
What remains is the proof of (4.45) and (4.46). Here the argument from (PY, , Section 8) applies with trivial modifications. The key inputs in our case are (4.44), Lemma 4.5, (4.40), and Lemma 4.9 combined with Remark 4.10. We omit further details. ∎
The isotropic law: proof of Theorem 3.11
In this section we complete the proof of Theorem 3.11. Since (3.18) was proved in Section 4, we only need to prove (3.16) and (3.17). For definiteness, we give the details of the proof of (3.16); the proof of (3.17) is very similar, and the required modifications are outlined at the end of Section 5.15 below.
It is convenient to introduce the rescaled quantities
The motivation behind this definition is that
2. Reduction to off-diagonal entries
By linearity and polarization, in order to prove (3.16) it suffices to prove that
The rest of this section is devoted to the proof of (5.7).
3. Sketch of the proof
The basic reason why (5.7) holds is that can be expanded, to leading order, as a sum of independent random variables using the identity (3.9). To simplify the presentation in this sketch, we set , so that and the rescalings from Section 5.1 indicated by a tilde are trivial. Hence we drop all tildes. From (3.9) we get
If we could replace the diagonal entries by the deterministic value , it would suffice to estimate the sum . By the independence of the entries of we have, using (3.3),
The error made in the approximation is of order by (5.3), so that the corresponding error term on the right-hand side of (5.8) may be bounded using (3.3) by
We conclude that the simple replacement of with its deterministic approximation in (5.8) is not affordable. Not only the leading term but also every error term has to be expanded in the entries of . This expansion is most effectively controlled if performed within a high-moment estimate. Thus, for large and even we shall estimate
Before explaining the general strategy, we sketch a second moment calculation. First, we write
Using (3.7), we maximally expand all resolvent entries in the indices . This means that we use (3.7) repeatedly until each term in the expansion is independent of all Latin indices that do not explicitly appear among its lower indices; here an entry is independent of an index if that index is an upper index of the entry. This generates a series of maximally expanded terms, whereby a resolvent entry is by definition maximally expanded if we cannot add to it upper indices from the set by using the identity (3.7). In other words, is maximally expanded if and only if .
To illustrate this procedure, we assume temporarily that are all distinct, and write, using (3.7),
We get a similar expression for . We plug both of these expansions into (5.10) and multiply out the product. The leading term is
We now expand both resolvent entries using (3.9), which gives
The goal is to use the expectation to get a pairing (or a more general partition) of the entries of . In order to do that, we shall require all terms that are not entries of to be independent of the randomness in the rows of . While the entries of satisfy this condition, the entries of do not. We shall hence have to perform a further expansion on them using the identities (3.7) and (3.9). In fact, these two types of expansions will have to be performed in tandem, using a two-step recursive procedure. The main reason behind this is that even if all entries of are maximally expanded, each application of (3.9) produces a diagonal entry that is not maximally expanded; for such terms the expansion using (3.7) has to be repeated. For the purposes of this sketch, however, we omit the details of the further expansion of the entries of , and replace them with their deterministic leading order, (see (5.3)). This approximation gives
Since all entries of are independent of all entries of , we can compute the expectation with respect to the rows . Note that the only possible pairing is , , , and . This results in the expression
This calculation, while giving the right order, was in fact an oversimplification, since the expansion (5.11) required that and . The correct argument requires first a decomposition of the summation over into a finite number of terms, indexed by the partitions of four elements, according to the coincidences among these four indices. Thus, we write
where a star over the summation indicates that all summation indices that are not explicitly equal to each other have to be distinct. The above calculation leading to (5.12) is valid for the first summation of (5.13), whose contribution (up to leading order) is zero, since the only possible pairing contradicts the condition that the indices be all distinct. It is not too hard to see that, among the sums in (5.13), only the last one gives a nonzero contribution (up to leading order), and it is, going back to (5.10), equal to
Next, we consider a subleading term from the first summation in (5.13), which has three off-diagonal entries:
We proceed as before, expanding all off-diagonal entries of using (3.9). Up to leading order, we get
The expectation again renders this term zero if are distinct.
Based on these preliminary heuristics, we outline the main steps in estimating a high moment of .
Partition the indices in (5.9) according to their coincidence structure: indices in the same block of the partition are required to coincide and indices in different blocks are required to be distinct. This leads to a reduced family, , of distinct indices.
Make all entries of maximally expanded by repeatedly applying the identity (3.7). Roughly, this entails adding upper indices from the family to each entry of using the identity (3.7). We stop the iteration if either (3.7) cannot be applied to any entry of or we have generated a sufficiently large number of off-diagonal entries of .
Apply (3.9) to each maximally expanded off-diagonal entry of . This yields factors of the form with and is independent of all entries of by construction. In addition, this application of (3.9) produces new diagonal entries of that are not maximally expanded.
Repeat Steps 2 and 3 recursively in tandem until we only have a sum of terms whose factors consist of maximally expanded diagonal entries of , entries of , and entries of from the rows indexed by .
Apply (3.8) to each maximally expanded diagonal entry of . We end up with factors consisting only of entries of and entries of from the rows indexed by .
Using the fact that all entries of are independent of all entries of , take a partial expectation over the rows of indexed by the set ; this only involves the entries of . Only those terms give a nonzero contribution whose Greek indices have substantial coincidences.
Steps 1–6 require a careful expansion algorithm and a meticulous bookkeeping of the resulting terms. We shall develop a graphical language that encodes the resulting monomials. Expansion steps will be recorded via operations on graphs such as merging certain vertices or replacing some vertex or edge by a small subgraph. Several ingredients of the graphical representation and the concept of graph operations are inspired by tools from EKY2 developed for random band matrices. Once the appropriate graphical language is in place and the expansion algorithm has been constructed, the observations in Steps 7 and 8 will yield the desired estimate by a power counting coupled with a parity argument.
4. The p𝑝p-th moment of 𝒵𝒵\mathcal{Z} and introduction of graphs
We shall estimate with high probability by estimating its -th moment for a large but fixed . It is convenient to rename the summation variables in the definition of as . Let be an even integer and write
where we recall the definition of from (5.6).
We shall perform the summation by first fixing the partition and by deriving an upper bound that is uniform in ; at the very end we shall sum trivially over .
In order to handle expressions of the form (5.15), as well as more complicated ones required in later stages of the proof, we shall need to develop a graphical notation. The basic idea is to associate matrix indices with vertices and resolvent entries with edges. The following definition introduces graphs suitable for our purposes.
By a graph we mean a finite, directed, edge-coloured, multigraph
Here is a finite set of vertices, a finite set of directed edges, and is a “colouring of ”, i.e. a mapping from to some finite set of colours. The graph may have multiple edges and loops. More precisely, is some finite set with maps ; here and represent the source and target vertices of the edge . We denote by the degree of the vertex .
We may now express the right-hand side of (5.15) using graphs. Fix the partition . We associate a graph with as follows. The vertex set is given by the blocks of , i.e. . The set of colours, i.e. the range of , is (we emphasize that these two colours are simply formal symbols whose name is supposed to evoke their meaning). The set of edges is parametrized as follows by the resolvent entries on the right-hand side of (5.15). Each resolvent entry gives rise to an edge with colour if is nothing and if is . The source vertex of this edge is the unique block of satisfying , and its target vertex the unique block of satisfying . Figure 5.1 illustrates the construction of , where the two different types of line correspond to the two colours . The graph has no loops.
We record the following basic properties of .
has no loops, i.e. for all .
.
5. Generalized colours and encoding
We shall need to enlarge the set of colours of edges, so as to be able to encode entries of not only and , but also entries of , , , and ; in addition, we shall need to encode diagonal entries of and that are in the denominator, as in the formulas (3.7), as well as to keep track of upper indices. We need all of these factors, since our expansion relies on a repeated application of the identities (3.7), (3.8), and (3.9).
In order to define the graphs precisely, we consider graphs satisfying Definition 5.3 whose vertex set is partitioned into black vertices and white vertices . Informally, black vertices are incident to edges encoding entries of and , and white vertices to edges encoding entries of and . In other words, black vertices are associated with Latin summation indices in the population space ; white vertices are associated with Greek summation indices in the sample space . See Remark 3.4. We shall only consider graphs satisfying
an assumption we make throughout the following. This means that only new Greek summation indices but no new Latin indices are generated, corresponding to the repeated applications of (3.8) and (3.9). In particular, the vertex colouring for our graph is very simple: the vertices of are black and all other vertices are white.
We now list some properties of all graphs we shall consider. To that end, we call a -edge if , an -edge if , and an -edge if .
If is a -edge then .
If is an -edge then .
If then and .
If then and .
If then and .
If then and .
Properties (i)–(iv) are straightforward compatibility conditions which are obvious in light of the type of matrix entry that the edge encodes. Property (v) states that only diagonal entries of and may be in the denominator. Property (vi) states that only entries of or may have a (nontrivial) upper index and the lower indices of an entry of or may not coincide with its upper indices (by definition of minors).
For with we define the resolvent entry encoded by in as
When drawing graphs, we represent a black vertex as a black dot and a white vertex as a white dot. An edge with is represented as a solid directed line joining two black dots, and an edge with as a dashed directed line joining two black dots. If we indicate this by decorating the edge with a white diamond (not to be confused with a white dot). Notice that such edges are always loops, according to property (v). Sometimes we also indicate the component in our graphs, simply by writing it next to the edge . See Figure 5.2 for our graphical conventions when depicting edges with .
For the other edges, with , we set
When drawing graphs, we represent an edge with as a solid directed line joining two white vertices, an edge with as a dashed directed line joining two white vertices, an edge with as a dotted directed line from a black to a white vertex, and an edge with as a dotted directed line from a white to a black vertex. Note that we use the same line style to draw - and -edges, since the orientation of the edge together with the vertex colouring distinguishes them uniquely. See Figure 5.3 for an illustration of these conventions, and Figure 5.6 for an illustration of (5.28).
6. R𝑅R-groups
We define an -group to be an induced subgraph of consisting of three edges, , , , such that and are -edges and is an -edge, and they form a chain in the sense that , , and both of these vertices have degree two. We call the centre of the -group and define and . If we call the -group diagonal; otherwise we call it off-diagonal. See Figure 5.4 for an illustration.
We require that our graphs satisfy the following property.
Each -edge and -edge of belongs to some -group of . In particular, all white vertices have degree two, and an -group is uniquely determined by its centre.
The -groups constitute graphical representations of the monomials on the right-hand sides of (3.8) and (3.9). It is important to stress that there is no restriction on possible coincidences among the white-vertex indices ; this means that even if two Greek summation indices arising from two different applications (3.8) or (3.9) coincide, they will nevertheless be encoded by distinct white vertices. This allows us to keep the graphical structure involving and edges very simple.
Note that the initial graph trivially satisfies the properties (i)–(vii).
7. Maximally expanded edges and sketch of the expansion
The following definition introduces a notion that underlies our entire expansion. Note that it only applies to -edges.
The expansion relies of three main operations:
make one of the -entries maximally expanded by adding upper indices using the identity (3.7);
expand all off-diagonal maximally expanded -entries of in terms of using the identity (3.9);
expand all diagonal maximally expanded -entries in terms of using (3.8).
We shall implement each ingredient by a graph surgery procedure. Operation (a) is the subject of Section 5.8; it creates two new graphs, and , from an initial graph . Operation (b) is the subject of Section 5.9; it creates one new graph, , from an initial graph . As it turns out, Operations (a) and (b) have to be performed in tandem using a coupled recursion, described by a tree , which is the subject of Section 5.10. Once this recursion has terminated, Operation (c) may be performed (see Section 5.11).
In order to avoid trivial ambiguities, we choose and fix an arbitrary ordering of the vertices and of the family of resolvent entries . Hence we may speak of the first vertex of and the first factor of a monomial in the entries .
We now describe Operation (a) of the expansion. It relies on the identities
Moreover, it follows immediately that the maps and do not change the vertices, so that we have
The procedure may also be explicitly described on the level graphs alone, but we shall neither need nor do this. Instead, we give a graphical depiction of this process in Figure 5.5.
If satisfies the properties (i)–(vii) from Sections 5.5 and 5.6 then so do and .
9. Operation (b): construction of the graph ρ(Γ)𝜌Γ\rho(\Gamma)
In this section we give the second operation, (b), outlined in Section 5.7. The idea is that Operation (a) from Section 5.5 generates off-diagonal -entries that are maximally expanded. They in turn will have to be expanded further using (3.9), so as to extract their explicit -dependence. Roughly, the map replaces each maximally expanded off-diagonal -edge by an off-diagonal -group.
where denotes the complex conjugate of . Note that the first diagonal term on the right-hand side is not maximally expanded (while the second one is).
Like and , the map may be explicitly defined on the level of graphs, which we shall however not do in order to avoid unnecessary and heavy notation. See Figure 5.6 for an illustration of .
The following result is an immediate corollary of the definition of .
If satisfies the properties (i)–(vii) from Sections 5.5 and 5.6 then so does .
10. Constructing the tree 𝒯𝒯\mathcal{T}: recursion using (a) and (b)
The algorithm generates a family of graphs which are indexed by finite binary strings , or, equivalently, by vertices of a rooted binary tree . We start the algorithm with , corresponding to the empty string or the root of the tree. The tree is constructed recursively according to
and so on, until a stopping rule is satisfied (see Definition 5.7 below). See Figure 5.7 for an illustration of the resulting tree.
The construction of the tree relies on the following stopping rule.
The tree , along with the graphs , is constructed recursively from the trivial tree, consistsing of the single vertex with , as follows. Let be a leaf of the tree such that does not satisfy the stopping rule. We add the children of , i.e. and , to the tree, and set
We continue this recursion on each leaf until all leaves satisfy the stopping rule from Definition 5.7. By Lemma 5.9 below, the resulting tree is finite, i.e. the recursion terminates after a finite number of steps.
The graphs have the following two properties. First,
In particular, the set of black vertices remains unchanged throughout the recursion: . Second,
Moreover, each for satisfies the properties (i)–(vii) from Sections 5.5 and 5.6.
The identity (5.32) follows immediately from (5.27) and (5.30). Similarly, (5.33) follows from (5.26) and (5.29). The final statement follows immediately from Lemmas 5.5 and 5.6. ∎
The interpretation of (5.33) is that the value of any graph is equal to the sum of the values of its two children, and .
Next, we express from (5.17) in terms of the graphs we just introduced. By Lemma 5.8 and the fact that , we have for all that
Let denote the leaves of . The identity (5.33) states that if is not a leaf of , we may replace the value of by the sum of the values of its two children. Starting from the root and the graph , we may propagate this identity recursively from the root down to the leaves. We conclude that
Recalling the definition (5.17) of , we get the following result.
The quantity defined in (5.17) may be written in terms of the tree as
By Definition 5.7, if is a nontrivial leaf then all -edges of are diagonal and maximally expanded. The estimate of the nontrivial leaves will be performed in Sections 5.12–5.14.
11. The trivial leaves
In this section we estimate the contribution of for a trivial leaf . Thus, fix . From (5.28) and Lemma 5.2 we get for
We therefore conclude that each off-diagonal -group of yields a contribution of size after summation over the indices associated with the vertices incident to its centre. Moreover, by definition of , each -group of is off-diagonal. In addition, each off-diagonal -edge yields a contribution of size by Lemma 5.2. Thus we get, summing out all indices associated with white vertices (i.e. inner vertices of -groups),
Hence the contribution of to the right-hand side of (5.36) may be bounded by
For any there exists a constant such that for any graph and any we have
The cases and are dealt with the deterministic estimates
which follows from . The cases follow immediately from (2.3). Finally, the cases and follow easily from (3.8). ∎
Using Lemma 5.9, we therefore conclude that the contribution of all trivial leaves to the right-hand side of (5.36) is bounded by
Here we used the bound , which follows from the definitions (3.15), (2.11), and (3.5).
12. The nontrivial leaves I: Operation (c)
From now on we focus on the nontrivial leaves, . Our goal is to prove the following estimate, which is analogous to (5.38). Its proof will be the content of this and the two following subsections, and will be completed at the end of Section 5.14.
In order to handle entries in the numerator, we rewrite this identity in the form
This is our main expansion for the diagonal -entries in the numerator. Both formulas (5.40) and (5.42) have trivial analogues for the Hermitian conjugate .
Exactly as in Section 5.11, we may brutally estimate the contribution of the rest term on the right-hand side of (5.43) by
Hence, in order to complete the proof of Proposition 5.12, it suffices to prove that for all and all we have
As before, the map may be explicitly given on the level of graphs, but we refrain from doing so. Instead, we illustrate this process for some simple cases in Figure 5.8.
13. The nontrivial leaves II: taking the expectation
Let us now consider a nontrivial leaf . By definition of , all -edges of are diagonal and maximally expanded. Therefore, any does not contain any -edges. This was the goal of the expansion generated by Operations (a)–(c). Hence, each consists solely of -groups.
We recall from Property (vii) in Section 5.6 that each white vertex is adjacent in to a unique black vertex . For each we introduce a partition of the subset of white vertices , and constrain the values of the indices to be compatible with . On the level of graphs, such a partition amounts to merging vertices in . Abbreviate , and denote by the graph obtained from by merging, for each , the vertices adjacent to according to . Note that, like , each satisfies the properties (i)–(vi) from Section 5.5, but, unlike , in general does not satisfy the property (vii) from Section 5.6. See Figure 5.9 for an illustration of the mapping .
which constrains the summation indices associated with different white vertices adjacent to the same black vertex to have different values. By definition of , we therefore have
and abbreviated for the set of -edges and for the set of -edges incident to . Here we used the independence described above.
Note that by definition of we have and for all . For the following we therefore drop the argument of . Define the subset
For let denote the number of vertices of adjacent to (these are all white since there are no -edges in , which are the only edges that join two black vertices).
Recalling (5.46), we assume without loss of generality that, for each , eack block of has size at least two; in particular, we assume that for each we have . From (5.46) we get
By definition, and leave invariant, and increases by or . In particular, they all leave the parity of invariant for . We conclude that is odd for each . Since each block of has size at least two, we find that
The proof is then completed by the following claim.
If for all then
What remains is to prove (5.47). Since has edges, we find
As observed above, and leave invariant, and increases by or . Let . Since by assumption , we find that in fact . This yields
Recall the quantity from (5.31), defined as the number of off-diagonal -edges plus the number of off-diagonal -groups. By definition of , . Moreover, , , and do not decrease . Since by construction has no -entries, we conclude that has at least off-diagonal -groups. We may therefore choose a set of size at least , such that each is the centre of an off-diagonal -group (see Section 5.6). The set is naturally mapped into , and is denoted by . We denote by and the end points of in . By (5.4), we have
As in Section 5.11, it is easy to take the expectation using Lemma 3.2 to get
where the last step follows from the fact that, by definition of , for all , as well as the estimate
Summing over concludes the proof of Proposition 5.12.
15. Conclusion of the proof of Theorem 3.11
Combining (5.38) and Proposition 5.12, and recalling (5.36) and (5.16), yieds
Now (5.7), and hence (3.16), follows by a simple application of Chebyshev’s inequality. Let and be given. Then
for . This, together with Remark 2.2 which allows us to interchange and in Definition 2.1, concludes the proof of (3.16).
Finally, we outline the proof of (3.17), which is very similar to that of (3.16). The expansion of Sections 5.4–5.12 may be taken over by swapping the roles of and . In other words, we use Lemma 3.8 instead of Lemma 3.6. The arguments from Sections 5.13 and 5.14 carry over with straightforward adjustments in the power counting of Section 5.14. We leave the details to the interested reader. This concludes the proof of Theorem 3.11.
Proof of Theorems 3.12 and 3.13
We only prove (3.19); the proof of (3.20) is the same, using (3.17) instead of (3.16). Moreover, to simplify notation, we assume that ; the case is handled in exactly the same way.
Note first that if then it is easy to see that (3.19) follows from (3.16), (3.6), and the lower bound . For the following we therefore assume that . By Lemma 3.3, for we have
By polarization and linearity, it therefore suffices to prove that
Since (6.1) holds at by (3.16), it is enough to prove the estimates
What remains is to prove (6.3). By Theorem 2.10 we have with high probability since . Therefore, since for all , we get
as follows from (3.6) and the estimate .
Finally, we estimate the real part of the error in (6.3) using
with high probability, where in the last step we used that with high probability. Combining (6.4) and (6.5) completes the proof of (6.3), and hence of Theorem 3.12. ∎
Proofs for generalized Wigner matrices
In this section we explain how to modify the arguments of Sections 3–6 to the case of generalized Wigner matrices, and hence how to complete the proof of the results from Section 2.2. Since we are dealing with generalized Wigner matrices, in this section we consistently use the notations from Section 2.2 instead of Section 2.1.
the distance from to the spectral edges .
For we have
(All implicit constants depend on .)
The proof is an elementary calculation; see Lemma 4.2 in EYY2 . ∎
The following definition is the analogue of Definitions 3.5 and 3.7. (Note that for generalized Wigner matrices we always simultaneously remove a row and the corresponding column.)
For we define by
Moreover, for we define the resolvent of the minor through
When , we abbreviate by in the above definitions; similarly, we write instead of .
We shall also need the following resolvent identities, proved in Lemma 4.2 of EYY1 and Lemma 6.10 of EKYY2 .
For and the identity (3.7) holds. Moreover, for and we have
Finally, for we have Schur’s formula
From (7.3) we find for and that
2. The isotropic law: proof of Theorem 2.12
As in (5.7), and using (2.28) instead of (4.2), it suffices to prove that
The quadratic term in the expansion of and contains an entry of and not of . (The matrix is not even defined for generalized Wigner matrices.)
Both (7.4) and (7.5) contain an additional term, an entry of .
Of these differences, the first one is minor. In order to mimic the bookkepping of Section 5, we still speak of black and white vertices. The simplest definition of our colouring is that the vertices of are black and any other vertices that were added to are white; see the explanation below (5.20). The second difference leads to a slightly larger class of graphs, but the new graphs will always be of subleading order. An alternative viewpoint is that the additional entry of on the right-hand side of (7.4) and (7.5) should be regarded as a negligible error term. Almost all of the differences highlighted below stem from this additional term.
We now sketch the argument for each of the eight steps, by highlighting the changes as compared to Section 5.
This concludes sketch of how the argument of Section 5 is to be modified for the proof of Theorem 2.12. We omit further details. Finally, Theorems 2.15 and 2.16 follow from Theorem 2.12 by repeating the arguments of Section 6 almost to the letter.