Menu
Home Explore People Places Arts History Plants & Animals Science Life & Culture Technology
On this page
Kendall rank correlation coefficient
Statistic for rank correlation

The Kendall rank correlation coefficient, or Kendall's τ (τ, tau), is a statistic that measures the ordinal association between two variables by assessing the similarity of their rankings. Developed by Maurice Kendall in 1938, this non-parametric method is used in a hypothesis test for statistical dependence. A high Kendall's τ indicates similar ranks, while a low value reflects dissimilar orderings. Alongside Spearman’s ρ, it relates to a general correlation coefficient framework. Its concepts of concordance and discordance are also used in metrics like the Rand index in cluster analysis.

We don't have any images related to Kendall rank correlation coefficient yet.
We don't have any YouTube videos related to Kendall rank correlation coefficient yet.
We don't have any PDF documents related to Kendall rank correlation coefficient yet.
We don't have any Books related to Kendall rank correlation coefficient yet.
We don't have any archived web articles related to Kendall rank correlation coefficient yet.

Definition

Let ( x 1 , y 1 ) , . . . , ( x n , y n ) {\displaystyle (x_{1},y_{1}),...,(x_{n},y_{n})} be a set of observations of the joint random variables X and Y, such that all the values of ( x i {\displaystyle x_{i}} ) and ( y i {\displaystyle y_{i}} ) are unique. (See the section #Accounting for ties for ways of handling non-unique values.) Any pair of observations ( x i , y i ) {\displaystyle (x_{i},y_{i})} and ( x j , y j ) {\displaystyle (x_{j},y_{j})} , where i < j {\displaystyle i<j} , are said to be concordant if the sort order of ( x i , x j ) {\displaystyle (x_{i},x_{j})} and ( y i , y j ) {\displaystyle (y_{i},y_{j})} agrees: that is, if either both x i > x j {\displaystyle x_{i}>x_{j}} and y i > y j {\displaystyle y_{i}>y_{j}} holds or both x i < x j {\displaystyle x_{i}<x_{j}} and y i < y j {\displaystyle y_{i}<y_{j}} ; otherwise they are said to be discordant.

In the absence of ties, the Kendall τ coefficient is defined as:

τ = ( number of concordant pairs ) − ( number of discordant pairs ) ( number of pairs ) = 1 − 2 ( number of discordant pairs ) ( n 2 ) . {\displaystyle \tau ={\frac {({\text{number of concordant pairs}})-({\text{number of discordant pairs}})}{({\text{number of pairs}})}}=1-{\frac {2({\text{number of discordant pairs}})}{n \choose 2}}.} 3

for i < j < n {\displaystyle i<j<n} where ( n 2 ) = n ( n − 1 ) 2 {\displaystyle {n \choose 2}={n(n-1) \over 2}} is the binomial coefficient for the number of ways to choose two items from n items.

The number of discordant pairs is equal to the inversion number that permutes the y-sequence into the same order as the x-sequence.

Properties

The denominator is the total number of pair combinations, so the coefficient must be in the range −1 ≤ τ ≤ 1.

  • If the agreement between the two rankings is perfect (i.e., the two rankings are the same) the coefficient has value 1.
  • If the disagreement between the two rankings is perfect (i.e., one ranking is the reverse of the other) the coefficient has value −1.
  • If X and Y are independent random variables and not constant, then the expectation of the coefficient is zero.
  • An explicit expression for Kendall's rank coefficient is τ = 2 n ( n − 1 ) ∑ i < j sgn ⁡ ( x i − x j ) sgn ⁡ ( y i − y j ) {\displaystyle \tau ={\frac {2}{n(n-1)}}\sum _{i<j}\operatorname {sgn}(x_{i}-x_{j})\operatorname {sgn}(y_{i}-y_{j})} .

Hypothesis test

The Kendall rank coefficient is often used as a test statistic in a statistical hypothesis test to establish whether two variables may be regarded as statistically dependent. This test is non-parametric, as it does not rely on any assumptions on the distributions of X or Y or the distribution of (X,Y).

Under the null hypothesis of independence of X and Y, the sampling distribution of τ has an expected value of zero. The precise distribution cannot be characterized in terms of common distributions, but may be calculated exactly for small samples; for larger samples, it is common to use an approximation to the normal distribution, with mean zero and variance 2 ( 2 n + 5 ) / 9 n ( n − 1 ) {\textstyle 2(2n+5)/9n(n-1)} .4

Theorem. If the samples are independent, then the variance of τ A {\textstyle \tau _{A}} is given by V a r [ τ A ] = 2 ( 2 n + 5 ) / 9 n ( n − 1 ) {\textstyle Var[\tau _{A}]=2(2n+5)/9n(n-1)} .

Asymptotic normality—At the n → ∞ {\textstyle n\to \infty } limit, z A = τ A V a r [ τ A ] = n C − n D n ( n − 1 ) ( 2 n + 5 ) / 18 {\textstyle z_{A}={\frac {\tau _{A}}{\sqrt {Var[\tau _{A}]}}}={n_{C}-n_{D} \over {\sqrt {n(n-1)(2n+5)/18}}}} converges in distribution to the standard normal distribution.

Proof

Use a result from A class of statistics with asymptotically normal distribution Hoeffding (1948).5

Case of standard normal distributions

If ( x 1 , y 1 ) , ( x 2 , y 2 ) , . . . , ( x n , y n ) {\textstyle (x_{1},y_{1}),(x_{2},y_{2}),...,(x_{n},y_{n})} are IID samples from the same jointly normal distribution with a known Pearson correlation coefficient r {\textstyle r} , then the expectation of Kendall rank correlation has a closed-form formula.6

Greiner's equality—If X , Y {\textstyle X,Y} are jointly normal, with correlation r {\textstyle r} , then r = sin ⁡ ( π 2 E [ τ A ] ) {\displaystyle r=\sin {\left({\frac {\pi }{2}}E[\tau _{A}]\right)}}

The name is credited to Richard Greiner (1909)7 by P. A. P. Moran.8

Accounting for ties

A pair { ( x i , y i ) , ( x j , y j ) } {\displaystyle \{(x_{i},y_{i}),(x_{j},y_{j})\}} is said to be tied if and only if x i = x j {\displaystyle x_{i}=x_{j}} or y i = y j {\displaystyle y_{i}=y_{j}} ; a tied pair is neither concordant nor discordant. When tied pairs arise in the data, the coefficient may be modified in a number of ways to keep it in the range [−1, 1]:

Tau-a

The Tau statistic defined by Kendall in 19389 was retrospectively renamed Tau-a. It represents the strength of positive or negative association of two quantitative or ordinal variables without any adjustment for ties. It is defined as:

τ A = n c − n d n 0 {\displaystyle \tau _{A}={\frac {n_{c}-n_{d}}{n_{0}}}}

where nc, nd and n0 are defined as in the next section.

When ties are present, n c + n d < n 0 {\displaystyle n_{c}+n_{d}<n_{0}} and, the coefficient can never be equal to +1 or −1. Even a perfect equality of the two variables (X=Y) leads to a Tau-a < 1.

Tau-b

The Tau-b statistic, unlike Tau-a, makes adjustments for ties. This Tau-b was first described by Kendall in 1945 under the name Tau-w10 as an extension of the original Tau statistic supporting ties. Values of Tau-b range from −1 (100% negative association, or perfect disagreement) to +1 (100% positive association, or perfect agreement). In case of the absence of association, Tau-b is equal to zero.

The Kendall Tau-b coefficient is defined as :

τ B = n c − n d ( n 0 − n 1 ) ( n 0 − n 2 ) {\displaystyle \tau _{B}={\frac {n_{c}-n_{d}}{\sqrt {(n_{0}-n_{1})(n_{0}-n_{2})}}}}

where

n 0 = n ( n − 1 ) / 2 n 1 = ∑ i t i ( t i − 1 ) / 2 n 2 = ∑ j u j ( u j − 1 ) / 2 n c = Number of concordant pairs, i.e. pairs with  0 < i < j < n  where  x i < x j  and  y i < y j  or  x i > x j  and  y i > y j n d = Number of discordant, i.e. pairs where  0 < i < j < n  where  x i < x j  and  y i > y j  or  x i < x j  and  y i > y j t i = Number of tied values in the  i th  group of ties for the empirical distribution of X u j = Number of tied values in the  j th  group of ties for the empirical distribution of Y {\displaystyle {\begin{aligned}n_{0}&=n(n-1)/2\\n_{1}&=\sum _{i}t_{i}(t_{i}-1)/2\\n_{2}&=\sum _{j}u_{j}(u_{j}-1)/2\\n_{c}&={\text{Number of concordant pairs, i.e. pairs with }}0<i<j<n{\text{ where }}x_{i}<x_{j}{\text{ and }}y_{i}<y_{j}{\text{ or }}x_{i}>x_{j}{\text{ and }}y_{i}>y_{j}\\n_{d}&={\text{Number of discordant, i.e. pairs where }}0<i<j<n{\text{ where }}x_{i}<x_{j}{\text{ and }}y_{i}>y_{j}{\text{ or }}x_{i}<x_{j}{\text{ and }}y_{i}>y_{j}\\t_{i}&={\text{Number of tied values in the }}i^{\text{th}}{\text{ group of ties for the empirical distribution of X}}\\u_{j}&={\text{Number of tied values in the }}j^{\text{th}}{\text{ group of ties for the empirical distribution of Y}}\end{aligned}}}

A simple algorithm developed in BASIC computes Tau-b coefficient using an alternative formula.11

Be aware that some statistical packages, e.g. SPSS, use alternative formulas for computational efficiency, with double the 'usual' number of concordant and discordant pairs.12

Tau-c

Tau-c (also called Stuart-Kendall Tau-c)13 was first defined by Stuart in 1953.14 Contrary to Tau-b, Tau-c can be equal to +1 or −1 for non-square (i.e. rectangular) contingency tables,1516 i.e. when the underlying scale of both variables have different number of possible values. For instance, if the variable X has a continuous uniform distribution between 0 and 100 and Y is a dichotomous variable equal to 1 if X ≥ 50 and 0 if X < 50, the Tau-c statistic of X and Y is equal to 1 while Tau-b is equal to 0.707. A Tau-c equal to 1 can be interpreted as the best possible positive correlation conditional to marginal distributions while a Tau-b equal to 1 can be interpreted as the perfect positive monotonic correlation where the distribution of X conditional to Y has zero variance and the distribution of Y conditional to X has zero variance so that a bijective function f with f(X)=Y exists.

The Stuart-Kendall Tau-c coefficient is defined as:17

τ C = 2 ( n c − n d ) n 2 ( m − 1 ) m = τ A n − 1 n m m − 1 {\displaystyle \tau _{C}={\frac {2(n_{c}-n_{d})}{n^{2}{\frac {(m-1)}{m}}}}=\tau _{A}{\frac {n-1}{n}}{\frac {m}{m-1}}}

where

n c = Number of concordant pairs n d = Number of discordant pairs r = Number of rows of the contingency table (i.e. number of distinct  x i ) c = Number of columns of the contingency table (i.e. number of distinct  y i ) m = min ( r , c ) {\displaystyle {\begin{aligned}n_{c}&={\text{Number of concordant pairs}}\\n_{d}&={\text{Number of discordant pairs}}\\r&={\text{Number of rows of the contingency table (i.e. number of distinct }}x_{i}{\text{)}}\\c&={\text{Number of columns of the contingency table (i.e. number of distinct }}y_{i}{\text{)}}\\m&=\min(r,c)\end{aligned}}}

Significance tests

When two quantities are statistically dependent, the distribution of τ {\displaystyle \tau } is not easily characterizable in terms of known distributions. However, for τ A {\displaystyle \tau _{A}} the following statistic, z A {\displaystyle z_{A}} , is approximately distributed as a standard normal when the variables are statistically independent:

z A = n c − n d 1 18 v 0 {\displaystyle z_{A}={n_{c}-n_{d} \over {\sqrt {{\frac {1}{18}}v_{0}}}}}

where v 0 = n ( n − 1 ) ( 2 n + 5 ) {\displaystyle v_{0}=n(n-1)(2n+5)} .

Thus, to test whether two variables are statistically dependent, one computes z A {\displaystyle z_{A}} , and finds the cumulative probability for a standard normal distribution at − | z A | {\displaystyle -|z_{A}|} . For a 2-tailed test, multiply that number by two to obtain the p-value. If the p-value is below a given significance level, one rejects the null hypothesis (at that significance level) that the quantities are statistically independent.

Numerous adjustments should be added to z A {\displaystyle z_{A}} when accounting for ties. The following statistic, z B {\displaystyle z_{B}} , has the same distribution as the τ B {\displaystyle \tau _{B}} distribution, and is again approximately equal to a standard normal distribution when the quantities are statistically independent:

z B = n c − n d v {\displaystyle z_{B}={n_{c}-n_{d} \over {\sqrt {v}}}}

where

v = 1 18 v 0 − ( v t + v u ) / 18 + ( v 1 + v 2 ) v 0 = n ( n − 1 ) ( 2 n + 5 ) v t = ∑ i t i ( t i − 1 ) ( 2 t i + 5 ) v u = ∑ j u j ( u j − 1 ) ( 2 u j + 5 ) v 1 = ∑ i t i ( t i − 1 ) ∑ j u j ( u j − 1 ) / ( 2 n ( n − 1 ) ) v 2 = ∑ i t i ( t i − 1 ) ( t i − 2 ) ∑ j u j ( u j − 1 ) ( u j − 2 ) / ( 9 n ( n − 1 ) ( n − 2 ) ) {\displaystyle {\begin{array}{ccl}v&=&{\frac {1}{18}}v_{0}-(v_{t}+v_{u})/18+(v_{1}+v_{2})\\v_{0}&=&n(n-1)(2n+5)\\v_{t}&=&\sum _{i}t_{i}(t_{i}-1)(2t_{i}+5)\\v_{u}&=&\sum _{j}u_{j}(u_{j}-1)(2u_{j}+5)\\v_{1}&=&\sum _{i}t_{i}(t_{i}-1)\sum _{j}u_{j}(u_{j}-1)/(2n(n-1))\\v_{2}&=&\sum _{i}t_{i}(t_{i}-1)(t_{i}-2)\sum _{j}u_{j}(u_{j}-1)(u_{j}-2)/(9n(n-1)(n-2))\end{array}}}

This is sometimes referred to as the Mann-Kendall test.18

Algorithms

The direct computation of the numerator n c − n d {\displaystyle n_{c}-n_{d}} , involves two nested iterations, as characterized by the following pseudocode:

numer := 0 for i := 2..N do for j := 1..(i − 1) do numer := numer + sign(x[i] − x[j]) × sign(y[i] − y[j]) return numer

Although quick to implement, this algorithm is O ( n 2 ) {\displaystyle O(n^{2})} in complexity and becomes very slow on large samples. A more sophisticated algorithm19 built upon the Merge Sort algorithm can be used to compute the numerator in O ( n ⋅ log ⁡ n ) {\displaystyle O(n\cdot \log {n})} time.

Begin by ordering your data points sorting by the first quantity, x {\displaystyle x} , and secondarily (among ties in x {\displaystyle x} ) by the second quantity, y {\displaystyle y} . With this initial ordering, y {\displaystyle y} is not sorted, and the core of the algorithm consists of computing how many steps a Bubble Sort would take to sort this initial y {\displaystyle y} . An enhanced Merge Sort algorithm, with O ( n log ⁡ n ) {\displaystyle O(n\log n)} complexity, can be applied to compute the number of swaps, S ( y ) {\displaystyle S(y)} , that would be required by a Bubble Sort to sort y i {\displaystyle y_{i}} . Then the numerator for τ {\displaystyle \tau } is computed as:

n c − n d = n 0 − n 1 − n 2 + n 3 − 2 S ( y ) , {\displaystyle n_{c}-n_{d}=n_{0}-n_{1}-n_{2}+n_{3}-2S(y),}

where n 3 {\displaystyle n_{3}} is computed like n 1 {\displaystyle n_{1}} and n 2 {\displaystyle n_{2}} , but with respect to the joint ties in x {\displaystyle x} and y {\displaystyle y} .

A Merge Sort partitions the data to be sorted, y {\displaystyle y} into two roughly equal halves, y l e f t {\displaystyle y_{\mathrm {left} }} and y r i g h t {\displaystyle y_{\mathrm {right} }} , then sorts each half recursive, and then merges the two sorted halves into a fully sorted vector. The number of Bubble Sort swaps is equal to:

S ( y ) = S ( y l e f t ) + S ( y r i g h t ) + M ( Y l e f t , Y r i g h t ) {\displaystyle S(y)=S(y_{\mathrm {left} })+S(y_{\mathrm {right} })+M(Y_{\mathrm {left} },Y_{\mathrm {right} })}

where Y l e f t {\displaystyle Y_{\mathrm {left} }} and Y r i g h t {\displaystyle Y_{\mathrm {right} }} are the sorted versions of y l e f t {\displaystyle y_{\mathrm {left} }} and y r i g h t {\displaystyle y_{\mathrm {right} }} , and M ( ⋅ , ⋅ ) {\displaystyle M(\cdot ,\cdot )} characterizes the Bubble Sort swap-equivalent for a merge operation. M ( ⋅ , ⋅ ) {\displaystyle M(\cdot ,\cdot )} is computed as depicted in the following pseudo-code:

function M(L[1..n], R[1..m]) is i := 1 j := 1 nSwaps := 0 while i ≤ n and j ≤ m do if R[j] < L[i] then nSwaps := nSwaps + n − i + 1 j := j + 1 else i := i + 1 return nSwaps

A side effect of the above steps is that you end up with both a sorted version of x {\displaystyle x} and a sorted version of y {\displaystyle y} . With these, the factors t i {\displaystyle t_{i}} and u j {\displaystyle u_{j}} used to compute τ B {\displaystyle \tau _{B}} are easily obtained in a single linear-time pass through the sorted arrays.

Approximating Kendall rank correlation from a stream

Efficient algorithms for calculating the Kendall rank correlation coefficient as per the standard estimator have O ( n ⋅ log ⁡ n ) {\displaystyle O(n\cdot \log {n})} time complexity. However, these algorithms necessitate the availability of all data to determine observation ranks, posing a challenge in sequential data settings where observations are revealed incrementally. Fortunately, algorithms do exist to estimate the Kendall rank correlation coefficient in sequential settings.2021 These algorithms have O ( 1 ) {\displaystyle O(1)} update time and space complexity, scaling efficiently with the number of observations. Consequently, when processing a batch of n {\displaystyle n} observations, the time complexity becomes O ( n ) {\displaystyle O(n)} , while space complexity remains a constant O ( 1 ) {\displaystyle O(1)} .

The first such algorithm22 presents an approximation to the Kendall rank correlation coefficient based on coarsening the joint distribution of the random variables. Non-stationary data is treated via a moving window approach. This algorithm23 is simple and is able to handle discrete random variables along with continuous random variables without modification.

The second algorithm24 is based on Hermite series estimators and utilizes an alternative estimator for the exact Kendall rank correlation coefficient i.e. for the probability of concordance minus the probability of discordance of pairs of bivariate observations. This alternative estimator also serves as an approximation to the standard estimator. This algorithm25 is only applicable to continuous random variables, but it has demonstrated superior accuracy and potential speed gains compared to the first algorithm described,26 along with the capability to handle non-stationary data without relying on sliding windows. An efficient implementation of the Hermite series based approach is contained in the R package package hermiter.27

Software Implementations

  • R implements the test for τ B {\displaystyle \tau _{B}} cor.test(x, y, method = "kendall") in its "stats" package (also cor(x, y, method = "kendall") will work, but the latter does not return the p-value). All three versions of the coefficient are available in the "DescTools" package along with the confidence intervals: KendallTauA(x,y,conf.level=0.95) for τ A {\displaystyle \tau _{A}} , KendallTauB(x,y,conf.level=0.95) for τ B {\displaystyle \tau _{B}} , StuartTauC(x,y,conf.level=0.95) for τ C {\displaystyle \tau _{C}} . Fast batch estimates of the Kendall rank correlation coefficient along with sequential estimates are provided for in the package hermiter.28
  • For Python, the SciPy library implements the computation of τ B {\displaystyle \tau _{B}} in scipy.stats.kendalltau
  • In Stata is implemeted as ktau varlist.

See also

  • Mathematics portal

Further reading

References

  1. Kendall, M. G. (1938). "A New Measure of Rank Correlation". Biometrika. 30 (1–2): 81–89. doi:10.1093/biomet/30.1-2.81. JSTOR 2332226. /wiki/Biometrika

  2. Kruskal, W. H. (1958). "Ordinal Measures of Association". Journal of the American Statistical Association. 53 (284): 814–861. doi:10.2307/2281954. JSTOR 2281954. MR 0100941. /wiki/William_Kruskal

  3. Nelsen, R.B. (2001) [1994], "Kendall tau metric", Encyclopedia of Mathematics, EMS Press https://www.encyclopediaofmath.org/index.php?title=Kendall_tau_metric

  4. Prokhorov, A.V. (2001) [1994], "Kendall coefficient of rank correlation", Encyclopedia of Mathematics, EMS Press https://www.encyclopediaofmath.org/index.php?title=Kendall_coefficient_of_rank_correlation

  5. Hoeffding, Wassily (1992), Kotz, Samuel; Johnson, Norman L. (eds.), "A Class of Statistics with Asymptotically Normal Distribution", Breakthroughs in Statistics: Foundations and Basic Theory, Springer Series in Statistics, New York, NY: Springer, pp. 308–334, doi:10.1007/978-1-4612-0919-5_20, ISBN 978-1-4612-0919-5, retrieved 2024-01-19 978-1-4612-0919-5

  6. Kendall, M. G. (1949). "Rank and Product-Moment Correlation". Biometrika. 36 (1/2): 177–193. doi:10.2307/2332540. ISSN 0006-3444. JSTOR 2332540. PMID 18132091. https://www.jstor.org/stable/2332540

  7. Richard Greiner, (1909), Ueber das Fehlersystem der Kollektiv-maßlehre, Zeitschrift für Mathematik und Physik, Band 57, B. G. Teubner, Leipzig, pages 121-158, 225-260, 337-373.

  8. Moran, P. A. P. (1948). "Rank Correlation and Product-Moment Correlation". Biometrika. 35 (1/2): 203–206. doi:10.2307/2332641. ISSN 0006-3444. JSTOR 2332641. PMID 18867425. https://www.jstor.org/stable/2332641

  9. Kendall, M. G. (1938). "A New Measure of Rank Correlation". Biometrika. 30 (1–2): 81–89. doi:10.1093/biomet/30.1-2.81. JSTOR 2332226. /wiki/Biometrika

  10. Kendall, M. G. (1945). "The Treatment of Ties in Ranking Problems". Biometrika. 33 (3): 239–251. doi:10.2307/2332303. PMID 21006841. Retrieved 12 November 2024. http://www.jstor.org/stable/2332303

  11. Alfred Brophy (1986). "An algorithm and program for calculation of Kendall's rank correlation coefficient" (PDF). Behavior Research Methods, Instruments, & Computers. 18: 45–46. doi:10.3758/BF03200993. S2CID 62601552. https://link.springer.com/content/pdf/10.3758/BF03200993.pdf

  12. IBM (2016). IBM SPSS Statistics 24 Algorithms. IBM. p. 168. Retrieved 31 August 2017. http://www-01.ibm.com/support/docview.wss?uid=swg27047033#en

  13. Berry, K. J.; Johnston, J. E.; Zahran, S.; Mielke, P. W. (2009). "Stuart's tau measure of effect size for ordinal variables: Some methodological considerations". Behavior Research Methods. 41 (4): 1144–1148. doi:10.3758/brm.41.4.1144. PMID 19897822. https://doi.org/10.3758%2Fbrm.41.4.1144

  14. Stuart, A. (1953). "The Estimation and Comparison of Strengths of Association in Contingency Tables". Biometrika. 40 (1–2): 105–110. doi:10.2307/2333101. JSTOR 2333101. /wiki/Biometrika

  15. Berry, K. J.; Johnston, J. E.; Zahran, S.; Mielke, P. W. (2009). "Stuart's tau measure of effect size for ordinal variables: Some methodological considerations". Behavior Research Methods. 41 (4): 1144–1148. doi:10.3758/brm.41.4.1144. PMID 19897822. https://doi.org/10.3758%2Fbrm.41.4.1144

  16. Stuart, A. (1953). "The Estimation and Comparison of Strengths of Association in Contingency Tables". Biometrika. 40 (1–2): 105–110. doi:10.2307/2333101. JSTOR 2333101. /wiki/Biometrika

  17. Stuart, A. (1953). "The Estimation and Comparison of Strengths of Association in Contingency Tables". Biometrika. 40 (1–2): 105–110. doi:10.2307/2333101. JSTOR 2333101. /wiki/Biometrika

  18. Valz, Paul D.; McLeod, A. Ian; Thompson, Mary E. (February 1995). "Cumulant Generating Function and Tail Probability Approximations for Kendall's Score with Tied Rankings". The Annals of Statistics. 23 (1): 144–160. doi:10.1214/aos/1176324460. ISSN 0090-5364. https://doi.org/10.1214%2Faos%2F1176324460

  19. Knight, W. (1966). "A Computer Method for Calculating Kendall's Tau with Ungrouped Data". Journal of the American Statistical Association. 61 (314): 436–439. doi:10.2307/2282833. JSTOR 2282833. /wiki/Journal_of_the_American_Statistical_Association

  20. Xiao, W. (2019). "Novel Online Algorithms for Nonparametric Correlations with Application to Analyze Sensor Data". 2019 IEEE International Conference on Big Data (Big Data). pp. 404–412. doi:10.1109/BigData47090.2019.9006483. ISBN 978-1-7281-0858-2. S2CID 211298570. 978-1-7281-0858-2

  21. Stephanou, M. and Varughese, M (2023). "Hermiter: R package for sequential nonparametric estimation". Computational Statistics. arXiv:2111.14091. doi:10.1007/s00180-023-01382-0. S2CID 244715035.{{cite journal}}: CS1 maint: multiple names: authors list (link) /wiki/ArXiv_(identifier)

  22. Xiao, W. (2019). "Novel Online Algorithms for Nonparametric Correlations with Application to Analyze Sensor Data". 2019 IEEE International Conference on Big Data (Big Data). pp. 404–412. doi:10.1109/BigData47090.2019.9006483. ISBN 978-1-7281-0858-2. S2CID 211298570. 978-1-7281-0858-2

  23. Xiao, W. (2019). "Novel Online Algorithms for Nonparametric Correlations with Application to Analyze Sensor Data". 2019 IEEE International Conference on Big Data (Big Data). pp. 404–412. doi:10.1109/BigData47090.2019.9006483. ISBN 978-1-7281-0858-2. S2CID 211298570. 978-1-7281-0858-2

  24. Stephanou, M. and Varughese, M (2023). "Hermiter: R package for sequential nonparametric estimation". Computational Statistics. arXiv:2111.14091. doi:10.1007/s00180-023-01382-0. S2CID 244715035.{{cite journal}}: CS1 maint: multiple names: authors list (link) /wiki/ArXiv_(identifier)

  25. Stephanou, M. and Varughese, M (2023). "Hermiter: R package for sequential nonparametric estimation". Computational Statistics. arXiv:2111.14091. doi:10.1007/s00180-023-01382-0. S2CID 244715035.{{cite journal}}: CS1 maint: multiple names: authors list (link) /wiki/ArXiv_(identifier)

  26. Xiao, W. (2019). "Novel Online Algorithms for Nonparametric Correlations with Application to Analyze Sensor Data". 2019 IEEE International Conference on Big Data (Big Data). pp. 404–412. doi:10.1109/BigData47090.2019.9006483. ISBN 978-1-7281-0858-2. S2CID 211298570. 978-1-7281-0858-2

  27. Stephanou, M. and Varughese, M (2023). "Hermiter: R package for sequential nonparametric estimation". Computational Statistics. arXiv:2111.14091. doi:10.1007/s00180-023-01382-0. S2CID 244715035.{{cite journal}}: CS1 maint: multiple names: authors list (link) /wiki/ArXiv_(identifier)

  28. Stephanou, M. and Varughese, M (2023). "Hermiter: R package for sequential nonparametric estimation". Computational Statistics. arXiv:2111.14091. doi:10.1007/s00180-023-01382-0. S2CID 244715035.{{cite journal}}: CS1 maint: multiple names: authors list (link) /wiki/ArXiv_(identifier)