NAS Parallel Benchmarks

<h2 id="history">History</h2>
<h3>Motivation</h3>
Traditional benchmarks that existed before NPB, such as the <a href="/facts/Livermore_loops/6wxHzlxv">Livermore loops</a>, the <a href="/facts/LINPACK/2VtBJ2va">LINPACK Benchmark</a> and the <a href="http://www.netlib.org/benchmark/nas">NAS Kernel Benchmark Program</a>, were usually specialized for vector computers. They generally suffered from inadequacies including parallelism-impeding tuning restrictions and insufficient problem sizes, which rendered them inappropriate for highly parallel systems. Equally unsuitable were full-scale application benchmarks due to high porting cost and unavailability of automatic software parallelization tools.<a class="footnote-ref" id="fnref:2" href="#fn:2">2</a> As a result, NPB were developed in 1991<a class="footnote-ref" id="fnref:3" href="#fn:3">3</a> and released in 1992<a class="footnote-ref" id="fnref:4" href="#fn:4">4</a> to address the ensuing lack of benchmarks applicable to highly parallel machines.

<h3>NPB 1</h3>
The first specification of NPB recognized that the benchmarks should feature

<ul><li>new parallel-aware algorithmic and software methods,</li>
<li>genericness and architecture neutrality,</li>
<li>easy verifiability of correctness of results and performance figures,</li>
<li>capability of accommodating new systems with increased power,</li>
<li>and ready distributability.</li></ul>
In the light of these guidelines, it was deemed the only viable approach to use a collection of "paper-and-pencil" benchmarks that specified a set of problems only algorithmically and left most implementation details to the implementer's discretion under certain necessary limits.
NPB 1 defined eight benchmarks, each in two problem sizes dubbed Class A and Class B. Sample codes written in <a href="/facts/Fortran/m1KqjcMU">Fortran 77</a> were supplied. They used a small problem size Class S and were not intended for benchmarking purposes.<a class="footnote-ref" id="fnref:5" href="#fn:5">5</a>

<h3>NPB 2</h3>
Since its release, NPB 1 displayed two major weaknesses. Firstly, due to its "paper-and-pencil" specification, computer vendors usually highly tuned their implementations so that their performance became difficult for scientific programmers to attain. Secondly, many of these implementation were proprietary and not publicly available, effectively concealing their optimizing techniques. Secondly, problem sizes of NPB 1 lagged behind the development of supercomputers as the latter continued to evolve.<a class="footnote-ref" id="fnref:6" href="#fn:6">6</a>
NPB 2, released in 1996,<a class="footnote-ref" id="fnref:7" href="#fn:7">7</a><a class="footnote-ref" id="fnref:8" href="#fn:8">8</a> came with source code implementations for five out of eight benchmarks defined in NPB 1 to supplement but not replace NPB 1. It extended the benchmarks with an up-to-date problem size Class C. It also amended the rules for submitting benchmarking results. The new rules included explicit requests for output files as well as modified source files and build scripts to ensure public availability of the modifications and reproducibility of the results.<a class="footnote-ref" id="fnref:9" href="#fn:9">9</a>
NPB 2.2 contained implementations of two more benchmarks.<a class="footnote-ref" id="fnref:10" href="#fn:10">10</a> NPB 2.3 of 1997 was the first complete implementation in <a href="/facts/Message_Passing_Interface/BEuBgDpm">MPI</a>.<a class="footnote-ref" id="fnref:11" href="#fn:11">11</a> It shipped with serial versions of the benchmarks consistent with the parallel versions and defined a problem size Class W for small-memory systems.<a class="footnote-ref" id="fnref:12" href="#fn:12">12</a> NPB 2.4 of 2002 offered a new MPI implementation and introduced another still larger problem size Class D.<a class="footnote-ref" id="fnref:13" href="#fn:13">13</a> It also augmented one benchmark with <a href="/facts/Input/output/WQTE8Jas">I/O</a>-intensive subtypes.<a class="footnote-ref" id="fnref:14" href="#fn:14">14</a>

<h3>NPB 3</h3>
NPB 3 retained the MPI implementation from NPB 2 and came in more flavors, namely <a href="/facts/OpenMP/69IpI80o">OpenMP</a>,<a class="footnote-ref" id="fnref:15" href="#fn:15">15</a> <a href="/facts/Java_(programming_language)/9ScgFyAL">Java</a><a class="footnote-ref" id="fnref:16" href="#fn:16">16</a> and <a href="/facts/High_Performance_Fortran/xS9Bymmx">High Performance Fortran</a>.<a class="footnote-ref" id="fnref:17" href="#fn:17">17</a> These new parallel implementations were derived from the serial codes in NPB 2.3 with additional optimizations.<a class="footnote-ref" id="fnref:18" href="#fn:18">18</a> NPB 3.1 and NPB 3.2 added three more benchmarks,<a class="footnote-ref" id="fnref:19" href="#fn:19">19</a><a class="footnote-ref" id="fnref:20" href="#fn:20">20</a> which, however, were not available across all implementations; NPB 3.3 introduced a Class E problem size.<a class="footnote-ref" id="fnref:21" href="#fn:21">21</a> Based on the single-zone NPB 3, a set of multi-zone benchmarks taking advantage of the MPI/OpenMP hybrid programming model were released under the name NPB-Multi-Zone (NPB-MZ) for "testing the effectiveness of multi-level and hybrid parallelization paradigms and tools".<a class="footnote-ref" id="fnref:22" href="#fn:22">22</a><a class="footnote-ref" id="fnref:23" href="#fn:23">23</a>

<h2 id="the-benchmarks">The benchmarks</h2>
As of NPB 3.3, eleven benchmarks are defined as summarized in the following table.

<table><tbody><tr><th>Benchmark</th><th>Name derived from<a class="footnote-ref" id="fnref:24" href="#fn:24">24</a></th><th>Available since</th><th>Description<a class="footnote-ref" id="fnref:25" href="#fn:25">25</a></th><th>Remarks</th></tr><tr><td>MG</td><td>MultiGrid</td><td rowspan="8">NPB 1<a class="footnote-ref" id="fnref:26" href="#fn:26">26</a></td><td>Approximate the solution to a three-dimensional <a href="/facts/Discrete_Poisson_equation/suIdn71h">discrete Poisson equation</a> using the V-cycle <a href="/facts/Multigrid_method/6FTEwkja">multigrid method</a></td><td></td></tr><tr><td>CG</td><td>Conjugate Gradient</td><td>Estimate the smallest <a href="/facts/Eigenvalue/8TjEoT8u">eigenvalue</a> of a large <a href="/facts/Sparse_matrix/FFtN0XjR">sparse</a> <a href="/facts/Symmetric_matrix/08CGwjNl">symmetric</a> <a href="/facts/Positive-definite_matrix/Hbr6AuPS">positive-definite matrix</a> using the <a href="/facts/Inverse_iteration/vvjavcom">inverse iteration</a> with the <a href="/facts/Conjugate_gradient_method/AFwzBS4U">conjugate gradient method</a> as a subroutine for solving <a href="/facts/System_of_linear_equations/fk9CFdgp">systems of linear equations</a></td><td></td></tr><tr><td>FT</td><td>Fast Fourier Transform</td><td>Solve a three-dimensional <a href="/facts/Partial_differential_equation/DyPsBlv7">partial differential equation</a> (PDE) using the <a href="/facts/Fast_Fourier_transform/caT7UUCh">fast Fourier transform</a> (FFT)</td><td></td></tr><tr><td>IS</td><td><a href="/facts/Integer_sorting/eItzeey5">Integer Sort</a></td><td>Sort small integers using the <a href="/facts/Bucket_sort/SuxxHqcc">bucket sort</a><a class="footnote-ref" id="fnref:27" href="#fn:27">27</a></td><td></td></tr><tr><td>EP</td><td><a href="/facts/Embarrassingly_parallel/phT66Up4">Embarrassingly Parallel</a></td><td>Generate independent <a href="/facts/Normal_distribution/UapjjPyQ">Gaussian</a> <a href="/facts/Random_variate/dTkjAeaj">random variates</a> using the <a href="/facts/Marsaglia_polar_method/YkEH5u5r">Marsaglia polar method</a></td><td></td></tr><tr><td>BT</td><td>Block Tridiagonal</td><td rowspan="3">Solve a synthetic system of <a href="/facts/Nonlinear_system/4aYItALC">nonlinear PDEs</a> using three different algorithms involving <a href="/facts/Block_matrix/fPI8HX9f">block tridiagonal</a>, scalar <a href="/facts/Pentadiagonal_matrix/S5khQsbp">pentadiagonal</a> and symmetric <a href="/facts/Successive_over-relaxation/rCUV11er">successive over-relaxation</a> (SSOR) solver kernels, respectively</td><td rowspan="3"><ul><li>The BT benchmark has I/O-intensive subtypes<a class="footnote-ref" id="fnref:28" href="#fn:28">28</a></li><li>All three benchmarks have multi-zone versions<a class="footnote-ref" id="fnref:29" href="#fn:29">29</a></li></ul></td></tr><tr><td>SP</td><td>Scalar Pentadiagonal<a class="footnote-ref" id="fnref:30" href="#fn:30">30</a></td></tr><tr><td>LU</td><td><a href="/facts/Triangular_matrix/qjXSFMM3">Lower-Upper</a> symmetric <a href="/facts/Gauss%E2%80%93Seidel_method/eK94QeFt">Gauss-Seidel</a><a class="footnote-ref" id="fnref:31" href="#fn:31">31</a></td></tr><tr><td>UA</td><td>Unstructured Adaptive<a class="footnote-ref" id="fnref:32" href="#fn:32">32</a></td><td rowspan="2">NPB 3.1<a class="footnote-ref" id="fnref:33" href="#fn:33">33</a></td><td>Solve <a href="/facts/Heat_equation/2JPPr5GG">Heat equation</a> with convection and diffusion from moving ball. Mesh is adaptive and recomputed at every 5th step.</td><td></td></tr><tr><td>DC</td><td><a href="/facts/Data_cube/t262Xw1k">Data Cube</a> operator<a class="footnote-ref" id="fnref:34" href="#fn:34">34</a></td><td></td><td></td></tr><tr><td>DT</td><td>Data Traffic<a class="footnote-ref" id="fnref:35" href="#fn:35">35</a></td><td>NPB 3.2<a class="footnote-ref" id="fnref:36" href="#fn:36">36</a></td><td></td><td></td></tr></tbody></table>

<h2 id="external-links">External links</h2>
<ul><li><a href="https://www.nas.nasa.gov/Software/NPB/">NAS Parallel Benchmarks Changes</a> (official website)</li></ul>

<h2 id="references">References</h2>

<ol>
<li id="fn:1">"NAS Parallel Benchmarks Changes". NASA Advanced Supercomputing Division. Retrieved 2009-02-23. <a href="https://www.nas.nasa.gov/Resources/Software/npb.html" target="_blank">https://www.nas.nasa.gov/Resources/Software/npb.html</a> <a href="#fnref:1" class="footnote-back-ref">↩</a></li>
<li id="fn:2">Baily, D.; Barszcz, E.; Barton, J.; Browning, D.; Carter, R.; Dagum, L.; Fatoohi, R.; Fineberg, S.; Frederickson, P.; Weeratunga, S. (March 1994), "The NAS Parallel Benchmarks" (PDF), NAS Technical Report RNR-94-007, NASA Ames Research Center, Moffett Field, CA <a href="https://www.nas.nasa.gov/assets/pdf/techreports/1994/rnr-94-007.pdf" target="_blank">https://www.nas.nasa.gov/assets/pdf/techreports/1994/rnr-94-007.pdf</a> <a href="#fnref:2" class="footnote-back-ref">↩</a></li>
<li id="fn:3">Bailey, D.; Harris, T.; Saphir, W.; van der Wijngaart, R.; Woo, A.; Yarrow, M. (December 1995), "The NAS Parallel Benchmarks 2.0" (PDF), NAS Technical Report NAS-95-020, NASA Ames Research Center, Moffett Field, CA <a href="https://www.nas.nasa.gov/News/Techreports/1995/PDF/nas-95-020.pdf" target="_blank">https://www.nas.nasa.gov/News/Techreports/1995/PDF/nas-95-020.pdf</a> <a href="#fnref:3" class="footnote-back-ref">↩</a></li>
<li id="fn:4">Wong, P.; van der Wijngaart, R. (January 2003), "NAS Parallel Benchmarks I/O Version 2.4" (PDF), NAS Technical Report NAS-03-002, NASA Ames Research Center, Moffett Field, CA <a href="https://www.nas.nasa.gov/News/Techreports/2003/PDF/nas-03-002.pdf" target="_blank">https://www.nas.nasa.gov/News/Techreports/2003/PDF/nas-03-002.pdf</a> <a href="#fnref:4" class="footnote-back-ref">↩</a></li>
<li id="fn:5">Baily, D.; Barszcz, E.; Barton, J.; Browning, D.; Carter, R.; Dagum, L.; Fatoohi, R.; Fineberg, S.; Frederickson, P.; Weeratunga, S. (March 1994), "The NAS Parallel Benchmarks" (PDF), NAS Technical Report RNR-94-007, NASA Ames Research Center, Moffett Field, CA <a href="https://www.nas.nasa.gov/assets/pdf/techreports/1994/rnr-94-007.pdf" target="_blank">https://www.nas.nasa.gov/assets/pdf/techreports/1994/rnr-94-007.pdf</a> <a href="#fnref:5" class="footnote-back-ref">↩</a></li>
<li id="fn:6">Bailey, D.; Harris, T.; Saphir, W.; van der Wijngaart, R.; Woo, A.; Yarrow, M. (December 1995), "The NAS Parallel Benchmarks 2.0" (PDF), NAS Technical Report NAS-95-020, NASA Ames Research Center, Moffett Field, CA <a href="https://www.nas.nasa.gov/News/Techreports/1995/PDF/nas-95-020.pdf" target="_blank">https://www.nas.nasa.gov/News/Techreports/1995/PDF/nas-95-020.pdf</a> <a href="#fnref:6" class="footnote-back-ref">↩</a></li>
<li id="fn:7">Saphir, W.; van der Wijngaart, R.; Woo, A.; Yarrow, M., New Implementations and Results for the NAS Parallel Benchmarks 2 (PDF), NASA Ames Research Center, Moffett Field, CA <a href="https://www.nas.nasa.gov/Resources/Software/npb_2.2.pdf" target="_blank">https://www.nas.nasa.gov/Resources/Software/npb_2.2.pdf</a> <a href="#fnref:7" class="footnote-back-ref">↩</a></li>
<li id="fn:8">van der Wijngaart, R. (October 2002), "NAS Parallel Benchmarks Version 2.4" (PDF), NAS Technical Report NAS-02-007, NASA Ames Research Center, Moffett Field, CA <a href="https://www.nas.nasa.gov/assets/pdf/techreports/2002/nas-02-007.pdf" target="_blank">https://www.nas.nasa.gov/assets/pdf/techreports/2002/nas-02-007.pdf</a> <a href="#fnref:8" class="footnote-back-ref">↩</a></li>
<li id="fn:9">Bailey, D.; Harris, T.; Saphir, W.; van der Wijngaart, R.; Woo, A.; Yarrow, M. (December 1995), "The NAS Parallel Benchmarks 2.0" (PDF), NAS Technical Report NAS-95-020, NASA Ames Research Center, Moffett Field, CA <a href="https://www.nas.nasa.gov/News/Techreports/1995/PDF/nas-95-020.pdf" target="_blank">https://www.nas.nasa.gov/News/Techreports/1995/PDF/nas-95-020.pdf</a> <a href="#fnref:9" class="footnote-back-ref">↩</a></li>
<li id="fn:10">Saphir, W.; van der Wijngaart, R.; Woo, A.; Yarrow, M., New Implementations and Results for the NAS Parallel Benchmarks 2 (PDF), NASA Ames Research Center, Moffett Field, CA <a href="https://www.nas.nasa.gov/Resources/Software/npb_2.2.pdf" target="_blank">https://www.nas.nasa.gov/Resources/Software/npb_2.2.pdf</a> <a href="#fnref:10" class="footnote-back-ref">↩</a></li>
<li id="fn:11">Wong, P.; van der Wijngaart, R. (January 2003), "NAS Parallel Benchmarks I/O Version 2.4" (PDF), NAS Technical Report NAS-03-002, NASA Ames Research Center, Moffett Field, CA <a href="https://www.nas.nasa.gov/News/Techreports/2003/PDF/nas-03-002.pdf" target="_blank">https://www.nas.nasa.gov/News/Techreports/2003/PDF/nas-03-002.pdf</a> <a href="#fnref:11" class="footnote-back-ref">↩</a></li>
<li id="fn:12">"NAS Parallel Benchmarks Changes". NASA Advanced Supercomputing Division. Retrieved 2009-03-17. <a href="https://www.nas.nasa.gov/Resources/Software/npb_changes.html" target="_blank">https://www.nas.nasa.gov/Resources/Software/npb_changes.html</a> <a href="#fnref:12" class="footnote-back-ref">↩</a></li>
<li id="fn:13">van der Wijngaart, R. (October 2002), "NAS Parallel Benchmarks Version 2.4" (PDF), NAS Technical Report NAS-02-007, NASA Ames Research Center, Moffett Field, CA <a href="https://www.nas.nasa.gov/assets/pdf/techreports/2002/nas-02-007.pdf" target="_blank">https://www.nas.nasa.gov/assets/pdf/techreports/2002/nas-02-007.pdf</a> <a href="#fnref:13" class="footnote-back-ref">↩</a></li>
<li id="fn:14">Wong, P.; van der Wijngaart, R. (January 2003), "NAS Parallel Benchmarks I/O Version 2.4" (PDF), NAS Technical Report NAS-03-002, NASA Ames Research Center, Moffett Field, CA <a href="https://www.nas.nasa.gov/News/Techreports/2003/PDF/nas-03-002.pdf" target="_blank">https://www.nas.nasa.gov/News/Techreports/2003/PDF/nas-03-002.pdf</a> <a href="#fnref:14" class="footnote-back-ref">↩</a></li>
<li id="fn:15">Jin, H.; Frumkin, M.; Yan, J. (October 1999), "The OpenMP Implementation of NAS Parallel Benchmarks and Its Performance" (PDF), NAS Technical Report NAS-99-011, NASA Ames Research Center, Moffett Field, CA <a href="https://www.nas.nasa.gov/News/Techreports/1999/PDF/nas-99-011.pdf" target="_blank">https://www.nas.nasa.gov/News/Techreports/1999/PDF/nas-99-011.pdf</a> <a href="#fnref:15" class="footnote-back-ref">↩</a></li>
<li id="fn:16">Frumkin, M.; Schultz, M.; Jin, H.; Yan, J., "Implementation of the NAS Parallel Benchmarks in Java" (PDF), NAS Technical Report NAS-02-009, NASA Ames Research Center, Moffett Field, CA <a href="https://www.nas.nasa.gov/News/Techreports/2002/PDF/nas-02-009.pdf" target="_blank">https://www.nas.nasa.gov/News/Techreports/2002/PDF/nas-02-009.pdf</a> <a href="#fnref:16" class="footnote-back-ref">↩</a></li>
<li id="fn:17">Frumkin, M.; Jin, H.; Yan, J. (September 1998), "Implementation of NAS Parallel Benchmarks in High Performance Fortran" (PDF), NAS Technical Report NAS-98-009, NASA Ames Research Center, Moffett Field, CA <a href="https://www.nas.nasa.gov/News/Techreports/1998/PDF/nas-98-009.pdf" target="_blank">https://www.nas.nasa.gov/News/Techreports/1998/PDF/nas-98-009.pdf</a> <a href="#fnref:17" class="footnote-back-ref">↩</a></li>
<li id="fn:18">"NAS Parallel Benchmarks Changes". NASA Advanced Supercomputing Division. Retrieved 2009-03-17. <a href="https://www.nas.nasa.gov/Resources/Software/npb_changes.html" target="_blank">https://www.nas.nasa.gov/Resources/Software/npb_changes.html</a> <a href="#fnref:18" class="footnote-back-ref">↩</a></li>
<li id="fn:19">Feng, H.; van der Wijngaart, F.; Biswas, R.; Mavriplis, C. (July 2004), "Unstructured Adaptive (UA) NAS Parallel Benchmark, Version 1.0" (PDF), NAS Technical Report NAS-04-006, NASA Ames Research Center, Moffett Field, CA <a href="https://www.nas.nasa.gov/News/Techreports/2004/PDF/nas-04-006.pdf" target="_blank">https://www.nas.nasa.gov/News/Techreports/2004/PDF/nas-04-006.pdf</a> <a href="#fnref:19" class="footnote-back-ref">↩</a></li>
<li id="fn:20">Frumkin, M.; Shabanov, L. (September 2004), "Benchmarking Memory Performance with the Data Cube Operator" (PDF), NAS Technical Report NAS-04-013, NASA Ames Research Center, Moffett Field, CA <a href="https://www.nas.nasa.gov/News/Techreports/2004/PDF/nas-04-013.pdf" target="_blank">https://www.nas.nasa.gov/News/Techreports/2004/PDF/nas-04-013.pdf</a> <a href="#fnref:20" class="footnote-back-ref">↩</a></li>
<li id="fn:21">"NAS Parallel Benchmarks Changes". NASA Advanced Supercomputing Division. Retrieved 2009-03-17. <a href="https://www.nas.nasa.gov/Resources/Software/npb_changes.html" target="_blank">https://www.nas.nasa.gov/Resources/Software/npb_changes.html</a> <a href="#fnref:21" class="footnote-back-ref">↩</a></li>
<li id="fn:22">"NAS Parallel Benchmarks Changes". NASA Advanced Supercomputing Division. Retrieved 2009-02-23. <a href="https://www.nas.nasa.gov/Resources/Software/npb.html" target="_blank">https://www.nas.nasa.gov/Resources/Software/npb.html</a> <a href="#fnref:22" class="footnote-back-ref">↩</a></li>
<li id="fn:23">van der Wijngaart, R.; Jin, H. (July 2003), "NAS Parallel Benchmarks, Multi-Zone Versions" (PDF), NAS Technical Report NAS-03-010, NASA Ames Research Center, Moffett Field, CA <a href="https://www.nas.nasa.gov/News/Techreports/2003/PDF/nas-03-010.pdf" target="_blank">https://www.nas.nasa.gov/News/Techreports/2003/PDF/nas-03-010.pdf</a> <a href="#fnref:23" class="footnote-back-ref">↩</a></li>
<li id="fn:24">Baily, D.; Barszcz, E.; Barton, J.; Browning, D.; Carter, R.; Dagum, L.; Fatoohi, R.; Fineberg, S.; Frederickson, P.; Weeratunga, S. (March 1994), "The NAS Parallel Benchmarks" (PDF), NAS Technical Report RNR-94-007, NASA Ames Research Center, Moffett Field, CA <a href="https://www.nas.nasa.gov/assets/pdf/techreports/1994/rnr-94-007.pdf" target="_blank">https://www.nas.nasa.gov/assets/pdf/techreports/1994/rnr-94-007.pdf</a> <a href="#fnref:24" class="footnote-back-ref">↩</a></li>
<li id="fn:25">Baily, D.; Barszcz, E.; Barton, J.; Browning, D.; Carter, R.; Dagum, L.; Fatoohi, R.; Fineberg, S.; Frederickson, P.; Weeratunga, S. (March 1994), "The NAS Parallel Benchmarks" (PDF), NAS Technical Report RNR-94-007, NASA Ames Research Center, Moffett Field, CA <a href="https://www.nas.nasa.gov/assets/pdf/techreports/1994/rnr-94-007.pdf" target="_blank">https://www.nas.nasa.gov/assets/pdf/techreports/1994/rnr-94-007.pdf</a> <a href="#fnref:25" class="footnote-back-ref">↩</a></li>
<li id="fn:26">Baily, D.; Barszcz, E.; Barton, J.; Browning, D.; Carter, R.; Dagum, L.; Fatoohi, R.; Fineberg, S.; Frederickson, P.; Weeratunga, S. (March 1994), "The NAS Parallel Benchmarks" (PDF), NAS Technical Report RNR-94-007, NASA Ames Research Center, Moffett Field, CA <a href="https://www.nas.nasa.gov/assets/pdf/techreports/1994/rnr-94-007.pdf" target="_blank">https://www.nas.nasa.gov/assets/pdf/techreports/1994/rnr-94-007.pdf</a> <a href="#fnref:26" class="footnote-back-ref">↩</a></li>
<li id="fn:27">Saphir, W.; van der Wijngaart, R.; Woo, A.; Yarrow, M., New Implementations and Results for the NAS Parallel Benchmarks 2 (PDF), NASA Ames Research Center, Moffett Field, CA <a href="https://www.nas.nasa.gov/Resources/Software/npb_2.2.pdf" target="_blank">https://www.nas.nasa.gov/Resources/Software/npb_2.2.pdf</a> <a href="#fnref:27" class="footnote-back-ref">↩</a></li>
<li id="fn:28">Wong, P.; van der Wijngaart, R. (January 2003), "NAS Parallel Benchmarks I/O Version 2.4" (PDF), NAS Technical Report NAS-03-002, NASA Ames Research Center, Moffett Field, CA <a href="https://www.nas.nasa.gov/News/Techreports/2003/PDF/nas-03-002.pdf" target="_blank">https://www.nas.nasa.gov/News/Techreports/2003/PDF/nas-03-002.pdf</a> <a href="#fnref:28" class="footnote-back-ref">↩</a></li>
<li id="fn:29">van der Wijngaart, R.; Jin, H. (July 2003), "NAS Parallel Benchmarks, Multi-Zone Versions" (PDF), NAS Technical Report NAS-03-010, NASA Ames Research Center, Moffett Field, CA <a href="https://www.nas.nasa.gov/News/Techreports/2003/PDF/nas-03-010.pdf" target="_blank">https://www.nas.nasa.gov/News/Techreports/2003/PDF/nas-03-010.pdf</a> <a href="#fnref:29" class="footnote-back-ref">↩</a></li>
<li id="fn:30">van der Wijngaart, R. (October 2002), "NAS Parallel Benchmarks Version 2.4" (PDF), NAS Technical Report NAS-02-007, NASA Ames Research Center, Moffett Field, CA <a href="https://www.nas.nasa.gov/assets/pdf/techreports/2002/nas-02-007.pdf" target="_blank">https://www.nas.nasa.gov/assets/pdf/techreports/2002/nas-02-007.pdf</a> <a href="#fnref:30" class="footnote-back-ref">↩</a></li>
<li id="fn:31">van der Wijngaart, R. (October 2002), "NAS Parallel Benchmarks Version 2.4" (PDF), NAS Technical Report NAS-02-007, NASA Ames Research Center, Moffett Field, CA <a href="https://www.nas.nasa.gov/assets/pdf/techreports/2002/nas-02-007.pdf" target="_blank">https://www.nas.nasa.gov/assets/pdf/techreports/2002/nas-02-007.pdf</a> <a href="#fnref:31" class="footnote-back-ref">↩</a></li>
<li id="fn:32">Feng, H.; van der Wijngaart, F.; Biswas, R.; Mavriplis, C. (July 2004), "Unstructured Adaptive (UA) NAS Parallel Benchmark, Version 1.0" (PDF), NAS Technical Report NAS-04-006, NASA Ames Research Center, Moffett Field, CA <a href="https://www.nas.nasa.gov/News/Techreports/2004/PDF/nas-04-006.pdf" target="_blank">https://www.nas.nasa.gov/News/Techreports/2004/PDF/nas-04-006.pdf</a> <a href="#fnref:32" class="footnote-back-ref">↩</a></li>
<li id="fn:33">"NAS Parallel Benchmarks Changes". NASA Advanced Supercomputing Division. Retrieved 2009-03-17. <a href="https://www.nas.nasa.gov/Resources/Software/npb_changes.html" target="_blank">https://www.nas.nasa.gov/Resources/Software/npb_changes.html</a> <a href="#fnref:33" class="footnote-back-ref">↩</a></li>
<li id="fn:34">Frumkin, M.; Shabanov, L. (September 2004), "Benchmarking Memory Performance with the Data Cube Operator" (PDF), NAS Technical Report NAS-04-013, NASA Ames Research Center, Moffett Field, CA <a href="https://www.nas.nasa.gov/News/Techreports/2004/PDF/nas-04-013.pdf" target="_blank">https://www.nas.nasa.gov/News/Techreports/2004/PDF/nas-04-013.pdf</a> <a href="#fnref:34" class="footnote-back-ref">↩</a></li>
<li id="fn:35">"NAS Parallel Benchmarks Changes". NASA Advanced Supercomputing Division. Retrieved 2009-03-17. <a href="https://www.nas.nasa.gov/Resources/Software/npb_changes.html" target="_blank">https://www.nas.nasa.gov/Resources/Software/npb_changes.html</a> <a href="#fnref:35" class="footnote-back-ref">↩</a></li>
<li id="fn:36">"NAS Parallel Benchmarks Changes". NASA Advanced Supercomputing Division. Retrieved 2009-03-17. <a href="https://www.nas.nasa.gov/Resources/Software/npb_changes.html" target="_blank">https://www.nas.nasa.gov/Resources/Software/npb_changes.html</a> <a href="#fnref:36" class="footnote-back-ref">↩</a></li>
</ol>

NAS Parallel Benchmarks open-in-new

NAS Parallel Benchmarks