Menu
Home
People
Places
Arts
History
Plants & Animals
Science
Life & Culture
Technology
Reference.org
Modeling and simulation
open-in-new
<h2 id="interest-in-simulations">Interest in simulations</h2> <p>Technically, simulation is well accepted. The 2006 <a href="/facts/National_Science_Foundation/FlDT8TbW">National Science Foundation</a> (NSF) Report on "Simulation-based Engineering Science"<a class="footnote-ref" id="fnref:3" href="#fn:3"><sup>3</sup></a> showed the potential of using simulation technology and methods to revolutionize the engineering science. Among the reasons for the steadily increasing interest in simulation applications are the following: </p> <ol><li>Using simulations is generally cheaper, safer and sometimes more ethical than conducting real-world experiments. For example, <a href="/facts/Supercomputer/HT9NwGAN">supercomputers</a> are sometimes used to simulate the detonation of nuclear devices and their effects in order to support better preparedness in the event of a <a href="/facts/Nuclear_explosion/BtpfgcUg">nuclear explosion</a>.<a class="footnote-ref" id="fnref:4" href="#fn:4"><sup>4</sup></a> Similar efforts are conducted to simulate hurricanes and other natural catastrophes.<a class="footnote-ref" id="fnref:5" href="#fn:5"><sup>5</sup></a><a class="footnote-ref" id="fnref:6" href="#fn:6"><sup>6</sup></a><a class="footnote-ref" id="fnref:7" href="#fn:7"><sup>7</sup></a> <p class="note">See also: <a href="/facts/Hurricane_Weather_Research_and_Forecasting_model/YkNnRMRX">Hurricane Weather Research and Forecasting model</a></p></li> <li>Simulations can often be even more realistic than traditional experiments, as they allow the free configuration of the realistic range of environment parameters found in the operational application field of the final product. Examples are supporting deep water operation of the US Navy or the simulating the surface of neighbored planets in preparation of <a href="/facts/NASA_mission/kFnXfjDU">NASA missions</a>.</li> <li>Simulations can often be conducted faster than <a href="/facts/Real-time_simulation/HX3eHNmc">real time</a>. This allows using them for efficient <a href="/facts/If-then-else/8gDQTqUD">if-then-else</a> analyses of different alternatives, in particular when the necessary data to initialize the simulation can easily be obtained from operational data. This use of simulation adds decision support simulation systems to the tool box of traditional <a href="/facts/Decision_support_system/HPeJMlRM">decision support systems</a>.</li> <li>Simulations allow setting up a coherent <a href="/facts/Synthetic_environment/lmKwYadn">synthetic environment</a> that allows for integration of simulated systems in the early analysis phase via mixed virtual systems with first prototypical components to a virtual <a href="/facts/Test_environment/gG7DJoE6">test environment</a> for the final system. If managed correctly, the environment can be migrated from the development and test domain to the training and education domain in follow-on life cycle phases for the systems (including the option to train and optimize a virtual twin of the real system under realistic constraints even before first components are being built).</li></ol> <p>The military and defense domain, in particular within the United States, has been the main M&S champion, in form of funding as well as application of M&S. E.g., M&S in modern <a href="/facts/Military/kgNmLUnN">military</a> organizations is part of the <a href="/facts/Military_Acquisition/74PpVAoe">acquisition</a>/<a href="/facts/Procurement/y35C00fn">procurement</a> strategy. Specifically, M&S is used to conduct Events and Experiments that influence requirements and training for military systems. As such, M&S is considered an integral part of <a href="/facts/Systems_engineering/gFwRmkDp">systems engineering</a> of military systems. Other application domains, however, are currently catching up. M&S in the fields of medicine, transportation, and other industries is poised to rapidly outstrip DoD's use of M&S in the years ahead, if it hasn't already happened.<a class="footnote-ref" id="fnref:8" href="#fn:8"><sup>8</sup></a> </p> <p class="note">Further information: <a href="/facts/Multi-use_simulation_models/8Km2nDEw">Multi-use simulation models</a></p> <h2 id="simulation-in-science">Simulation in science</h2> <p class="note">Further information: <a href="/facts/Scientific_modelling/aNyvIyUQ">Scientific modelling</a></p> <p>Modeling and simulation are important in research. Representing the real systems either via <a href="/facts/Physical_model/remaCtIh">physical</a> reproductions at smaller scale, or via <a href="/facts/Mathematical_model/CGhyuxgz">mathematical models</a> that allow representing the dynamics of the system via simulation, allows exploring system behavior in an articulated way which is often either not possible, or too risky in the real world. </p> <h2 id="as-an-emerging-discipline">As an emerging discipline</h2> <p>"The emerging discipline of M&S is based on developments in diverse computer science areas as well as influenced by developments in <a href="/facts/Systems_Theory/C56Ck7DQ">Systems Theory</a>, <a href="/facts/Systems_Engineering/gFwRmkDp">Systems Engineering</a>, <a href="/facts/Software_Engineering/KX6cE9kz">Software Engineering</a>, <a href="/facts/Artificial_Intelligence/lJGauQwX">Artificial Intelligence</a>, and more. This foundation is as diverse as that of engineering management and brings elements of art, engineering, and science together in a complex and unique way that requires domain experts to enable appropriate decisions when it comes to application or development of M&S technology in the context of this paper. The diversity and application-oriented nature of this new discipline sometimes result in the challenge, that the supported application domains themselves already have vocabularies in place that are not necessarily aligned between disjunctive domains. A comprehensive and concise representation of concepts, terms, and activities is needed that make up a professional Body of Knowledge for the M&S discipline. Due to the broad variety of contributors, this process is still ongoing."<a class="footnote-ref" id="fnref:9" href="#fn:9"><sup>9</sup></a> </p><p>Padilla et al. recommend in "Do we Need M&S Science" to distinguish between M&S Science, Engineering, and Applications.<a class="footnote-ref" id="fnref:10" href="#fn:10"><sup>10</sup></a> </p> <ul><li><i>M&S Science</i> contributes to the Theory of M&S, defining the academic foundations of the discipline.</li> <li><i>M&S Engineering</i> is rooted in Theory but looks for applicable solution patterns. The focus is general methods that can be applied in various problem domains.</li> <li><i>M&S Applications</i> solve real world problems by focusing on solutions using M&S. Often, the solution results from applying a method, but many solutions are very problem domain specific and are derived from problem domain expertise and not from any general M&S theory or method.</li></ul> <p>Models can be composed of different units (models at finer granularity) linked to achieving a specific goal; for this reason they can be also called <a href="/facts/Biophysical_Models/INS6TnJv">modeling solutions</a>. </p><p>More generally, modeling and simulation is a key enabler for systems engineering activities as the system representation in a computer readable (and possibly executable) model enables engineers to reproduce the system (or Systems of System) behavior. A collection of applicative modeling and simulation method to support systems engineering activities in provided in.<a class="footnote-ref" id="fnref:11" href="#fn:11"><sup>11</sup></a> </p> <h2 id="application-domains">Application domains</h2> <p>There are many categorizations possible, but the following taxonomy has been very successfully used in the <a href="/facts/Military/kgNmLUnN">defense domain</a>, and is currently applied to <a href="/facts/Medical_simulation/Y5s4apRh">medical simulation</a> and <a href="/facts/Transportation_simulation/hYhTxxUD">transportation simulation</a> as well. </p> <ul><li><i>Analyses Support</i> is conducted in support of planning and experimentation. Very often, the search for an optimal solution that shall be implemented is driving these efforts. What-if analyses of alternatives fall into this category as well. This style of work is often accomplished by simulysts - those having skills in both simulation and as analysts. This blending of simulation and analyst is well noted in Kleijnen.</li> <li><i>Systems Engineering Support</i> is applied for the procurement, development, and testing of systems. This support can start in early phases and include topics like executable system architectures, and it can support testing by providing a virtual environment in which tests are conducted. This style of work is often accomplished by engineers and architects.</li> <li><i>Training and Education Support</i> provides simulators, <a href="/facts/Virtual_training/5lf2A2Vj">virtual training</a> environments, and <a href="/facts/Serious_game/llz5f4sE">serious games</a> to train and educate people. This style of work is often accomplished by trainers working in concert with computer scientists.</li></ul> <p>A special use of <i>Analyses Support</i> is applied to ongoing business operations. Traditionally, decision support systems provide this functionality. Simulation systems improve their functionality by adding the dynamic element and allow to compute estimates and predictions, including optimization and what-if analyses. </p> <h2 id="individual-concepts">Individual concepts</h2> <p class="note">Further information: <a href="/facts/Conceptual_model/hgysE2kP">Conceptual model</a></p> <p>Although the terms "modeling" and "simulation" are often used as synonyms within disciplines applying M&S exclusively as a tool, within the discipline of M&S both are treated as individual and equally important concepts. <a href="/facts/Conceptual_model/hgysE2kP">Modeling</a> is understood as the purposeful abstraction of reality, resulting in the formal specification of a conceptualization and underlying assumptions and constraints. M&S is in particular interested in models that are used to support the implementation of an executable version on a computer. The execution of a model over time is understood as the simulation. While modeling targets the <a href="/facts/Conceptualization/jCUJBHWI">conceptualization</a>, <a href="/facts/Simulation/Q4QJV1oI">simulation</a> challenges mainly focus on <a href="/facts/Implementation/IH1KXgP3">implementation</a>, in other words, modeling resides on the abstraction level, whereas simulation resides on the implementation level. </p><p>Conceptualization and implementation – modeling and simulation – are two activities that are mutually dependent, but can nonetheless be conducted by separate individuals. Management and engineering knowledge and guidelines are needed to ensure that they are well connected. Like an engineering management professional in systems engineering needs to make sure that the systems design captured in a systems architecture is aligned with the systems development, this task needs to be conducted with the same level of professionalism for the model that has to be implemented as well. As the role of big data and analytics continues to grow, the role of combined simulation of analysis is the realm of yet another professional called a simplest – in order to blend algorithmic and analytic techniques through visualizations available directly to decision makers. A study designed for the Bureau of Labor and Statistics<a class="footnote-ref" id="fnref:12" href="#fn:12"><sup>12</sup></a> by Lee et al. provides an interesting look at how bootstrap techniques (statistical analysis) were used with simulation to generate population data where there existed none. </p> <h2 id="academic-programs">Academic programs</h2> <p>Modeling and Simulation has only recently become an academic discipline of its own. Formerly, those working in the field usually had a background in engineering. </p><p>The following institutions offer degrees in Modeling and Simulation: </p> Ph D. Programs <ul><li><a href="/facts/University_of_Pennsylvania/LBBBULox">University of Pennsylvania</a> (Philadelphia, PA)</li> <li><a href="/facts/Old_Dominion_University/NjcSGsH5">Old Dominion University</a> (Norfolk, VA)</li> <li><a href="/facts/University_of_Alabama_in_Huntsville/u1sqAjNB">University of Alabama in Huntsville</a> (Huntsville, AL)</li> <li><a href="/facts/University_of_Central_Florida/Gbx281mg">University of Central Florida</a> (Orlando, FL)</li> <li><a href="/facts/Naval_Postgraduate_School/K7CDD8XD">Naval Postgraduate School</a> (Monterey, CA)</li> <li><a href="/facts/University_of_Genoa/UyKuseG3">University of Genoa</a> (Genoa, Italy)</li></ul> Masters Programs <ul><li><a href="/facts/National_University_of_Science_and_Technology,_Pakistan/aFgD9yVa">National University of Science and Technology, Pakistan</a> (Islamabad, Pakistan)</li> <li><a href="/facts/Arizona_State_University/e4lLNfmP">Arizona State University</a> (Tempe, AZ)</li> <li><a href="/facts/Old_Dominion_University/NjcSGsH5">Old Dominion University</a> (Norfolk, VA)</li> <li><a href="/facts/University_of_Central_Florida/Gbx281mg">University of Central Florida</a> (Orlando, FL)</li> <li><a href="/facts/The_University_of_Alabama_in_Huntsville/u1sqAjNB">the University of Alabama in Huntsville</a> (Huntsville, AL)</li> <li><a href="/facts/Middle_East_Technical_University/60TLQ0cL">Middle East Technical University</a> (Ankara, Turkey)</li> <li><a href="/facts/University_of_New_South_Wales/h64vknzj">University of New South Wales</a> (Australia)</li> <li><a href="/facts/Naval_Postgraduate_School/K7CDD8XD">Naval Postgraduate School</a> (Monterey, CA)</li> <li>Department of Scientific Computing, Modeling and Simulation (M.Tech (Modelling & Simulation)) (Savitribai Phule Pune University, India)</li> <li><a href="/facts/Columbus_State_University/IfGL6rzt">Columbus State University</a> (Columbus, GA)</li> <li><a href="/facts/Purdue_University_Calumet/T8GgfnWs">Purdue University Calumet</a> (Hammond, IN)</li> <li><a href="/facts/Delft_University_of_Technology/wtPV7UmG">Delft University of Technology</a> (Delft, The Netherlands)</li> <li><a href="/facts/University_of_Genoa/UyKuseG3">University of Genoa</a> (Genoa, Italy)</li> <li><a href="/facts/Hamburg_University_of_Applied_Sciences/URwdwC6S">Hamburg University of Applied Sciences</a> (Hamburg, Germany)</li></ul> Professional Science Masters Programs <ul><li><a href="/facts/University_of_Central_Florida/Gbx281mg">University of Central Florida</a> (Orlando, FL)</li></ul> Graduate Certificate Programs <ul><li><a href="/facts/Portland_State_University/uzc2z68w">Portland State University</a> Systems Science</li> <li>Columbus State University (Columbus, GA)</li> <li><a href="/facts/The_University_of_Alabama_in_Huntsville/u1sqAjNB">the University of Alabama in Huntsville</a> (Huntsville, AL)</li></ul> Undergraduate Programs <ul><li><a href="/facts/Old_Dominion_University/NjcSGsH5">Old Dominion University</a> (Norfolk, VA)</li> <li><a href="/facts/Ghulam_Ishaq_Khan_Institute_of_Engineering_Sciences_and_Technology/HuSehloB">Ghulam Ishaq Khan Institute of Engineering Sciences and Technology</a> (Swabi, Pakistan)</li></ul> <h2 id="modeling-and-simulation-body-of-knowledge"><i>Modeling and Simulation Body of Knowledge</i></h2> <p>The <i>Modeling and Simulation Body of Knowledge</i> (M&S BoK) is the domain of knowledge (information) and capability (competency) that identifies the modeling and simulation <a href="/facts/Community_of_practice/gMgDQYX6">community of practice</a> and the M&S profession, industry, and market.<a class="footnote-ref" id="fnref:13" href="#fn:13"><sup>13</sup></a> </p><p>The M&S BoK Index is a set of pointers providing handles so that subject information content can be denoted, identified, accessed, and manipulated.<a class="footnote-ref" id="fnref:14" href="#fn:14"><sup>14</sup></a> </p> <h2 id="summary">Summary</h2> <p>Three activities have to be conducted and orchestrated to ensure success: </p> <ol><li>a model must be produced that captures formally the conceptualization,</li> <li>a simulation must implement this model, and</li> <li>management must ensure that model and simulation are interconnected and on the current state (which means that normally the model needs to be updated in case the simulation is changed as well).</li></ol> <h2 id="see-also">See also</h2> <ul><li><a href="/facts/Computational_science/PnVD19hw">Computational science</a></li> <li><a href="/facts/Computational_engineering/dvIJ5o36">Computational engineering</a></li> <li><a href="/facts/Defense_Technical_Information_Center/E7Vq7hhD">Defense Technical Information Center</a></li> <li><a href="/facts/Glossary_of_military_modeling_and_simulation/hzcfurHu">Glossary of military modeling and simulation</a></li> <li><a href="/facts/Interservice/Industry_Training,_Simulation_and_Education_Conference/842bxzPg">Interservice/Industry Training, Simulation and Education Conference</a> (I/ITSEC)</li> <li><a href="/facts/Microscale_and_macroscale_models/xUQHCYKr">Microscale and macroscale models</a></li> <li><a href="/facts/Military_Operations_Research_Society/6CFSUAa3">Military Operations Research Society</a> (MORS)</li> <li><a href="/facts/Military_simulation/5qjV8o4x">Military simulation</a></li> <li><a href="/facts/Modeling_and_Simulation_Coordination_Office/J94TpF7T">Modeling and Simulation Coordination Office</a></li> <li><a href="/facts/Operations_research/H5yJkV5n">Operations research</a></li> <li><a href="/facts/Orbit_modeling/dcYKSXAH">Orbit modeling</a></li> <li><a href="/facts/Power_system_simulation/seR6tXmb">Power system simulation</a></li> <li><a href="/facts/Rule-based_modeling/zTdEjFVP">Rule-based modeling</a></li> <li><a href="/facts/Simulation_Interoperability_Standards_Organization/GCbWeLjD">Simulation Interoperability Standards Organization</a> (SISO)</li> <li><a href="/facts/Society_for_Modeling_and_Simulation_International/QyKRVQoF">Society for Modeling and Simulation International</a> (SCS)</li></ul> <ul><li>Master of Science, Purdue University Calumet. <a href="https://archive.today/20141008234945/http://webs.purduecal.edu/techgrad/master-of-science-in-modeling-simulation-and-visualization/">"Modeling, Simulation and Visualization"</a>. Archived from <a href="http://webs.purduecal.edu/techgrad/master-of-science-in-modeling-simulation-and-visualization/">the original</a> on 2014-10-08. Retrieved 2014-10-08.</li></ul> <h2 id="further-reading">Further reading</h2> <ul><li>The Springer Publishing House publishes the Simulation Foundations, Methods, and Applications Series <a href="https://www.springer.com/series/10128">[1]</a>.</li> <li>Recently, Wiley started their own Series on Modeling and Simulation.<a class="footnote-ref" id="fnref:15" href="#fn:15"><sup>15</sup></a></li></ul> <h2 id="external-links">External links</h2> Look up <i>Modeling & Simulation</i> in Wiktionary, the free dictionary. Wikimedia Commons has media related to Modeling and simulation. <ul><li><a href="http://www.msco.mil/index.html">US Department of Defense (DoD) Modeling and Simulation Coordination Office (M&SCO)</a></li> <li><a href="http://www.modsimworldconference.com/">MODSIM World Conference</a></li> <li><a href="http://www.scs.org">Society for Modeling and Simulation</a></li> <li><a href="https://www.acm-sigsim-mskr.org/">Association for Computing Machinery (ACM) Special Interest Group (SIG) on SImulation and Modeling (SIM)</a></li> <li><a href="http://forbes.house.gov/Biography/mscaucus.htm">US Congressional Modeling and Simulation Caucus</a></li> <li><a href="http://www.site.uottawa.ca/~oren/MSBOK/MSBOK-index.htm">Example of an M&S BoK Index</a> developed by <a href="/facts/Tuncer_%C3%96ren/7ABz4Lsy">Tuncer Ören</a></li> <li><a href="https://web.archive.org/web/20110728023727/http://www.sim-summit.org/BoK07/BoK_SharePoint.htm">SimSummit collaborative environment supporting an M&S BoK</a></li></ul> <h2 id="references">References</h2> <ol> <li id="fn:1"><p>"Department of Defense INSTRUCTION NUMBER 5000.61: Modeling and Simulation (M&S) Verification, Validation, and Accreditation" (PDF). Department of Defense. 2009-12-09. Archived from the original (PDF) on July 14, 2007. <a href="https://web.archive.org/web/20070714013742/http://www.dtic.mil/whs/directives/corres/pdf/500061p.pdf" target="_blank">https://web.archive.org/web/20070714013742/http://www.dtic.mil/whs/directives/corres/pdf/500061p.pdf</a> <a href="#fnref:1" class="footnote-back-ref">↩</a></p></li> <li id="fn:2"><p>"Department of Defense DIRECTIVE NUMBER 5000.59: DoD Modeling and Simulation (M&S) Management" (PDF). Department of Defense. 2007-08-08. Archived from the original (PDF) on July 10, 2007. <a href="https://web.archive.org/web/20070710122647/http://www.dtic.mil/whs/directives/corres/pdf/500059p.pdf" target="_blank">https://web.archive.org/web/20070710122647/http://www.dtic.mil/whs/directives/corres/pdf/500059p.pdf</a> <a href="#fnref:2" class="footnote-back-ref">↩</a></p></li> <li id="fn:3"><p>"Report on Simulation-Based Engineering Science" (PDF). National Science Foundation (NSF) Blue Ribbon Panel. 2006-05-01. Archived (PDF) from the original on 2021-06-07. <a href="https://www.nsf.gov/pubs/reports/sbes_final_report.pdf" target="_blank">https://www.nsf.gov/pubs/reports/sbes_final_report.pdf</a> <a href="#fnref:3" class="footnote-back-ref">↩</a></p></li> <li id="fn:4"><p>George Dvorsky (6 June 2012). "Supercomputer simulates nuclear explosion down to the molecular level". io9. Gawker Media. Archived from the original on 2021-06-07. <a href="https://io9.gizmodo.com/5916320/supercomputer-simulates-nuclear-explosion-down-to-the-molecular-level" target="_blank">https://io9.gizmodo.com/5916320/supercomputer-simulates-nuclear-explosion-down-to-the-molecular-level</a> <a href="#fnref:4" class="footnote-back-ref">↩</a></p></li> <li id="fn:5"><p>"Hurricane Force Supercomputing: Petascale Simulations of Sandy". HPCwire. 15 November 2013. Archived from the original on 2021-06-07. <a href="http://www.hpcwire.com/2013/11/14/behind-blue-waters-hurricane-sandy-simulation/" target="_blank">http://www.hpcwire.com/2013/11/14/behind-blue-waters-hurricane-sandy-simulation/</a> <a href="#fnref:5" class="footnote-back-ref">↩</a></p></li> <li id="fn:6"><p>"NOAA's SciJinks :: Simulate a Hurricane". Archived from the original on 2021-06-07. <a href="https://scijinks.jpl.nasa.gov/hurricane-simulation/" target="_blank">https://scijinks.jpl.nasa.gov/hurricane-simulation/</a> <a href="#fnref:6" class="footnote-back-ref">↩</a></p></li> <li id="fn:7"><p>"9 Super-Cool Uses for Supercomputers". LiveScience.com. 30 April 2010. Archived from the original on 2021-06-07. <a href="http://www.livescience.com/6392-9-super-cool-supercomputers.html" target="_blank">http://www.livescience.com/6392-9-super-cool-supercomputers.html</a> <a href="#fnref:7" class="footnote-back-ref">↩</a></p></li> <li id="fn:8"><p>Collins, A.J.; S.R. Shefrey; J. Sokolowski; C.D. Turnitsa; E. Weisel (January 2011). "Modeling and Simulation Standards Study: Healthcare Workshop report". VMASC Report, Suffolk VA. <a href="#fnref:8" class="footnote-back-ref">↩</a></p></li> <li id="fn:9"><p>Tolk, Andreas. "Engineering Management Challenges for Applying Simulation as a Green Technology" (PDF). {{cite journal}}: Cite journal requires |journal= (help) <a href="http://ww2.odu.edu/~atolk/research/ASEM.045.pdf" target="_blank">http://ww2.odu.edu/~atolk/research/ASEM.045.pdf</a> <a href="#fnref:9" class="footnote-back-ref">↩</a></p></li> <li id="fn:10"><p>Padilla, Jose; S.Y. Diallo; A. Tolk (October 2011). "Do We Need M&S Science?" (PDF). SCS M&S Magazine (4): 161–166. Archived from the original (PDF) on June 6, 2013. Retrieved July 1, 2012. <a href="https://web.archive.org/web/20130606094638/http://www.scs.org/magazines/2011-10/index_file/Files/Padilla-Diallo-Tolk.pdf" target="_blank">https://web.archive.org/web/20130606094638/http://www.scs.org/magazines/2011-10/index_file/Files/Padilla-Diallo-Tolk.pdf</a> <a href="#fnref:10" class="footnote-back-ref">↩</a></p></li> <li id="fn:11"><p>Gianni, Daniele; D'Ambrogio, Andrea; Tolk, Andreas, eds. (December 2, 2014). Modeling and Simulation-Based Systems Engineering Handbook (1st ed.). CRC Press. p. 513. ISBN 9781466571457. <a href="9781466571457" target="_blank">9781466571457</a> <a href="#fnref:11" class="footnote-back-ref">↩</a></p></li> <li id="fn:12"><p>Lee, Hyunshik J.; et al. (2013). "Simulation Study to Validate Sample Allocation for the National Compensation Survey" (PDF). JSM 2013 - Survey Research Methods Section. Bureau of Labor Statistics. Archived from the original (PDF) on 2014-05-04. <a href="https://web.archive.org/web/20140504084914/http://www.bls.gov/osmr/pdf/st130210.pdf" target="_blank">https://web.archive.org/web/20140504084914/http://www.bls.gov/osmr/pdf/st130210.pdf</a> <a href="#fnref:12" class="footnote-back-ref">↩</a></p></li> <li id="fn:13"><p>"Waite, W. (2004) "Foundations '04: A Workshop for VV&A in the 21st Century, Session 10: V&V Education Initiatives". Archived from the original on 2011-09-30. Retrieved 2010-10-15. <a href="https://web.archive.org/web/20110930014211/https://www.scs.org/confernc/foundations/finalprogram.doc" target="_blank">https://web.archive.org/web/20110930014211/https://www.scs.org/confernc/foundations/finalprogram.doc</a> <a href="#fnref:13" class="footnote-back-ref">↩</a></p></li> <li id="fn:14"><p>"Waite, W. (2004) "Foundations '04: A Workshop for VV&A in the 21st Century, Session 10: V&V Education Initiatives". Archived from the original on 2011-09-30. Retrieved 2010-10-15. <a href="https://web.archive.org/web/20110930014211/https://www.scs.org/confernc/foundations/finalprogram.doc" target="_blank">https://web.archive.org/web/20110930014211/https://www.scs.org/confernc/foundations/finalprogram.doc</a> <a href="#fnref:14" class="footnote-back-ref">↩</a></p></li> <li id="fn:15"><p>http://www.wiley.com/WileyCDA/Section/id-815482.html <a href="http://www.wiley.com/WileyCDA/Section/id-815482.html" target="_blank">http://www.wiley.com/WileyCDA/Section/id-815482.html</a> <a href="#fnref:15" class="footnote-back-ref">↩</a></p></li> </ol>