Implicit parallelism

<h2 id="example">Example</h2>
<p>If a particular problem involves performing the same operation on a group of numbers (such as taking the <a href="/facts/Sine/gQ6LXK8z">sine</a> or <a href="/facts/Logarithm/QeXaV97q">logarithm</a> of each in turn), a language that provides implicit parallelism might allow the programmer to write the instruction thus:
</p>
numbers = [0 1 2 3 4 5 6 7];
result = sin(numbers);

<p>The compiler or interpreter can calculate the sine of each element independently, spreading the effort across multiple processors if available.
</p>
<h2 id="advantages">Advantages</h2>
<p>A programmer that writes implicitly parallel code does not need to worry about task division or process communication, focusing instead on the problem that his or her program is intended to solve. Implicit parallelism generally facilitates the design of parallel programs and therefore results in a substantial improvement of programmer productivity.
</p><p>Many of the constructs necessary to support this also add simplicity or clarity even in the absence of actual parallelism. The example above, of <a href="/facts/List_comprehension/aYAax9k0">list comprehension</a> in the sin() function, is a useful feature in of itself. By using implicit parallelism, languages effectively have to provide such useful constructs to users simply to support required functionality (a language without a decent <a href="/facts/For_loop/cwV2nRzp">for loop</a>, for example, is one few programmers will use).
</p>
<h2 id="disadvantages">Disadvantages</h2>
<p>Languages with implicit parallelism reduce the control that the programmer has over the parallel execution of the program, resulting sometimes in less-than-optimal <a href="/facts/Parallel_efficiency/CyKANbvF">parallel efficiency</a>. The makers of the <a href="/facts/Oz_programming_language/Fsb7wHsv">Oz programming language</a> also note that their early experiments with implicit parallelism showed that implicit parallelism made debugging difficult and object models unnecessarily awkward.<a class="footnote-ref" id="fnref:2" href="#fn:2"><sup>2</sup></a>
</p><p>A larger issue is that every program has some parallel and some serial logic. Binary I/O, for example, requires support for such serial operations as Write() and Seek(). If implicit parallelism is desired, this creates a new requirement for constructs and keywords to support code that cannot be threaded or distributed.
</p>
<h2 id="notes">Notes</h2>

<h2 id="references">References</h2>

<ol>
<li id="fn:1"><p>Nikhil, Rishiyur; Arvind (February 20, 2024). Implicit Parallel Programming in pH. Morgan Kaufmann Publishers. ISBN 978-1-55860-644-9. <a href="978-1-55860-644-9" target="_blank">978-1-55860-644-9</a> <a href="#fnref:1" class="footnote-back-ref">↩</a></p></li>
<li id="fn:2"><p>Seif Haridi (June 14, 2006). "Introduction". Tutorial of Oz. Archived from the original on May 14, 2011. Retrieved September 20, 2007. <a href="https://web.archive.org/web/20110514010946/http://www.mozart-oz.org/documentation/tutorial/node1.html#chapter.introduction" target="_blank">https://web.archive.org/web/20110514010946/http://www.mozart-oz.org/documentation/tutorial/node1.html#chapter.introduction</a> <a href="#fnref:2" class="footnote-back-ref">↩</a></p></li>
</ol>

Implicit parallelism open-in-new

Implicit parallelism