Menu
Home
People
Places
Arts
History
Plants & Animals
Science
Life & Culture
Technology
Reference.org
Purely functional data structure
open-in-new
<h2 id="definition">Definition</h2> <p><a href="/facts/Persistent_data_structure/K7IpHlkR">Persistent data structures</a> have the property of keeping previous versions of themselves unmodified. On the other hand, non-persistent structures such as <a href="/facts/Array_data_structure/BKGvF8AM">arrays</a> admit a destructive update,<a class="footnote-ref" id="fnref:1" href="#fn:1"><sup>1</sup></a> that is, an update which cannot be reversed. Once a program writes a value in some index of the array, its previous value can not be retrieved anymore. </p><p>Formally, a <i>purely functional data structure</i> is a data structure which can be implemented in a <a href="/facts/Purely_functional_language/am3DcNAd">purely functional language</a>, such as <a href="/facts/Haskell_(programming_language)/4Htv9WLu">Haskell</a>. In practice, it means that the data structures must be built using only persistent data structures such as tuples, <a href="/facts/Sum_type/uMFenvCQ">sum types</a>, <a href="/facts/Product_type/y6Qj08vW">product types</a>, and basic types such as integers, characters, strings. Such a data structure is necessarily persistent. However, not all persistent data structures are purely functional.<a class="footnote-ref" id="fnref:2" href="#fn:2"><sup>2</sup></a>: 16 For example, a <a href="/facts/Persistent_array/MzRB1fka">persistent array</a> is a data-structure which is persistent and which is implemented using an array, thus is not purely functional. </p><p>In the book <i>Purely functional data structures</i>, Okasaki compares destructive updates to master chef's knives.<a class="footnote-ref" id="fnref:3" href="#fn:3"><sup>3</sup></a>: 2 Destructive updates cannot be undone, and thus they should not be used unless it is certain that the previous value is not required anymore. However, destructive updates can also allow efficiency that can not be obtained using other techniques. For example, a data structure using an array and destructive updates may be replaced by a similar data structure where the array is replaced by a <a href="/facts/Map_(computer_science)/IFGd2xcP">map</a>, a random access list, or a <a href="/facts/Balanced_tree/W7WAsES0">balanced tree</a>, which admits a purely functional implementation. But the access cost may increase from constant time to <a href="/facts/Logarithmic_time/77T62gmf">logarithmic time</a>. </p> <h2 id="ensuring-that-a-data-structure-is-purely-functional">Ensuring that a data structure is purely functional</h2> <p>A data structure is never inherently functional. For example, a stack can be implemented as a <a href="/facts/Singly-linked_list/Ik4JTgJW">singly-linked list</a>. This implementation is purely functional as long as the only operations on the stack return a new stack without altering the old stack. However, if the language is not purely functional, the run-time system may be unable to guarantee immutability. This is illustrated by Okasaki,<a class="footnote-ref" id="fnref:4" href="#fn:4"><sup>4</sup></a>: 9–11 where he shows the concatenation of two singly-linked lists can still be done using an imperative setting. </p><p>In order to ensure that a data structure is used in a purely functional way in an impure functional language, <a href="/facts/Modular_programming/sNoqKvRD">modules</a> or <a href="/facts/Class_(computer_programming)/zvzkSAtE">classes</a> can be used to ensure manipulation via authorized functions only. </p> <h2 id="using-purely-functional-data-structures">Using purely functional data structures</h2> <p>One of the central challenges in adapting existing code to use purely functional data structures lies in the fact that mutable data structures provide "hidden outputs" for functions that use them. Rewriting these functions to use purely functional data structures requires adding these data structures as explicit outputs. </p><p>For instance, consider a function that accepts a mutable list, removes the first element from the list, and returns that element. In a purely functional setting, removing an element from the list produces a new and shorter list, but does not update the original one. In order to be useful, therefore, a purely functional version of this function is likely to have to return the new list along with the removed element. In the most general case, a program converted in this way must return the "state" or "store" of the program as an additional result from every function call. Such a program is said to be written in <a href="/facts/Store-passing_style/ADbqhbPC">store-passing style</a>. </p> <h2 id="examples">Examples</h2> <p>Here is a list of abstract data structures with purely functional implementations: </p> <ul><li>Stack (first in, last out) implemented as a <a href="/facts/Singly_linked_list/Ik4JTgJW">singly linked list</a>,</li> <li>Queue, implemented as a <a href="/facts/Real-time_queue/hVPjPXus">real-time queue</a>,</li> <li>Double-ended queue, implemented as a <a href="/facts/Real-time_deque/pQboJcly">real-time double-ended queue</a>,</li> <li><a href="/facts/Set_(abstract_data_type)/ovoXUmF9">(Multi)set</a> of ordered elements and <a href="/facts/Map_(computer_science)/IFGd2xcP">map</a> indexed by ordered keys, implemented as a <a href="/facts/Red%E2%80%93black_tree/ckgWTV7G">red–black tree</a>, or more generally by a <a href="/facts/Search_tree/zJIIMEH8">search tree</a>,</li> <li><a href="/facts/Priority_queue/1uXVo4Uf">Priority queue</a>, implemented as a <a href="/facts/Brodal_queue/3NzyhnJn">Brodal queue</a></li> <li>Random access list, implemented as a skew-binary random access list</li> <li><a href="/facts/Hash_consing/k7B1oy80">Hash consing</a></li> <li><a href="/facts/Zipper_(data_structure)/Vjlz5eEe">Zipper (data structure)</a></li></ul> <h2 id="design-and-implementation">Design and implementation</h2> <p>In his book <i>Purely Functional Data Structures</i>, computer scientist <a href="/facts/Chris_Okasaki/U4STTLpz">Chris Okasaki</a> describes techniques used to design and implement purely functional data structures, a small subset of which are summarized below. </p> <h3>Laziness and memoization</h3> <p>Lazy evaluation is particularly interesting in a purely functional language<a class="footnote-ref" id="fnref:5" href="#fn:5"><sup>5</sup></a>: 31 because the order of the evaluation never changes the result of a function. Therefore, lazy evaluation naturally becomes an important part of the construction of purely functional data structures. It allows a computation to be done only when its result is actually required. Therefore, the code of a purely functional data structure can, without loss of efficiency, consider similarly data that will effectively be used and data that will be ignored. The only computation required is for the first kind of data; that is what will actually be performed. </p><p>One of the key tools in building efficient, purely functional data structures is memoization.<a class="footnote-ref" id="fnref:6" href="#fn:6"><sup>6</sup></a>: 31 When a computation is done, it is saved and does not have to be performed a second time. This is particularly important in lazy implementations; additional evaluations may require the same result, but it is impossible to know which evaluation will require it first. </p> <h3>Amortized analysis and scheduling</h3> <p>Some data structures, even those that are not purely functional such as <a href="/facts/Dynamic_array/EtocbTWK">dynamic arrays</a>, admit operations that are efficient most of the time (e.g., constant time for dynamic arrays), and rarely inefficient (e.g., linear time for dynamic arrays). <i><a href="/facts/Amortized_analysis/9fFYenJz">Amortization</a></i> can then be used to prove that the average running time of the operations is efficient.<a class="footnote-ref" id="fnref:7" href="#fn:7"><sup>7</sup></a>: 39 That is to say, the few inefficient operations are rare enough, and do not change the asymptotical evolution of time complexity when a sequence of operations is considered. </p><p>In general, having inefficient operations is not acceptable for persistent data structures, because this very operation can be called many times. It is not acceptable either for real-time or for imperative systems, where the user may require the time taken by the operation to be predictable. Furthermore, this unpredictability complicates the use of <a href="/facts/Parallel_computing/nQzcpzQt">parallelism</a>.<a class="footnote-ref" id="fnref:8" href="#fn:8"><sup>8</sup></a>: 83 </p><p>In order to avoid those problems, some data structures allow for the inefficient operation to be postponed—this is called <a href="/facts/Scheduling_(computing)/XptmcM1a">scheduling</a>.<a class="footnote-ref" id="fnref:9" href="#fn:9"><sup>9</sup></a>: 84 The only requirement is that the computation of the inefficient operation should end before its result is actually needed. A constant part of the inefficient operation is performed simultaneously with the following call to an efficient operation, so that the inefficient operation is already totally done when it is needed, and each individual operation remains efficient. </p> <h4>Example: queue</h4> <p><a href="/facts/Amortized_queue/hVPjPXus">Amortized queues</a><a class="footnote-ref" id="fnref:10" href="#fn:10"><sup>10</sup></a>: 65 <a class="footnote-ref" id="fnref:11" href="#fn:11"><sup>11</sup></a>: 73 are composed of two singly-linked lists: the front and the reversed rear. Elements are added to the rear list and are removed from the front list. Furthermore, whenever the front queue is empty, the rear queue is reversed and becomes the front, while the rear queue becomes empty. The amortized time complexity of each operation is constant. Each cell of the list is added, reversed and removed at most once. In order to avoid an inefficient operation where the rear list is reversed, <a href="/facts/Real-time_queue/hVPjPXus">real-time queues</a> add the restriction that the rear list is only as long as the front list. To ensure that the front list stays longer than the rear list, the rear list is reversed and appended to the front list. Since this operation is inefficient, it is not performed immediately. Instead, it is spread out over the subsequent operations. Thus, each cell is computed before it is needed, and the new front list is totally computed before a new inefficient operation needs to be called. </p> <h2 id="see-also">See also</h2> <ul><li><a href="/facts/Persistent_data_structure/K7IpHlkR">Persistent data structure</a></li></ul> <h2 id="external-links">External links</h2> <ul><li><a href="https://www.cs.cmu.edu/~rwh/students/okasaki.pdf">Purely Functional Data Structures</a> thesis by Chris Okasaki (PDF format)</li> <li><a href="https://www.cs.cmu.edu/~sleator/papers/making-data-structures-persistent.pdf">Making Data-Structures Persistent</a> by James R. Driscoll, Neil Sarnak, Daniel D. Sleator, Robert E. Tarjan (PDF)</li> <li><a href="https://www.cs.cmu.edu/~sleator/papers/fully-persistent-lists.pdf">Fully Persistent Lists with Catenation</a> by James R. Driscoll, Daniel D. Sleator, Robert E. Tarjan (PDF)</li> <li><a href="http://ocw.mit.edu/courses/electrical-engineering-and-computer-science/6-854j-advanced-algorithms-fall-2005/lecture-notes/persistent.pdf">Persistent Data Structures</a> from the <a href="/facts/MIT_OpenCourseWare/mgl2Cl5m">MIT OpenCourseWare</a> course <a href="http://ocw.mit.edu/courses/electrical-engineering-and-computer-science/6-854j-advanced-algorithms-fall-2005">Advanced Algorithms</a></li> <li><a href="https://cstheory.stackexchange.com/q/1539">What's new in purely functional data structures since Okasaki?</a> on <i>Theoretical Computer Science <a href="/facts/Stack_Exchange/VQvJKJMh">Stack Exchange</a></i></li></ul> <h2 id="references">References</h2> <ol> <li id="fn:1"><p>Purely functional data structures by Chris Okasaki, Cambridge University Press, 1998, ISBN 0-521-66350-4 <a href="http://www.cambridge.org/us/academic/subjects/computer-science/algorithmics-complexity-computer-algebra-and-computational-g/purely-functional-data-structures" target="_blank">http://www.cambridge.org/us/academic/subjects/computer-science/algorithmics-complexity-computer-algebra-and-computational-g/purely-functional-data-structures</a> <a href="#fnref:1" class="footnote-back-ref">↩</a></p></li> <li id="fn:2"><p>Purely functional data structures by Chris Okasaki, Cambridge University Press, 1998, ISBN 0-521-66350-4 <a href="http://www.cambridge.org/us/academic/subjects/computer-science/algorithmics-complexity-computer-algebra-and-computational-g/purely-functional-data-structures" target="_blank">http://www.cambridge.org/us/academic/subjects/computer-science/algorithmics-complexity-computer-algebra-and-computational-g/purely-functional-data-structures</a> <a href="#fnref:2" class="footnote-back-ref">↩</a></p></li> <li id="fn:3"><p>Purely functional data structures by Chris Okasaki, Cambridge University Press, 1998, ISBN 0-521-66350-4 <a href="http://www.cambridge.org/us/academic/subjects/computer-science/algorithmics-complexity-computer-algebra-and-computational-g/purely-functional-data-structures" target="_blank">http://www.cambridge.org/us/academic/subjects/computer-science/algorithmics-complexity-computer-algebra-and-computational-g/purely-functional-data-structures</a> <a href="#fnref:3" class="footnote-back-ref">↩</a></p></li> <li id="fn:4"><p>Purely functional data structures by Chris Okasaki, Cambridge University Press, 1998, ISBN 0-521-66350-4 <a href="http://www.cambridge.org/us/academic/subjects/computer-science/algorithmics-complexity-computer-algebra-and-computational-g/purely-functional-data-structures" target="_blank">http://www.cambridge.org/us/academic/subjects/computer-science/algorithmics-complexity-computer-algebra-and-computational-g/purely-functional-data-structures</a> <a href="#fnref:4" class="footnote-back-ref">↩</a></p></li> <li id="fn:5"><p>Purely functional data structures by Chris Okasaki, Cambridge University Press, 1998, ISBN 0-521-66350-4 <a href="http://www.cambridge.org/us/academic/subjects/computer-science/algorithmics-complexity-computer-algebra-and-computational-g/purely-functional-data-structures" target="_blank">http://www.cambridge.org/us/academic/subjects/computer-science/algorithmics-complexity-computer-algebra-and-computational-g/purely-functional-data-structures</a> <a href="#fnref:5" class="footnote-back-ref">↩</a></p></li> <li id="fn:6"><p>Purely functional data structures by Chris Okasaki, Cambridge University Press, 1998, ISBN 0-521-66350-4 <a href="http://www.cambridge.org/us/academic/subjects/computer-science/algorithmics-complexity-computer-algebra-and-computational-g/purely-functional-data-structures" target="_blank">http://www.cambridge.org/us/academic/subjects/computer-science/algorithmics-complexity-computer-algebra-and-computational-g/purely-functional-data-structures</a> <a href="#fnref:6" class="footnote-back-ref">↩</a></p></li> <li id="fn:7"><p>Purely functional data structures by Chris Okasaki, Cambridge University Press, 1998, ISBN 0-521-66350-4 <a href="http://www.cambridge.org/us/academic/subjects/computer-science/algorithmics-complexity-computer-algebra-and-computational-g/purely-functional-data-structures" target="_blank">http://www.cambridge.org/us/academic/subjects/computer-science/algorithmics-complexity-computer-algebra-and-computational-g/purely-functional-data-structures</a> <a href="#fnref:7" class="footnote-back-ref">↩</a></p></li> <li id="fn:8"><p>Purely functional data structures by Chris Okasaki, Cambridge University Press, 1998, ISBN 0-521-66350-4 <a href="http://www.cambridge.org/us/academic/subjects/computer-science/algorithmics-complexity-computer-algebra-and-computational-g/purely-functional-data-structures" target="_blank">http://www.cambridge.org/us/academic/subjects/computer-science/algorithmics-complexity-computer-algebra-and-computational-g/purely-functional-data-structures</a> <a href="#fnref:8" class="footnote-back-ref">↩</a></p></li> <li id="fn:9"><p>Purely functional data structures by Chris Okasaki, Cambridge University Press, 1998, ISBN 0-521-66350-4 <a href="http://www.cambridge.org/us/academic/subjects/computer-science/algorithmics-complexity-computer-algebra-and-computational-g/purely-functional-data-structures" target="_blank">http://www.cambridge.org/us/academic/subjects/computer-science/algorithmics-complexity-computer-algebra-and-computational-g/purely-functional-data-structures</a> <a href="#fnref:9" class="footnote-back-ref">↩</a></p></li> <li id="fn:10"><p>Purely functional data structures by Chris Okasaki, Cambridge University Press, 1998, ISBN 0-521-66350-4 <a href="http://www.cambridge.org/us/academic/subjects/computer-science/algorithmics-complexity-computer-algebra-and-computational-g/purely-functional-data-structures" target="_blank">http://www.cambridge.org/us/academic/subjects/computer-science/algorithmics-complexity-computer-algebra-and-computational-g/purely-functional-data-structures</a> <a href="#fnref:10" class="footnote-back-ref">↩</a></p></li> <li id="fn:11"><p>Purely functional data structures by Chris Okasaki, Cambridge University Press, 1998, ISBN 0-521-66350-4 <a href="http://www.cambridge.org/us/academic/subjects/computer-science/algorithmics-complexity-computer-algebra-and-computational-g/purely-functional-data-structures" target="_blank">http://www.cambridge.org/us/academic/subjects/computer-science/algorithmics-complexity-computer-algebra-and-computational-g/purely-functional-data-structures</a> <a href="#fnref:11" class="footnote-back-ref">↩</a></p></li> </ol>