Menu
Home
People
Places
Arts
History
Plants & Animals
Science
Life & Culture
Technology
Reference.org
llama.cpp
open-in-new
<p> llama.cpp is an <a href="/facts/Open_source/7X9rCdz4">open source</a> <a href="/facts/Software_library/xRzL3P7q">software library</a> that performs <a href="/facts/Inference_engine/oLlNX14Q">inference</a> on various <a href="/facts/Large_language_model/WnogWVJY">large language models</a> such as <a href="/facts/Llama_(language_model)/rmrWj35n">Llama</a>. It is co-developed alongside the GGML project, a general-purpose <a href="/facts/Tensor_(machine_learning)/hsdCknKW">tensor</a> library. </p><p><a href="/facts/Command-line_interface/R9JpGmXQ">Command-line tools</a> are included with the library, alongside a <a href="/facts/Web_server/A4GS6thA">server</a> with a simple <a href="/facts/Web_application/BLkF3BIN">web interface</a>. </p>