Extreme learning machine

Extreme learning machines are <a href="/facts/Feedforward_neural_network/CP0pPGDF">feedforward neural networks</a> for <a href="/facts/Statistical_classification/jXXHRkXR">classification</a>, <a href="/facts/Regression_analysis/n6z5Tf7K">regression</a>, <a href="/facts/Cluster_analysis/HUeDnWPt">clustering</a>, <a href="/facts/Sparse_approximation/IkUA6yDf">sparse approximation</a>, compression and <a href="/facts/Feature_learning/6GYV0mux">feature learning</a> with a single layer or multiple layers of hidden nodes, where the parameters of hidden nodes (not just the weights connecting inputs to hidden nodes) need to be tuned. These hidden nodes can be randomly assigned and never updated (i.e. they are <a href="/facts/Random_projection/VbPrR5jp">random projection</a> but with nonlinear transforms), or can be inherited from their ancestors without being changed. In most cases, the output weights of hidden nodes are usually learned in a single step, which essentially amounts to learning a linear model.
The name "extreme learning machine" (ELM) was given to such models by Guang-Bin Huang who originally proposed for the networks with any type of nonlinear piecewise continuous hidden nodes including biological neurons and different type of mathematical basis functions. The idea for artificial neural networks goes back to <a href="/facts/Frank_Rosenblatt/fdPnkXdt">Frank Rosenblatt</a>, who not only published a single layer <a href="/facts/Perceptron/ArxdkAC1">Perceptron</a> in 1958, but also introduced a <a href="/facts/Multilayer_perceptron/jkq4t7Gy">multilayer perceptron</a> with 3 layers: an input layer, a hidden layer with randomized weights that did not learn, and a learning output layer.
According to some researchers, these models are able to produce good generalization performance and learn thousands of times faster than networks trained using <a href="/facts/Backpropagation/lCsIdKHc">backpropagation</a>. In literature, it also shows that these models can outperform <a href="/facts/Support_vector_machine/XobxpdBG">support vector machines</a> in both classification and regression applications.

Extreme learning machine open-in-new

Extreme learning machine