where the vector function m gives the errors between the data p, and the model predictions. The vector q gives some variable parameters that are the model's unknown parts.
The parameters q vary with the operating conditions c in a manner to be determined. This relation can be specified as q = Ac where A is a matrix of unknown coefficients, and c as in linear regression includes a constant term and possibly transformed values of the original operating conditions to obtain non-linear relations between the original operating conditions and q. It is then a matter of selecting which terms in A are non-zero and assigning their values. The model completion becomes an optimization problem to determine the non-zero values in A that minimizes the error terms m(f,p,Ac) over the data.
Once a selection of non-zero values is made, the remaining coefficients in A can be determined by minimizing m(f,p,Ac) over the data with respect to the nonzero values in A, typically by non-linear least squares. Selection of the nonzero terms can be done by optimization methods such as simulated annealing and evolutionary algorithms. Also the non-linear least squares can provide accuracy estimates for the elements of A that can be used to determine if they are significantly different from zero, thus providing a method of term selection.
It is sometimes possible to calculate values of q for each data set, directly or by non-linear least squares. Then the more efficient linear regression can be used to predict q using c thus selecting the non-zero values in A and estimating their values. Once the non-zero values are located non-linear least squares can be used on the original model m(f,p,Ac) to refine these values .
so that aT is now in a linear position with all other terms known, and thus can be analyzed by linear regression techniques. For more than one parameter the method extends in a direct manner. After checking that the model has been improved this process can be repeated until convergence. This approach has the advantages that it does not need the parameters q to be able to be determined from an individual data set and the linear regression is on the original error terms
Where sufficient data is available, division of the data into a separate model construction set and one or two evaluation sets is recommended. This can be repeated using multiple selections of the construction set and the resulting models averaged or used to evaluate prediction differences.
An attempt to predict the residuals m(, ) with the operating conditions c using linear regression will show if the residuals can be predicted. Residuals that cannot be predicted offer little prospect of improving the model using the current operating conditions. Terms that do predict the residuals are prospective terms to incorporate into the model to improve its performance.
The model inversion technique above can be used as a method of determining whether a model can be improved. In this case selection of nonzero terms is not so important and linear prediction can be done using the significant eigenvectors of the regression matrix. The values in A determined in this manner need to be substituted into the nonlinear model to assess improvements in the model errors. The absence of a significant improvement indicates the available data is not able to improve the current model form using the defined parameters. Extra parameters can be inserted into the model to make this test more comprehensive.
Bohlin, Torsten P. (7 September 2006). Practical Grey-box Process Identification: Theory and Applications. Springer Science & Business Media. ISBN 978-1-84628-403-8. 978-1-84628-403-8
"Grey-box model estimation". Mathworks 2. 2012. http://www.mathworks.com.au/help/ident/grey-box-model-estimation.html
Kroll, Andreas (2000). Grey-box models: Concepts and application. In: New Frontiers in Computational Intelligence and its Applications, vol.57 of Frontiers in artificial intelligence and applications, pp. 42-51. IOS Press, Amsterdam.
Sohlberg, B., and Jacobsen, E.W., 2008. Grey box modelling - branches and experiences, Proc. 17th World Congress, Int. Federation of Automatic Control, Seoul. pp 11415-11420
https://www.sciencedirect.com/science/article/pii/S1474667016408025
Whiten, B., 2013. Model completion and validation using inversion of grey box models, ANZIAM J.,54 (CTAC 2012) pp C187–C199.
http://journal.austms.org.au/ojs/index.php/ANZIAMJ/article/view/6125/1682
Draper, Norman R.; Smith, Harry (25 August 2014). Applied Regression Analysis. John Wiley & Sons. pp. 657–. ISBN 978-1-118-62568-2. 978-1-118-62568-2
Weisberg, Sanford (25 November 2013). Applied Linear Regression. Wiley. ISBN 978-1-118-59485-8. 978-1-118-59485-8
Heaton, J., 2012. Introduction to the math of neural networks, Heaton Research Inc. (Chesterfield, MO), ISBN 978-1475190878 /wiki/ISBN_(identifier)
Stergiou, C.; Siganos, D. (2013). "Neural networks". Archived from the original on 2009-12-16. Retrieved 2013-07-03. https://web.archive.org/web/20091216110504/http://www.doc.ic.ac.uk/~nd/surprise_96/journal/vol4/cs11/report.html
Lawson, Charles L.; J. Hanson, Richard (1 December 1995). Solving Least Squares Problems. SIAM. ISBN 978-0-89871-356-5. 978-0-89871-356-5
Press, W.H.; Teukolsky, S.A.; Vetterling, W.T.; Flannery, B.P. (2007). Numerical Recipes (3rd ed.). Cambridge University Press. ISBN 978-0-521-88068-8. 978-0-521-88068-8
Gelman, Andrew; Carlin, John B.; Stern, Hal S.; Dunson, David B.; Vehtari, Aki; Rubin, Donald B. (1 November 2013). Bayesian Data Analysis, Third Edition. CRC Press. ISBN 978-1-4398-4095-5. 978-1-4398-4095-5
Bohlin, Torsten P. (7 September 2006). Practical Grey-box Process Identification: Theory and Applications. Springer Science & Business Media. ISBN 978-1-84628-403-8. 978-1-84628-403-8
Mathworks, 2013. Supported grey box models
http://www.mathworks.com.au/help/ident/ug/supported-grey-box-models.html
Hauth, J. (2008), Grey Box Modelling for Nonlinear Systems (PDF) (dissertation, Kaiserslautern University of Technology). https://kluedo.ub.uni-kl.de/files/2045/diss.pdf
Hauth, J. (2008), Grey Box Modelling for Nonlinear Systems (PDF) (dissertation, Kaiserslautern University of Technology). https://kluedo.ub.uni-kl.de/files/2045/diss.pdf
Nash, J.C. and Walker-Smith, M. 1987. Nonlinear parameter estimation, Marcel Dekker, Inc. (New York).
Whiten, B., 2013. Model completion and validation using inversion of grey box models, ANZIAM J.,54 (CTAC 2012) pp C187–C199.
http://journal.austms.org.au/ojs/index.php/ANZIAMJ/article/view/6125/1682
Whiten, W.J., 1971. Model building techniques applied to mineral treatment processes, Symp. on Automatic Control Systems in Mineral Processing Plants, (Australas. Inst. Min. Metall., S. Queensland Branch, Brisbane), 129-148.
Whiten, B., 2013. Model completion and validation using inversion of grey box models, ANZIAM J.,54 (CTAC 2012) pp C187–C199.
http://journal.austms.org.au/ojs/index.php/ANZIAMJ/article/view/6125/1682
Whiten, B., 2013. Model completion and validation using inversion of grey box models, ANZIAM J.,54 (CTAC 2012) pp C187–C199.
http://journal.austms.org.au/ojs/index.php/ANZIAMJ/article/view/6125/1682
Whiten, W.J., 1994. Determination of parameter relations within non-linear models, SIGNUM Newsletter, 29(3–4,) 2–5. 10.1145/192527.192535.
Whiten, B., 2014. Determining the form of ordinary differential equations using model inversion, ANZIAM J. 55 (EMAC2013) pp.C329–C347.
http://journal.austms.org.au/ojs/index.php/ANZIAMJ/article/view/7767
Whiten, B., 2013. Model completion and validation using inversion of grey box models, ANZIAM J.,54 (CTAC 2012) pp C187–C199.
http://journal.austms.org.au/ojs/index.php/ANZIAMJ/article/view/6125/1682
Whiten, W.J., 1994. Determination of parameter relations within non-linear models, SIGNUM Newsletter, 29(3–4,) 2–5. 10.1145/192527.192535.
Draper, Norman R.; Smith, Harry (25 August 2014). Applied Regression Analysis. John Wiley & Sons. pp. 657–. ISBN 978-1-118-62568-2. 978-1-118-62568-2
Weisberg, Sanford (25 November 2013). Applied Linear Regression. Wiley. ISBN 978-1-118-59485-8. 978-1-118-59485-8
Polynomial /wiki/Polynomial
Spline (mathematics) /wiki/Spline_(mathematics)
Bohlin, Torsten P. (7 September 2006). Practical Grey-box Process Identification: Theory and Applications. Springer Science & Business Media. ISBN 978-1-84628-403-8. 978-1-84628-403-8
Whiten, W.J., 1971. Model building techniques applied to mineral treatment processes, Symp. on Automatic Control Systems in Mineral Processing Plants, (Australas. Inst. Min. Metall., S. Queensland Branch, Brisbane), 129-148.
Kojovic, T., and Whiten W. J., 1994. Evaluation of the quality of simulation models, Innovations in mineral processing, (Lauretian University, Sudbury) pp 437–446. ISBN 088667025X /wiki/ISBN_(identifier)
Kojovic, T., 1989. The development and application of Model - an automated model builder for mineral processing, PhD thesis, The University of Queensland.
Xiao, J., 1998. Extensions of model building techniques and their applications in mineral processing, PhD thesis, The University of Queensland.
Press, W.H.; Teukolsky, S.A.; Vetterling, W.T.; Flannery, B.P. (2007). Numerical Recipes (3rd ed.). Cambridge University Press. ISBN 978-0-521-88068-8. 978-0-521-88068-8
Nash, J.C. and Walker-Smith, M. 1987. Nonlinear parameter estimation, Marcel Dekker, Inc. (New York).
Linhart, H.; Zucchini, W. (1986). Model selection. Wiley. ISBN 978-0-471-83722-0. 978-0-471-83722-0
Miller, Alan (15 April 2002). Subset Selection in Regression. CRC Press. ISBN 978-1-4200-3593-3. 978-1-4200-3593-3
Whiten, W.J., 1971. Model building techniques applied to mineral treatment processes, Symp. on Automatic Control Systems in Mineral Processing Plants, (Australas. Inst. Min. Metall., S. Queensland Branch, Brisbane), 129-148.
Kojovic, T., and Whiten W. J., 1994. Evaluation of the quality of simulation models, Innovations in mineral processing, (Lauretian University, Sudbury) pp 437–446. ISBN 088667025X /wiki/ISBN_(identifier)
Kojovic, T., 1989. The development and application of Model - an automated model builder for mineral processing, PhD thesis, The University of Queensland.
Whiten, B., 2013. Model completion and validation using inversion of grey box models, ANZIAM J.,54 (CTAC 2012) pp C187–C199.
http://journal.austms.org.au/ojs/index.php/ANZIAMJ/article/view/6125/1682
Whiten, W.J., 1994. Determination of parameter relations within non-linear models, SIGNUM Newsletter, 29(3–4,) 2–5. 10.1145/192527.192535.
Whiten, B., 2014. Determining the form of ordinary differential equations using model inversion, ANZIAM J. 55 (EMAC2013) pp.C329–C347.
http://journal.austms.org.au/ojs/index.php/ANZIAMJ/article/view/7767
Linhart, H.; Zucchini, W. (1986). Model selection. Wiley. ISBN 978-0-471-83722-0. 978-0-471-83722-0
Miller, Alan (15 April 2002). Subset Selection in Regression. CRC Press. ISBN 978-1-4200-3593-3. 978-1-4200-3593-3
Lawson, Charles L.; J. Hanson, Richard (1 December 1995). Solving Least Squares Problems. SIAM. ISBN 978-0-89871-356-5. 978-0-89871-356-5
Whiten, B., 2013. Model completion and validation using inversion of grey box models, ANZIAM J.,54 (CTAC 2012) pp C187–C199.
http://journal.austms.org.au/ojs/index.php/ANZIAMJ/article/view/6125/1682
Whiten, B., 2014. Determining the form of ordinary differential equations using model inversion, ANZIAM J. 55 (EMAC2013) pp.C329–C347.
http://journal.austms.org.au/ojs/index.php/ANZIAMJ/article/view/7767
Whiten, W.J., 1994. Determination of parameter relations within non-linear models, SIGNUM Newsletter, 29(3–4,) 2–5. 10.1145/192527.192535.
Whiten, B., 2013. Model completion and validation using inversion of grey box models, ANZIAM J.,54 (CTAC 2012) pp C187–C199.
http://journal.austms.org.au/ojs/index.php/ANZIAMJ/article/view/6125/1682
Deming, William Edwards (2000). Out of the Crisis p272. MIT Press. ISBN 978-0-262-54115-2. 978-0-262-54115-2
Press, W.H.; Teukolsky, S.A.; Vetterling, W.T.; Flannery, B.P. (2007). Numerical Recipes (3rd ed.). Cambridge University Press. ISBN 978-0-521-88068-8. 978-0-521-88068-8
Kojovic, T., and Whiten W. J., 1994. Evaluation of the quality of simulation models, Innovations in mineral processing, (Lauretian University, Sudbury) pp 437–446. ISBN 088667025X /wiki/ISBN_(identifier)
Kojovic, T., 1989. The development and application of Model - an automated model builder for mineral processing, PhD thesis, The University of Queensland.
Whiten, B., 2013. Model completion and validation using inversion of grey box models, ANZIAM J.,54 (CTAC 2012) pp C187–C199.
http://journal.austms.org.au/ojs/index.php/ANZIAMJ/article/view/6125/1682
Kojovic, T., and Whiten W. J., 1994. Evaluation of the quality of simulation models, Innovations in mineral processing, (Lauretian University, Sudbury) pp 437–446. ISBN 088667025X /wiki/ISBN_(identifier)
Whiten, B., 2013. Model completion and validation using inversion of grey box models, ANZIAM J.,54 (CTAC 2012) pp C187–C199.
http://journal.austms.org.au/ojs/index.php/ANZIAMJ/article/view/6125/1682