Multivariate function approximation using sparse grids and high Dimensional Model Representation – a comparison

Mateusz Baran


In many areas of science and technology, there is a need for effective procedures for approximating multivariate functions. Sparse grids and cut-HDMR (High Dimensional Model Representation) are two alternative approaches to such multivariate approximations. It is therefore interesting to compare these two methods. Numerical experiments performed in this study indicate that the sparse grid approximation is more accurate than the cut-HDMR approximation that uses a comparable number of known values of the approximated function unless the approximated function can be expressed as a sum of high order polynomials of one or two variables.

Słowa kluczowe: Sparse Grids, Approximation, Numerical experiments, Metamodelling, Curse of dimensionality

Donoho D.L., Aide-Memoire. High-Dimensional Data Analysis: The Curses and Blessings of Dimensionality, presented at the Mathematical Challenges of 21st Century, Los Angeles 2000.

Barton R.R., Metamodels for Simulation Input-output Relations, [in:] Proceedings of the 24th Conference on Winter Simulation, New York 1992, 289-299.

Barton R.R., Metamodeling: a state of the art review, [in:] Simulation Conference Proceedings, 1994. Winter, 1994, 237-244.

Shan S., Wang GG., Metamodeling for High Dimensional Simulation-Based Design Problems, J. Mech. Des., vol. 132, no. 5, 051009-1-051009-11, May 2010.

Jin R., Chen W., Simpson T.W., Comparative studies of metamodelling techniques under multiple modelling criteria, Struct Multidisc Optim, vol. 23, no. 1, Dec. 2001, 1-13.

Klimke A., Pye C.J., Sparse Grid Meta-Models for Model Updating, [in:] Proceedings of the IMAC-XXVII, Orlando 2009.

Schoendorf J., Rabitz H., Li G., A fast and accurate operational model of ionospheric electron density, Geophysical Research Letters, vol. 30, no. 9, 2003.

Geremia J., Weiss E., Rabitz H., Achieving the laboratory control of quantum dynamics phenomena using nonlinear functional maps, Chemical Physics, vol. 267, no. 1–3, Jun. 2001, 209-222.

Zabaras N., An Information-Theoretic Multiscale Framework With Applications toPolycrystalline Materials, Cornell University, Ithaca NY, Materials Process Design and Control Laboratory, Feb. 2010.

Chowdhury R., Rao B.N., Assessment of high dimensional model representation techniques for reliability analysis, Probabilistic Engineering Mechanics, vol. 24, no. 1, Jan. 2009, 100-115.

Bieniasz L.K., Rabitz H., High-Dimensional Model Representation of Cyclic Voltammograms, Anal. Chem., vol. 78, no. 6, Mar. 2006, 1807-1816.

Balu A.S., Rao B.N., Reliability analysis using high dimensional model representation for mixed uncertain variables, IOP Conf. Ser.: Mater. Sci. Eng., vol. 10, no. 1, Jun. 2010, 012014.

Smolyak S., Quadrature and interpolation formulas for tensor products of certain classes of functions, Soviet Mathematics, Doklady, vol. 4, 1963, 240-243.

Gordon W.J., Blending-Function Methods of Bivariate and Multivariate Interpolation and Approximation, SIAM Journal on Numerical Analysis, vol. 8, no. 1, Mar. 1971, 158-177.

Delvos F.J., Schempp W.J., Boolean Methods in Interpolation and Approximation. Longman Higher Education, 1989.

Shen J., Wang L.-L., Sparse Spectral Approximations of High-Dimensional Problems Based on Hyperbolic Cross, SIAM J. Numer. Anal., vol. 48, no. 3, Jul. 2010, 1087-1109.

Sobol I.M., Sensitivity Estimates for Nonlinear Mathematical Models, Mathematical Modelling and Computational Experiment, vol. 1, no. 4, 1993, 407-414.

Rabitz H., Aliş Ö.F., General foundations of high‐dimensional model representations, Journal of Mathematical Chemistry, vol. 25, no. 2–3, Jun. 1999, 197-233.

Rabitz H., Aliş Ö.F., Shorter J., Shim K., Efficient input-output model representations, Computer Physics Communications, vol. 117, no. 1-2, Mar. 1999, 11-20.

Li G., Wang S.-W., Rabitz H., High Dimensional Model Representation (HDMR): Concepts and Applications, 2000.

Quadling D.A., Lagrange’s Interpolation Formula, The Mathematical Gazette, vol. 50, no. 374, Dec. 1966, 372.

Barthelmann V., Novak E., Ritter K., High dimensional polynomial interpolation on sparse grids, Advances in Computational Mathematics, vol. 12, no. 4, Mar. 2000, 273-288.

Griebel M., Sparse grids and related approximation schemes for higher dimensional problems, 2005.

Wang X., On the approximation error in high dimensional model representation, [in:] Proceedings of the 40th Conference on Winter Simulation, Miami, Florida 2008, 453-462.