Error Bounds for Compositions of Piecewise Affine Approximations (2402.15601v1)
Abstract: Nonlinear expressions are often approximated by piecewise affine (PWA) functions to simplify analysis or reduce computational costs. To reduce computational complexity, multivariate functions can be represented as compositions of functions with one or two inputs, which can be approximated individually. This paper provides efficient methods to generate PWA approximations of nonlinear functions via functional decomposition. The key contributions focus on intelligent placement of breakpoints for PWA approximations without requiring optimization, and on bounding the error of PWA compositions as a function of the error tolerance for each component of that composition. The proposed methods are used to systematically construct a PWA approximation for a complicated function, either to within a desired error tolerance or to a given level of complexity.
- Althoff, M. (2015). An introduction to CORA 2015. Applied Verification for Continuous and Hybrid Systems.
- Approximate reachability analysis of piecewise-linear dynamical systems. In N. Lynch and B.H. Krogh (eds.), Hybrid Systems: Computation and Control, 20–31. Springer Berlin Heidelberg.
- Reachability analysis of nonlinear systems using conservative approximation. In O. Maler and A. Pnueli (eds.), Hybrid Systems: Computation and Control, 20–35. Springer Berlin Heidelberg.
- Lebesgue piecewise affine approximation of nonlinear systems. Nonlinear Analysis: Hybrid Systems, 4(1), 92–102.
- Approximation of reachable sets by direct solution methods for optimal control problems. Optimisation Methods and Software, 22(3), 433–452.
- Special facilities in a general mathematical programming system for non-convex problems using ordered sets of variables. Operational Research, 69, 447–454.
- Observability and controllability of piecewise affine and hybrid systems. IEEE Transactions on Automatic Control, 45(10), 1864–1876.
- A bounded-error approach to piecewise affine system identification. IEEE Transactions on Automatic Control, 50(10), 1567–1580.
- Dijkstra, E.W. (1961). Algol 60 translation : An algol 60 translator for the x1 and making a translator for algol 60. Technical report, Mathematisch Centrum.
- Signal approximations based on nonlinear and optimal piecewise affine functions. Circuits, Systems, and Signal Processing, 42, 2366–2384.
- Dunham, J.G. (1986). Optimum uniform piecewise linear approximation of planar curves. IEEE Transactions on Pattern Analysis and Machine Intelligence, PAMI-8(1), 67–75.
- Integrated model predictive traffic and emission control using a piecewise-affine approach. IEEE Transactions on Intelligent Transportation Systems, 14(2), 587–598.
- Gurobi Optimization, L. (2021). Gurobi Optimizer Reference Manual. URL http://www.gurobi.com.
- Error bounds for approximations with deep ReLU neural networks in Ws,psuperscript𝑊𝑠𝑝W^{s,p}italic_W start_POSTSUPERSCRIPT italic_s , italic_p end_POSTSUPERSCRIPT norms. Analysis and Applications, 18(5), 803–859.
- Piecewise linear approximations of digitized space curves with applications. In N.M. Patrikalakis (ed.), Scientific Visualization of Physical Phenomena, 545–569. Springer Japan, Tokyo.
- Computational-geometric methods for polygonal approximations of a curve. Computer Vision, Graphics, and Image Processing, 36(1), 31–41.
- Polygonal approximations of a curve — formulations and algorithms. In G.T. Toussaint (ed.), Computational Morphology, volume 6 of Machine Intelligence and Pattern Recognition, 71–86. North-Holland.
- Kolmogorov, A.N. (1957). On the representation of continuous functions of many variables by superposition of continuous functions of one variable and addition. Doklady Akademii Nauk SSSR, 114(5), 953–956.
- Improved piecewise linear approximation of nonlinear functions in hybrid control. IFAC Proceedings Volumes, 44(1), 14982–14987. IFAC World Congress.
- Piecewise affine approximations for functions of bounded variation. Numerische Mathematik, 132(2), 329–346.
- Identification and control of nonlinear systems via piecewise affine approximation. In IEEE Conference on Decision and Control, 6395–6402.
- Data-based identification and control of nonlinear systems via piecewise affine approximation. IEEE Transactions on Neural Networks, 22(12), 2189–2200.
- Branch-and-refine for mixed-integer nonconvex global optimization. Mathematics and Computer Science Division, Argonne National Laboratory, 39, 40–78.
- Convex piecewise-linear fitting. Optimization and Engineering, 10, 1–17.
- Robust vehicle lateral stabilisation via set-based methods for uncertain piecewise affine systems. Vehicle System Dynamics, 50(6), 861–882.
- On piecewise linear approximation of quadratic functions. Journal for Geometry and Graphics, 4(1), 31–53.
- Continuous piecewise linear delta-approximations for univariate functions: Computing minimal breakpoint systems. Journal of Optimization Theory and Applications, 167(2), 617–643.
- Roll, J. (2003). Local and piecewise affine approaches to system identification. Linköping University, Ph.D. Thesis.
- Reachability analysis of nonlinear systems using hybrid zonotopes and functional decomposition. arXiv 2304.06827.
- Set-valued state estimation for nonlinear systems using hybrid zonotopes. In IEEE Conference on Decision and Control, 2172–2177.
- Stämpfle, M. (2000). Optimal estimates for the linear interpolation error on simplices. Journal of Approximation Theory, 103(1), 78–90.
- Optimal piecewise affine approximations of nonlinear functions obtained from measurements. IFAC Proceedings Volumes, 45(9), 160–165. IFAC Conference on Analysis and Design of Hybrid Systems.
- Configuration of continuous piecewise-linear neural networks. IEEE Transactions on Neural Networks, 19(8), 1431–1445.
- Intersection-based piecewise affine approximation of nonlinear systems. In Mediterranean Conference on Control and Automation, 640–645.