APPLICATION OF TENSOR ALGEBRA IN THE DIFFERENTIAL CALCULUS OF MULTIDIMENSIONAL MAPPINGS

Authors

DOI:

https://doi.org/10.31110/fmo2024.v39i3-03

Keywords:

derivative, differential, linear space, linear operator, vector function, matrix, tensor product, bilinear mapping, quadratic form

Abstract

Formulation of the problem. There are known formulas that can be used to find the derivative of each element of a multidimensional mapping. At the same time, the Jacobi matrix - its first derivative, the Hessian matrix - the second derivative of a scalar function of several variables, etc., are rarely used in practice. At the same time, using matrices as a technical device for solving similar problems is convenient and practical. Difficulties still arise on this path, for example, when writing the derivative of a matrix as a matrix. For an adequate description of such constructions, it is worth using tensor products of matrices, where together with ordinary matrices and vectors work with a formal vector - a linear operator, the elements of which are partial derivative operators. At the same time, the formulas for the derivative of arbitrary and differential order from the vector function become clear and transparent.

Materials and methods. To study high-order derivatives of multidimensional mappings, the method of tensor (Kroneker) matrix products is widely used. At the same time, the derivative of an arbitrary order of the vector function is defined as the tensor degree of the formal differential operator of the first order - the transposed gradient vector. The action of such tensor expressions on a vector function gives its derivative of the appropriate order. This makes it possible to describe the construction of derivatives in the language of matrices, which is qualitatively different from finding partial derivatives of each component of a multidimensional mapping.

The results. Formulas for the first and second derivatives of vector functions are proved and written out in detail by using tensor products of matrices, and it is also indicated how the derivative of arbitrary order is found. In classical courses of mathematical analysis, as a rule, the Jacobian matrix of the multidimensional mapping and the Hessian matrix (second derivative) of the scalar-valued function of the multidimensional argument are written out. The proposed article shows the algorithm for finding an arbitrary derivative as an operator acting in the tensor product of linear spaces, which allows a better understanding of this important construction of mathematical analysis.

Conclusions. Wide application of tensor operations, in which the formal vector operator of the first-order derivative also works, turns out to be very effective. Moreover, in this way, it is possible to show the structure and find out which elements of linear spaces are the derivatives. In this way, it is possible to obtain all derivatives of the desired order at once instead of each partial derivative separately.

Downloads

Download data is not yet available.

References

Abraham, R., Marsden, J.E., & Ratiu, T. (1998). Manifolds, Tensor Analysis, and Applications, 2nd edition, SpringerVerlag, N.Y. https://doi.org/10.1007/978-1-4612-1029-0

Aja-Fernandez, S., García, R. L., Tao, D., Li, X. (ed.) (2009). Tensors in Image Processing and Computer Vision. Series: Advances in Pattern Recognition, Springer-Verlag, London (e.g. see : A review of tensors and tensor signal processing, by L. Cammoun et al.) https://doi.org/10.1007/978-1-84882-299-3

Bokhonov, Yu. (2022). Liniyna alhebra: Kurs lektsiy: kurs lekts. dlya stud. spetsialʹnosti 122 «Kompʺyuterni nauky» / KPI im. Ihorya Sikorsʹkoho. Kyyiv. https://ela.kpi.ua/handle/123456789/47625

Bokhonov, Yu. (2021). Matematychnyy analiz. Chastyna 2. Dyferentsialʹne chyslennya funktsiy kilʹkokh diysnykh zminnykh. Intehraly, shcho zalezhatʹ vid parametra: navch. posib. dlya stud. spetsialʹnosti 122 «Komp’yuterni nauky» / KPI im. Ihorya Sikorsʹkoho. Kyyiv . https://ela.kpi.ua/handle/123456789/56825

Hardy, Y., & Steeb, W. ·(2019). Matrix Calculus, Kronecker Product And Tensor Product. A Practical Approach To Linear Algebra, Multilinear Algebra And Tensor Calculus With Software Implementations.

Itskov, M. (2009). Tensor Algebra and Tensor Analysis for Engineers. Springer-Verlag Berlin Heidelberg. https://doi.org/10.1007/978-3-540-93907-8

Lancaster, P., & Tismenersky, M. (1985). The Theory of Matrices with Applications. Academic Press, New York.

Madill, D.R. (1998). Tensor Products and Matrix Calculus. Department of Electrical and Computer Engineering, University of Waterloo.

Marcus, M., & Minc, H. (1992). A Survey of Matrix Theory and Matrix Inequalities. Courier Corporation.

Nguyen-Schäfer, H., & Schmidt, J-Ph. (2014). Springer-Verlag Berlin Heidelberg. https://doi.org/10.1007/978-3-662-43444-4

Published

30.06.2024

How to Cite

Bokhonov, Y. (2024). APPLICATION OF TENSOR ALGEBRA IN THE DIFFERENTIAL CALCULUS OF MULTIDIMENSIONAL MAPPINGS. Physical and Mathematical Education, 39(3), 24-30. https://doi.org/10.31110/fmo2024.v39i3-03

Most read articles by the same author(s)