## The Annals of Mathematical Statistics

- Ann. Math. Statist.
- Volume 19, Number 4 (1948), 517-534.

### Symbolic Matrix Derivatives

Paul S. Dwyer and M. S. Macphail

#### Abstract

Let $X$ be the matrix $\lbrack x_{mn}\rbrack, t$ a scalar, and let $\partial X/\partial t, \partial t/\partial X$ denote the matrices $\lbrack\partial x_{mn}/\partial t\rbrack, \lbrack\partial t/\partial x_{mn}\rbrack$ respectively. Let $Y = \lbrack y_{pq}\rbrack$ be any matrix product involving $X, X'$ and independent matrices, for example $Y = AXBX'C$. Consider the matrix derivatives $\partial Y/\partial x_{mn}, \partial y_{pq}/\partial X$. Our purpose is to devise a systematic method for calculating these derivatives. Thus if $Y = AX$, we find that $\partial Y/\partial x_{mn} = AJ_{mn}, \partial y_{pq}/\partial X = A'K_{pq}$, where $J_{mn}$ is a matrix of the same dimensions as $X$, with all elements zero except for a unit in the $m$-th row and $n$-th column, and $K_{pq}$ is similarly defined with respect to $Y$. We consider also the derivatives of sums, differences, powers, the inverse matrix and the function of a function, thus setting up a matrix analogue of elementary differential calculus. This is designed for application to statistics, and gives a concise and suggestive method for treating such topics as multiple regression and canonical correlation.

#### Article information

**Source**

Ann. Math. Statist. Volume 19, Number 4 (1948), 517-534.

**Dates**

First available in Project Euclid: 28 April 2007

**Permanent link to this document**

http://projecteuclid.org/euclid.aoms/1177730148

**Digital Object Identifier**

doi:10.1214/aoms/1177730148

**Mathematical Reviews number (MathSciNet)**

MR27254

**Zentralblatt MATH identifier**

0032.00103

**JSTOR**

links.jstor.org

#### Citation

Dwyer, Paul S.; Macphail, M. S. Symbolic Matrix Derivatives. Ann. Math. Statist. 19 (1948), no. 4, 517--534. doi:10.1214/aoms/1177730148. http://projecteuclid.org/euclid.aoms/1177730148.