One can see Matrix Computations by Golub and Van Loan for more in depth math background than we will cover in class.