Seems like GE on a 2x2 matrix should be pretty darn fast.... especially if you use scalar * vector type operations.
One of the fundamental operations in machine learning is computing the inverse of a square matrix. But not all matrices have an inverse. The most common way to check if a matrix has an inverse or not ...