this discussion emerged from discord, one of them mentioned orthogonalized llama3, which brought me to review what orthogonalizing a matrix means.