A Single Linear Layer Yields Optimal Low-Rank Matrices