Structured State Space Decoder for Speech Recognition and Synthesis