Pass decoder hidden state instead of decoder id for sequential generation

In the huggingface whisper implementation, in super().generate() function, the decoder token ids are passed to predict next token. I want to pass the initial decoder hidden states (instead of tokens) and output the next token hidden state (and not the actual integer token). is there a way to do that in this implementation?