Why GRU in DECODER doesn't initialize every batch?

[JaviS-Rei]

In Decoder's function 'call()'
output, state = self.gru(x)
When second sentence comes in, the first hidden is still in there?
Why is not the code like :
output, state = self.gru(x, initial_hidden = ...)

A freshman in tensorflow, thanks for help.