About infer in GPU

[JohnFengNeumann]

Hello，@jishengpeng . I'm testing your job, but I found the code for wavtokenizer.decode can't be inferred in GPU. Could you tell me how I can fix this problem?

[jishengpeng]

Hello，@jishengpeng . I'm testing your job, but I found the code for wavtokenizer.decode can't be inferred in GPU. Could you tell me how I can fix this problem?

To utilize the GPU during inference, simply change 'cpu' to 'cuda:0' in the device settings. Ensure that all inputs to the decoder, such as features and bandwidth, are placed on the GPU.