Is there a workaround for panoptic segmentation and tracking in idol?

[Wu-Xiang123]

I tried to set stuff as special "things" and set each stuff class a same tracking id, while thing classes keep their different tracking id, but it results in a bad perfermance on stuff segmentation. Is there anything wrong with idol's loss or mathing method when considering big area stuff who may always surround things? What should I do to make it work? Thanks a lot!
Note, in other vis method such as mask2former, it works fine when generalize to panoptic segmentation and tracking.