doesn`t work when 5+player playing with both keyboard and controller

[ELITTK]

two xbox controllers is fine. but for p3 and p4, for example, the joycon(L) and the keyboard we use will control the player 3 at the same time.
we also try online mode with two different computer, keyboard and joycon still can not control different player. if the joycon joined the lobby, keyboard just simply unable to do anything except open the menu.