gamepad controls showing up evertime when i host a party.

I tried to dissconect everthing for the controller and STILL it dont work and restarted the game and still it dont work so when i get invited to a party i dont have the controls but why is it in?