Can't rejoin a Mudrunner game???

Mudrunner was just released for free on Epic Games, so me and my brother were playing it for a while. I have no way to join back; Here's the story. We both left for thanksgiving lunch, and came back to us being kicked for idle. No big deal. He joins his multiplayer server, I go to multiplayer and try to join back, and this happens - I join my own lobby. My progress is saves but I'm not with my brother? He has no way to invite me back either. Epic Games has no built in way for you to join friends like steam, so I would expect Mudrunner to have that, but since it was originally built for steam, it doesn't have that. If I try to join someone else, the game threatens to delete my progress. Any solutions?