Don't allow a PVP match to start with uneven teams. It always takes the join in progress feature at least two minutes to find someone. You can imagine how well this works in games like rift.