This is normally already balanced out by the additional popcap you receive on top when you're on the side with lesser players.
but it means that have alway the same amount of troop by time? i tink it if is yes the game is already balanced, as defending territory with less commander is a mistake of the general and make 2 army combined is one thing, 2 troops commanded by only one player are more efficient