They weren't playing each other.
Each man played 5 games against different opponents (or the same opponent, but not each other). Both won 3, lost 2 — or any split — but never faced one another.
Classic lateral thinking puzzle. The answer is always in the unstated assumption.