Sizing up the population of gamma-ray binaries