selectorate

noun: A smaller group of people, as opposed to the general population, involved in picking a person, especially for a political position.