Ballarat's botanical gardens has a bust of every Australian prime minister and at $30,000 a head, the recent leadership instability is proving quite costly.