Neil Parish, the MP for Tiverton and Honiton in Devon, has had the Conservative whip removed after being accused of the act by two female ministers.