The Bora-Hansgrohe rider says the Tour de France cannot be delayed further after being delayed until August