A popular event that draws thousands of people every year will not take place this year after safety concerns were raised.