The chairman of Haverhill Rovers has reiterated their zero tolerance approach to abuse after supporters had to be removed from the stadium.