BJP workers left the party