‘Congress workers should never do anything to damage party’