The party leaders wanted to present a memorandum to the Punjab Governor over Manipur violence