The Phrase Finder explains that the expression means to cause trouble or create an uproar. The verb “to raise” has been used to mean “to conjure up and to cause a spirit to appear.” If you are making trouble you are raising or conjuring up “…the accursed spirit of Cain” who had murdered his brother Abel.