Douglas Harper's Etymology Dictionary
criminy
also crimine, 1680s; it looks like Italian crimine "crime" but likely is simply another euphemism for Christ as a swear-word.
Wiktionary
criminy
interj. (non-gloss: A minced oath that expresses surprise.)