Wiktionary
ghost at the feast
n. (context idiomatic English) A presence that mars one's enjoyment by causing guilt or reviving unwelcome memories.