Wiktionary
fun sponge
n. (context figurative English) Someone who or something which soaks up all of the fun, taking the fun out of life.