Find the word definition

Wiktionary
smash the stack

vb. (context computing English) To corrupt the call stack, causing execution to jump to a random address, sometimes used as a malicious attack on a system.