Wiktionary
throw smoke
vb. (context idiomatic baseball slang English) To consistently pitch fastballs that are difficult to hit.
Usage examples of "throw smoke".
I'm sure I hit some of them, but I couldn't swear to anything but that I hit one good and he started to throw smoke and went into a spin.