Wiktionary
take one's eye off the ball
vb. (context idiomatic English) To lose one's concentration on what is most important.