Wiktionary
put someone down as
vb. (context idiomatic English) to assume someone has a particular character from very little information.