Wiktionary
a. Interested in having relationships with both men and women, curious about one's potential bisexuality; especially, of heterosexual people, considering a first sexual experience with a member of the same sex.
Wikipedia
Bi-curious is a phenomenon in which people of a heterosexual or homosexual identity who, while showing some curiosity for a relationship or sexual activity with a person of the sex they do not favor, distinguish themselves from the bisexual label. The term is sometimes used to describe a broad continuum of sexual orientation between heterosexuality and bisexuality. Such continuums include mostly-heterosexual or mostly-homosexual, but these can be self identified without identifying as bisexual. The terms heteroflexible and homoflexible are also applied to bi-curiosity, though some authors distinguish heteroflexibility as lacking the "wish to experiment with ... sexuality" implied by the bi-curious label.
The term bi-curious implies that the individual has either no or limited homosexual experience in the case of heterosexual individuals or no or limited heterosexual experience in the case of homosexual people, but may continue to self-identify as bi-curious if they do not feel they have adequately explored these feelings, or if they do not wish to identify as bisexual.