I have to admit that this is one of the things which frighten teachers. There is such a fine line between what is appropriate and what is not appropriate that many teachers tend to flee towards the side which no one can assume is wrong.
That being said, from how it sounds to me, is that you are having these feelings because someone took an interest in your well-being. If this is the case, the emotions you are having are normal. Unfortunately, these feelings have a cost--either to the teacher or the student. The student may take things too far, admitting their feelings, and be shut down by the teacher. This would force the student to, again, feel as though no one cares. On the other hand, the teacher may begin to feel as if the student has feelings for them and begin to change their behavior toward the student (which either makes the student try harder out of fear or embarrass the student because the teacher misread their own feelings about what was/is going on).
Regardless, I think that you need to evaluate your own feelings. If you are having romantic thoughts about the teacher, and you do care about them as a person, you need to back off. You could be putting the teacher's career at stake. On the other hand, if you are simply in the "relationship" because they are concerned for your well-being, and you understand that, it would seem to be healthy.
Please remember that this is a very sensitive subject for both sides and that I am simply offering my opinion as an educator and not a psychologist/psychiatrist.