There are a number of meanings that you can infer from the words of this poem. In some ways, inferred meanings are in the opinion of the reader -- that's why they are inferred.
You can infer, for example, from the first four lines that the speaker and the object of the poem have some deep bond. The speaker is implying that the two of them can talk to each other with their eyes. This is something that only happens between people who have a pretty intimate relationship.
On the other hand, you can infer from the last 8 lines that the object of the poem does not actually love the speaker. You can infer that she sent back the roses that he gave her and all she did was breathe on them. Why would she send them back if she loved him?
So there are many things you can infer from this poem, depending on how you want to read it.