I always thought that I am a transman, but the problem is, I do feel attracted to men, and that confuses me.

Your gender identity does not have that kind of relationship to sexuality. They’re both intersectional but represent two realities. So you can be trans* and gay, or non-binary and straight, and so on. One does not set the other in stone.