Adam
I would suggest that next time you are at it, observe yourself closely, see your feel before as in what triggers you), during and post your visit at a gay porn site.
That would help you know that what is it that you seek. That is the most pertinent question here.
You see your visiting a gay porn is not the issue, but your intention is. Stay with it, and you'd get clarity.
Just dont try to curb a habit just because you think it is not 'right', once you understand it, you will automatically feel no need to indulge in it, anymore.
See it like any addiction like drugs or alcohol. Please dont judge yourself for it, it is just a learnt mechanism, that you would unlearn soon.
I am living proof that you can get out of it, even if you were once living for it.