I need help, im confused.

I'm new here and hoping for good advice to my problem. Sorry for my bad English. Here's my issue:

I and my brother had a sexual encounter about few years ago. Since that time we've never talked about it. And for me it makes me sad, anxious, and guilty because it interferes my relation with him. I'm not able to be open with him. I don't know if he still remember, forgotten, or just ignoring what happened. What should I do? Should I remind what we did and reconcile? Or should I keep it to myself, try to forget, and try to move on?

I already forgive myself and him but never told him. I fear of possible negative reaction. I know I can't change the past and cannot blame him. I observed him and it seems like he's okay. Why I cant be like him? If I told him, he may be depressed like what I am going through and get mad. If I keep this to myself, sadness and regret may continue in my life. I don't know now.... My problem is like a dilemma.

Please tell me how should I fix this. I want to know the reasons on why should I tell him, and reasons why I should not tell him?

Thanks in advance.