Sounds like early stages of hemorrhoids. Seeing a doctor is a good idea. In the meantime try some preparation H.
WARNING: This is kind of disturbing so be prepared. Inside my butt it burns and itches. I sit on the toilet and it all goes away. What's wrong with me? How do I make it go away?
See your doctor