I have had a recurring ear canal boil, the only pain relief I had to hand was ibuprofen which, surprisingly, worked quite well but it is still recurring. The immune system normally gets rid of these boils, but if not a course of antibiotics should do the trick. Otherwise seek other specialist help.
