These annoying and painful little sores tend to resolve on their own. But if they don’t – or you have any of these other symptoms – it could be time to seek help.