How to treat it: If your nose bump is from a keloid, then you should remove the piercing right away. This may help slow your body's exaggerated healing reaction. If you're prone to keloids ...