Some toothpastes contain ingredients like hydrogen peroxide or baking soda that can help shrink the pimple, but they may also dry out the skin.