I have peeled off the numbers and then used Goof Off (available at Walmart either in the paint section or the laundry section) to get off the sticky residue. It also helps to have the area you are working on, on something very flat like a counter top or piece of glass. When you apply the Goof Off, use a credit card to scrape the residue off. After you think it is off, use the Goof Off again with a soft cloth/towel until you cannot detect "sticky"
Terry