To avoid making holes in the first place, use vinyl siding clips instead of fasteners to hang decorations. They're designed to attach to vinyl siding without doing any damage or leaving a mark.

A vinyl siding removal tool (VSRT ... Work the tool up and back and forth until the bent portion of the tool hooks on to the lower lip of the upper piece of siding. Pull down and out to separate ...