How can women get pregnant after their husbands had vasectomies?

I don't get it. Vasectomies are suppose to be permanent. If there's a chance a woman might become pregnant, why don't the doctors just remove a large segment of the vas (or remove it completely) instead of a small piece?