That's a tough call. I'm one who likes to keep as many original pieces as possible. For example, my interior is all original except the drivers seat and carpet. I've never had anyone say to me "Hey, you're driver's seat is slightly off from the rest of the seats."
I hope you keep it as original as possible. But on the other hand, if you can afford it, why not?