It's such a difficult question. I've seen plenty of buildings that at least had some appeal (to me anyway) to them be replaced by basically boxes with windows. In which case, I lean towards conservation. (If we are talking about architecture.)
On the other hand, I know things do have to change. I just wish they changed for the better. A lot of the time, they seem to change for something more cost effective that doesn't work as well.