People say this. I don't understand it. We fucked up their country. How are we going to do anything by staying there other than continuing to fuck it up?

That doesn't logically follow. Conquering a country usually involved "fucking it up." You seem to be arguing that a conqueror should never reconstruct, which would be a rather nihilistic way of war, to say the least!