God's justice requires him to punish sin to correct behavior and purify. The exile in Babylon happened to cleanse Israel's wickedness and remove all of Israel's sins (see Romans 11:27).
This aimed to end all pagan worship in Israel, including the incense altars and the poles used for worshiping the goddess Asherah.