You should always keep an eye on the defense of your district. Especially if you've unlocked a new unit type, you may want to adjust your defense. Click on the "Charter" symbol on the left of your screen.

Adjusting and placing your defenders works the same way as in an attack. If you've made a change, you always have to confirm it with the "Defense Ready" button.