We were always taking backups before import, no matter the status of
this box.
Turns out we were testing for the presence of the property defined by
the checkbox, rather than the value of the property, and as such were
always doing a backup.
We're now checking the status, and it behaves as expected