Drop SDD and focus on 4u Maths. You'll do fine with the extra time for study. Your intuition told you to drop it in the preliminary years. If you lost interest in it, frankly to say, I don't think you'd have the interest to concentrate on SDD anymore...
I say go for 11 units =)