first year is ok, the physics courses' math content wont get harder than easy ext.2 mechanics and ext.1 SHM, although the physics concepts can get difficult. the maths courses go more in-depth with calculus (also covers complex numbers, ext.2 volumes and integration) and you'll start linear algebra which is entirely new - deals with matrices and vectors. the maths in the engineering courses themselves usually just involves memorising a key methodology. you'll do some boolean algebra (binary math), deal with some trig functions and complex numbers (for ac waves), and learn some processes for analysing circuits.
the math content is not so advanced but the concepts make things pretty hard. you also cover a lot of material and have to learn independently. i think you shouldnt find 1st year too difficult if you've done ext.2 - would definitely help if you also did physics. although 1st year isnt too hard, i can imagine things getting much more difficult in upcoming years, so you'll definitely have to work hard