I guess it depends on what particular area of biomedical engineering you are interested in, can you elaborate a bit more on what you mean by you are not really into physics? I know from a friend who is currently studying biomedical engineering that you do do a fair bit of maths in first year, and you learn about things such as fluid dynamics which is like physics but apply it to systems in the body, depending on what field you want to specialise in, all disciplines of engineering can be very involved in computer, whether it be modelling a particular biological system. Perhaps you could look at the course outline to give you a better idea of whether the topics seems interesting to last for a few years of study