Sometimes you may be assessed during your lecture (e.g. quizzes in junior Biology) so you must be in your correct lecture at those times. In most cases though, you can interchange between streams.
It depends on things like what Ozko said. But i'm changing on my own for one of my lectures and my lecturer said it was fine, i didn't need any permission or anything. So it would be best if you talked to them first imo.