lol, I don't think the board of studies have a specific rule that prevents teachers from doing this, they would be unable to predict every possible situation, like all laws-constructed by humans, inevitable that there will be some flaws, so I don't think you can report this to board of studies and be successful...
When you say you got marked down for not rounding off to at least 3 decimal places, do you mean a lot of people just write more than 3 decimal places? or did they just round down to 2? It also depends on the question and the data within the question, it is not an explicit rule, but it is generally a fact that if the question has data to 3dp, this includes 0, i.e. 3.100, your answer should only be three decimal place max, because if you have more than 3 decimal places, it is impossible to get a value to an even greater accuracy/precision than the original measurements(data from the question)that it was extracted/analysed from. So although it may not be in the question of how many decimal places you have to round off, but your teacher may have told you in the past or assumed you know certain rules relating to rounding off-do you by any chance remember they telling you that?
As long as if the teacher had marked consistently-i.e. they marked down all the people who didn't round off-I think it is hard to report this to the head teacher or say they are not allowed. Although in hindsight you may feel it is vastly unfair, but what you can take from this is to take the responsibility to ask teachers about their requirements, i.e. answering questions rounding off before future assessment, and perhaps ask them to explain to you why you got marked down for not rounding off-i.e. will there be an implication for later errors or harder to draw a graph accurately if not rounded off if a graph was required...
Ask your teacher for a reason and learn a lesson from this-life can never be absolutely fair
you just have to make the best of everything and hope next time, this doesn't happen again
hope this helped