I think you take them all off or leave it be but whatever.
However if you take off the M and leave 340i then I think you are essentially saying I bought an inferior car that doesn't deserve the badge the manufacturer deemed appropriate - I'm ashamed of this M and I know the car and I aren't worthy.