No, not always. I fly a GV and we go to 470 / 490 all the time. If you are going to worry about something, why don't you try using science. How many accidents have been caused (or made worse) by being at 490 as opposed to 410? None! Stats can be very usefull, they make you not pull concerns out of your rear. Look at where most accidents happen, then focus your worries on making that phase of flight safer. Many times 490 could be SAFER than 410 (wx, traffic spacing, etc.) Everyone has the right to an opinion, I just like the ones that are backed up by facts.
Ps: I am also asuming (considering your concerns about rappid decompression) that you always have your mask on and sealed above 350, right?
Ace