The answer actually is that velocities don't just add up. You have to study relativity to understand why (and is was a long time ago that I, sort of, understood). At every day speeds just adding together is accurate enough - you are only out by an amount equal to the product of the velocities divided by the square of the speed of light.
Just because the conveyor belt is a practical impossibility - due to infinite mass - doesn't really answer the question. The counter-intuitive idea that velocities don't simply add together does.
My personal variant of this question is consider a long, stiff stick. I push one end, doesn't the other end move instantaneously, therefore faster than light transfer of information? The answer is, it depends what you mean by stiff. Infinitely stiff would do the trick, but there you go ... no infinitely stiff stuff exists so real sticks move like a spring.