It is not possible to answer your question without knowing:
- the output impedance of the stage driving the volume pot
- the minimum allowed load impedance of this stage
- the input impedance of the next stage
- the maximum allowed source impedance for the next stage
- signal level (for noise aspect)
In general, the lower serial resistance is the better, if the previous stage tolerates it

Are you sure this is the optimal topology for your application?