Polarity vs cone movement for different drivers

While working with a crossover and thinking about polarity, I had the thought that unless there is some kind of standardization in place, the + and - marked terminals on a driver only have meaning for that particular driver model, or possibly manufacturer. If I mix and match brands of woofers, mids, tweeters, who's to say that applying a positive voltage to the + terminal will make all the cones move in the same direction, since it depends on the direction the voice coil is wound. Is this a valid thought or am I missing something?