Not a problem with SB Acoustics since they use both glue and screws. And so does many other aswell but ive seen horrible example where they have this punch machine to squeeze the basket with rivet style (Seas is one)From a PA perspective, I've seen magnet assemblies fall off the basket from rough handling - they are just glued together, remember.
If mounting a speaker by its magnet instead of the frame, handle very gently!
Sorry english not my native language!