about magnet swapping, is it true that the bigger the magnets, the better?

I'm not sure, but it would seem like it would all depend on how much magnetic force a magnet would have, right?