Well, all masses attract each other (don't ask me how THAT actually works), the bigger the masses, the stronger the attraction.
But it takes a bigger force to move (more precisely to say: to change the speed and direction of movement of) an object with a big mass. That's why a big stone, which is much harder to move, falls to the ground just as quickly as a small stone, which is easier to move but not attracted as strongly.
This is also why the ball moves towards the earth and not the earth towards the ball, though the attraction force is always the same on both sides between two objects - you'd need a much bigger force to significantly move an object like Earth.
It's also because of gravity that the planets keep circling round the sun and don't fly away in a straight line (without changing speed and direction) into open space.