Get off the Earth Puzzle

Get off the Earth

Made famous by puzzler Sam Loyd. Count the swordmen. Move the red dot to the other side. Count the sword men again. What's going on?