When did we start using passports?

As the world becomes increasingly global for some, and increasingly divided for others, the question remains: Should lines on a map be what determine a person's rights and freedoms?