When using the first pay telephone, a caller did not deposit coins in the machine. He or she gave them to an attendant who stood next to the telephone. Coin telephones did not appear until 1899.

Source: absolutetrivia.com

More money fun facts at SavingAdvice.com.