Infoplease.com observes that card players would place a marker, called a “buck” in front of the person who was the dealer. The buck would be passed to the next person who then had the responsibility to deal. The expression “passing the buck” eventually became synonymous with passing responsibility.