The Phrase Finder defines this idiom as meaning a burdensome possession that creates more trouble than it is worth. Albino elephants were considered holy in ancient Thailand. A subordinate who displeased the Thai King would be given a white elephant, and the cost of the special food and providing access to worshipers would often ruin the person receiving the gift.