The actual phrase is cater corner, and cater is from the French word “quatre” (four).  It means directly and diagonally across. It was Americanized by replacing the unfamiliar “cater” with the familiar “catty” and then “kitty.”  Phrases.org explains replacing an unfamiliar word such as cater with a familiar one is called “folk etymology.”