If you take a look at the map of the Median Empire (provided by wikipedia), you see that Cappadocia was on the eastern extremity of it, a border region, probably very prone to all sorts of invasions by neighbouring empires. It's just a hide-out, sort of an ancient type of bunker.