You have to pay all the time if you dont want a boring game. From level 5 up (from Age 5) it takes days. To get the resources to make an upgrade, also it at least 2 or 3 days for an upgrade of a regular building (unless you dont pay a lot of real money to buy gold for upgrades.
I would prefer to pay for buying the game rather to to have to pour money all the time, or if not to have to play such slow, time consuming and boring game.
AlBundys about Age of Empires: Castle Siege, v1.17