Can I track retainers and how much has been used?

Yes. Set a project’s billing type to retainer with its included hours, and the Retainers tab shows the drawdown — hours used against hours included, a progress bar, and a warning when you go over the retainer for the period.