If I find out after I have purchased a property that the former owner has not settled the Government rent, will I be liable to pay?

Yes. An owner should ensure that all Government rent (including any outstanding Government rent not paid by the former owners) for the property has been paid in full.