Does the IRS have to formally assess the tax before charging evasion?

No. If you fail to file and the IRS later determines what you owe. In fact the IRS is authorized to use a criminal charge and order of restitution by the court in a criminal tax case as the basis for a civil tax assessment under IRC 6201(a)(4) (a \”restitution based assessment\”, or \”RBA\”).