If you finalized your divorce before January 1, 2019 you do need to report alimony for those years. Do that by amending the returns.
For divorces finalized after December 31, 2018, the person paying spousal support cannot deduct the payment on federal income tax forms. The person receiving support will not have to declare the support payments as income on federal income tax forms.