You need to file an adjustment for the year in question. If mailing in, send in form T1-Adj. and attach a copy your T4 issued with the arrears.

Depending on the year, and whether you are registered ,you may also be able to use ReFile to make changes.