If you received Canada Emergency Response Benefit (CERB) payments you weren’t entitled to, you have to return them to the CRA or Service Canada.
You can repay via online banking or by mail using the instructions found on the CRA's Return or repay the CERB page.
To claim a deduction for the amount of CERB benefits you repaid on your tax return: see How do I claim a tax deduction on my COVID-19 benefit repayment?