You can't do that. You borrowed HBP out your own RRSP, not your spouse's.
You need to make a contribution to your own RRSP in order to repay HBP, otherwise CRA will assume you have withdrawn the amount in question. It then gets added to your income and is taxed.