As per this Canada Revenue Agency (CRA) page: Contributing to your spouse's or common-law partner's RRSPs
“Contributions you make to a spousal or common-law partner RRSP reduce your RRSP deduction limit. The total amount you can deduct for contributions you make to your RRSP or your spouse's or common-law partner's RRSP cannot be more than your RRSP deduction limit.”
So, you will not be able to claim any amount that your husband over contributed.
Thank you for choosing TurboTax.