According to CRA, the conditions to be eligible to participate in the HBP under "Your RRSP deduction may be affected by your participation in the HBP", the withdraw that you made in November 2019 from RRSP does not qualify for HBP because you cannot buy or build a qualifying home before October 1st of the year after the year of the withdrawal (October 1st, 2020).
However, your withdrawal will not be taxed if you choose to cancel and repay the full amount you withdrew under the HBP to your RRSPs. Any amount of your withdrawal that is not repaid will be reported as income on line 12900 of your income tax and benefit return for the year in which the funds were received.
In addition, there are some extensions that could be considered to qualify the HBP from your RRSP withdraws. You can check the link here: Extensions for buying or building a qualifying home or replacement property
If you require further assistance please contact our phone support team or contact us directly on Facebook or Twitter.