Yes, if you made an RRSP contribution in February 2022, you have to enter it on your 2021 return.
Ideally, you would wait until you received your NOA from the CRA after changing your 2021, and if you are using ReFile or My Account to make the change, it should not take long to get it. But if you are in a hurry, you can adjust the 2021 and then send your 2022 without waiting for the NOA.
