If your Eligible Pension Income is less than $2,000, the Pension Income Amount will adjust to that amount. Not all income reported on a T4A qualifies as Eligible Pension Income.

This CRA document explains further which income does qualify: https://www.canada.ca/en/revenue-agency/services/tax/individuals/topics/about-your-tax-return/tax-re...