No, you don't have to claim expenses against your Self-Employment income. 

The likely reason why your Self-Employment expenses are reducing your tax refund is because they are reducing your income to below the level needed to qualify for the Canada Workers Benefit (CWB).