Can I report the payments I made to an employee-nanny against my self-employment income? Or should this be reported only under Child Care Expenses?

The childcare expenses section is the correct spot to enter those amounts. Although you incurred the expense in order to run your business, the cost belongs in the childcare section of your return - not business expenses.