Do I deduct GST paid on expenses from GST collected to calculate the GST I owe for my business?

It's my first year dealing with GST for my proprietorship. I've input the amount I collected, but I don't know if the GST I've paid on my expenses (ie. office supplies) should be deducted from that to create the total amount I actually owe.