Do i enter both my children in the dependent section if my ex-spouse has claimed my eldest son on his taxes?

Yes.

You'll still enter both kids as dependants on your return. You'll just choose the appropriate credits to claim for each of them. For example, if your ex-spouse claimed the eligible dependant credit for your eldest son on their return, you can't claim him again for the same credit on yours.