Should we claim 4 exemptions?

Currently, my husband is the income provider and he makes less that $40k a year and I do not work and we have 2 kids (5 year and 2 year old) and currently my husband claims married and 2 exemptions should we claim 4 for each of us and does this mean we will have to pay back a bunch of money year end?