At two years old I do not see the problem here. Now there will be an age, not too far away, that you may want to re-think that. But at two? You need to do what you and your wife are comfortable with.
I have two teenage boys. I am lucky to even get a hug these days.
Enjoy the little one while you can!