It is a sore point because you do have advantages if you have access to more than one language. You also have problems because on bad days you don't trust yourself either in your first or your second language and so you feel like a complete halfwit.
It is the people who can do nothing who find nothing to do and the secret to happiness in this world is not only to be useful but to be forever elevating one's uses.