Yes, but gently. There is really no need tho because they will fall off on their own.
It's more that they are 'baby leafs', they exist as a 'stop gap' until the plant has grown a few proper leafs, but yes just leave them alone.those leaves will fall off, the plant is getting rid of them cuz they dont get enough light