What are you trying to do? By the time you're using your soil, it should be composted enough that the worms don't have anything to feed on.
My compost pile is outside. I'm sure some worms make it inside via the soil, but I don't think they live long.
The only things I can think of that would be attracted to the worms are birds and fish.