Well I didn't find a caterpillar, but I did find a box elder bug! The internet says they normally don't eat/mess with house plants but if its not the box elder bug then I have no clue what else it could be, anyone have any knowledge about box elder bugs and weed plants?