You would have to drink over 60 liters per day of soda sweetened with aspartame everyday to overwhelm your body’s ability to metabolize it. It’s not a poison, even though some absolute wing-nuts seem to think so (see here if you want an IQ lowering). Everything in moderation.

Aspartame in powdered from—Via Wikipedia