I have a few that have done that. Just make sure you rinse well and don't soak them in anything you want to re-use. It shouldn't harm glass and if you sozzle something glass to shake off any loose rust particles before you put it near plastic you should be fine using them with plastic too.
If you want the rust to stop, soak the metal parts for a little while in Coca Cola, the phosphoric acid will convert it from the red rust that spreads to the black rust that doesn't, not sure how long that will last when you're exposing it to cleaning chemicals afterwards though. Maybe do a final soak/rinse with Coke when you're done with them to prevent further rust?
I never bothered with this part, I just use 'em rusty and rinse well.