Swimming right after weights should not "waste all the work you have just done". It may delay your post work out nutrition if you wait till after swimming to have a shake etc. Which may not be ideal, but your muscles will start recovering after you finish exercising. Your not undoing the traing you just did.

Just my two cents. I'm sure one of the guru's around here will pipe up with some better answers.