IMO it all depends on the type of diet your following. If your running something like a CKD or UD2 were fats are moderate to high, then keeping the yolk is of great benifit. That is were all the fat (both good and bad) are contained.
If your running a low fat, or 40/40/20 you may want to toss them.
You do bring up an interesting point though, many people believe that the all of the protien is in the white, but that simply isnt true.
I don't do this for my family, my friends, women, accolades, pride, or ego. I do it for me and no one else, its just part of who I am.