Nope, a gallon of whole milk is usually the missing link towards increased strength/mass.
Matter of fact, if anyone was paying attention during the movie, "Pumping Iron", a reporter asked Arnold is he drank a lot of skim milk. Arnold replied saying, "Oh no, only a lot of WHOLE MILK". Everyone demonizes whole milk in these bodybuilding forums, but unless you're 8 weeks out from strutting on stage, you should stop being a pussy about what you eat and JUST EAT!
This goes back to people misinterpreting the nasty words "clean bulk". A lot of people seem to think that means 'skim milk', a handful of almonds, and lots of tuna!
-> Same people who are the perpetually ripped 150 lbs and are pissed they cannot gain muscle.