Your body will go into starvation mode and hold on to everything it can and will store fat and eat away your muscle. Like Brad said diet and exercise and when you said you will workout every now and again you will not be very successful on gaining muscle and you will be getting weaker.