Ross, if it makes you feel any better, I have naturally scrawny upper arms (in relation to my upper body)
I don't really look like I work out, aside from my traps, and upper torso. I once was really fat. I am at about an average 'guy who eats well and doesn't workout' fat level.