How high's your bodyfat? If you're carrying too much the shrinking arm could be from fat-loss in the upper arms. Extra fat is stored in the triceps-area with some people.

Of course, be sure you're not mistaking arm-pump for arm-growth.