Go Back   Bodybuilding.net - Bodybuilding Forum > Main Forums > Training


Analyzing Studies



Reply
 
Thread Tools Display Modes
  #1  
Old 10-17-2007, 12:52 PM
EricT EricT is offline
Rank: Heavyweight
 
Join Date: Jul 2005
Posts: 6,314
Default Analyzing Studies

If you go to Bryan Chung's Blog here:

http://evidencebasedfitness.blogspot.com/

And look at the "Going the Extra Mile..." entry you will see a very good example of someone analyzing the pros and cons of a study on fitness (here it is static stretching). This is the kind of thing that can benefit everyone. Even if you don't read studies like us nerds you do need the ability to question the validity or lack thereof of the studies fitness writers use to back up their assertions. Chung makes some very good points about how the study he is looking at applies or doesn't apply.

I think I might post other examples of this kind of thing if I can them.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.



To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
or
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.


If you act sanctimonious I will just list out your logical fallacies until you get pissed off and spew blasphemous remarks.
Reply With Quote
  #2  
Old 10-17-2007, 01:14 PM
Ross86's Avatar
Ross86 Ross86 is offline
Rank: Light Heavyweight
 
Join Date: Jan 2007
Location: NC
Posts: 3,268
Send a message via AIM to Ross86
Default

Do it!

It is so important for people to be able to read and understand a study for what it is. I think that most people just get bogged down and don't really pay attention to the shortcomings of so many of these studies. A large percentage of studies regarding exercise and supplementation are really worthless! Like the one you just posted...it's not realistic. But someone reading the intro and outcome would have thought it was worthwhile. It helps to cut through the **** in all of the worthless studies that supplement companies mention in their advertising.
Reply With Quote
  #3  
Old 10-17-2007, 01:25 PM
EricT EricT is offline
Rank: Heavyweight
 
Join Date: Jul 2005
Posts: 6,314
Default

The thing is it's not always the studies fault. Like here for instance it seemed pretty logical to use sedentray subjects to tease out whether changes were due to stretching and not something else...

Regardless of that, most of the time the problem is the media or some "guru" blowing everything out of proportion or making claims about a study that the researchers themselves never made or intended to. With the media in general it's just finding shit to write about probably but with the fitness gurus it's usually because they already have an opinion and are looking to twist data to fit that or are only including data that fits their pre-conceived opinions.
Reply With Quote
  #4  
Old 10-17-2007, 01:50 PM
Ross86's Avatar
Ross86 Ross86 is offline
Rank: Light Heavyweight
 
Join Date: Jan 2007
Location: NC
Posts: 3,268
Send a message via AIM to Ross86
Default

Agreed. I read an article in Flex about soy protein and decreasing test levels. The people conducting the study included someone that was probably coming off of a cycle of steroids judging by his test levels at the beginning of the study...there were only 13 subjects, I believe. The results were obviously skewed. If you took that one subject out of the study, then testosterone levels increased slightly. The media supposedly went wild and soy got a bad rap. Post that article if you can find it... I just looked (not very hard) and I couldn't find it.

Props to Flex for pointing that study out. They cleaned the study up and presented the facts.
Reply With Quote
  #5  
Old 10-17-2007, 01:51 PM
_Wolf_'s Avatar
_Wolf_ _Wolf_ is offline
Rank: Light Heavyweight
 
Join Date: Jul 2005
Location: Trinity University, San Antonio, Texas
Posts: 4,794
Send a message via MSN to _Wolf_
Default

boomarked and will be read over the weekend. thanks E
Reply With Quote
  #6  
Old 10-17-2007, 02:20 PM
EricT EricT is offline
Rank: Heavyweight
 
Join Date: Jul 2005
Posts: 6,314
Default

Here's a thing by Lyle MacDonald. It's his reaction to a research review on caloric restriction and life span. For those of you who don't know about this it is the idea that if you just generally eat a whole lot less (but with optimal nutrition) you may live a lot longer....

Not exactly very useful for our purposes here at BB.NET but another good example of critical thinking:

Research Review
Speakman JR and Hambly C. J Nutr. 2007 Apr;137(4):1078-86.

Starving for Life: What Animal Studies Can and Cannot Tell Us about the Use of Caloric Restriction to Prolong Human Lifespan.

Caloric restriction (CR) is the only experimental nongenetic paradigm known to increase lifespan. It has broad applicability and extends the life of most species through a retardation of aging. There is considerable interest in the use of CR in humans, and animal studies can potentially tell us about the impacts. In this article we highlight some of the things that animal studies can tell us about CR in humans. Rodent studies indicate that the benefits of CR on lifespan extension are related to the extent of restriction. The benefits of CR, however, decline as the age of onset of treatment is delayed. Modeling these impacts suggests that if a 48-y-old man engaged in 30% CR until his normal life expectancy of 78, he might increase his life expectancy by 2.8 y.

Exercise and cold exposure induce similar energy deficits, but animals respond to these energy deficits in different ways that have a minor impact on lifespan. Measurements of animal responses when they cease restriction indicate that prolonged CR does not diminish hunger, even though the animals may have been in long-term energy balance. Neuroendocrine profiles support the idea that animals under CR are continuously hungry. The feasibility of restricting intake in humans for many decades without long-term support is questionable. However, what is unclear from animal studies is whether taking drugs that suppress appetite will generate the same impact on longevity or whether the neuroendocrine correlates of hunger play an integral role in mediating CRs effects.

My comments: Excuse me a bit of lofty prose here…

For literally centuries, man has looked for ways to extend life or achieve immortality. From drugs to anti-oxidants to various other approaches, escaping the breaths of death has been a common human goal. In recent years, one approach has come to the forefront as not only having the potential to increase lifespan but actually having been shown to do so in most models studied (apparently houseflies are an odd exception).

That approach is called caloric restriction (CR) and is sometimes differentiated from your basic calorie restricted diet by adding the rider of caloric restriction with optimal nutrition (CRON) with the idea of CRON being a reduction in total food intake while still ensuring sufficient/optimal intake of required nutrients.

Of course, by needs, most of the research on CR has been done in animal models since it’s not feasible to track humans over their lifespan to see what effect CR will have. However, CR has been studied in humans under more short-term conditions, looking primarily at various health parameters as an end result. For example, the Biosphere II experiment ended up being a 2 year CR model when the food supply failed and this allowed researchers to examine a number of effects of CR on human metabolism.

And before addressing this week’s study, I want to make that very clear distinction: there are two possible effects of CR. The first, and the one that the paper this week addresses is an actual increase in lifespan. As the paper points out, in some studies, an increase in 50% of average lifespan has been observed in some animal models. Applied to humans, CR might be expected to increase lifespan from an average of 78 to 116 years in men and 83 to 124.5 years in women.

However, an additional potential impact of CR is on overall health and even if CR fails to increase human lifespan, it could still have potential benefits on various health parameters (such as insulin levels and cancer risk). That second aspect of CR is not discussed in this paper but may be of as much importance.
One of the questions, and the one this paper addresses is what animal studies can and cannot tell us about the impact of CR on human metabolism.

The first issue addressed is what level of restriction is needed with 50% of normal intake generating the largest impact on lifespan. Because of the intakes of the control animals, this actually ends up being a 65% reduction from normal food intake. This level of restriction is required to get the maximum 50% increase in lifespan. Smaller reductions, such as 30% below normal, generate only a 20% increase in lifespan. Think about those numbers for a second. A male with a predicted maintenance of 2700 calories/day would be expected to consume 1350 cal/day for extended periods, a female with an 1800 cal/day maintenance would have to subsist on 900 calories per day for extended periods to gain benefits of CR.

The next topic discussed had to do with when restriction should begin for optimal results. The paper points out that almost all studies of CR in rodents and mammals occur very early in life, essentially after they are weaned (basically, child mice and rats). Basically, they are CR for their entire lives. Studies where CR is instituted later in life typically show much lesser impact with mortality rate frequently being identical to non CR animals.
Clearly, early onset CR has little relevance to humans who are unlikely to restrict their caloric intake for their entire lives. Rather, individuals (typically as they get older) become more interested in CR. An important question is then what benefits might occur if CR is started later.

Tangentially, and interestingly, the paper notes that elderly often begin eating less (often due to the onset of disease) and a loss of weight tends to be associated with higher mortality; nutritionists often focus on trying to keep bodyweight from dropping in these individuals.

In any case, plotting the relationship between the impact of CR on lifespan and when it is started, the researchers show a linear decline in impact as age goes up. putting this into table form, assuming that the animal research applies to humans, they show the following

Age at onset Time on restriction 15% restriction 30% restriction
15.6 years 62.4 years 5.6 years 11.2 years
23.4 years 54.6 years 4.7 years 9.4 years
31.2 years 46.8 years 3.3 years 6.5 years
39 years 39 years 2.4 years 4.8 years
46.8 years 31.2 years 1.4 years 2.8 years
54.6 years 23.4 years .25 years .3 years
62.4 years 15.6 years 0 years 0 years

Age of onset is when CR is begun, time on restriction refers to how many years the subject would have to restrict calories. The last two columns show the potential impact on lifespan of either 15% or 30% caloric restriction. For example, if someone began CR at 39 years old, and restricted their food intake by 15% for the next 39 years, they could expect an increase in lifespan of 2.4 years. If they could handle a 30% reduction in food intake, they might get 4.8 years extra lifespan. By the time folks are in their 50’s, CR has essentially zero impact on predicted lifespan. Again, assuming that the animal research holds. It’s possible that CR will be more effective in humans, just as its possible that it won’t even be as effective as in animals.

Another important question regarding CR has to do with hunger and whether or not it ever goes away with chronic CR (tangentially: this is also a question of importance to anyone trying to maintain an extremely reduced bodyfat level). To test this, the researchers placed mice on 20% CR for 50 days (equivalent to roughly 2.5 years in humans) and then allowed them to eat ad libitum to see if appetite had decreased. Quite simply, it hadn’t and the animals ate like crazy when given access to food. Unpublished data on their neuroendocrine profiles indicated that the animals remain physiologically hungry throughout the CR period.

The next point addressed by the researchers had to do with the mechanisms by which CR work which I’m not going to go into in detail. However, the researchers make an important note regarding the impact of CR on energy levels and exercise along with differences in the most common causes of death between rodents and humans. In rodents, the major cause of death is cancer whereas in humans it is cardiovascular disease.

Additionally, while exercise regularly is shown to have benefits for humans (in terms of health), this is not the case for animals.
They mention that the reductions in activity that typically occur with CR (they anecdotal reports of humans involved in CR of low-energy, along with chronic cold) could be detrimental to humans (but not to rodents); reducing exercise due to low energy levels might predispose humans to higher risk for cardiovascular disease. At the same time, primate studies of CR suggest improvements in markers of cardiovascular function. Additionally, one study of CR groups suggest a much improved cardiovascular risk profile; however that group was also engaged in regular exercise and were much leaner. Whether the impact on risk was due to exercise/low bodyfat or CR per se is impossible to determine.

Finally, the paper addresses what the animal studies can’t tell us about CR. The first issue is whether or not the extent and duration of CR required to generate effects in humans is even feasible in humans. That is, in animal models it’s simple to institute CR, the animals eat what you give them. Outside of small groups, it seems unlikely for the average human to voluntarily reduce food intake by 20% or more for upwards of 40 years, especially if the benefit is a mere 4-5 years increase lifespan.

Another issue is whether drugs that generate weight loss (usually through blunting appetite) have the same impact as CR per se. Given that some of the effects of CR seem to be mediated through the same neuroendocrine effects that make the animals hungry, drugs that alter normal neuroendocrinology may not generate the same effects. Interestingly, the researchers mention surgical intervention as being a potential way of ensuring lifetime adherence to CR protocols.

Finally, they address whether it’s feasible (beyond issues of hunger) for humans to engage in CR when they have to live in the real world. That is, it’s one thing to have rodents confined to a cage who eat what they are given engage in prolonged CR. Even there, studies in rodents suggest a loss of lean body mass. While this isn’t detrimental to a caged animal, a loss of functional mass would be detrimental to humans who have to function to survive. An additional issue would be immune function as rodents are kept in a pathogen free environment; however studies of CR suggest an increase in immune function.

Summing up: assuming that the animal research can be applied to humans, it would appear that CR is unlikely to have a large impact on human lifespan per se (again, this is outside of potential health benefits) even if it is instituted quite early. Since this is unlikely, and most individuals engaging in CR are older in the first place, it’s interesting to note that the predicted impact on total lifespan is small approaching negligible. Thirty years of chronic hunger, cold and low energy levels might net a 40 year old an extra couple of years of life at best. This seems rather unreasonable to me.

Once again, an issue not addressed in this review is the impact of CR on various health parameters. However, at least some research suggests that other approaches (such as intermittent fasting or every other day fasting, or exercise to generate the caloric deficit) may generate the same effects as CR per se and may be much more reasonable for long-term application.
Reply With Quote
  #7  
Old 10-18-2007, 07:06 AM
hrdgain81's Avatar
hrdgain81 hrdgain81 is offline
Rank: Light Heavyweight
 
Join Date: Mar 2005
Posts: 3,713
Default

Lyle is very good at tearing through the bullshit in studies, and breaking things down. There are a few very glaring things to look for when it comes to both training and suppliment/diet studies, and I think it would be helpful to have a list of them, I will kick it off, please add to the list as you see fit, i'm sure I'll miss 90% of them.

1. Studies on untrained athletes.

this one always interests me, because we all know how newbie gains go. When your untrained, a very simple change in stimuli or diet can create "amazing" results. On the other hand, if your a newbie, this can work to your advantage.

2. Age factors

this is especially true for supplimentation studies. I think many of the tribulus studies (tribex anyone?), have age factors to thank for thier positive results. Of course if you give an 80yo man some trib, hormone levels will sky rocket, now go sell it to some 22yo kids saying it increases test by 1500%, and that its proven, sounds like dirty pool to me.

3. Animal studies

And this goes for just about every kind of study I can think of. Give a super dose of compound X to a rat, Y is the result. Give a proportioned super dose to a human, Z is the result. Animal studies mean nothing, whether your injectin nicotin, or BCAA's its just not the same.

4. Sponsored Studies

I saw something about this on Lyle's site not to long ago, and it is something to watch for. When ever a specific suppliment, or training regiment is published make sure to see who is funding it. 9 times out of 10 if its a study for some compound, rest assured there is a suppliment company funding, and sitting on a patent, just waiting to see the good results so they can sell the shit out of it.
__________________
I don't do this for my family, my friends, women, accolades, pride, or ego. I do it for me and no one else, its just part of who I am.
Reply With Quote
  #8  
Old 10-18-2007, 10:26 AM
EricT EricT is offline
Rank: Heavyweight
 
Join Date: Jul 2005
Posts: 6,314
Default

Good stuff.

Let me add to number three though.

3. The thing I said about media interpretation goes into this. I see a lot of people downing scientists and all that and it is not always fair. When they take compound x and give super unrealistic doses of it to a certain strain of cancer prone rats they are not necessarily trying to prove that it gives cancer to humans or does this or that. They are looking for potentials and whether or not further research is justified. Obviously they can't use humans for the same purpose. I have my opinions on animal testing but that is not my purpose here. I think it is important to realize that 90% of us are hearing and going by the fucked up interpretation of the media and not the scientific community itself.

4. A certain brand of hydrolized whey comes to mind. Again though, it ain't easy to get funding and not all research is biased based on funding. Is it something to look for, hell yes! I've never seen one study funded by the dairy council that didn't have milk being the ilixir of life.
Reply With Quote
  #9  
Old 10-18-2007, 11:40 AM
hrdgain81's Avatar
hrdgain81 hrdgain81 is offline
Rank: Light Heavyweight
 
Join Date: Mar 2005
Posts: 3,713
Default

Quote:
Originally Posted by Eric3237 View Post
Good stuff.

Let me add to number three though.

3. The thing I said about media interpretation goes into this. I see a lot of people downing scientists and all that and it is not always fair. When they take compound x and give super unrealistic doses of it to a certain strain of cancer prone rats they are not necessarily trying to prove that it gives cancer to humans or does this or that. They are looking for potentials and whether or not further research is justified. Obviously they can't use humans for the same purpose. I have my opinions on animal testing but that is not my purpose here. I think it is important to realize that 90% of us are hearing and going by the fucked up interpretation of the media and not the scientific community itself.

4. A certain brand of hydrolized whey comes to mind. Again though, it ain't easy to get funding and not all research is biased based on funding. Is it something to look for, hell yes! I've never seen one study funded by the dairy council that didn't have milk being the ilixir of life.
On # 3. Spot on, IMO what you need to look at in these types of studies is what exactly the scientists are looking to find. If they are looking for possible cancer causes, and end up finding something that increased muscle mass in rats, its not the scientists fault that the marketing department at IllTakeYourMoney Labs will have a field day with it. The study only says what it says.

and I'll add

5. Protocols

Every study follows a very strict protocol. Subjects are given certain stimuli at the same time, in the same way, of the same dosage/durration ect ect. But how does this relate to you? If a study was published saying that compound X was 1000% more anabolic then test, but only when taken a 4am, while in a 1000 calorie deficite for 4 months, and standing on your head, how the hell will that help you? Understand that if there is even a fraction of a chance for a company to use a study (no matter how crazy the protocol) they will, and legally, cause its a published medical study.
Reply With Quote
  #10  
Old 10-18-2007, 11:53 AM
EricT EricT is offline
Rank: Heavyweight
 
Join Date: Jul 2005
Posts: 6,314
Default

Absolutely.
Reply With Quote
Reply

  Bodybuilding.net - Bodybuilding Forum > Main Forums > Training


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools
Display Modes



 



All times are GMT -8. The time now is 12:02 AM.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2024, vBulletin Solutions Inc.