I'm going to paraphrase/sometimes quote some stuff , words about
research by one who claims to be a researcher, from the book “the art and science of low carbohydrate living” by a Volek PhD/RD and Phinney, Md/PhD, that I think applies to the subject of this thread.
From Page 145: “ when a research paper appears in a peer review journal, we tend to think of it as something that can be believed is true until other studies come out proving it right or wrong. You make the observation and report it. Research later on will confirm or not. Plain vanilla science.
But i reality, when a research paper is published that reinforces what we already believe, we ( the mainstream consensus) treat it as dogma. ………………………. If this sounds overly cynical to you the reader, Please accept our apologies. But if you have ever tried to argue data over dogma, maybe this sounds familiar……………………………….
Every year or so, there's a high profile case in which a scientist makes up data to generate a high profile publication. This is clear scientific malfeasance. Fame, fortune and federal grants ride on high profile publications. Some of these people forfeit their research careers, and some go to jail.
But what we don't hear about
is a much more common situation wear a scientist designs of study with a particular result in mind.(Billy Bob's words here: I'm thinking here of research on low carbohydrate diets versus low fat/ low calorie diets, where the carbohydrates are never really lowered enough to get much effect. Then it is announced in the media" no difference in low carb versus low-fat" Or"low fat superior to low-carb") say that your preliminary data tell you that you'll probably see the results you want after one week or two weeks, but it will probably not last longer than that. So then you design a study for just one or two weeks observation.
Or, what about
just not publishing data and it turns out to be embarrassing, that is the opposite maybe from what your institution has been teaching? So shouldn't the peer review System catch these sorts of things to ensure proper scientific method and logical conclusions made from results? Yes, ideally this is true, but in reality this system is far from perfect. And has a strong tendency to favor findings that agree with the current consensus. Occasionally a reviewer made comment "your data do not support your conclusions”, but this is more of a rarity that it is the norm.
What would motivate a scientist to take such a chance? How about
”peer pressure”?
What we publish and what we cite: science, in general, and nutritional sciences in particular, have become highly conformist.. Smart scientist go to their scientific meetings, listen to the discussion, an come to understand what is acceptable And what is not. Those who ignore this readily available information do so at their own peril. Non-conformists tend to have trouble getting papers published and research grants funded.”…………………………………………………………………………………………..
Well, this turns out to be too long to cover here, and it would require too much semi quoting as it covers close to 20 pages in the book. The authors give several examples of what they are claiming, some fairly famous. The book was worth reading just for this chapter. Now the examples given mostly apply to nutritional science, but it could also apply to all science- or should I say all scientific research? What it tells me is that we must aggressively look for any bias in any studies we are considering. Although, that can be really hard to figure out for us laymen. For one example, if it is a drug study, how can we really know if the researcher(s) have some relationship, or hopes of a future relationship, with the drug company that stands to make billions if their drug gets approved by the FDA?
And have you ever wondered how it is that, over and over, the FDA approves some drug as safe and effective, only to limit it severely or pull it from the market a year or 2 later after some harm is found that did not show up in studies of thousands of patients costing millions of dollars? I’m sure they had the studies proving the drugs were safe and effective, but it turns out not so much.
Anyway, I thought this section of the book went well with the article Ilinked about
sorry or false research.
Post Edited (BillyBob@388) : 4/18/2016 4:32:26 PM (GMT-6)