Is that “research”cited in an article or blog reliable

These days, we’re slammed with “studies,” “research,” and “polls.” Statistics are casually thrown around 92% of the time with no real data other than it sounds good (I just pulled that number out of the sky).

The truth is most studies show….

Nothing, most studies (and in fact, polls) show absolutely nothing. Research is so flawed (if true research is cited at all). We know the drill, this week, coffee is good (no wait, it’s bad…. well drinking two cups is good but after that it’s gonna kill ya) but eggs are definitely bad – the whites are good (not anymore, now we’re supposed to eat the yellows). These are just two examples of how “studies” are misused to rope readers in. These are often poorly conducted studies (or hypotheses that haven’t been further studied at all) that are not intended for release to, much less use by, the general public. Many studies are just for the researchers to determine where to go next, someone picks up on it and BOOM! Everyone is cutting out eggs and coffee.

The problem with studies is that there are very few long-term ones that account for confounding variables, uncontrollable variables, are replicable, and that are done on humans. When you’re reading the newest research and the latest thing that’s sure to work, ask yourself

1- who conducted the study and why (researchers trying to get published, students trying to earn a grade, a medical facility trying to gain grant money)

2- who FUNDED the study (this is especially important- did the butter folks fund a study that proves butter is better than margarine? Oh, hello conflict of interest, not so nice to see you here).

3- What are the uncontrollable variables? Conflicts? There are things researchers and polls can’t control in every study, these can complicate things.

4- How long was did the study last? Long term studies are the most reliable because the data is tested time and again, some studies are just too short term to really have solid results. we simply can’t tell how a new type of sweetener reacts to the body, what the longterm health effects are, because the product hasn’t been in existence long enough.

5- How big was the study (50 people really don’t paint a picture of the rest of the world). Animal studies are also not always reliable- we aren’t worms, mice, or even primates.

6- What was the sample comprised of (the same age, all in the same location- if it’s a lung cancer study and everyone came from the same city perhaps there’s something in their area that is affecting them rather than the variable they are trying to tie it to)

7- Are the results replicable?

We’ve seen the diet crazes that change over night- the bottom line is everything in moderation! Use your common sense here. I ate a pineapple every single day for three years because it’s supposed to be the food of gods, will make my body function perfectly…. well, after three years my teeth are screaming as they crumble from the acid. Donuts and fried butter, probably not a good thing either (ever). But generally, almost everything is okay if you don’t do it every. single. day. Listen to your body and its cravings.

Usually, things that boast being “THE BEST” or “ALWAYS working” are not legit either. Generalizations, anything that is all inclusive, exclusive (uses words like always, all, nothing, never) shouldn’t be believed. (Some headlines and online media will use phrases like this- don’t believe them…. “like ever….” )

If you read a something that includes headlines like “ONCE IN FOR ALL” or are too casual, it’s probably not a reputable source, either. An opinion, an inkling or hope, an idea or a hypthosis is very different from a real, reliable, well-done study or a poll or research that is conducted in a reputable manner.

It’s up to you to use your good judgement; if something sounds too good (or bad) to be true, it probably is. If the backing study sounds hinky or flawed, take it for a grain of salt.

Do your own research, tap into various sources (not just one) and don’t take one sources as a do-all-end-all authority.

The bottom line, we know very little. Things constantly change, what’s good or right for you may not work or work well for someone else. There are ooooooodles of factors that come into play. Don’t be a sheeple or fall victim to a bad study (the ramifications can be costly).

Leave a comment