\nOnline Courses: Contact us at seminars@crossfit.com \nCrossFit Games Support: Reach out to support@crossfitgames.com \nFor T-Shirt Purchase: Check your inbox for instructions from customer@trackorder.site
\n","orderHistoryHeadlineText":"Order History","orderHistoryLabelText":"Order History","viewOrderDetailsText":"View order details"},"resourcesKickerText":"Resources","rulebookLabelText":"Rulebook","rulebookLinkUrl":"https://games.crossfit.com/rules","preferenceCenter":{"checkAllText":"Check All","emailCommunicationBodyText":"Select which lists you would like to receive communication from","emailCommunicationHeadlineText":"Email Communication","newsletters":[{"bodyText":"Every day since 2001, CrossFit has published a Workout of the Day for new CrossFit athletes, seasoned veterans, and anyone in between. Subscribe to Workout of the Day emails, and you'll receive CrossFit programming in a three-days-on, one-day-off, two-days-on, one-day-off cadence.","brazeGroupId":"d68551b9-ac7e-437e-bfd2-d225702413cc","headlineText":"Workout of the Day"},{"bodyText":"Get inspired with the latest and/or trending articles, stories, videos, and podcasts focused on the CrossFit community and methodology.","brazeGroupId":"1bfd806e-efe3-404d-9980-c8f38c39490b","headlineText":"What's Trending"},{"bodyText":"Be the first to know when official updates and announcements are released from CrossFit HQ.","brazeGroupId":"cb28cb07-ca09-4739-b73b-7413f95a4892","headlineText":"Updates and Announcements from CrossFit HQ"},{"bodyText":"This subscription is for those interested in announcements, updates, and stories about the CrossFit Games season and its competitors. ","brazeGroupId":"e56abfcc-c940-482d-879c-eed93958cbbe","headlineText":"CrossFit Games"},{"bodyText":"This monthly newsletter includes important CrossFit Games competition season updates, resources, and tips. It is intended for competitive athletes but is open to anyone interested in learning more about the CrossFit Games season.","brazeGroupId":"fce49890-9b3c-4e1f-9e06-1bd06cd696a3","headlineText":"The Hopper"},{"bodyText":"The Professional Coach provides a wealth of articles, media, and webinar opportunities that cover all aspects of coaching, including best practices, real-world coaching application, scaling, methodology, nutrition, CEU opportunities, and more. With contributions from experts inside and outside the CrossFit space, this twice-monthly newsletter is the ultimate tool for any coach looking to improve their skills and knowledge. This newsletter is exclusively available to those who hold a Level 1 Certificate or higher. ","brazeGroupId":"653207fb-9734-44c9-a988-23eb18142529","headlineText":"The Professional Coach"},{"bodyText":"The Affiliate Update is a newsletter for CrossFit affiliate owners and includes upcoming event details, business and marketing resources, and general updates from CrossFit HQ. The Affiliate Update is only available to licensees of record (LOR).","brazeGroupId":"1d3e4c63-f03f-4b61-8453-1fbb186ae27e","headlineText":"CrossFit Affiliate Update"},{"bodyText":"An email series for learning what it takes to open and run a successful CrossFit gym","brazeGroupId":"6ab8a53a-167c-4c74-b5ea-3a06cb857068","headlineText":"Interested in Affiliation"},{"bodyText":"CAP is a weekly email available exclusively to affiliate owners that provides comprehensive class plans, resources, and educational tips to help coaches deliver an exceptional experience to their members.","brazeGroupId":"ba7e977e-ec76-41e3-8465-158d38167ed6","headlineText":"CrossFit Affiliate Programming (CAP)"},{"bodyText":"CrossFit Health serves as a vital bridge connecting the realms of fitness and healthcare. Committed to delivering valuable insights, CrossFit Health harnesses the expertise of renowned professionals from the health, wellness, and CrossFit communities. Our mission is to educate individuals on the transformative potential of CrossFit as a powerful lifestyle intervention, ultimately optimizing health outcomes.","brazeGroupId":"a9c5a8a4-df0a-4b0c-acb6-e9b4631fc00c","headlineText":"CrossFit Health"},{"bodyText":"Be the first to know when new products are added to the Official CrossFit Store and receive special offers and discounts conveniently delivered directly to your inbox.","brazeGroupId":"905db0be-a3c8-4f5b-8903-536a04cb0a40","headlineText":"The CrossFit Store"},{"bodyText":"This subscription is for companies interested in on-site event activations and vendor booths at the CrossFit Games and other events hosted by CrossFit.","brazeGroupId":"92fa7fe8-262a-4d6a-9b0d-9fcc8cc17e7d","headlineText":"Interested in On-Site Event Activations / Vendor Booths"},{"bodyText":"Get alerted for upcoming courses. CrossFit courses and certifications are open to individuals and trainers seeking to improve their health and fitness through effective training and nutritional strategies.","brazeGroupId":"dd1ee7a4-2ef5-477b-affb-77347ce81684","headlineText":"Interested in Finding a Course Near You"}],"preferenceCenterHeadlineText":"Newsletter Preferences","preferenceCenterLabelText":"Newsletter Preferences","uncheckAllText":"Uncheck All"}}},"pages":{"breadcrumbs":{"links":[{"text":"Health","url":"/health"},{"text":"The Cardinal Sins of Skewed Research, Part 5: Burning Britches","url":"#"}]},"contentPublishDate":"20190429","contentType":"article","commentTopics":[{"title":"The Cardinal Sins of Skewed Research, Part 5: Burning Britches","topicId":"article.20190429112125753"}],"title":"The Cardinal Sins of Skewed Research, Part 5: Burning Britches","topicId":"article.20190429112125753","socialMetaData":{"title":"The Cardinal Sins of Skewed Research, Part 5: Burning Britches","image":"https://www.crossfit.com/wp-content/uploads/2019/04/29135909/05_Burning_B_v1_1.png"},"path":"/health/the-cardinal-sins-of-skewed-research-part-5-burning-britches","components":[{"name":"ArticleHeader","props":{"topicId":"article.20190429112125753","date":"20190429","articleDate":"20190429","authorName":"Drs. Michael and Mary Dan Eades","bylineText":"By","headlineText":"The Cardinal Sins of Skewed Research, Part 5: Burning Britches"}},{"name":"TextBlock","props":{"children":"
In the last of our series on sleight-of-hand maneuvers that skew research and pollute the body of scientific literature, we point the finger at britches-burning deception in the form of outright fraud. \n
\n
Scientific fraud can take many forms: using specimen pictures from other studies; substituting Western blot images from old research; fudging data; filling in or deleting outliers; or just plain reporting conclusions utterly at odds with the data collected. All such methods produce research that is suspect because the resulting conclusions have not been reached using the scientific method—not to mention the doubt cast by the outright deception. Many instances of this type of misbehavior are doubtless driven by the publish-or-perish dictum. Below are a few astounding instances.
\n
Dr. Brian Wansink, a well-known professor at Cornell, sowed the seeds of his own destruction in late 2016 with an honest blog post (now removed) about how he helped a foreign graduate student generate a handful of papers from one data set. The title of the post, “The Grad Student Who Never Said ‘No,’” described Wansink’s efforts to shepherd a willing graduate student through the process of slicing and dicing data that apparently didn’t add up to much into something “worthy” of publication.
\n
At each step in the paper-generating process, Wansink gave one of his paid post-doctoral fellows the opportunity to hash the data around. The postdoc repeatedly refused, which inspired the title of the post.
\n
Of the unpaid graduate student’s efforts, Wansink wrote:
\n
When she arrived, I gave her a data set of a self-funded, failed study which had null results (it was a one month study in an all-you-can-eat Italian restaurant buffet where we had charged some people ½ as much as others). I said, “This cost us a lot of time and our own money to collect. There’s got to be something here we can salvage, because it’s a cool (rich & unique) data set.” I had three ideas for potential Plan B, C, & D directions (since Plan A had failed). I told her what the analyses should be and what the tables should look like. I then asked her if she wanted to do them.
\n
Every day she came back with puzzling new results, and every day we would scratch our heads, ask “Why,” and come up with another way to reanalyze the data with yet another set of plausible hypotheses. Eventually we started discovering solutions that held up regardless of how we pressure-tested them. I outlined the first paper, and she wrote it up, and every day for a month I told her how to rewrite it and she did.
\n
It would be surprising if there were no hypothesis driving the experiment when this data was collected. If the data had confirmed the hypothesis, a paper would certainly have already been in publication before this grad student arrived. The fact that so much work went into making any ensuing papers publishable (helped no doubt in great measure by having Wansink’s prestigious name attached) indicated how tenuous the connection was between the experimental data and anything meaningful. Yet, the “findings” of this experiment made their way into five journal articles in five different publications.
\n
When Wansink published the blog post, the reaction was swift and overwhelmingly negative. The first response from a fellow academic set the tone: “Brian – Is this a tongue-in-cheek satire of the academic process or are you serious? I hope it’s the former.” Others’ comments were worse.
\n
Wansink tried to explain his actions in terms of mentoring his students through the intricacies and difficulties of the tenure-attainment process. His responses made it apparent that he was clueless as to the scientific malfeasance inherent in such behavior.
\n
As the outrage mounted, Wansink found himself fighting for his academic life—a fight he ultimately lost. Based on his explanations of how he had encouraged his grad student to use highly questionable methods of data analysis to secure publication, researchers started going through all his work and found multiple problems. At last count, 15 of his papers had been retracted. He is no longer involved in teaching or research at Cornell and is scheduled for early retirement this year.
\n
Wansink’s story is far from unique, but because of the degree of fame he possessed, his story made the news. The tenure track is brutal, and publish or perish is the order of the day. It appears that Wansink was trying his best to mentor his charges through the process, and scientific rigor simply fell by the wayside. How many others are out there doing the same thing?
\n
In 2001, Dr. Piero Anversa, a cardiac researcher at Harvard Medical School, riveted the scientific community with the publication of a study in which he showed that heart muscle could be regenerated using stem cells from bone. Building upon these early findings, Anversa found that the heart produced its own stem cells, which could be removed, grown in medium, and injected back into the heart to repair damage. His work was truly astonishing and prompted startup industries to develop stem-cell replacement for heart damage and generated numerous grants from the NIH for further study. The problem was, no one could replicate his work. His response was to extol his own laboratory expertise and tell other researchers that, basically, they just didn’t have his touch.
\n
Ultimately, another researcher named Dr. Jeffery Molkentin, who had been trying to replicate Anversa’s experiments, developed his own methods of tracing the genetic material in the cells that had allegedly transformed into the healthy heart cells. When he checked, he found that Anversa’s results were not possible. The publication of Molkentin’s results in 2014 spelled doom for Dr. Anversa, who subsequently had 31 of his papers retracted.
\n
Stem-cell research is apparently fertile ground for fraudulent research. In 2014, Haruko Obokata, a stem-cell biologist at the prestigious Riken Center for Developmental Biology in Kobe, Japan, published two papers in the journal Nature on a simple new method for creating stem cells. Like Anversa’s papers, these quickly captured the attention of the scientific community, but within a short time, it became apparent that the experiments had been sloppily done and the data falsified. Nature retracted both papers six months after publication. Tragically, Obokata’s supervisor and the co-author of the two papers, Dr. Yoshiki Sasai, subsequently committed suicide.
\n
These are three instances of highly regarded researchers in prestigious institutions falsifying or torturing data to make it prove something it really doesn’t. If this kind of academic misbehavior takes place under the watchful glare of top-level research facilities, how much goes unnoticed in less prestigious places?
\n
Physicians today are inculcated with the noble admonition to practice evidence-based medicine. Evidence-based medicine is medicine practiced in accordance with the principles grounded in good science. Science advances via publication in the scientific literature. If published research findings are tainted by sleights of hand that include outright fraud, how can physicians effectively practice evidence-based medicine?
Drs. Michael and Mary Dan Eades are the authors of 14 books in the fields of health, nutrition, and exercise, including the bestseller Protein Power.
\n
Dr. Michael Eades was born in Springfield, Missouri, and educated in Missouri, Michigan, and California. He received his undergraduate degree in engineering from California State Polytechnic University and his medical degree from the University of Arkansas. After completing his medical and post-graduate training, he and his wife, Mary Dan, founded Medi-Stat Medical Clinics, a chain of ambulatory out-patient family care clinics in central Arkansas. Since 1986, Dr. Michael Eades has been in the full-time practice of bariatric, nutritional, and metabolic medicine.
\n
Dr. Mary Dan Eades was born in Hot Springs, Arkansas, and received her undergraduate degree in biology and chemistry from the University of Arkansas, graduating magna cum laude. After completing her medical degree at the University of Arkansas, she and her husband have been in private practice devoting their clinical time exclusively to bariatric and nutritional medicine, gaining first-hand experience treating over 6,000 people suffering from high blood pressure, diabetes, elevated cholesterol and triglycerides, and obesity with their nutritional regimen.
\n
Together, the Eades give numerous lectures to the general public and various lay organizations on their methods of treatment. They have both been guest nutritional experts on over 150 radio and television shows, including national segments for FOX and CBS.
\n","hideText":"Hide","status":"active","type":"alert_banner","userCanHide":"no"},"header":{"desktopLinks":[{"below":[{"id":93961,"parent":"93960","target":"_self","text":"What is CrossFit?","url":"/what-is-crossfit"},{"id":93962,"parent":"93960","target":"_self","text":"Find a Gym","url":"/map"}],"id":93960,"parent":"0","target":"_self","text":"Getting Started","url":"/what-is-crossfit"},{"below":[{"id":93964,"parent":"93963","target":"_self","text":"About","url":"/education/about"},{"id":93966,"parent":"93963","target":"_self","text":"Level 1 Certificate Course","url":"/certificate-courses/level-1"},{"id":93965,"parent":"93963","target":"_self","text":"Explore All Courses","url":"/education/explore-courses"},{"id":109033,"parent":"93963","target":"_self","text":"Private Courses","url":"/private-course/"},{"id":109034,"parent":"93963","target":"_self","text":"Military Resources","url":"/army-ignited"},{"id":93967,"parent":"93963","target":"_self","text":"Coaching Resources","url":"/education/resources"}],"id":93963,"parent":"0","target":"_self","text":"Courses","url":"/education/about"},{"below":[{"id":95951,"parent":"93968","target":"_self","text":"Workout of the Day","url":"/wod"},{"id":93969,"parent":"93968","target":"_self","text":"Explore Workouts","url":"https://www.crossfit.com/workout"},{"id":101892,"parent":"93968","target":"_self","text":"Hero Workouts","url":"https://www.crossfit.com/heroes/"},{"id":93970,"parent":"93968","target":"_self","text":"Movements","url":"https://www.crossfit.com/crossfit-movements"}],"id":93968,"parent":"0","target":"_self","text":"Workouts","url":"https://www.crossfit.com/workout"},{"id":93971,"parent":"0","target":"_self","text":"Learn","url":"/media"},{"id":93972,"parent":"0","target":"_blank","text":"Games","url":"https://games.crossfit.com"},{"id":105467,"parent":"0","target":"_blank","text":"Store","url":"https://store.crossfit.com/?utm_source=owned&utm_medium=nav&utm_campaign=main"},{"id":106137,"parent":"0","target":"_self","text":"Open A Gym","url":"/open-crossfit-gym"}],"mobileLinks":[{"text":"Open a CrossFit Gym"},{"text":"Browse","links":[{"below":[{"id":93961,"parent":"93960","target":"_self","text":"What is CrossFit?","url":"/what-is-crossfit"},{"id":93962,"parent":"93960","target":"_self","text":"Find a Gym","url":"/map"}],"id":93960,"parent":"0","target":"_self","text":"Getting Started","url":"/what-is-crossfit"},{"below":[{"id":93964,"parent":"93963","target":"_self","text":"About","url":"/education/about"},{"id":93966,"parent":"93963","target":"_self","text":"Level 1 Certificate Course","url":"/certificate-courses/level-1"},{"id":93965,"parent":"93963","target":"_self","text":"Explore All Courses","url":"/education/explore-courses"},{"id":109033,"parent":"93963","target":"_self","text":"Private Courses","url":"/private-course/"},{"id":109034,"parent":"93963","target":"_self","text":"Military Resources","url":"/army-ignited"},{"id":93967,"parent":"93963","target":"_self","text":"Coaching Resources","url":"/education/resources"}],"id":93963,"parent":"0","target":"_self","text":"Courses","url":"/education/about"},{"below":[{"id":95951,"parent":"93968","target":"_self","text":"Workout of the Day","url":"/wod"},{"id":93969,"parent":"93968","target":"_self","text":"Explore Workouts","url":"https://www.crossfit.com/workout"},{"id":101892,"parent":"93968","target":"_self","text":"Hero Workouts","url":"https://www.crossfit.com/heroes/"},{"id":93970,"parent":"93968","target":"_self","text":"Movements","url":"https://www.crossfit.com/crossfit-movements"}],"id":93968,"parent":"0","target":"_self","text":"Workouts","url":"https://www.crossfit.com/workout"},{"id":93971,"parent":"0","target":"_self","text":"Learn","url":"/media"},{"id":93972,"parent":"0","target":"_blank","text":"Games","url":"https://games.crossfit.com"},{"id":105467,"parent":"0","target":"_blank","text":"Store","url":"https://store.crossfit.com/?utm_source=owned&utm_medium=nav&utm_campaign=main"},{"id":106137,"parent":"0","target":"_self","text":"Open A Gym","url":"/open-crossfit-gym"}]}],"brandLinks":[{"id":93974,"parent":"0","target":"_self","text":"Open a CrossFit Gym","url":"/open-crossfit-gym"}],"loggedInMenu":[{"id":72863,"parent":"0","target":"_self","text":"Manage Account","url":"https://www.crossfit.com/dashboard"},{"id":72864,"parent":"0","target":"_self","text":"Competition Dashboard","url":"https://games.crossfit.com/manage-competition/athlete"}]},"footer":{"mainLinks":[{"below":[{"id":9764,"parent":"511","target":"_self","text":"What Is CrossFit?","url":"/what-is-crossfit"},{"id":9765,"parent":"511","target":"_self","text":"Get Started","url":"/get-started"},{"id":45861,"parent":"511","target":"_self","text":"Workouts","url":"/workout/"},{"id":45862,"parent":"511","target":"_self","text":"Movements","url":"/essentials/movements"},{"id":1741,"parent":"511","target":"_self","text":"FAQ","url":"/faq"},{"id":90183,"parent":"511","target":"_self","text":"Help Center","url":"https://crossfit.my.site.com/Support/s/"},{"id":45103,"parent":"511","target":"_self","text":"Careers","url":"/careers/"}],"id":511,"parent":"0","target":"_self","text":"About CrossFit","url":"#"},{"below":[{"id":45864,"parent":"45863","target":"_self","text":"Courses Near You","url":"/courses-near-you/"},{"id":45865,"parent":"45863","target":"_self","text":"Certificate Courses","url":"/certificate-courses/"},{"id":45866,"parent":"45863","target":"_self","text":"Certifications","url":"/certifications/"},{"id":45868,"parent":"45863","target":"_self","text":"Online Courses","url":"https://www.crossfit.com/online-courses"}],"id":45863,"parent":"0","target":"_self","text":"Education","url":"#"},{"below":[{"id":45870,"parent":"45871","target":"_self","text":"Open a CrossFit Gym","url":"/open-crossfit-gym"},{"id":45884,"parent":"45871","target":"_self","text":"Field Leaders","url":"/field-leaders"},{"id":90935,"parent":"45871","target":"_self","text":"Global Mentor Program","url":"/global-mentor-program/"},{"id":93982,"parent":"45871","target":"_self","text":"Affiliate Portal","url":"https://affiliate.crossfit.com/tools/"}],"id":45871,"parent":"0","target":"_self","text":"Affiliates","url":"#"},{"below":[{"id":16638,"parent":"45875","target":"_self","text":"Find a Trainer","url":"https://trainerdirectory.crossfit.com/"},{"id":45876,"parent":"45875","target":"_self","text":"Scholarship Program","url":"/scholarship-program-inquiry"},{"id":45877,"parent":"45875","target":"_self","text":"Foundation","url":"/foundation"},{"id":104122,"parent":"45875","target":"_self","text":"CrossFit Medical Society","url":"https://www.crossfitmedicalsociety.com/"}],"id":45875,"parent":"0","target":"_self","text":"Community","url":"#"},{"below":[{"id":45881,"parent":"45879","target":"_self","text":"About the Games","url":"https://games.crossfit.com/"},{"id":45880,"parent":"45879","target":"_self","text":"Leaderboard","url":"https://games.crossfit.com/leaderboard/games/2022?division=2"},{"id":45882,"parent":"45879","target":"_self","text":"Schedule","url":"https://games.crossfit.com/games/schedule?_ga=2.142929340.802559833.1690817966-401013740.1685640771"},{"id":91727,"parent":"45879","target":"_self","text":"Workouts","url":"https://games.crossfit.com/workouts/games/2023"}],"id":45879,"parent":"0","target":"_self","text":"The CrossFit Games","url":"#"}],"brandLinks":[],"socialLinks":[{"id":66715,"parent":"0","target":"_self","text":"facebook","url":"https://www.facebook.com/crossfit"},{"id":66716,"parent":"0","target":"_self","text":"twitter","url":"https://twitter.com/CrossFit"},{"id":66717,"parent":"0","target":"_self","text":"instagram","url":"https://www.instagram.com/crossfit/"},{"id":66718,"parent":"0","target":"_self","text":"youtube","url":"https://www.youtube.com/channel/UCtcQ6TPwXAYgZ1Mcl3M1vng"}],"contactLinks":[{"id":531,"target":"_self","text":"Careers","url":"https://www.crossfit.com/jobs"},{"id":532,"target":"_self","text":"Contact Us","url":"https://www.crossfit.com/contact-us"}],"legalLinks":[{"id":533,"parent":"0","target":"_self","text":"Terms & Conditions","url":"https://www.crossfit.com/terms-and-conditions"},{"id":534,"parent":"0","target":"_self","text":"Privacy Policy","url":"https://www.crossfit.com/privacy-policy"},{"id":10717,"parent":"0","target":"_self","text":"Cookie Policy","url":"https://www.crossfit.com/cookie-policy"},{"id":57312,"parent":"0","target":"_self","text":"Disclaimer","url":"https://www.crossfit.com/disclaimer"},{"id":10883,"parent":"0","target":"_self","text":"Contact Us","url":"https://www.crossfit.com/contact-us"},{"id":45883,"parent":"0","target":"_self","text":"Report IP Theft","url":"https://www.crossfit.com/iptheft"}]},"locationPages":{"simpleTiles":{"cards":[{"bodyText":"CrossFit offers a results-based, community-driven approach to functional training that helps you build strength and improve your health—over your lifetime.","headlineText":"Functional Fitness for Everyday Life","icon":{"alt":"Lifting Icon","url":"https://www.crossfit.com/wp-content/uploads/2024/04/26123658/crossfit-icon-workout-barbell-overhead-press.svg"}},{"bodyText":"Stay motivated with our community of coaches and members, who support your goals through approachable group training classes, helping you stay accountable and excited for each session.","headlineText":"Community Support and Motivation","icon":{"alt":"Heart Icon","url":"https://www.crossfit.com/wp-content/uploads/2024/04/26123700/crossfit-icon-heart.svg"}},{"bodyText":"Coaches scale class workouts to your fitness level to help you achieve your strength building goals.","headlineText":"Tailored to Your Fitness Levels","icon":{"alt":"Graph Icon","url":"https://www.crossfit.com/wp-content/uploads/2024/04/26123649/crossfit-icon-levels.svg"}},{"bodyText":"CrossFit coaches are experienced and trained to provide well-rounded and personalized guidance to individuals with varying fitness levels and goals.","headlineText":"Industry Certified Coaches","icon":{"alt":"Certification Icon","url":"https://www.crossfit.com/wp-content/uploads/2024/04/26123656/crossfit-icon-check-badge.svg"}}],"headlineText":"Build Strength for a Fuller Life"},"gymFinderPromo":{"bodyText":"Contact CrossFit to start your fitness journey. We’ll connect you to the closest gym in your area.","headlineText":"Get Started today","image":{"alt":"Man Lifting Barbell","sizes":{"1536x1536":"https://www.crossfit.com/wp-content/uploads/2018/12/13135656/aa6daff2983e555e3688654515568d25-1-768x512-1.jpeg","1536x1536Height":512,"1536x1536Width":768,"2048x2048":"https://www.crossfit.com/wp-content/uploads/2018/12/13135656/aa6daff2983e555e3688654515568d25-1-768x512-1.jpeg","2048x2048Height":512,"2048x2048Width":768,"hero":"https://www.crossfit.com/wp-content/uploads/2018/12/13135656/aa6daff2983e555e3688654515568d25-1-768x512-1.jpeg","heroHeight":512,"heroWidth":768,"heroLarge":"https://www.crossfit.com/wp-content/uploads/2018/12/13135656/aa6daff2983e555e3688654515568d25-1-768x512-1.jpeg","heroLargeHeight":512,"heroLargeWidth":768,"large":"https://www.crossfit.com/wp-content/uploads/2018/12/13135656/aa6daff2983e555e3688654515568d25-1-768x512-1.jpeg","largeHeight":512,"largeWidth":768,"medium":"https://www.crossfit.com/wp-content/uploads/2018/12/13135656/aa6daff2983e555e3688654515568d25-1-768x512-1.jpeg","mediumHeight":512,"mediumWidth":768,"mediumLarge":"https://www.crossfit.com/wp-content/uploads/2018/12/13135656/aa6daff2983e555e3688654515568d25-1-768x512-1.jpeg","mediumLargeHeight":512,"mediumLargeWidth":768,"small":"https://www.crossfit.com/wp-content/uploads/2018/12/13135656/aa6daff2983e555e3688654515568d25-1-768x512-1-300x200.jpeg","smallHeight":200,"smallWidth":300,"thumbnail":"https://www.crossfit.com/wp-content/uploads/2018/12/13135656/aa6daff2983e555e3688654515568d25-1-768x512-1-150x150.jpeg","thumbnailHeight":150,"thumbnailWidth":150}},"links":[{"link":{"priority":"primary","text":"Find a Gym","url":"/map"}},{"link":{"priority":"secondary","text":"What Is CrossFit?","url":"/what-is-crossfit"}}]},"locationCourseCards":{"courseLinkText":"Register Now","findCourseLink":{"text":"Find More Courses","url":"https://www.crossfit.com/courses-near-you"},"headerText":"Courses Near You","seminarType":["level-one","level-two"]},"socialSharing":{"facebook":{"description":"Jump into CrossFit in [City Name]! Our certified coach led group training and fitness classes feature strength, conditioning, and functional workouts.","title":"CrossFit Gyms in [State] | Functional Fitness Classes & Group Training"}}}},"user":{},"coachCertifications":{}}
The Cardinal Sins of Skewed Research, Part 5: Burning Britches
ByDrs. Michael and Mary Dan EadesApril 29, 2019
In the last of our series on sleight-of-hand maneuvers that skew research and pollute the body of scientific literature, we point the finger at britches-burning deception in the form of outright fraud.
Scientific fraud can take many forms: using specimen pictures from other studies; substituting Western blot images from old research; fudging data; filling in or deleting outliers; or just plain reporting conclusions utterly at odds with the data collected. All such methods produce research that is suspect because the resulting conclusions have not been reached using the scientific method—not to mention the doubt cast by the outright deception. Many instances of this type of misbehavior are doubtless driven by the publish-or-perish dictum. Below are a few astounding instances.
Dr. Brian Wansink, a well-known professor at Cornell, sowed the seeds of his own destruction in late 2016 with an honest blog post (now removed) about how he helped a foreign graduate student generate a handful of papers from one data set. The title of the post, “The Grad Student Who Never Said ‘No,’” described Wansink’s efforts to shepherd a willing graduate student through the process of slicing and dicing data that apparently didn’t add up to much into something “worthy” of publication.
At each step in the paper-generating process, Wansink gave one of his paid post-doctoral fellows the opportunity to hash the data around. The postdoc repeatedly refused, which inspired the title of the post.
Of the unpaid graduate student’s efforts, Wansink wrote:
When she arrived, I gave her a data set of a self-funded, failed study which had null results (it was a one month study in an all-you-can-eat Italian restaurant buffet where we had charged some people ½ as much as others). I said, “This cost us a lot of time and our own money to collect. There’s got to be something here we can salvage, because it’s a cool (rich & unique) data set.” I had three ideas for potential Plan B, C, & D directions (since Plan A had failed). I told her what the analyses should be and what the tables should look like. I then asked her if she wanted to do them.
Every day she came back with puzzling new results, and every day we would scratch our heads, ask “Why,” and come up with another way to reanalyze the data with yet another set of plausible hypotheses. Eventually we started discovering solutions that held up regardless of how we pressure-tested them. I outlined the first paper, and she wrote it up, and every day for a month I told her how to rewrite it and she did.
It would be surprising if there were no hypothesis driving the experiment when this data was collected. If the data had confirmed the hypothesis, a paper would certainly have already been in publication before this grad student arrived. The fact that so much work went into making any ensuing papers publishable (helped no doubt in great measure by having Wansink’s prestigious name attached) indicated how tenuous the connection was between the experimental data and anything meaningful. Yet, the “findings” of this experiment made their way into five journal articles in five different publications.
When Wansink published the blog post, the reaction was swift and overwhelmingly negative. The first response from a fellow academic set the tone: “Brian – Is this a tongue-in-cheek satire of the academic process or are you serious? I hope it’s the former.” Others’ comments were worse.
Wansink tried to explain his actions in terms of mentoring his students through the intricacies and difficulties of the tenure-attainment process. His responses made it apparent that he was clueless as to the scientific malfeasance inherent in such behavior.
As the outrage mounted, Wansink found himself fighting for his academic life—a fight he ultimately lost. Based on his explanations of how he had encouraged his grad student to use highly questionable methods of data analysis to secure publication, researchers started going through all his work and found multiple problems. At last count, 15 of his papers had been retracted. He is no longer involved in teaching or research at Cornell and is scheduled for early retirement this year.
Wansink’s story is far from unique, but because of the degree of fame he possessed, his story made the news. The tenure track is brutal, and publish or perish is the order of the day. It appears that Wansink was trying his best to mentor his charges through the process, and scientific rigor simply fell by the wayside. How many others are out there doing the same thing?
In 2001, Dr. Piero Anversa, a cardiac researcher at Harvard Medical School, riveted the scientific community with the publication of a study in which he showed that heart muscle could be regenerated using stem cells from bone. Building upon these early findings, Anversa found that the heart produced its own stem cells, which could be removed, grown in medium, and injected back into the heart to repair damage. His work was truly astonishing and prompted startup industries to develop stem-cell replacement for heart damage and generated numerous grants from the NIH for further study. The problem was, no one could replicate his work. His response was to extol his own laboratory expertise and tell other researchers that, basically, they just didn’t have his touch.
Ultimately, another researcher named Dr. Jeffery Molkentin, who had been trying to replicate Anversa’s experiments, developed his own methods of tracing the genetic material in the cells that had allegedly transformed into the healthy heart cells. When he checked, he found that Anversa’s results were not possible. The publication of Molkentin’s results in 2014 spelled doom for Dr. Anversa, who subsequently had 31 of his papers retracted.
Stem-cell research is apparently fertile ground for fraudulent research. In 2014, Haruko Obokata, a stem-cell biologist at the prestigious Riken Center for Developmental Biology in Kobe, Japan, published two papers in the journal Nature on a simple new method for creating stem cells. Like Anversa’s papers, these quickly captured the attention of the scientific community, but within a short time, it became apparent that the experiments had been sloppily done and the data falsified. Nature retracted both papers six months after publication. Tragically, Obokata’s supervisor and the co-author of the two papers, Dr. Yoshiki Sasai, subsequently committed suicide.
These are three instances of highly regarded researchers in prestigious institutions falsifying or torturing data to make it prove something it really doesn’t. If this kind of academic misbehavior takes place under the watchful glare of top-level research facilities, how much goes unnoticed in less prestigious places?
Physicians today are inculcated with the noble admonition to practice evidence-based medicine. Evidence-based medicine is medicine practiced in accordance with the principles grounded in good science. Science advances via publication in the scientific literature. If published research findings are tainted by sleights of hand that include outright fraud, how can physicians effectively practice evidence-based medicine?
Drs. Michael and Mary Dan Eades are the authors of 14 books in the fields of health, nutrition, and exercise, including the bestseller Protein Power.
Dr. Michael Eades was born in Springfield, Missouri, and educated in Missouri, Michigan, and California. He received his undergraduate degree in engineering from California State Polytechnic University and his medical degree from the University of Arkansas. After completing his medical and post-graduate training, he and his wife, Mary Dan, founded Medi-Stat Medical Clinics, a chain of ambulatory out-patient family care clinics in central Arkansas. Since 1986, Dr. Michael Eades has been in the full-time practice of bariatric, nutritional, and metabolic medicine.
Dr. Mary Dan Eades was born in Hot Springs, Arkansas, and received her undergraduate degree in biology and chemistry from the University of Arkansas, graduating magna cum laude. After completing her medical degree at the University of Arkansas, she and her husband have been in private practice devoting their clinical time exclusively to bariatric and nutritional medicine, gaining first-hand experience treating over 6,000 people suffering from high blood pressure, diabetes, elevated cholesterol and triglycerides, and obesity with their nutritional regimen.
Together, the Eades give numerous lectures to the general public and various lay organizations on their methods of treatment. They have both been guest nutritional experts on over 150 radio and television shows, including national segments for FOX and CBS.
The Cardinal Sins of Skewed Research, Part 5: Burning Britches