When a massive replicability study in psychology was published last year, the results were, to some, shocking: 60% of the 100 experimental results failed to replicate. . . .
The article continues . . .
Now, the latest attempt to verify findings in the social sciences—this time with a small batch from experimental economics—also finds a substantial number of failed replications. Following the exact same protocols of the original studies, the researchers failed to reproduce the results in about 40% of cases. . . .
A study published by the Federal Reserve Board, found similar, discomforting results.
The study looked at 69 economcis papers, obtrained the original data from the authors, in many cases obtained helpfrom the authors and yet, when these third-party researchers re-ran the experiments, only 29 of 59 papers (49%) actually produced the results the authors claimed.
We attempt to replicate 67 papers published in 13 well-regarded economics journals using author-provided replication files that include both data and code. . . . Aside from 6 papers that use confidential data . . .
Excluding the 6 papers that use confidential data and the 2 papers that use software we do not possess, we replicate 29 of 59 papers (49%) with assistance from the authors. . . .
Unfortunately the problem goes beyond the social sciences.
Although the rates vary from country to country
(a LOT of bad studies come out of China and Brazil)
even the medical sciences are polluted with a large volume of irreprocibile studies.
I’m gonna blame the Libs,
and probably the libs are gonna blame, big pharma or Elon Musk, or racism and homophobia.
I guess the more important thing is that we take the first step
and recognize that science these days is not what were were told.
If a roofer or an auto mechanic had this track record he’d be brought upon charges.
Ditto with Walmart or Target if they got this many prices wrong,
or advertisers if they made this many false claims.
I guess people should blame whomever they want to blame so long as they stop treating today’s “scientists” as trustworthy people deserving of more money.
And with this MAHA/MAGAs have two paths to take (in my opinion)
Work with scientists to make science better.
Work with non-scientists “experts” to make science even worse to own the libz
Which path do we think they will take? I vote 2. The whole “my heart doctor is wrong so I am going to listen to my high school dropout mechanic friend on Facebook instead”
1.1. When a scientists lies he should get the same treatment as a roofer who lies, a used car salesman who lies etc… When a university or research institute turns a blind eye to lying,
the university or research institute should get the same treatment as a corporation, an insurance company etc. who turns a blind eye to rampant lying by their employees.
—> The lying scientists should be crushed out of their field and reduced to bagging groceries or driving Uber for a living.
—>The university should be hit with multimillion dollar fines. plus class action lawsuits. No more “Oh it’s okay for him to lie. There should be no punishment . He is a ‘scientist.’”