https://www.lesswrong.com/posts/WnheMGAka4fL99eae/hindsight-...
Would you really have been surprised if the study's conclusion had been the opposite, or would you just rationalize that obviously there are a lot of introverts out there, and hugs stress them out disproportionately?
This system, it is my observation, is extremely intolerant of knowledge produced by other systems. Other sources may be examined, but they must be interpreted, and more importantly tested, according to the established "scientific" methodologies (a collection of various inductive techniques, but, mostly, the use of complex physical and mathematical instruments), and then presented in the appropriately hallowed place using scientific jargon. Until such approval is given, the system is unwilling to acknowledge the validity of other kinds of knowledge. Thus, we have to once again "prove" what is already well-known to everybody.
A secondary problem is that the "acceptable methodology" criterion of scientific knowledge is subject to the latest vogue, and people don't read old papers, so everything we know must be re-proved or re-packaged using contemporary methodology every thirty years.
Maybe we need a discipline which has the purpose of merging the knowledge from science with other source, but I don't think it's fair to criticize scientists for not doing that work - it's none of their business.
Scientism is certainly a problem, but the solution is not to jumble the methods of obtaining knowledge with science in an attempt to bleed some prestige from it. It should be to valorize those other methods separately, recognizing their particular advantages (and disadvantages) over science.
I don't advocate jumbling the methods of obtaining knowledge (although I think the notion of methodological purity in science is incorrect, I think the consistent principle in science is the establishment of authority, and not the methods applied by that authority, which change over time) - naturally every system must have its own internal consistency, or else it would not be a system. I advocate instead something close to what you are saying. It is fine to read scientific literature, but it is also useful to recognize that science can't tell you everything, and that its epistemology more or less fails at discovering certain things.
I'm not saying this is the best example of a study i've ever read, but the scientific method as we use it today was developed over a long time and is used because as of right now, this is the best way we've found to acquire useful knowledge. Is it the best? Maybe, maybe not. Has it given humanity consistently better and more accurate knowledge than other methods throughout history....personally i'd be willing to say yes.
Doing research, writing and presenting a paper don't exist to make science a special club. They're written the way they are to ensure all methodologies and results are clearly laid out and given, allowing others to repeat the process, the discussion giving the author's conclusion is kept separate from the rest.
The peer review system, while definitely flawed and full of problems, exists to ensure submitted papers followed reasonable methodologies and that the reported results and conclusions make sense.....
Now....that's the way it's supposed to be. In my experience, science isn't the problem it's scientists. Personally, the biggest problem I noticed, at least among biologists is worked with, was emotional attachment to personal theories and other things to the point where inconsistent or straight up contradictory data would be ignored or resampled until the desired results were found.
Money was also a pretty big problem especially when it comes to grants and continued funding. Again, inconsistent or contradictory data would be ignored to ensure the desired results and continued funding. Proposals would need to provide economic justification for funding. So there had to be an economically viable reason to do the study. And honestly, a lot of petty arguments and bullshit between scientists over the small amounts of funding available for different projects.
Science itself is great, the institutions we've built up around them not so much. They've corrupted it pretty heavily to the point where depending on who's funding a study you can already give a pretty good guess as to what the biases will be.