• TalkBass has been independent since 1998. Add your voice.
    Create a free account to reply to discussions, view embedded media, and browse with fewer display ads.
    Join freeLog in
    Want zero display ads or expanded classifieds tools? Compare plans.

The scientific method (and why I love it).

dullsilver_mike said:
I think there are a decent number of scientists who rush to publish and deliver misinformation in the process. Fortunately, the fields are so insanely competitive that anyone who does so is instantly called out. That's the reason I don't understand skeptics of mainstream science, not because of some altruism of labeling oneself a scientist, but because the career field doesn't leave any room for liars--as soon as someone comes up with a bogus claim, or even a bogus but subtle implication, there are hundreds of people ready to call their dishonesty out for the sake of advancing their own careers.

Well, not exactly. So much stuff gets published that it can't all be subjected to intensive critique. However, a lot of that stuff also has minimal impact.
 
Pilgrim said:
I don't really see the problem with this. If you want to measure non-physical phenomena, it may be necessary to work on a new research method. One has to use the tools in endeavors for which they are designed.

For tackling a new type of research, new methods may be needed. However, I think it's possible you will encounter problems with people who maintain that things which cannot be measured must not exist. I disagree with that, but some folks are really tunnel-visioned about their methodology.

I have a broad definition of 'measure,' but I have so far never been confronted with a reason to regret simply ignoring all things that are inaccessible to naturalistic inquiry.
 
Well, not exactly. So much stuff gets published that it can't all be subjected to intensive critique. However, a lot of that stuff also has minimal impact.

It's a generalization. I'm just trying to have fun with the idea that a publishing scientist can obtain as much notoriety from debunking someone else's claim as making their own. There was a nice wave of general periodical articles this month on the top 5 debunked scientific studies of 2011. My point is that there's a near fail-safe built into all discourse in the field these days. Someone might be able to publish absolute crap, but not in any forum where anyone important will pay attention to it for more than a month.
 
dullsilver_mike said:
It's a generalization. I'm just trying to have fun with the idea that a publishing scientist can obtain as much notoriety from debunking someone else's claim as making their own. There was a nice wave of general periodical articles this month on the top 5 debunked scientific studies of 2011. My point is that there's a near fail-safe built into all discourse in the field these days. Someone might be able to publish absolute crap, but not in any forum where anyone important will pay attention to it for more than a month.

That seems reasonable.
 
Well, not exactly. So much stuff gets published that it can't all be subjected to intensive critique. However, a lot of that stuff also has minimal impact.

That's part and parcel of the point I made. It's my job to disseminate what's made the cut and what hasn't. If something hasn't been peer-reviewed, that doesn't necessarily mean it's bunk, and certain peer reviews don't necessarily convey a true sense of comfort, but they are certainly better than nothing.

Consideration of the ultimate use of the data and its temporal impact is important. If the use is to consider further studies on the sex life of the tsetse fly, then a lack of peer review may not be a deal-breaker (assmuing that gov't funds aren't involved, of course - there's the rub), but if questionable data suggest that contaminant X is the next scourge on human life, then perhaps further investigation is reasonable prior to extensive peer review.
 
I think there are a decent number of scientists who rush to publish and deliver misinformation in the process. Fortunately, the fields are so insanely competitive that anyone who does so is instantly called out. That's the reason I don't understand skeptics of mainstream science, not because of some altruism of labeling oneself a scientist, but because the career field doesn't leave any room for liars--as soon as someone comes up with a bogus claim, or even a bogus but subtle implication, there are hundreds of people ready to call their dishonesty out for the sake of advancing their own careers.

Bingo.

Nothing works the scientific ego better than writting a rebuttal!
 
Well, not exactly. So much stuff gets published that it can't all be subjected to intensive critique. However, a lot of that stuff also has minimal impact.

True, but even within the smaller sub-fields of research, there tend to be a fair number of active scientists, often competing with each other.

There is a lot of information out there, but as you'll know, you end up being pretty tightly focused and reading all the literature that's popping up which is relevant to your specific field.
 
Just to play devil's advocate, as a scientist of 26 years, I'll demonstrate my bias, not lack of bias:

1. I assume every assumption is either invalid or insufficiently justified;
2. I assume every conclusion is based on at least one observation that glosses over some level of uncertainty;
3. I try my best to poke as many holes into a study as possible;
4. My first thought is often "How are people going to take this information and either misinterpret it, or @#$% things up, or both?"

So, I am very biased toward the concept that everything is wrong. Only when I can dissect and analyze information and conclusions may I eventually come to accept it as "valid within the parameters of what we currently understand."

Remember, science does not necessarily describe absolute truth, but rather, only what we can glean of absolute truth within the limits of our current understanding.

A lot of this feels like my personal philosophy. I've been a paramedic for a long time. And in general, I've found that people are simultaneously spectacularly dumb and amazingly inventive at finding ways to harm themselves.

So the generally most useful philosophy is to always assume the worst possible event, then work your way backwards from there.

It's how we treat all traumas. If there is any possibilty of spinal injury, they are getting the full immobilizer deal. C-collar, backboard and head blocks. That way they can't paralyze themselves and sue you for it.

The Dispatcher says you have an unresponsive person. Assume they are dead and plan for a full arrest resuscitation. When you get there, you are ready. Then it turns out he is only really drunk and you don't need the stuff you got out of the truck for a full resus. But you were ready for it.

Or maybe they say..."unidentified medical", my least favorite because it can be literally anything. Figure on something horrible, like Ebola or Marburg, that is horrifically contagious and with 95+% mortality. Your basic end-of-the-world plague. When it turns out to just be a stroke, you'll feel so relieved.
 
I follow, however, I'd say that we simply can't fully appreciate the whys, yet.

It's the great thing about science, always moving forward, always something to still figure out :)

Oh, dont get me wrong. Im not knocking the scientific method, and I agree, its a matter of "yet".
Pilgrim's post, I think, expounds on the idea even further:

I don't really see the problem with this. If you want to measure non-physical phenomena, it may be necessary to work on a new research method. One has to use the tools in endeavors for which they are designed.

For tackling a new type of research, new methods may be needed. However, I think it's possible you will encounter problems with people who maintain that things which cannot be measured must not exist. I disagree with that, but some folks are really tunnel-visioned about their methodology.

Well, I think it could be that the scientific method may apply once we've developed methods of better understanding the nonphysical.
It could be possible that we need new research methods to better understand these phenomena, and that the scientific method can be applied after the fact.
I agree with you, that not everything that exists can yet be measured.
 
This is about an article in the New York Times:

A story today of prolific fraud out of UConn. University researcher Dipak K. Das has been accused of falsifying research related to the health benefits of red wine. A three-year investigation has produced a 60,000-page report detailing 145 instances in which he fabricated data.

Das has been awarded loads of money over the years in federal grants for his “research,” most of which was published in obscure journals and was of laughably low quality. Two newly received grants alone were worth $890,000.
 
This is about an article in the New York Times:

A story today of prolific fraud out of UConn. University researcher Dipak K. Das has been accused of falsifying research related to the health benefits of red wine. A three-year investigation has produced a 60,000-page report detailing 145 instances in which he fabricated data.

Das has been awarded loads of money over the years in federal grants for his “research,” most of which was published in obscure journals and was of laughably low quality. Two newly received grants alone were worth $890,000.

I would suspect something more at play than just the researcher being crooked there.

If he was only publishing in obscure, low quality journals, the majority of grant boards wouldn't touch him with a 10ft pole.
 
I don't really see the problem with this. If you want to measure non-physical phenomena, it may be necessary to work on a new research method. One has to use the tools in endeavors for which they are designed.

For tackling a new type of research, new methods may be needed. However, I think it's possible you will encounter problems with people who maintain that things which cannot be measured must not exist. I disagree with that, but some folks are really tunnel-visioned about their methodology.

The university near my house already has loads of methods to choose from: Philosophy, history, theology, psychology, sociology, various departments of "studies," the Humanities, business administration, and physical education, to name a few. That's not enough? Do scientists even need to be involved?
 
I just love the open and honest approach that 99% of all scientists seem to have. They approach each subject of research with a humbling amount of innocence...leaving truth to be something backed up by real, measurable facts...even if those facts don't quite match their own personal beliefs. THAT is real intellectual honesty. There is no agenda other then the truth, and cold hard facts!

On the other hand, scientists are human, and not immune to some foibles of regular people. Sometimes scientists want so much to believe their theories are correct that they may jump ahead and draw conclusions that are not supported by evidence. Pons and Fleischman of cold fusion fame are good examples of this. Some may even falsify experimental data.

That said, give me scientists every time over people like "crop circle reserachers" and the like. At least scientists don't make me want to regurgitate whenever I see one on TV.

I don't play a scientist on TV, but I am one.
 
I don't really see the problem with this. If you want to measure non-physical phenomena, it may be necessary to work on a new research method. One has to use the tools in endeavors for which they are designed.

For tackling a new type of research, new methods may be needed. However, I think it's possible you will encounter problems with people who maintain that things which cannot be measured must not exist. I disagree with that, but some folks are really tunnel-visioned about their methodology.

If you can't observe or measure something, it doesn't exist for all practical purposes. For instance, the concept of string theory is popular at the moment. The problem is that there is currently no way to experimentally confirm the existence of strings, hence the "study" of strings is philosophy, not science. Now, maybe some day they will develop a means of discovering strings (by means of the super-colossal gargantuan enormous hadron collider or something), but until then, they don't exist. If you say they might, that just makes you an agnostic. If you say they do, that makes you superstitious.
 
That's ok. You are entitled to do what you want. But a scientist probably would not have stopped after the first sentence he did not agree with. he would have read on and investigated. But the other side, the superstitious non-scientists, already have their minds made up...and therefore never need to 'read on'.
 

Latest posts