Interesting post. I thought the study was quite interesting and fundamentally sound. I just wanted to offer a few clarifications on the comments regarding the scientific value of the study. First, science does not prove anything, that is not what scientists do. We build explanations and then test those explanations where they are weakest so as to ascertain whether the explanation is incorrect. Then we modify and test further. It is by attacking the weakest parts that we avoid the "black swan fallacy". Therefore, it is unfair to hold this study to that standard. Further, it is a bit ridiculous to think that one study can test all possible facets of the question at hand. No single study can definitively answer all the questions raised in the comments. Instead, scientists isolate parts of a phenomenon; the collection of the results from isolated parts paints the bigger picture. Third, I don't know what a "control group" for this study would be? A control does not nave the construct being tested (e.g., a placebo in a drug study). What would constitute a control in this case? Air? Plaster? And what would that control have to say about differences among woods? Next, some posters are correct that the experiment should have had some number of boards of each variety. In that way, we could see variation within species and the degree to which we might be fooled by a particularly melodious piece of plywood verses a very dull piece of pine. It would also facilitate a test of significant difference as we would have a standard deviation from which confidence intervals could be calculated. There is no standard deviation in a single board.
It is generally a good idea to read the study before commenting on it so one can see that they controlled volume via the plucking mechanism and how the "guitars" were built. They were careful and their internal validity is good. Some commenters are correct that these are not real guitars played on a real stage by real musicians. that is an issue with external validity. The balance between internal validity and external validity is a bit of a zero sum game such that it is highly improbable that this question can be answered in a single study that has both high internal and high external validity. The researchers need to choose one and he critiqued on the extent to which they met that criteria.
It is generally a good idea to read the study before commenting on it so one can see that they controlled volume via the plucking mechanism and how the "guitars" were built. They were careful and their internal validity is good. Some commenters are correct that these are not real guitars played on a real stage by real musicians. that is an issue with external validity. The balance between internal validity and external validity is a bit of a zero sum game such that it is highly improbable that this question can be answered in a single study that has both high internal and high external validity. The researchers need to choose one and he critiqued on the extent to which they met that criteria.