The Best Ways Cannabis Researchers Can Prevent Biased Results
As demand for research increases, we’re seeing a surge in the number of studies on cannabis and its effects. But much of it is sponsored by cannabis companies, potentially creating conflicts of interest for researchers and undermining the validity of their findings.
Numerous universities have recently received multi-million-dollar donations from the cannabis industry, raising questions of what companies expect in return for their support.
Cannabis Companies Sponsoring Research
Many of these companies sponsor research because they want to use the results for marketing purposes, naturally creating vested interests that undermine the scientific process.
A common practice is to establish a weak argument as a null hypothesis and debunk it in order to make the sponsor’s products look superior. For example, researchers assessing CBD nano water might want to prove that CBD is more bioavailable when consumed via a specific product; a simple way to do this is to give test subjects both the product and CBD in its raw form and examine their blood serum levels of CBD an hour after consuming each; results may then show that CBD is more bioavailable when consumed via the product, and will be cited as proof of its effectiveness.
But this ignores the fact that few people take CBD in its raw form, or that there are numerous other consumption methods that may make it more bioavailable than the product being tested.
Another technique, known as P-hacking, is to conduct a study multiple times and cherry-pick the one(s) whose results match a desired outcome. For instance, a test could be undertaken 20 times, produce the “correct” outcome twice, and only have those two sets of results presented.
Sadly, many credible universities accept funding from cannabis companies even if it means compromising the integrity of a study, creating a hospitable environment for these kinds of practices.
Why Do Cannabis Researchers Accept Funding From Companies?
Most universities would prefer to receive grants rather than funding from commercial enterprises, but not all have the choice. Lots of the labs studying cannabis are relatively new, making it difficult for them to be selective regarding which sources of revenue they accept.
Furthermore, some companies simply need essential research to be undertaken and sponsor it without attaching stipulations. Government grants aren’t always available to support basic cannabinoid and terpene research — particularly into the effect-based outcomes of interest to the average medicinal and recreational consumers — leaving a funding gap that firms need to fill themselves.
It’s also worth noting that not all cannabis researchers bend to the will of their financial backers; some publish the results of their studies regardless of their outcomes.
However, plenty are more pliable, as evidenced by the bias seen in many of the studies funded directly by cannabis companies.
How Bias Appears in Research
There are multiple ways to manipulate studies in order to produce a specific set of outcomes. In addition to P-hacking, researchers can use inadequate sample sizes, presenting the results of experiments with egregiously few participants in order to make “scientific” claims about a product.
Alternatively, they can define a study’s parameters vaguely — for example, by comparing a product to “pure CBD” without providing sufficient information regarding how the CBD was prepared. Many factors, including preparation and delivery method, have a significant impact on the effect that CBD produces but, by pretending they don’t, researchers can administer CBD in a way that ensures its effects compare favorably to those of the product.
The importance of dose-dependent responses is also regularly overlooked; if a study links a specific outcome to the consumption of a product, it often follows that a higher dose will produce a greater amount of that outcome (for instance, a prolonged or more intense effect), yet many experiments simply compare one specific dose to no dose at all.
Experiments like these have no scientific value, and the need for greater integrity in cannabis research, for the good of the industry as a whole, is clear.
How Biased Research Affects the Cannabis Industry
If allowed to continue unabated, the effects of biased research could undermine the perception of the entire cannabis industry. However, studies with vested interests are systemic in most scientific disciplines, and experts in the cannabis sector believe that high-quality research will soon supersede the bad.
A wave of good research and subsequent meta-analyses should then yield substantive results.
Ways That Cannabis Researchers Can Eliminate Bias
But until that wave arrives, cannabis researchers need to be proactive in eliminating bias from their studies. This requires them to adopt strategies that will guarantee the validity of their results:
Preregistration
One of the best ways to eliminate outcome-based motives is to preregister studies. This means outlining their design and committing to publish their results in a journal before conducting them, thus ensuring that the data speaks for itself.
Use a Double-Blind Placebo
This is best practice across a range of research-based disciplines. A double-blind placebo requires samples to be sent to the clinical research office in a way that ensures the tested substance(s) and the placebos are indiscernible. This prevents both the people conducting the experiment and those taking part from knowing what each participant has consumed, making the observed outcomes more reliable.
Look for a Dose-Dependent Response
Testing for dose-dependent responses is integral to forming solid conclusions. Taking precautions against false discovery rates for both type-one and type-two errors, doing multiple comparisons corrections and mapping accurate dose-dependent response curves should form the basis of in-depth statistical analyses.
Employ Rigorous Statistical Testing
If a hypothesis is examined by comparing multiple groups, it’s essential to undertake rigorous statistical testing. This requires forming a null hypothesis (stating that the study will produce no observable difference between the groups examined) with a view either rejecting or not rejecting it.
Statistical testing can then determine the probability of producing an observable difference between the groups whereby, if the probability is less than a pre-agreed figure, the null hypothesis is rejected. This can be also used to conclude whether that difference is statistically significant or due to chance.
Biased studies have the potential to damage the cannabis industry, but there are many methods that cannabis researchers can employ in order to increase the validity of their work. Trustworthy studies must supplant poor research in order to provide consumers and manufacturers with reliable information and subsequently enhance the perception of cannabis-based products. The long-term health of the industry may depend on it.