Speaker: Boba Stokic, M.D., D.Sc. (Methodist Rehabilitation Center, USA)
The European Forum for Research in Rehabilitation hosted a webinar featuring Professor Boba Stokic, who presented on the misuse and proper usage of terms like "feasibility", "pilot", and "proof of concept" in rehabilitation research. Boba discussed the importance of conducting proper pilot studies and addressed questions about publishing small studies, sample size estimation, and the significance of transparent communication in research. The webinar also covered upcoming events, including a future presentation on data mining versus manual screening for systematic reviews.
Rehabilitation Research Feasibility Webinar
The European Forum for Research in Rehabilitation (EFRR) hosted a webinar on the feasibility, proof-of-concept, and pilot studies in rehabilitation research, featuring Professor Boba Stokic as the main speaker. The webinar was moderated by Frederike van Wyck, who provided an introduction to the EFRR and its mission to promote the biopsychosocial model in rehabilitation research, practice, and education. Professor Stokic, who is also the editor-in-chief of the International Journal of Rehabilitation Research, discussed the importance of considering various aspects in early-stage research before conducting formal studies. Participants were encouraged to submit questions in the chat, which would be addressed after the presentation.
Misuse of Study Terms in Research
Boba presented a research study on the misuse of terms like "feasibility", "pilot", and "proof of concept" in academic literature, particularly in rehabilitation studies. He argued that these terms are often used interchangeably or incorrectly, leading to confusion about the study's purpose and results. Boba found that while pilot studies are indeed feasibility studies, not all feasibility studies are pilot studies, based on a consensus framework developed by Eldridge in 2016. Through a PubMed search, Boba discovered over 12,000 pilot studies and fewer feasibility studies in the rehabilitation field, highlighting the prevalence of these terms in academic literature.
Types of Pilot Studies Explained
Boba presented on the different types of pilot studies, focusing on feasibility, proof of concept, and preliminary efficacy studies. He explained the key questions each type addresses and provided examples from his own research. Boba emphasized the importance of conducting pilot work to address practical and conceptual viability before larger studies. He also discussed how to interpret and present results from preliminary efficacy studies, advocating for focusing on effect size and confidence intervals rather than p-values. Boba concluded by recommending a title template for pilot studies and emphasizing the iterative nature of this type of research.
Value of Pilot Studies in Research
Boba discussed the importance of pilot studies in research design and addressed questions about publishing small studies and the concept of "publish or perish." He suggested that time constraints, rather than the pressure to publish, often lead to incomplete pilot studies. Boba also explained the significance of proper outcome measures in proof-of-concept studies and emphasized the value of publishing negative results to advance scientific knowledge.
Sample Size Estimation in Research
Boba discussed the importance of sample size estimation in preliminary studies and emphasized the need for transparency in study limitations and results, regardless of the outcome. He advised against overstating conclusions or hiding study limitations, as careful readers will spot these issues. Frederike and Boba agreed on the value of clear communication in research, including the feasibility of interventions and the importance of addressing these aspects in publications. They also discussed the upcoming webinar in January featuring Dr. Elena Ierardi, who will present on data mining versus manual screening for systematic reviews.