ResearchPod Summary
Personalized N-of-1 trials are designed to identify individual-level treatment effects for interventions with high variability. Researchers aimed to determine if such trials could effectively evaluate the impact of different melatonin doses (3.0 mg and 0.5 mg) versus placebo on self-reported poor sleep, while simultaneously assessing the feasibility and acceptability of a remote, digital trial platform.
This study conducted 60 personalized N-of-1 crossover trials. Each participant underwent a 2-week baseline period followed by a 12-week intervention period. During the intervention, participants were randomized into two treatment orders (ABCCBA or CBAABC) to test two melatonin doses against a placebo. Adherence and outcomes were monitored using Nomi smart pill bottles, Fitbit Charge 5 activity trackers, and daily ecological momentary assessment (EMA) text-message surveys tracking sleep quality, fatigue, and stress. Feasibility and satisfaction were evaluated through the System Usability Scale (SUS) and post-trial surveys.
The trial demonstrated high feasibility, with participants reporting an average SUS score of 76.3 and 96% stating they would recommend the experience. Despite the successful implementation, melatonin did not provide statistically significant improvements in sleep duration or quality compared to placebo. Furthermore, formal analysis of the heterogeneity of treatment effects (HTE) revealed minimal variation in how participants responded to the melatonin, indicating that there is no individual-level benefit that would necessitate the continued use of personalized N-of-1 trials for melatonin in this population. These results suggest that while the digital trial framework itself is a valid research tool, melatonin may not be an appropriate intervention for this personalized approach.
Alex: Personalized sleep trials worked as a service, but melatonin did not outperform placebo. In this study, people generally liked testing treatments on themselves, yet neither dose improved sleep beyond the dummy capsule. That distinction matters: a successful way to deliver research is not necessarily a successful treatment.
Sam: If people responded differently, though, an average could hide useful benefits. Was finding those individual differences part of the point?
Alex: That was central to this randomized clinical trial by Mark Butler and colleagues, published in JMIR Formative Research in 2025. They tested whether remote personal trials were usable, whether melatonin helped, and whether responses differed enough to justify personalization.
Sam: So this matters both to sleep researchers and to anyone building trials around individual treatment choices.
Alex: Yes. We’ll separate the platform’s success from the treatment results, then examine how strongly the evidence argues against further personalized testing.
Sam: Why expect personalized testing to help here? Was there already evidence that melatonin worked differently for different people?
Alex: Earlier trials and reviews reported variation in melatonin’s effects. A systematic review found substantial differences across studies. The authors took that as a reason to investigate personalized treatment. But variation across studies and variation between individual patients are not the same question.
Sam: Different studies can recruit different populations or use different procedures. How did this design get closer to the individual question?
Alex: Through N-of-1 trials: repeated treatment comparisons within a single person. Each participant received higher-dose melatonin, lower-dose melatonin, and placebo at different times. That creates an individual treatment estimate. Combining those estimates also lets researchers examine how much treatment effects differ between people.
Sam: Make that concrete. What did someone actually do after enrolling?
Alex: The study enrolled 60 people with self-reported poor sleep. They began with a baseline period, managing sleep as usual without study capsules. They then followed an assigned treatment schedule for twelve weeks. Participants received a Fitbit, supplements, and smart pill bottles that transmitted medication-adherence data.
AI-generated third-party summary by ResearchPod. Not official content or an endorsement by the paper authors or affiliated organizations.
Sam: Were they choosing which bottle to try, or was the sequence controlled?
Alex: They were randomized to one of two schedules. For example, one schedule ran higher dose, lower dose, placebo, placebo, lower dose, higher dose. Capsules looked identical, and participants did not know which treatment each bottle contained. Nightly messages told them which bottle to use.
Sam: That sounds workable remotely, but it also asks for sustained effort. What did participants have to record?
Alex: The Fitbit recorded sleep duration. A morning text asked about the previous night’s sleep quality, using a modified consensus sleep diary—a standardized sleep questionnaire. Additional texts asked about symptoms, including fatigue and stress. Participants also received a personalized report after completing the trial.
Sam: Before we get to whether they liked it, who counted as having poor sleep? That could shape the treatment result.
Alex: Eligibility required recurring difficulty falling asleep, staying asleep, or feeling refreshed, persisting for at least a month. Symptoms also had to bother participants substantially. But the enrolled sample’s average sleep duration was only moderately short, and average reported sleep quality was near the middle of the scale.
Sam: So these were people troubled by sleep, but not necessarily people with the most severe measured sleep problems.
Alex: That’s an important boundary. Another is that participants had to meet adherence requirements during baseline before progressing. The usability findings therefore describe a group already able to engage with the monitoring and surveys, rather than everyone who initially expressed interest.
Sam: Within that group, did the remote system actually feel manageable?
Alex: On the System Usability Scale, a validated usability questionnaire, the average score was about 76 out of a hundred. The authors classified that as acceptable. Ratings varied considerably, though: some participants found the system less than acceptable, while others rated it excellent.
Sam: An average usability score can conceal specific friction. Which parts worked, and which parts wore people down?
Alex: Participants especially liked the Fitbit and the presentation of their results. Text-message prompts and survey questions received lower satisfaction ratings. Still, among satisfaction-survey respondents, 96 percent said they would recommend the trial. That supports acceptability, without suggesting every component was equally welcome.
Sam: Now the treatment comparison. What doses were tested, and how much extra sleep did they produce?
Alex: The lower dose was half a milligram. The higher dose was three milligrams. Neither significantly increased sleep duration relative to placebo. For the higher dose, the pooled model estimated roughly five extra minutes per night compared with placebo.
Sam: Five minutes sounds small, but an estimate is not the same as a precise answer. How uncertain was it?
Alex: Its confidence interval included both less sleep and more sleep than placebo. So the result does not establish an exactly zero effect. My reading is narrower: this study found no clear sleep-duration advantage at either tested dose, using these measurements in this sample.
Sam: What about feeling that you slept better? Device-recorded duration might miss something people care about.
Alex: Reported sleep quality improved from baseline during all intervention conditions, including placebo. But neither melatonin dose beat placebo on that outcome. There was a small statistically significant difference favouring the lower dose over the higher dose. That did not translate into superiority over placebo.
Sam: So a before-and-after improvement would tell a more encouraging story than the actual treatment comparison.
Alex: It would, and that’s why the placebo comparison matters here. Fatigue also improved slightly from baseline in some conditions, including placebo. Neither melatonin dose significantly outperformed placebo for fatigue, and stress showed no significant treatment differences.
Sam: That still leaves the original personalization argument. Could some people benefit even when the pooled result is unconvincing?
Alex: The researchers explicitly tested that possibility. Their models accounted for autocorrelation, meaning that measurements close together in time can be related. They then compared models allowing treatment effects to vary between people with models that did not allow that variation.
Sam: Did allowing variation improve the models? That seems like the obvious evidence for individual differences.
Alex: It improved model fit for sleep duration, fatigue, and stress. But the authors’ separate indices of treatment-effect heterogeneity—how much effects differ between people—were low. They interpreted those indices as indicating little usefulness for future personal trials of these treatments and outcomes in this population.
Sam: So better model fit did not automatically mean differences large enough to make personalized testing worthwhile. Was sleep quality assessed the same way?
Alex: No. The formal heterogeneity analysis for sleep quality could not be completed because responses varied too little. The authors thought that also suggested limited differences in treatment effects. But we should distinguish that suggestion from a completed statistical test.
Sam: How far should we take the negative result? It would be easy to turn this into “melatonin never helps.”
Alex: That would go beyond the evidence. The authors discuss earlier research suggesting melatonin works best with sleep restriction or altered sleep schedules. They connect that to circadian rhythm, the body’s daily timing cycle. This trial broadly recruited people reporting poor sleep, whose difficulties could have varied causes.
Sam: And which limitation most affects your confidence in what they measured?
Alex: The sleep outcomes came from self-report and a consumer wearable. The authors acknowledge that more precise methods might detect nuances these tools missed. The sample also was not representative, and only the selected doses were tested. Sample size was chosen primarily for a preliminary feasibility assessment.
Sam: Who should read the full document, and where should they start?
Alex: Researchers building remote personalized trials should start with study design, adherence rules, and usability results. Sleep researchers should examine the placebo comparisons and the treatment-heterogeneity analysis, then the limitations. For everyone else: this study shows that people can value a personal trial even when the treatment does not beat placebo.
Sam: Keep those two successes separate.