All posts

How many days until the data means anything?

· The Daynostic Team

A week of data cannot reveal a reliable pattern.

A week of mood and sleep logs is enough for an app to compute a correlation, but not enough for any sound method to separate a real pattern from random noise. How many days personal data needs before it means something has a concrete, quantifiable answer, and it is useful to know it before trusting any number a tracker displays.

Statistical power

Before running a study, researchers calculate statistical power: the probability that, if a real effect exists, the study will have enough data to detect it. With too few participants, even a genuine effect stays buried in the noise, the study is underpowered, and a null result means nothing.

Required sample size depends almost entirely on effect size. Jacob Cohen's standard reference, A Power Primer, tabulates it directly.1 Detecting a correlation with the conventional 80% power, at the usual significance threshold, takes roughly:

  • ~28 observations for a large effect (correlation near 0.5),
  • ~85 observations for a medium effect (near 0.3),
  • ~780 observations for a small effect (near 0.1).

A strong relationship can become detectable within a few weeks of daily logging. A weak one, and most effects in daily life are weak, can require two years of unbroken daily data before it is detectable at all. No algorithm gets around this.

Days are not independent observations

It is tempting to treat each day as one clean observation, so that 780 observations means 780 days. It does not work that way, because of autocorrelation: consecutive days are not independent. One day's mood resembles the previous day's, rough patches cluster into rough weeks, and sleep debt carries over. Weekly rhythms and slow trends add further structure.

When observations are correlated like this, the effective sample size is smaller than the raw day count, sometimes much smaller. A hundred logged days might carry the statistical weight of perhaps forty independent ones. The number of days required is therefore larger than Cohen's table suggests, and a feature that promises an insight after thirty days is not doing statistics.

Why the list is empty at first

Weak effects need hundreds of observations, and those observations are partly redundant. Together these mean that an empty insights list in the first weeks is the expected result of a correct analysis.

The threshold rises further when several variables are tracked at once. More variable pairs mean more chances for a coincidence to look significant, which is why serious analysis raises the threshold in proportion to the number of questions asked, a correction described separately. With low power early on and many comparisons, the correct procedure is to wait until a pattern has enough data behind it to clear a deliberately high threshold. The strongest correlation in a small, noisy dataset is almost always noise, whatever an app chooses to do with it.

More days

Power grows with every logged day. Each one moves small, real effects from undetectable toward visible and tightens the estimates on those already showing. There is no substitute for sample size; it can only be accumulated.

This is the logic behind an analysis held to a high statistical threshold: the waiting period is the data accumulating until a result can be supported.

A pattern from a handful of logs is almost always noise. Detecting a weak effect can take hundreds of observations, so an empty insights list in the first weeks is the expected result.
Daynostic is a wellness tool, not a medical device. Its insights are statistical associations within a person's own data, not medical advice.

Footnotes

  1. Cohen, J. (1992). A power primer. Psychological Bulletin, 112(1), 155-159. DOI: 10.1037/0033-2909.112.1.155. The cited sample sizes are for a product-moment correlation, two-tailed, α = .05, power = .80. ↩

Read next