Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

iTechGuides is reader-supported. When you buy through links on our site, we may earn an affiliate commission. As an Amazon Associate I earn from qualifying purchases. Learn more

To find out whether a stock-market seasonal trend holds up, define the pattern and return measure before testing, account for every rule you searched, then test the unchanged rule on a later period. A small p-value for the best-looking pattern in the same data is not enough: it may reflect data mining, and a historical result does not by itself establish a current trading opportunity.

Define the seasonal claim before calculating it

“Seasonality” can mean many different hypotheses: weekday effects, calendar-month effects, weekdays within a month, weeks of a month, semi-month periods, holidays, or turns of the week, month, or year. Choose the exact calendar rule before looking for results.

Separate a return difference from a trading strategy

These are different questions. A statistical claim might be: “The mean daily return on the first trading day of each month differs from the mean on other trading days in this index during these dates.” A strategy claim asks whether following a specified rule would outperform a benchmark such as buy-and-hold. State which one you are testing; a difference in average returns does not automatically establish that a strategy is profitable.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Write down the scope

Specify the index or securities, geography, start and end dates, observation frequency, and return field. State how dividends and corporate actions are treated, and keep the historical asset universe consistent with the question. Make clear whether the claim concerns a particular market and sample or is meant to generalize more broadly.

Count the full search, not just the winning result

If you tried many calendars, indices, date ranges, holding periods, filters, or strategy definitions, the most impressive result may have emerged by chance. Record the complete family of alternatives you considered and report it alongside the winner. There is no objectively exhaustive set of imaginable calendar patterns: the possible universe depends partly on the researcher’s choices.

Sullivan, Timmermann, and White evaluated nearly 9,500 calendar-effects-based trading rules and found that the best in-sample rule was no longer conventionally significant after accounting for the broader universe; its out-of-sample performance was also inferior. In a smaller analysis of 244 known calendar rules, apparent significance likewise was not robust to the data-mining adjustment. Their paper explains why a nominal p-value for a selected rule can overstate the evidence: Dangers of data mining: The case of calendar effects in stock returns.

Rank #2

Choose an inference method that matches the search

A conventional test on the single rule that looked strongest treats that rule as if it had been specified in advance. When it was selected after trying many alternatives, inference needs to account for that search. Describe both the adjustment and the family of hypotheses it covers.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Family-wise corrections and dependence

A simple family-wise correction can be useful for a limited, clearly listed set of tests, but methods differ in how they handle dependence among rules. The Atlanta Fed authors explain that a Bonferroni bound is more conservative because it ignores dependence among candidate rules. Adjustments can also reduce power to detect a genuine effect, so an adjusted non-significant result is not proof that no effect exists.

Bootstrap tests for a broader rule universe

Hansen, Lunde, and Nason describe a bootstrap generalized-F test that evaluates calendar effects in the context of a specified universe of possible rules. Their study examined 181 calendar effects drawn from the literature and emphasizes that the choice of universe matters: changing it can change the inference. See the authors’ Testing the Significance of Calendar Effects for the method and its qualifications.

Reserve a later period for confirmation

Use an earlier sample to identify a candidate rule, then lock its definition and evaluate it on a later period that played no role in choosing or tuning it. Report how it performs there, even if it fails. If you revise the rule after seeing the holdout results, that period is no longer an untouched confirmation test for the revised rule.

The 2001 Sullivan, Timmermann, and White study found that its best in-sample calendar rule performed worse out of sample. This illustrates why success in the period used to discover a pattern is not the same as evidence that it will persist.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Check whether the result is stable and economically meaningful

Compare the result across sensible subperiods and, where relevant, other markets. A pattern confined to one historical window may be real for that sample without being durable. Markets can also be correlated, so finding a similar pattern in several indices does not necessarily amount to several independent confirmations.

Historical findings are not interchangeable. Rozeff and Kinney’s 1989 study reported persistent anomalous returns around turns of the week, month, and year, and around holidays, using 90 years of daily Dow Jones Industrial Average data. Hansen, Lunde, and Nason report time-varying effects and fragile Dow Jones evidence in later subsamples. The studies use different samples and methods, so neither establishes a universal present-day effect.

For a strategy claim, report the effect size and specify exposure, risk, and relevant trading costs. A statistically detectable historical return difference does not establish net profitability for a particular investor after costs or taxes.

Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

Use a reproducible reporting checklist

  • Rule: State the exact calendar definition and whether the hypothesis is about average returns or strategy performance.
  • Data: Name the market or securities, geography, dates, frequency, return measure, and treatment of dividends and corporate actions.
  • Search: Disclose the rules, markets, date ranges, filters, and strategy variations considered—not only the best result.
  • Inference: Identify the multiple-testing method, the hypothesis family it covers, and how dependence among rules is handled.
  • Confirmation: Show results for a later untouched period and explain whether the rule was fixed before that period was examined.
  • Robustness and relevance: Report subperiod and market checks, the effect size, and—if evaluating a tradable strategy—the exposure, risk, and costs considered.

Keep the conclusion no broader than the test. A result for one index, period, and defined rule is evidence about that setting—not proof of a universal or currently exploitable seasonal trend.

What’s actually slowing this PC down?

Pick the symptom - the matching free tool is one click away.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.