Email Marketing

Subject Line A/B Testing — Real Case Studies and Data from Indian Campaigns

Why Generic Subject Line Advice Only Gets You So Far

Every email list behaves differently. A tactic that doubles open rates for one audience might do nothing for another. The only way to know what truly works for your specific list is systematic A/B testing over time. This guide shares patterns observed across many campaigns to help you form better initial hypotheses — but your own testing data should always be the final authority.

Case Pattern 1 — Personalisation vs Generic (E-commerce)

Across e-commerce campaigns, subject lines using the subscriber's first name consistently outperform generic versions, typically by 15-25% in open rate. However, the effect diminishes with repeated use — subscribers who receive personalised subject lines in every single email become less responsive to the tactic over time. The best-performing approach uses personalisation selectively for higher-stakes campaigns (major sales, cart abandonment) rather than every routine send.

Case Pattern 2 — Question vs Statement (SaaS Newsletters)

For SaaS product newsletters, question-based subject lines ("Are you using this feature yet?") typically outperform statement versions ("New feature update") by 8-15%. The effect is strongest for subject lines addressing a specific pain point the reader likely experiences, and weaker for purely informational announcements where curiosity has less to attach to.

Case Pattern 3 — Urgency Language (Flash Sales)

Genuine urgency ("Sale ends in 3 hours") reliably outperforms non-urgent alternatives by 20-35% for time-bound promotions. However, this effect depends entirely on the urgency being real. Lists that have previously received false urgency messaging (sales that mysteriously "extend") show measurably reduced response to urgency language over time — subscribers learn not to trust the signal.

Case Pattern 4 — Numbers vs No Numbers (Educational Content)

Subject lines containing a specific number ("5 mistakes to avoid") outperform equivalent text-only versions ("Mistakes to avoid") by 10-20% across educational and listicle-style content. Odd numbers show a very slight edge over even numbers in some tests, though this effect is small enough that it shouldn't be prioritised over more impactful factors like relevance and clarity.

Case Pattern 5 — Long vs Short Subject Lines

Shorter subject lines (under 40 characters) generally outperform longer versions for promotional and sales content, likely due to better mobile rendering and quicker comprehension. For newsletter and educational content, moderately longer subject lines (up to 60 characters) that provide more context can perform equally well or better, since the audience is already engaged and reading with more intent than a promotional scan.

Case Pattern 6 — Emoji Usage

A single relevant emoji at the start or end of a subject line typically improves open rates by 5-15% for consumer and lifestyle brands. For B2B and professional services content, emoji use shows mixed or even negative results, as it can undermine the professional tone the audience expects. Industry context matters more than any universal emoji rule.

How to Run Your Own Valid A/B Test

To get statistically meaningful results, test with a minimum sample size of 1,000 recipients split evenly between variants — smaller samples produce results too noisy to trust. Change only one variable per test (length, personalisation, urgency, emoji, or format) so you can clearly attribute the result. Run tests at the same time of day and day of week to control for timing variables, and always document your results in a simple spreadsheet so patterns become visible over multiple campaigns rather than being forgotten after each individual test.

A/B Testing Quick Reference

• Minimum 1,000 recipients per variant for reliable results
• Test one variable at a time — never change multiple elements together
• Personalisation works best used selectively, not in every email
• Urgency only works if it's genuine — fake urgency erodes trust over time
• Emoji helps consumer brands, often hurts B2B and professional tone
• Document every test result to build your own list-specific playbook