Enrollment Test Outcomes

Experiment

A copy refresh on the enrollment Start page (no layout changes), using NSLS promoter analysis and member-feedback language. Messaging shifted toward leadership growth, confidence, and long-term value rather than extrinsic perks like discounts and partner benefits.

Hypothesis

Messaging centered on the core value members describe in feedback will improve progression from Start → Your Info and Start → FOL101 conversion.

Decision

What we learned

Shifting the enrollment page messaging toward the core value members consistently describe in feedback and promoter analysis improved progression through the funnel. Messaging centered around leadership growth, confidence, and long-term value performed better than more extrinsic benefit framing like discounts and partner perks. The stronger start-page engagement translated into meaningful downstream lifts in both Your-info progression and FOL101 conversion.

Experiment

Added Cognia, ACE, and NCCRS accreditation badges inside the A&E upsell page pricing card, with the line "The NSLS is accredited by Cognia and recognized by colleges and universities nationwide."

Hypothesis

Credibility signals from authoritative institutions will lift A&E upsell conversion.

Decision

What we learned

Adding relevant trust badges near the CTA, where applicable, can help improve conversion. The badges lifted A&E upsell conversion overall, with the strongest and most confident lift on desktop. Authoritative accreditation acts as a growth lever where generic e-commerce reassurance saturates as hygiene.

Experiment

Required a personal (non-school) email at the Your Info step. School email moved to a profile-page entry post-enrollment.

Hypothesis

Removes ambiguity at the choice point, unblocks social sign-on, improves deliverability.

Decision

What we learned

Requiring a personal email simplifies the enrollment decision point by removing ambiguity. The lift in Grad Set conversion suggests downstream confidence improved. Neutral on near-term metrics but enables strategic levers (social sign-on, email deliverability, cleaner identity).

Experiment

Removed the Grad Set upsell from the payment page; repositioned it onto the plaque page after enrollment.

Hypothesis

Removing peripheral upsells from the cognitive-bottleneck step reduces friction at the highest drop-off point.

Decision

What we learned

Decision-environment simplification works. Significant lift in FOL conversion, especially on mobile. Major increase in plaque attach. Revenue impact diverges by device: mobile positive, desktop negative without Shop recapture or pricing changes. Significant reduction in Grad Set confusion contacts. "Stopped early" can mean "data is clear enough, now design the follow-up."

Experiment

Combined the grad set + plaque into one $12 upsell package on the payment page (vs. existing two-step setup).

Hypothesis

Combining the upsells into one package will increase ARPM.

Decision

What we learned

Bundle pricing matters more than bundle existence. Underpriced bundles cannibalize without recovering revenue. Hex analysis projected revenue-neutral at $12, +$7.3K/12 days at $18. Refund rates DOWN across all products (no buyer remorse — bundle concept is sound).

Experiment

Widened desktop button (larger target). Added fixed/floating button on mobile with context copy.

Hypothesis

Mobile-specific UX changes can have outsized positive impact without hurting desktop when forked by device.

Decision

What we learned

Mobile and desktop need separate button treatments. Persistent CTAs help most where screen real-estate is tightest. FOL101 was excluded — purchasing it was a prerequisite for reaching upsell, so the metric was gated. Always check if a prerequisite purchase gates the upsell metric.

Experiment

Added a floating mobile/tablet button to each step's form once all required fields were filled.

Hypothesis

Reducing tap distance via a persistent CTA will lift completion, especially on tablet.

Decision

What we learned

Persistent CTAs help most where screen real-estate is tightest. Tablet showed the strongest lift across every metric — worth designing tablet treatments separately rather than defaulting tablet to mobile or desktop behavior.

Experiment

Removed the required-field treatment on the grad set selection. Members no longer forced to make a choice.

Hypothesis

Less decision pressure → higher completion.

Decision

What we learned

Removing forced decisions lifts desktop materially. On mobile, "optional" can read as "missing" — affordance clarity matters more than choice load on small screens. Device-fork was the right call.

Experiment

Dropped the "Part 1" label from the upsell page heading (member feedback flagged it as confusing).

Hypothesis

Cleaner header → less cognitive load.

Decision

What we learned

Sequence framing matters. "Part 1" signaled structured progression and program legitimacy. Removing it reduced perceived continuity and dropped A&E conv −27%. Member feedback isn't always what to ship — test the change.

Experiment

Removed the ~$85 parent-package upsell from the payment step.

Hypothesis

Less cognitive load at payment → higher completion + downstream attach.

Decision

What we learned

Removing a peripheral purchase option at the cognitive-bottleneck step simplifies the decision and lifts both completion AND adjacent upsell attach. Net revenue positive because A&E upsell jumps. Pattern confirmed: simplify the payment surface.

Experiment

Moved the Terms & Conditions agreement from the payment page to the Your Info page.

Hypothesis

Front-loading legal reduces drop-off later by enabling earlier data capture.

Decision

What we learned

Legal disclosures need to land closer to the commit moment. Showing T&Cs at Step 1 raised perceived commitment cost before motivation was built. Timing of legal framing matters more than its location.

Experiment

Added Credit Transfer Assurance to the upsell page and reduced red text near the CTA.

Hypothesis

Clearer credit-transfer language reduces purchase hesitation and lifts conversion.

Decision

What we learned

Control's copy + structure is well-tuned for this surface. Layered assurance copy didn't add lift — possibly diluted the primary message. When an existing surface is already strong, polish ≠ improvement.

Experiment

Replaced the calendar date picker with a single date input field that auto-formats user input.

Hypothesis

Removing the calendar pop-up reduces friction.

Decision

What we learned

Some form elements serve psychological orientation, not just data capture. The picker anchored "progress made" — removing it tanked downstream conversion. Not every UI element is decorative.

Experiment

Defaulted payment page to express checkout (PayPal, Apple Pay on iOS) instead of manual card entry.

Hypothesis

Faster path → higher completion.

Decision

What we learned

Familiar institutional payment flow is more trusted than ecommerce-style express checkout. Default behavior matters — express should be opt-in. Convenience features common in retail can reduce perceived legitimacy in institutional contexts.

Experiment

Floating enroll button on the start page that persists during scroll on mobile.

Hypothesis

Persistent primary action reduces nav friction.

Decision

What we learned

Visibility of primary action matters more than visual polish. Mobile interactions benefit disproportionately from persistent CTAs (Fitts's Law). Validated the pattern that later seeded CDP-339 steps-1–3 mobile work.

Experiment

Improved the UX of the enroll button on the desktop payment page — made it span full page width instead of being small and right-aligned.

Hypothesis

Larger, more visible enroll button lifts conversion.

Decision

What we learned

Button visibility + clarity of primary action lifts conversion modestly even on a surface late in the funnel. Larger desktop targets work; this set up the pattern for CDP-353 mobile button work.

Experiment

Added the Newsweek badge to the enrollment flow footer on every page.

Hypothesis

Incorporating a third-party media badge adds trust signals and improves funnel conversion.

Decision

What we learned

Mild but real lift from credibility signals in footer placement. Early proof of the credibility-vs-hygiene distinction later sharpened by EE-8 accreditation badges. Footer is a low-friction place to add reassurance without overwhelming the primary surface.

Experiment

Added a member testimonial above the CTA on the start page, plus a floating CTA for mobile.

Hypothesis

Adding social proof at the start lifts conversion.

Decision

What we learned

Adding decision complexity to /start makes the page feel like a second decision rather than a continuation. Decision-momentum is still forming at /start; social proof belongs downstream. Not a rejection of testimonials generally — a rejection of placing them at /start.

Experiment

Same as CDP-282 but without the floating CTA — isolated the effect of the testimonial alone.

Hypothesis

Testing the testimonial in isolation will clarify whether it lifts conversion.

Decision

What we learned

The floating CTA in CDP-282 partially offset the testimonial drag. Isolating the testimonial revealed its true cost on /start. Confirms: testimonials belong downstream, not at decision-momentum-forming surfaces.

Experiment

Follow-up to CDP-281 — tested a third copy variant against V2 (the prior winner).

Hypothesis

Further copy refinement lifts conversion.

Decision

What we learned

Diminishing returns on copy iteration once you find a strong variant. V3 was clearer but lacked persuasive weight to pull hesitant users through. Click-to-purchase rate among engaged users was higher for V3 (4.92% vs 4.25%) — quality up, volume down.

Experiment

Made the Continue button clearer and action-oriented with larger font. Shortened copy on the purchase button.

Hypothesis

Updating button copy to remove guilt, stoke action, and clarify the choice will lift conversion + reduce refunds.

Decision

What we learned

Action-oriented button copy lifts both conversion AND quality. Refunds dropped −57% (A&E) and −49% (FOL) per day, the strongest quality signal in the 2025 set. Larger fonts on critical buttons read as confident, not pushy.

Experiment

Larger secure-payment badge + lifetime-access badge near card entry.

Hypothesis

Stacking trust signals at the highest-anxiety step compounds confidence.

Decision

What we learned

Generic security badges saturate quickly. Stacking visual reassurance produces marginal lift only. Treat ecommerce-style trust signals as hygiene, not growth — a different category from accreditation/credibility signals (later confirmed by EE-8 accreditation badges +12.09%).

Experiment

Updated button copy to remove guilt/pressure language. Removed the "short on cash" section.

Hypothesis

Softer copy reduces refunds and support contacts on the A&E bundle.

Decision

What we learned

Softer copy reduces post-purchase regret + support load but also removes urgency for marginal converters. Among members who didn't drop off, the variant performed better (13.15% vs 12.26% click-to-purchase). Intent quality > top-funnel volume in this case.

Experiment

Added secure-payment copy + lock icon near card entry.

Hypothesis

Security reassurance at the highest-anxiety step reduces hesitation.

Decision

What we learned

Security signaling at the payment step gives a small but real lift. Baseline hygiene, not a primary growth lever. Contrast with credibility signals from accreditation (EE-8 +12.09%) — different categories, different lift magnitudes.

Experiment

Three variants on Step 1: V1 remove contact header, V2 add green trust box, V3 reorganize layout.

Hypothesis

Reducing clutter, adding trust signals, and reorganizing the page lifts conversion.

Decision

What we learned

Strongest proof that NSLS users evaluate enrollment like a university decision, not a retail purchase. Contact info is a legitimacy signal — don't remove institutional markers untested. Green ecommerce trust boxes undermine institutional positioning. Reorganization without clear user benefit increased cognitive load.

Experiment

Reduced Step 1 field count to match Step 2's effort/length.

Hypothesis

Eliminating redundant fields without removing legitimacy signals lifts conversion.

Decision

What we learned

Cognitive load reduction works when the cut fields are truly redundant. Matched-effort design across steps preserves institutional feel — proof that "reduce friction" and "preserve institutional feel" aren't in conflict when done carefully.

Experiment

Added an SMS opt-in checkbox at Step 1 with copy explaining message frequency and privacy.

Hypothesis

Voluntary micro-commitment lifts conversion via effort justification AND enables SMS retargeting for drop-offs.

Decision

What we learned

Voluntary commitments work on two channels at once: (1) the micro-commitment lifts conversion via effort justification, (2) asking for opt-in (rather than auto-checking) signals NSLS handles member communications responsibly — itself a trust signal.

Experiment

Surfaced NSLS's existing 30-day refund policy on the start + payment pages.

Hypothesis

Risk reversal increases enrollment confidence without cheapening the offer.

Decision

What we learned

Risk reversal works — money-back guarantees, framed academically, increase trust without cheapening the offer. Making existing policies visible is low-hanging fruit. Institutional risk reversal is high-ROI and doesn't reduce prestige.