CASE STUDY
3 min read
TL;DR
KEY METRICS
28%
of users exhausted all free AI credits
13%
of those users upgraded to Teal+
Status
Shipped
Role
Lead Product Designer (solo)
Year
Q3 2024
Product
Teal (B2C Career Platform)
Audience
Job Seekers across the U.S.
Skills
UX Design
Growth Strategy
User Research
A/B Testing
Prototyping
The final design
The Challenge
Users initiated the AI experience by clicking “Write with AI”.
The old experience hid advanced AI features under a “Customize with AI“ button.
Free vs. Paid Experience
Initial Solution: Elevating the Value of AI
Advanced AI tools where immediately accessible.
We hypothesized that giving user quicker access to the tools would increase the amount of user exhausting their credits.
A/B Testing & What We Learned
Post-Test Refinement:
Designing for Confidence and Conversion
Using insights from the test, I iterated the experience further:
Simplified First Interaction
We doubled down on “Write with AI” as the main CTA. Its clarity, familiarity, and performance made it the anchor of the interface. The credit tracker remained but was redesigned to sit cleanly within the button.
Progressive Tool Reveals
Features like keywords and custom prompts were hidden behind tabs, which brought visibility, but didn’t force them upon the user. This allowed us to reduce overwhelm while still surfacing depth.
Final Designs
One of the core assumptions was that feature visibility equals perceived value. But the A/B test proved otherwise. Overexposing the interface created friction, not momentum. In response, I:
Re-centered the experience around simplicity
Hid complexity behind optional, progressive interactions
Worked with engineering to focus on creating a strong first impression with high-quality AI output
Collaboration & Execution
I worked closely with our PM and CEO to define the product funnel and success metrics. Engineers and I partnered weekly to implement interaction logic and measure impact.
Created annotated Figma designs with edge case handling
Delivered async Loom walkthroughs
Monitored tests and user behavior in Amplitude
Measuring & Validation
I used a mixed-methods approach:
A/B testing to measure conversion outcomes
Session replays to observe real usage
User feedback and support tickets to identify edge case confusion
The improved flow resulted in:
28% of users using all 5 free credits
13% of those upgrading to Teal+
The final design
Reflections &
What’s Next
Explore more of my work
mattsburt@gmail.com

