When I started using Thumbnail Personalization for Titan Tower Defense the results were overall pretty good. Most thumbnails did not fall below a 1% QPTR. However since then the results kept getting worse with each time I would try new thumbnails even though some of the thumbnails were literally the same and the QPTR they were getting was 3x less. Besides QPTR, session time also drastically changed from 11 minutes to around 5.
Thanks for the report! We’ll follow up when we have an update for you!
Thanks for sharing your experience! It’s awesome to see your commitment to optimizing Thumbnail Personalization! It’s completely normal for thumbnail performance to shift over time as early users convert, making it harder to engage the rest of the audience with the same designs.
For this experience, QPTR has shown improvement recently. Great work with trying new thumbnails in personalization! One thing to consider is the frequency of iterations, as updating every 1-2 days may not give the algorithm enough time to stabilize. Allowing each iteration to run for about 7 days can help the algorithm fully optimize and capture a representative user cohort across both weekdays and weekends.