Every year, the (Dutch) Shopping Tomorrow initiative brings together a large group subject matter experts (450 this year) to tackle specific busnisess challenges about — you guessed it — how consumers are shopping in the near future (tackling both online and offline).
2016 I was part of the ‘Revenue Optimization’ group for the second time.
Together with 18 other experts improved on the process of optimizing
on-site revenue that we first created in 2015.
Here I’d like to share the main findings that we published in our (Dutch) whitepaper [download].
Looking at the CRO version of Maslovs piramid, we made the following choices:
example: if you find a SSL security issue during a usability test,
you’re not going to A/B test how that impacts conversion: you just
implement it. But when there are issues with usability of functionality,
it depends on the issue if you want to test it or implement it
Final take-aways from the expert group
Create your list of potential improvements always on basis of (qualitative or quantitative) data instead of gut feeling
Also use data to prioritize your list in order to get maximum impact in your KPIs with minimum effort
Validate potential improvements through A/B testing and setup processes to continuously learn from your target audience.
Hope this is useful to you, if you have any specific questions about the Dutch resources I linked to, let me know :).
One final personal note I want to add: At Euroflorist
I’m working with all of the above and a great help with all of this is
our CRO Project Management tool: Effective Experiments. We are very
happy with how this tool structures the process, guides the CRO team,
documents everything and (partially automatically) keeps the rest of the
organization involved and informed about what is going on in the
optimization team. If you are a level 2 or higher, I’d highly recommend
you give it a try!
A hierarchy of evidence (or levels of evidence) is a heuristic used to rank the relative strength of results obtained from scientific research. I've created a version of this chart/pyramid applied to CRO which you can see below. It contains the options we have as optimizers and tools and methods we often use to gather data.
This is a bonus episode with Emily Robinson (Senior Data Scientist at Warby Parker) en Lukas Vermeer (Director of Experimentation at Booking.com).
In her earlier session that day, Emily said that real progress starts when you put your work online for others to see and comment on which in this case was about Github. Someone from the audience wondered how that works out in larger companies where a manager or even a legal department might not be overly joyous about that to say the least so I asked Emily about her thoughts on that.
Recorded live with audience pre-covid-19 at the Conversion Hotel conference in november 2019 on the island of Texel in The Netherlands.
(oorspronkelijk gepubliceerd op https://www.cro.cafe/)