The CRO Process

Written by Guido Jansen in
February 2017

Every year, the (Dutch) Shopping Tomorrow initiative brings together a large group subject matter experts (450 this year) to tackle specific busnisess challenges about — you guessed it — how consumers are shopping in the near future (tackling both online and offline).

In 2016 I was part of the ‘Revenue Optimization’ group for the second time. Together with 18 other experts improved on the process of optimizing on-site revenue that we first created in 2015.

Here I’d like to share the main findings that we published in our (Dutch) whitepaper [download].

Also see my next article: Proving the monetary value of A/B testing.

CRO Maturity

We created a model to see where you stand regarding conversion optimization in your company. We defined 7 area’s that can be scored on a scale from 1–5:

  1. People
  2. CRO skills
  3. CRO activities
  4. Testing Quantity
  5. CRO Tools
  6. Optimization KPI’s
  7. Company-wide support

The table below gives you a global idea of the different levels for each:

[See the full table]

We also created a neat website (in Dutch) where you can calculate your own CR Maturity score:

CRO Cycle

So ok, nice to know the competencies you need and where you stand right now, but how does the process itself look like?

Well, according to it will (basically) look like this for all companies on Level 2–5:

[See full scheme]

CRO Priority

So when you have your list of ideas, where do you start? How do you prioritize?

For this we made combination of the PIE (Potential Importance Ease) model and the ConversionXL (PXL).

[View spreadsheet to use yourself]

If prioritizing your testing ideas is an issue for you, I’d highly recommend reading 4 Frameworks To Help Prioritize & Conduct Your Conversion Testing.

What to test and what to implement directly?

Looking at the CRO version of Maslovs piramid, we made the following choices:

For example: if you find a SSL security issue during a usability test, you’re not going to A/B test how that impacts conversion: you just implement it. But when there are issues with usability of functionality, it depends on the issue if you want to test it or implement it directly.

Final take-aways from the expert group

  1. Create your list of potential improvements always on basis of (qualitative or quantitative) data instead of gut feeling
  2. Also use data to prioritize your list in order to get maximum impact in your KPIs with minimum effort
  3. Validate potential improvements through A/B testing and setup processes to continuously learn from your target audience.

See the complete presentation and cases on slideshare (in Dutch).

Hope this is useful to you, if you have any specific questions about the Dutch resources I linked to, let me know :).

CRO Tool

One final personal note I want to add: At Euroflorist I’m working with all of the above and a great help with all of this is our CRO Project Management tool: Effective Experiments. We are very happy with how this tool structures the process, guides the CRO team, documents everything and (partially automatically) keeps the rest of the organization involved and informed about what is going on in the optimization team. If you are a level 2 or higher, I’d highly recommend you give it a try!

Recent posts
AI & Personalization
AI & Personalization

Guy Yalif performed his CH2019 keynote "AI & Personalization Demystified" and spoke about how we can use AI and machine learning, what it is (and isn't) good for in marketing and personalization. After his session, he and Niels Reimer joined me in the café to talk about this! (oorspronkelijk gepubliceerd op

Make All of Your Data Actionable With Ringside Data
Make All of Your Data Actionable With Ringside Data

Do you struggle to get enough actionable data from Google Analytics? Then you need to listen to Russell McAthy, CEO and co-founder of Ringside Data. Key takeaways include: Why Russell set up Ringside Data, the companies with the biggest data problem, how Ringside outperforms Google Analytics, if you’re investing in data analytic tools, you need people with specific skill sets, the biggest pain points Ringside is trying to solve, the benefit of Ringside for eCommerce businesses, and what attribution is. (originally published on