Test Strategy for AB Experimentation for an eCommerce kind of website and underlying application

[SwetaSKK]

Beginner Question - What strategies do you use to AB experiment a website that is not exactly an ecommerce website but is similar in terms of its offerings and services. (Adobe Target)
1. How do you test AI chatbot and help section?

2. How do you include MVT testing?

3. And how do you leverage "recommendations" in Adobe Target and build tests?

[Akanksha_Singh · Accepted solution]

Hi @SwetaSKK ,

You can use various approach using adobe target depending on the nature of the website's offerings and services.

1. Testing AI Chatbots and Help Sections

Strategies:

• Placement Testing: Experiment with different positions on the page (e.g., bottom right corner vs. a pop-up).
• Interaction Testing: Test different interaction styles (e.g., proactive vs. reactive responses).
• Set up A/B tests in Adobe Target to compare different versions of the chatbot or help section
• Track metrics such as user engagement, interaction rates, and satisfaction scores.

2. Including MVT

Create Variants: Develop different versions of each element.

For example, if testing a landing page, you might test variations of headlines, images, and button text.

3. Leveraging Recommendations

• Content Recommendations: Use algorithms to recommend relevant content to users based on their behavior and preferences.
• Product Recommendations: As per the type of business, recommend relevant articles, services, or case studies and other relevant category.
• Different Recommendation Algorithms: Test different recommendation algorithms to see which provides the most relevant results.

Hope you find this information useful!

Thanks,
Akanksha Singh