DataCamp
How might we implement a quiz onboarding process for DataCamp users to enhance the online course completion rates?
Team
Solo
Timeline
September 2021 ~ December 2022, Shipped
My Role
I conducted user research to pinpoint issues in Brightspace's troubleshooting system. I then conceptualized and developed a chatbot troubleshooting system, overseeing the entire process from conception to the UI, with a focus on improving support for faculty and administrators.
Outcome
The new chatbot troubleshooting solution increased user self-sufficiency, with 90% successfully rediscovering Brightspace resources. This efficiency is expected to reduce support ticket submissions by 60%, emphasizing the positive impact on user satisfaction and issue resolution.
Current Situation
Current Situation
Current Situation
Current Situation
Coding skills are highly in demand, even luring those with no CS background into self-learning online coding courses to enhance their careers.
Despite the low cost and convenience of online courses, many people do not stick with them, giving up eventually.
Coding skills are highly in demand, even luring those with no CS background into self-learning online coding courses to enhance their careers.
Despite the low cost and convenience of online courses, many people do not stick with them, giving up eventually.
Coding skills are highly in demand, even luring those with no CS background into self-learning online coding courses to enhance their careers.
Despite the low cost and convenience of online courses, many people do not stick with them, giving up eventually.
Coding skills are highly in demand, even luring those with no CS background into self-learning online coding courses to enhance their careers.
Despite the low cost and convenience of online courses, many people do not stick with them, giving up eventually.
The Problem
The Problem
The Problem
The Problem
Users can not complete the courses they enrolled, the average completion rate is as low as 13%.
Users can not complete the courses they enrolled, the average completion rate is as low as 13%.
Users can not complete the courses they enrolled, the average completion rate is as low as 13%.
Users can not complete the courses they enrolled, the average completion rate is as low as 13%.
Understanding Users
Understanding Users
Understanding Users
Understanding Users
White Paper Research
White Paper Research
White Paper Research
White Paper Research
Desktop Research
Survey
Interview
User Problem
User Problem
User Problem
User Problem
As a result, I defined the problem of unable to complete courses in relation to both new users and existing users:
As a result, I defined the problem of unable to complete courses in relation to both new users and existing users:
As a result, I defined the problem of unable to complete courses in relation to both new users and existing users:
As a result, I defined the problem of unable to complete courses in relation to both new users and existing users:
1. They do not have experience and background knowledge of coding.
2. It's hard to estimate the difficulty level and when signing up for an online course.
For new users, they underestimate the time and efforts it takes to complete the course:
For existing users, they find it difficult to stay on track with their online courses:
1. They have other responsibilities which can make it difficult to stay on top of their online course work.
2. They do not know how to get back on track after falling behind in their online courses.
1. They do not have experience and background knowledge of coding.
2. It's hard to estimate the difficulty level and when signing up for an online course.
For new users, they underestimate the time and efforts it takes to complete the course:
For existing users, they find it difficult to stay on track with their online courses:
1. They have other responsibilities which can make it difficult to stay on top of their online course work.
2. They do not know how to get back on track after falling behind in their online courses.
1. They do not have experience and background knowledge of coding.
2. It's hard to estimate the difficulty level and when signing up for an online course.
For existing users, they find it difficult to stay on track with their online courses:
For new users, they underestimate the time and efforts it takes to complete the course:
1. They have other responsibilities which can make it difficult to stay on top of their online course work.
2. They do not know how to get back on track after falling behind in their online courses.
1. They do not have experience and background knowledge of coding.
2. It's hard to estimate the difficulty level and when signing up for an online course.
For existing users, they find it difficult to stay on track with their online courses:
For new users, they underestimate the time and efforts it takes to complete the course:
1. They have other responsibilities which can make it difficult to stay on top of their online course work.
2. They do not know how to get back on track after falling behind in their online courses.
1. They do not have experience and background knowledge of coding.
2. It's hard to estimate the difficulty level and when signing up for an online course.
For existing users, they find it difficult to stay on track with their online courses:
For new users, they underestimate the time and efforts it takes to complete the course:
1. They have other responsibilities which can make it difficult to stay on top of their online course work.
2. They do not know how to get back on track after falling behind in their online courses.
Define Success
Define Success
Define Success
Define Success
I can estimate how long it will take me to complete each online course.
Underestimating the required time and efforts to complete the course.
User Goals
New users
Pain Point
User
I can find out which course is right for me based on my availability.
I will be informed l when I am behind schedule/ learning goals.
Can not stay on track with the courses they enrolled in.
Existing users
I can pause and resume my progress at any time.
I can estimate how long it will take me to complete each online course.
Underestimating the required time and efforts to complete the course.
User Goals
New users
Pain Point
User Group
Existing users
Can not stay on track with the courses they enrolled in.
I can find out which course is right for me based on my availability.
I can pause and resume my progress at any time.
I will be informed l when I am behind schedule/ learning goals.
User Story 1
User Story 1
User Story 1
User Story 1
"As a new user wanting to reach my professional goals by certain deadlines, I would like to know how much time I need to study to complete the courses."
"As a new user wanting to reach my professional goals by certain deadlines, I would like to know how much time I need to study to complete the courses."
"As a new user wanting to reach my professional goals by certain deadlines, I would like to know how much time I need to study to complete the courses."
"As a new user wanting to reach my professional goals by certain deadlines, I would like to know how much time I need to study to complete the courses."
Solution: Quiz Onboarding
Solution: Quiz Onboarding
Solution: Quiz Onboarding
Solution: Quiz Onboarding
During onboarding, users will be prompted to set their learning goals and learning schedule in order to receive personalized course recommendations. Each recommendation card lists the time needed on a weekly basis to finish the course, which helps users better estimate their completion time.
During onboarding, users will be prompted to set their learning goals and learning schedule in order to receive personalized course recommendations. Each recommendation card lists the time needed on a weekly basis to finish the course, which helps users better estimate their completion time.
During onboarding, users will be prompted to set their learning goals and learning schedule in order to receive personalized course recommendations. Each recommendation card lists the time needed on a weekly basis to finish the course, which helps users better estimate their completion time.
During onboarding, users will be prompted to set their learning goals and learning schedule in order to receive personalized course recommendations. Each recommendation card lists the time needed on a weekly basis to finish the course, which helps users better estimate their completion time.
User Story 2
User Story 2
User Story 2
User Story 2
"As an existing user and cannot keep up with the current learning track, I would like to find a program that fits my schedule better."
"As an existing user and cannot keep up with the current learning track, I would like to find a program that fits my schedule better."
"As an existing user and cannot keep up with the current learning track, I would like to find a program that fits my schedule better."
"As an existing user and cannot keep up with the current learning track, I would like to find a program that fits my schedule better."
Solution: Remind users that they can update quiz responses
Solution: Remind users that they can update quiz responses
Solution: Remind users that they can update quiz responses
Solution: Remind users that they can update quiz responses
Users receive an email reminder that tells them that they can make updates on their quiz responses in case the current learning track doesn't meet their needs.
Users receive an email reminder that tells them that they can make updates on their quiz responses in case the current learning track doesn't meet their needs.
Users receive an email reminder that tells them that they can make updates on their quiz responses in case the current learning track doesn't meet their needs.
Users receive an email reminder that tells them that they can make updates on their quiz responses in case the current learning track doesn't meet their needs.
Solution: Recommendation filter
Solution: Recommendation filter
Solution: Recommendation filter
Solution: Recommendation filter
Users can select their ideal completion date and weekly availability, or toggle between career tracks, skill tracks and courses without leaving the page.
Users can select their ideal completion date and weekly availability, or toggle between career tracks, skill tracks and courses without leaving the page.
Users can select their ideal completion date and weekly availability, or toggle between career tracks, skill tracks and courses without leaving the page.
Users can select their ideal completion date and weekly availability, or toggle between career tracks, skill tracks and courses without leaving the page.
#1. Switch Learning Track
#1. Switch Learning Track
#1. Switch Learning Track
#1. Switch Learning Track
#2. Change Estimated Completion Time
#2. Change Estimated Completion Time
#2. Change Estimated Completion Time
#2. Change Estimated Completion Time
How I got there?
How I got there?
How I got there?
How I got there?
Since DataCamp does not yet have an onboarding feature that provides course recommendations, I relied on usability testing as part of my design process to validate my solution. Within 6 weeks, I conducted both moderated and unmoderated usability testing with online coding course users.
As a result, I was able to gain a deeper understanding of how users interact with my prototypes, as well as their concerns about working on an online coding course. I identified a few areas that needed changes, and I went through 4 iterations before I settled on the final design.
Since DataCamp does not yet have an onboarding feature that provides course recommendations, I relied on usability testing as part of my design process to validate my solution. Within 6 weeks, I conducted both moderated and unmoderated usability testing with online coding course users.
As a result, I was able to gain a deeper understanding of how users interact with my prototypes, as well as their concerns about working on an online coding course. I identified a few areas that needed changes, and I went through 4 iterations before I settled on the final design.
Since DataCamp does not yet have an onboarding feature that provides course recommendations, I relied on usability testing as part of my design process to validate my solution. Within 6 weeks, I conducted both moderated and unmoderated usability testing with online coding course users.
As a result, I was able to gain a deeper understanding of how users interact with my prototypes, as well as their concerns about working on an online coding course. I identified a few areas that needed changes, and I went through 4 iterations before I settled on the final design.
Since DataCamp does not yet have an onboarding feature that provides course recommendations, I relied on usability testing as part of my design process to validate my solution. Within 6 weeks, I conducted both moderated and unmoderated usability testing with online coding course users.
As a result, I was able to gain a deeper understanding of how users interact with my prototypes, as well as their concerns about working on an online coding course. I identified a few areas that needed changes, and I went through 4 iterations before I settled on the final design.
Testing Type
Moderated
Unmorderated
Round
3
2
Participants
12
23
Tools
Figma; Maze;
Google Form
Figma;
Google Meet;
Google Form
Testing Type
Round
Participants
Tools
Moderated
3
12
Figma; Maze;
Google Form
Unmorderated
2
23
Figma; Google Meet;
Google Form
#1. User Flow
#1. User Flow
#1. User Flow
#1. User Flow
Reasons rejected:
Reasons rejected:
Reasons rejected:
Reasons rejected:
Making a study plan for exactly when to learn sounds very rigid, and users can’t predict what happens every week.
Starting date could be more general, prefer choosing a range of period.
Users would like to see prospect of completing the course, achievements, what topics, skills it covers...
Reasons Rejected:
Reasons Rejected:
Reasons Rejected:
Reasons Rejected:
Users don’t know anything about Data Science and I don’t understand what are the topics and subjects about.
Users want to see more details about each track in terms of the length/course duration. (e.g: how long did other people take to complete it?)
Decision: Getting recommendations by choosing completion time & course information
Decision: Getting recommendations by choosing completion time & course information
Decision: Getting recommendations by choosing completion time & course information
Decision: Getting recommendations by choosing completion time & course information
When it comes to setting a deadline, people have different preferences, many want a range of dates rather than a precise date. I decided to make deadlines optional but leave options for people to change in the final recommendation screen.
When it comes to setting a deadline, people have different preferences, many want a range of dates rather than a precise date. I decided to make deadlines optional but leave options for people to change in the final recommendation screen.
When it comes to setting a deadline, people have different preferences, many want a range of dates rather than a precise date. I decided to make deadlines optional but leave options for people to change in the final recommendation screen.
When it comes to setting a deadline, people have different preferences, many want a range of dates rather than a precise date. I decided to make deadlines optional but leave options for people to change in the final recommendation screen.
#2. Recommendation Screen
#2. Recommendation Screen
#2. Recommendation Screen
#2. Recommendation Screen
Reasons Rejected:
Reasons Rejected:
Reasons Rejected:
Reasons Rejected:
Users want to see more details about each track in terms of the length/course duration.
Not sure what’s the difference between ‘Career Track’; ‘Skill Track’ and ‘Course’ .
Reasons Rejected:
Reasons Rejected:
Reasons Rejected:
Reasons Rejected:
It’s a bit hard to understand what toggle is used for.
Not sure how difficult each track is, so it's hard to estimate how much time they need to complete.
Users are confused about what 'X hours ' means. Better indicate it's total length of course.
Decision: Making filters more intuitive and easy to understand
Decision: Making filters more intuitive and easy to understand
Decision: Making filters more intuitive and easy to understand
Decision: Making filters more intuitive and easy to understand
When it comes to setting a deadline, people have different preferences, many want a range of dates rather than a precise date. I decided to make deadlines optional but leave options for people to change in the final recommendation screen.
When it comes to setting a deadline, people have different preferences, many want a range of dates rather than a precise date. I decided to make deadlines optional but leave options for people to change in the final recommendation screen.
When it comes to setting a deadline, people have different preferences, many want a range of dates rather than a precise date. I decided to make deadlines optional but leave options for people to change in the final recommendation screen.
When it comes to setting a deadline, people have different preferences, many want a range of dates rather than a precise date. I decided to make deadlines optional but leave options for people to change in the final recommendation screen.
#3. Cards
#3. Cards
#3. Cards
#3. Cards
Reasons Rejected:
Reasons Rejected:
Reasons Rejected:
Reasons Rejected:
Providing only "course topics" or "average time to learn" will not help users make a decision, since they lack context about the course.
Visual hierarchy is confusing.
Decision: Presenting information about estimated completion time + learning track description
Decision: Presenting information about estimated completion time + learning track description
Decision: Presenting information about estimated completion time + learning track description
Decision: Presenting information about estimated completion time + learning track description
Final Testing Results
Final Testing Results
Final Testing Results
Final Testing Results
The new onboarding prototype was tested by 14 participants with a direct task success rate of 98%.
94% of participants answered this prototype is helpful in estimating the amount of time and effort required to complete a learning track.