Loading

REIMAGINING POWER BI GET DATA

The first step to using Power BI in any meaningful way is to add data. However, we knew that this can be a painful process for many users, particularly new or less-technical users. We have an incredibly powerful data prep tool and all this power can be overwhelming and inaccessible to users.

The various entry points and methods for importing data into Power BI can make it challenging for new users to onboard and navigate this tool.

What is Power BI?

Role

Lead Product Desinger

Product

Microsoft Power BI

Team

1 Product Managers

3 Engineers

1 Researcher

1 Content Designer

Duration

6 Months

The Big Problem

Huge Drop Off

Users cannot always find the data source they’re looking for because of bad categorization or bad naming or not sure where to go to select a right type.

In this chart you can see out of 1.07 Million Power BI launches, about 49% of our users that launched Power BI, drop off because it's too complicated and cumbersome to even try bring their data into our app. This is very bad! We need to fix this.

Get Data (0.52M)

48.6%

Load Data Completed (0.41M)

38.32%

Create Visuals (0.33M)

30.84%

Add Field (0.29M)

27.1%

Succcessful Save (0.20M)

18.69%

Succcessful Publish (0.06M)

5.61%
The Confusion

Bringing Data To Power BI Is Complex

When users open Power BI for first time they land on a blank canvas with couple of options. The first step is to bring some data in Power BI app. Here is where 49% of our users drop off.

The problem is that these options are super unclear for our users specifically new ones, it's not designed to make the job done and doesn't provide any info about what would be the next step and which option is the right one to pick.

Selecting any type of data in previous screen opens this modal with many options to choose from making things even more complicated and annoying. Even if our users know what they need to, they have to go through each step that opens in a new modal, losing the previous modal's context without giving them any hint about what's next step or what's needed from them.

Once users found the data that is suitable to start working with, they will see another modal that asks them to choose which data or table they need to import. Also they need to be sure that their data is clean and properly formatted to be used in Power BI.

Problem is our app doesn't tell any of those to our users, they might end up importing some data that is not clean and end up seeing random errors.

Even if users knew that their data is not clean and clicked on Transform data in previous screen, they end up in this UI which is super complicated, overkill and feels so disconnected compared to previous screens.

Lorem ipsum dolor sit amet consectetur adipisicing elit. consectetur numquam magnam, sed perspiciatis mollitia nesciunt amet, consequuntur error culpa nobis dolore asperiores eum non quasi duis cursus, mi quis viverra ornare, eros dolor interdum nulla, commodo diam libero.

  • 1x Lorem ipsum dolor sit
  • Eiusmod incididunt ut labore et
What Did We Want To Improve?

The initial steps of creating a Power BI report involve selecting and preparing the right data, which are fundamental to the report's success. However, if users struggle with these steps or bring the wrong data, it can lead to frustration and confusion, potentially leading them to abandon the platform.

To address this, we aimed to simplify these fundamental processes and provide clear guidance to users, boosting their confidence in creating successful reports.

Choosing the right data type

Cleaning and preparing data

The Planning

Project Timeline

Early on in the project, I leveraged my past experiences and learnings to create a comprehensive timeline that was divided into sprints, each with specific deliverables and collaborative tasks for the design process plus the status of each item.

This approach proved highly effective in keeping our team on track, informed, and focused on achieving our objectives.

Project Timeline
Project Timeline
The History

How Can We Track Design Changes?

One of the other major design decisions that I implemented during this project was documenting the process in Figma file. Each design has a side panel with sections for questions that have been asked during review process, comments that team members added, ideas that might solve some review feedback or from team and changes that happened since previous design version. This way for example even if I leave the project, new designer will understand what happened so far and any reason behind all these decisions.

Design Iteration History
Design Iteration History
What Were Our Design Principles?

We defined these three principles through our design process to address the current issues and help users get to their goals faster and easier.

Simplify and Streamline the get data experience

Help users to get insights faster and easier

Consistent experience across different surfaces

The Persona

Who Should We Design For?

The business end user have simpler needs and correspondingly needs a simpler experience. They will most often have a single source, and even just a single table, and will at most only need the most simple of data cleaning steps. They just have some data and want to visualize it.

They will eventually graduate to full query and modeling capabilities but need a simple first run experience to start their Power BI journey.

The Persona
What Were Our Design Challenges?

Along the way we faced many challenges and needed to coordinate with many teams to address these issues as well as our passionate users that as many of you know changing something after couple of years is going to be hard for them. There were more than 150 data connectors that each had unique properties and settings and we needed to consider all possible scenarios in our new design.

More than 150 data connectors

Many dependencies on other teams

Lots of passionate and advanced users

The Journey Map

Where Do Our Users Have Struggles?

After numerous brainstorm and collaboration sessions with our team and many iterations, I created our current user journey map to highlight the pain points, needs and possible solutions for each step in the process of bringing data and preparing it for report creation.

This helped our team to understand where we should put our main focus and what are the highest priority pain points that we need to tackle first.

Journey Map
Journey Map
What Were Our Business Goals?

After reviewing journey maps, previous benchmark studies and user surveys, we know lots of new Power BI users have difficulty start creating their reports. Our goal is reduce that steep learning curve with this refreshed experience for getting data ready.

Closing gap with competitors

Improve performance

Higher NPS due to better usability

Higher new user retention

The Collaborations

Do We Know Everything?

I gathered all stakeholders, researchers and other team members and asked them to start add anything that you think would solve our issues. From previous user studies that we ran, users feedback on our forums, any direct customer interaction and so on.

Gathered all information in FigJam and then started doing affinity mapping with all those ideas.

Brainstorming And Collaborating With Team
Brainstorming And Collaborating With Team
Brainstorming And Collaborating With Team

We found these major pain points and issues after rounds of brainstorming together:

Not clear where to start

Terminology is confusing

So many data connectors and data types

Difficulty selecting and previewing data

Errors were not clear

Data cleaning and preparing is complex

Let's Design

Some Of The Early Concepts And Mocks

I started designing some lo-fi concepts to explore possible solutions based on what we learned so far and tried to achieve these goals in my designs:

Reducing the number of steps

I Wanted to simplify all current multiple entry points and modals into one central location for users to bring and prepare their data. No more guessing where to go and start.

Making it easy and familiar

Decided to go with drag/drop concept since it’s very familiar and feels natural with Windows and web users.

No need to think about data types and connectors

My idea was to reduce cognitive load from users by letting them bring anything here and let us (Power BI) detect correct next steps based on their file and data type.

Early Concept Showing Drag/Drop and Reduced Steps To Bring Data
Early Concept Showing Drag/Drop and Reduced Steps To Bring Data
Making data prep easy

My idea here was to automatically detect issues of their data and clean it up for them or give them enough guidance to solve the issue.

Contextual help

There will be contextual help in every page that will help users if they get stuck at any step.

Early Concept Showing Contextual Help And Guide
Early Concept Showing Contextual Help And Guide

We tested these early concepts with 10 users to understand if we are on a right path or not before jumping into hi-fi designs. Here are some major takeaways from our study:

Users understood that they need to bring data to start when saw this UI.

Users noticed help button and mentioned couple of times.

Users immediately understood the drag and drop functionality and mentioned it makes things easier.

Some Got little confused about “Connect to data source” button.

They asked about what type of data can be dragged an dropped?

Some users mentioned they'll get annoyed after a while about the message on top

Lots Of Iterations

We Went Through Many Rounds Of Iterations

After doing initial research, I started going deeper into designs and details of each step for this scenario. You can read more about each part of the scenario and some the reasons for each design:

Empty State

This is the first stage of scenario, users land on this page when they open Power BI.

  • All panes and ribbon are collapsed to reduce distraction and focus on canvas which main goal is
  • Sidebar that shows user's organizational data if they are already signed in to help them start by selecting familiar data from their organization
  • A header welcome message to let users know what they can achieve in this page

One of the other issues that we found in early concepts was using whole canvas as an entry point for get data, in Power BI users can bring more data after they created reports with initial data so in this case we can't use the canvas for get data experience since it's been using for reports and visuals.

To mitigate this issue I tried the modal experience approach in this concept:

Using Modal To Separate Get Data Experience From Canvas
Using Modal To Separate Get Data Experience From Canvas
Selecting Data Source

Next step is to use a proper data source

  • Drop down has list of all connections categorized in groups, there is also search box that user can search for specific connection
  • We also could show flat list of all possible connectors in a modal box
  • Tried to merge all different connector modals into a single cohesive experience

Since I knew that selecting between 150 different connectors for users is going to be a challenging task, I brought up this idea of letting user drag/drop their data into our application and we on the background choose the right steps depending on the file and data and guide users through next steps.

There were many advantages doing this way:

  • Users can drop multiple files at once instead of waiting for each one to be finished
  • Not only files, but they can also copy and paste a web URL or even a connection string here
  • They are also able to copy/paste a dataset from any other apps like Excel here

Users Can Drag/Drop Files Without Selecting Any Data Connector
Users Can Drag/Drop Files Without Selecting Any Data Connector

After they dropped their data then we can show the proper next steps and if there is an any issue we can guide them.

Showing The loading Process Of Each File/Data
Showing The loading Process Of Each File/Data

After successfully loaded their data, users can preview the data tables in this view.

Previewing Data
Previewing Data
Data Prepping And Cleaning

In these designs my goal was to make data prepping and cleaning easy specifically for new users. We conducted research and put some of the major cleaning tasks based on research results in this screen instead of floading it with complex actions.

  • In this concept Power BI tries to automatically clean and prepare data for user. We show this by green message on top letting users know that we made some improvements on their data.
  • Most used actions here based on research were: Remove column headers, Edit delimeters, Changing data types and Sort/Filter
  • We also added an entry point to advanced PQ editor for users that prefer that environment

Data Prepping And Cleaning
Data Prepping And Cleaning
Contextual Guidance

As I mentioned before, one of major pain points from users perspective was lack of help and guidance during this process. In these concepts I tried to implement a contextual help in each step. Basically if users get stuck, they can easily click the help button and a step by step tour will guide them on the screen and help them finish the process.

Contextual Help
Contextual Help
Almost There

Latest Design Changes And Updates

There were so many more iteration along the way by collaborating with internal teams and external users, as you can see in this zoomed out image of how we progressed till reached to this point.

Iterations, Iterations, Iterations
Iterations, Iterations, Iterations

Here are most recent designs:

Project Summary

What Did I Do?

  • Lead design effort by working with various members from different teams
  • Provided clarity on timeline, goals and priority list
  • Collaborated with research and content team to find right persons and ask right questions
  • Addressed most of main pain points based on feedback
  • Worked with engineering team to address technical issues and design possible alternatives
  • Reviewed with our customer relation team PMs to address their concerns

What Is Next?

  • Go deeper into our data connectors and find anomalies that might not work with current proposal
  • Work with research and content team to plan the next round of research
  • Collaborate with Fluent/Visualization teams for alignment and create final visualizations
  • Stress test new design in other surfaces, like web and other applications that user Power BI
  • Keep track of upcoming feedback from users
Project Summary
The End