Google Content Review Tool

Ever wonder what happens when you flag a photo as pornographic? I led a first engagement with a team at Google that uses an internal content review tool to manage such photos. When content on a Google product gets flagged as violating certain policies, a real person manually reviews the content. Together with another senior designer, I designed two new features that will take less time, make the process easier on the reviewers, and ensure higher quality reviews.

Skills

Lead interaction design, visual design, prototyping, test planning, test moderating, analysis, client relations, project management

Impact

The new features will improve content reviewers' emotionally draining workday by:

  1. Increasing their efficiency through doing reviews in bulk (more reviews, less time)

  2. Raising the quality of the reviews by allowing them to group reviews and assign more specific verdicts to the content

  3. Applying Material Design and using larger images for a more aesthetically pleasing experience

Process

This project spanned three months. We spent several weeks shadowing reviewers and analysts in different locations in order to understand their workflows and pain points. We brainstormed in person and separately. Our designs went from sketches to low-fidelity wireframes; at that point, we switched the pieces we were working on to give new perspective to our new pieces for the medium-fidelity wireframes.

Iteration

I planned and moderated two weeks of intense usability tests of our clickable prototypes on a dozen reviewers and analysts. In between the two rounds, we quickly updated the prototypes with improvements. I analyzed all of the usability sessions and we created a comprehensive presentation deck of all of our findings. Our final deliverables included clickable prototypes with the usability findings incorporated.

Discoveries

The client originally wanted a quantitative time-based study to validate findings, but I convinced him that a formative task-based usability test would be able to both validate findings and identify important issues with the design. In the process, I learned the value of baking in revision time between distinct one-week rounds of testing to iterate on the prototype.

What's Next

The design was very well received internally both by the client and the end users at Google. Engineers began building out the features. Due to the NDA, the designs cannot be publicly shown.


Next Project: