diff --git a/VAMobile/documentation/docs/UX/Foundations/Research/montly-reviews.md b/VAMobile/documentation/docs/UX/Foundations/Research/montly-reviews.md index 046264a49f9..89a64bbdbf9 100644 --- a/VAMobile/documentation/docs/UX/Foundations/Research/montly-reviews.md +++ b/VAMobile/documentation/docs/UX/Foundations/Research/montly-reviews.md @@ -5,7 +5,17 @@ sidebar_position: 2 # Monthly App Store Review Process -## Step 1: Download the reviews from the [feedback hub](https://feedback-hub-e659c24714b9.herokuapp.com/) +## Overview +Each month, the VA Mobile app team analyzes all of the app review comments that were left for the app in the [Google Play Store](https://play.google.com/store/apps/details?id=gov.va.mobileapp&hl=en_US) and [Apple's App Store](https://apps.apple.com/us/app/va-health-and-benefits/id1559609596) during the previous month. + +We download the reviews from the [Feedback Hub](https://feedback-hub-e659c24714b9.herokuapp.com/app_store/sentiment). The Feedback Hub is a site run by the Mobile team that scrapes information from the app stores as well as the **/r/VeteransBenefits** and **/r/Veterans** subreddits and displays it in a way that is more usable. We label the comments with [tags](https://github.com/department-of-veterans-affairs/va.gov-team/blob/master/products/va-mobile-app/reporting/App-Stores-Reviews/Tag%20Definitions) relevant to their content, such as “accessibility,” “ease of use,” “homepage,” “login,” “performance,” or “requests,” then analyze trending sentiments by looking at which tags that used most frequently or more than usual and whether they are used with positive, neutral, negative ratings. Finally, we remove any PII and upload all of the information to Github. + +You can find the full list of comments and corresponding data (OS, user’s app version, date and time of review, rating number, and review title) as well as an overview with the trending sentiment information for each month in the [VA Mobile app team’s App Stores Reviews folder in Github](https://github.com/department-of-veterans-affairs/va.gov-team/tree/master/products/va-mobile-app/reporting/App-Stores-Reviews). +You can review a step-by-step guide to the app store review process below. + + +## How-to +### Step 1: Download the reviews from the [feedback hub](https://feedback-hub-e659c24714b9.herokuapp.com/) 1. Select App Store or Play Store at the top. 2. Ensure “All” ratings are selected from the dropdown. @@ -13,11 +23,11 @@ sidebar_position: 2 4. Tap “search”. 5. Click the “Download as .csv” button to export. -## Step 2: Import the data to Google Sheets +### Step 2: Import the data to Google Sheets [In the spreadsheet](https://docs.google.com/spreadsheets/d/1Lj65hvWUkdTpmpvsObOOD2hjG8CHAiQ7z0mCeowabh0/edit?usp=sharing), create two new sheets for the month (one for overview and one for reviews) and import the reviews for the corresponding date into that month’s "reviews" sheet. - _Note: You can duplicate a previous month and remove the data._ -## Step 3: Clean up the import +### Step 3: Clean up the import 1. Verify that data pulled in correctly 2. Add wrapping to the grids @@ -26,7 +36,7 @@ sidebar_position: 2 4. Define the range for the tags column (i.e. TagMarch24). - This allows the spreadsheet to do the math and pull the totals into the overview sheet. -## Step 4: Analyze the data +### Step 4: Analyze the data 1. Update the overview with the correct dates and review totals for the month. 2. Read each review and add a corresponding tag. @@ -39,12 +49,12 @@ sidebar_position: 2 5. Pull out a few of the reviews that you think are important and add them to the review sample column (try to limit the samples to 2-4). - If the trending sentiment is “mixed”, try to pull both positive and negative samples into the overview. -## Step 5: Find or create a new folder on Github +### Step 5: Find or create a new folder on Github In the [App Store Reviews folder on Github](https://github.com/department-of-veterans-affairs/va.gov-team/tree/master/products/va-mobile-app/reporting/App-Stores-Reviews), find or create the folder for the corresponding quarter. If you are adding app store reviews for a month in an existing quarter’s folder, select the month that you are updating and edit the file. -### How to create a folder for a new quarter +#### How to create a folder for a new quarter 1. Create the new folder (add a file in Github and `/` at the end to create a new folder). - Follow the naming convention of the previous quarters (four digit year followed by a hyphen and then the quarter). @@ -52,7 +62,7 @@ If you are adding app store reviews for a month in an existing quarter’s folde - Follow the naming convention of the other files (i.e. 2024-04-Summary-VA-Mobile-App-Store-Reviews.md) 3. Add a readme.md file to the folder (content can be copied from the readme.md file in another folder, but be sure to update the dates in the file to the new quarter). -## Step 6: Add the overview to Github +### Step 6: Add the overview to Github 1. Back in your app store review sheet, select only your table in the overview and then [convert the overview table to markdown](https://tabletomarkdown.com/convert-spreadsheet-to-markdown/). 2. Paste the converted markdown table into your Github file. @@ -62,7 +72,7 @@ If you are adding app store reviews for a month in an existing quarter’s folde - Add bold styling to the date. 5. Preview your file and if everything looks good, commit the changes. -## Step 7: Add the full list of reviews to Github +### Step 7: Add the full list of reviews to Github __Note:__ To protect PII (Personal Identifiable Information), when you are pulling in the full list of reviews into Github, delete the author column prior to copying the table. You can restore it after by undoing the action (edit > undo or ⌘+Z). Replace any personally identifiable information in any of the reviews with [redacted]. @@ -72,7 +82,7 @@ Replace any personally identifiable information in any of the reviews with [reda 3. Preview your file and if everything looks good, commit the changes. 4. If you have not already done so, restore the author column in the Google sheet. -## Step 8: Notify the team on Slack +### Step 8: Notify the team on Slack After the app store reviews have been added to Github, share the findings in the following Slack channel: - [#va-mobile-app](https://dsva.slack.com/archives/C018V2JCWRJ) (in DSVA) - Provide a short description and link back to that month's overview page on Github. \ No newline at end of file