Create research-findings.md

products/veteran-military-records/discharge-upgrade-wizard/research/2024-Review-Flow/research-findings.md

@@ -0,0 +1,283 @@
+# Research Findings: Discharge Upgrade Wizard Usability Testing 
+
+**Office of the CTO - Digital Experience (OCTO-DE), Discharge Upgrade Wizard, Sitewide Public Websites**
+
+Date: 11/14/2024
+
+Jordan Wood [[email protected]]
+
+[Research readout](When available)
+
+**Jump to:**
+
+- [Hypotheses and conclusions](#hypotheses-and-conclusions)
+- [Key findings](#key-findings)
+- [Recommendations](#recommendations)
+- [Further research needed](#further-research-needed)
+- [Who we talked to](#who-we-talked-to)
+
+
+## Research Goals
+The Discharge Upgrade Wizard is part of the unauthenticated experience and uses a wizard pattern to guide Veterans through an optimized series of questions to help them determine how to apply for a discharge upgrade. 
+
+There are many potential touchpoints between the Veteran and this application throughout the [Veteran journey](https://github.com/department-of-veterans-affairs/va.gov-team/blob/master/platform/design/va-product-journey-maps/Veteran%20Journey%20Map.pdf):
+
+- Getting out (Engaging VA to access benefits and services)
+- Starting up (Attending to health needs)
+- Taking care of myself (Recognizing and addressing mental health needs, Managing primary care and chronic health issues, Seeking support for an acute health event, Maintaining my health)
+- Retiring (Taking care of my health, Finding additional sources of income)
+- Aging (Managing my declining health, Planning for long term care)
+
+The purpose of this research is to find out whether we’ve met these goals:
+
+- Veterans can understand how to edit an answer that introduces branching logic and navigate back to the review page.
+- Veterans can understand why they may be asked additional questions when editing an answer to a particular question.
+- After editing a question, updates to the review page are clear and easy for Veterans to understand.
+- Veterans can navigate through the entire flow using the subtask pattern with ease.
+- Veterans that use assistive technology, like screen readers or screen magnifier technology, can navigate through user flows with ease.
+
+## Research Questions
+
+1. What feedback do Veterans have on editing questions with branching logic?
+2. What feedback do Veterans have on the entire edit flow?
+     - Alerts on question and results pages
+     - Back and Continue button functionality
+3. What feedback do Veterans have after the review page has been updated with new questions and answers?
+4. Do Veterans understand how their answers relate to their results?
+
+## Methodology 
+
+We conducted remote moderated usability testing over Zoom from October 22-November 7, 2024 to observe research participants using the Discharge Upgrade Wizard in a live coded environment (staging) with the updated sub task pattern. This allowed us to use the current branching logic and our experimental edit flow pattern.
+
+## Hypotheses and Conclusions
+
+1. The edit flow is simple enough for Veterans to understand and the actions in this flow are what they expect.
+   - TRUE: All participants were able to navigate the edit flow with no difficulty. 
+2. Veterans will understand that they may be asked to answer additional questions.
+   - LIKELY TRUE: Most participants didn't comment on additional questions being asked, but were able to edit questions with ease. Some participants noticed the alert on question pages that indicated more may be asked.
+3. Veterans will understand the updated review page and how it relates to the questions they answered.
+   - LIKELY TRUE: Most participants didn't comment on updated answers on the review screen and continued to the results page with no questions. Some participants noticed the alert on the review page that their answer was updated.
+4. Veterans will understand how their answers relate to their results.
+   - MOSTLY TRUE: Most participants understood the purpose of the results page and the information it provided. One participant expressed that the information on the page was very general and not specific to the discharge upgrade reason they gave.
+5. Veterans will find the content of the questions relevant to their understanding of a Discharge Upgrade and how it applies to them.
+   - MOSTLY TRUE: Most participants didn't comment on the questions or felt that they were clear. Some participants found a couple of the questions confusing or lacking information.
+
+---TBD---
+
+## Key Findings
+
+_The 5-10 top findings from your study should be listed here. Write your findings so that if someone reads only these bullets they can leave feeling they got useful information and the study was worthwhile. Examples might be "Most participants used the Search field to find the form, and searched for the term 'veteran health'" or "Most participants struggled with the secondary caregiver section on the form"._
+
+_[See an example](https://github.com/department-of-veterans-affairs/va.gov-team/blob/master/products/find-a-va-form/initiatives/2021-post-mvp-releases/research/research-findings.md#key-findings)_
+
+1. Finding one
+
+2. Finding two
+
+3. Finding three
+
+4. Finding four
+
+5. Finding five
+
+6. Finding six
+
+7. Finding seven
+
+
+## Details of Findings 
+
+_For each finding, list details with supporting quotes and images when possible. Please **add relevant keywords/labels to your findings** selected from the [research repository label list](https://github.com/department-of-veterans-affairs/va.gov-research-repository/labels?page=1&sort=name-asc). Adding keywords/labels to your findings will help others find research relevant to their work._
+
+
+_To add images: ![text](link - add image to github folder and link here with .png)_
+
+
+**Finding 1**
+
+Labels: label 1, label 2 
+
+_List all labels that apply to this finding from the [research repository label list](https://github.com/department-of-veterans-affairs/va.gov-research-repository/labels?page=1&sort=name-asc)._
+
+Brief description
+
+> _Supporting data: Quote here_
+
+> _Supporting data: Quote here_
+
+
+**Finding 2**
+
+Labels: label 1, label 2 
+
+_List all labels that apply to this finding from the [research repository label list](https://github.com/department-of-veterans-affairs/va.gov-research-repository/labels?page=1&sort=name-asc)._
+
+Brief description
+
+> _Supporting data: Quote here_
+
+> _Supporting data: Quote here_
+
+
+**Finding 3**
+
+Labels: label 1, label 2 
+
+_List all labels that apply to this finding from the [research repository label list](https://github.com/department-of-veterans-affairs/va.gov-research-repository/labels?page=1&sort=name-asc)._
+
+Brief description
+
+> _Supporting data: Quote here_
+
+> _Supporting data: Quote here_
+
+
+## Additional Insights
+
+_Any additional insights that aren't "key findings." These can be powerful comments from users that don’t represent a pattern in this study, but may be part of one outside this study._
+
+
+## Recommendations
+
+_Put together initial recommendations here based on your findings along with supporting evidence. Review with your team, then edit as needed._
+
+* Recommendation 1
+    * _Supporting evidence_
+* Recommendation 2
+    * _Supporting evidence_
+
+
+## Next Steps
+
+_Next steps here. Include owners if appropriate._
+
+
+## Further research needed
+
+_If there are demographics that were not included in this study or you discovered that more research should be done, make note of that here._
+
+
+## Appendix
+
+[Research plan](link here)
+
+[Conversation guide](link here)
+
+[Interview transcripts](link here)
+
+
+## Tools used for Synthesis
+
+e.g. mural boards, etc.  
+
+
+## Pages and applications used
+
+Link to prototypes or pages that were tested
+
+
+## Other supporting documents created
+
+e.g. user flows, personas, etc.
+
+
+## Secondary research
+
+Include any secondary research you may have. 
+
+E.g. web analytics, ForeSee data, SME interviews, competitive analysis, or other relevant research studies.
+
+
+## Who we talked to 
+_Complete the demographic info below using information from the Perigean recruitment survey. For those items where you didn't have participants, please mark with "0". You can use "unknown" if you aren't sure if your participants had a characteristic._ 
+_[See an example](https://github.com/department-of-veterans-affairs/va.gov-team/blob/master/products/find-a-va-form/initiatives/2021-post-mvp-releases/research/research-findings.md#who-we-talked-to)_
+
+**Recruitment criteria**
+
+_If you had specific criteria that you recruited for, use this space to explain what those were along with other information you feel would be important to understanding your participants._
+
+We talked to **x participants.**
+
+Audience segment:
+* Veterans: x 
+* Caregivers: x 
+* Family members of a Veteran: x  
+
+
+Gender:
+* Male: x 
+* Female: x 
+
+
+LGBTQ+:
+* Transgender: x 
+* Nonbinary, gender fluid, gender queer, Two-Spirit (Indigenous only), or another gender beyond man or woman: x
+* Gay, lesbian, or bisexual: x
+
+
+Devices used during study: 
+* Desktop: x 
+* Tablet: x 
+* Smart phone: x 
+* Assistive Technology: x
+
+
+Age:
+* 25-34: x
+* 35-44: x
+* 45-54: x
+* 55-64: x
+* 65+: x
+* Unknown: x
+
+
+Education:
+* High school degree or equivalent: x
+* Some college (no degree): x
+* Associate's degree, trade certificate or vocational training: x
+* Bachelor's degree: x
+* Master's degree: x
+* Doctorate degree: x
+* Unknown: x
+
+
+Geographic location:
+* Urban: x
+* Rural: x
+* Unknown: x
+
+
+Race:
+* White: x
+* Black: x
+* Hispanic: x
+* Biracial: x
+* Asian: x
+* Native: x
+
+
+Disability and Assistive Technology (AT):
+* Cognitive: x
+* AT beginner: x
+* AT advanced user: x
+* Desktop screen reader: x
+* Mobile screen reader: x
+* Magnification/Zoom: x
+* [Speech Input Technology](https://www.w3.org/WAI/perspective-videos/voice/) like Siri/Dragon Naturally Speaking: x
+* Hearing aids: x
+* Sighted keyboard: x
+* Captions: x
+
+
+## Underserved groups we haven’t talked to 
+
+_[Complete the VA recruitment checker for marginalized Veteran groups](https://docs.google.com/spreadsheets/d/1pq7TSHZonfpzAQBJj6B2geGHlNUwZEs4DzEvxcRgu0o/edit#gid=1221033726)_
+
+This research does not include the perspectives of the following marginalized Veteran groups:
+_List all groups in red from the spreadsheet_
+* Group 1
+* Group 2
+* Group 3
+
+_[insert screenshot of completed recruitment checker]_
+![VA-recruitment-checker](link - add image to github folder and link here with .png)