FLIGHT TEST MANAGEMENT SYSTEM

Gulfstream’s Flight Test Management System (FTMS) is a responsive web app for Flight Test Engineers (FTEs) to manage the many requirements to certify new aircraft. The system had been attempted twice before, the most recent having been abandoned by the users in favor of spreadsheets. These spreadsheets caused rampant inconsistencies across groups and did not allow for tracking or reporting at the program level. We estimate that the new FTMS system will save approximately 4,260 man-hours per model certified after its deployment. I was the lead designer on this project, working alongside design partners at times.

 

Discovery

Our team conducted 17 interviews including both project stakeholders and users. We focused on understanding why the original application was not being used and the processes different groups were following as workarounds.

It turned out that the old application had poor performance, often taking 2, 10, even 30 seconds to load. This was the root cause for frustration and abandonment. It was also missing some essential functionality that would have kept the various working groups more aligned on verbiage, process, and formatting of documents. 

We needed to better understand the FTEs’ process from start to finish so that we would have a better idea of where the new FTMS would fit into their day. We decided to bring in a small subset of users to participate in a user journey mapping session. The final user journey was so complex that it contained 5 phases and over 50 steps total. 

The original intention of the project was to reuse as much of the original FTMS as possible to speed development time. So, as an additional discovery activity, we did a usability assessment of the existing system. We discovered many hidden actions such as right-clicks, unnecessary modals, vague iconography, a lack of visual hierarchy, and validated the users’ complaints of poor performance. We determined that the front end should not be utilized in any capacity, but the developers would attempt to reuse as much of the back end as they could, while improving the performance along the way.

Initial sketching for FTMS

Round 1 of wireframes

Initial Design & Testing

We began with a few sketching sessions as a team that were then turned into wireframes. Other teams within Business Technology had started utilizing Angular as a standard web platform, so our team decided to follow suit for speed and maintainability. When we moved into a more high-resolution design, we tried to design as close to default Material as possible. FTMS was one of the UX team’s first web projects, so we were able to build out a reusable web design system along with the project deliverables, also helping the developers by reusing existing components.

We went through 2 rounds of usability testing on clickable prototypes. We learned a lot more about the poor choices in verbiage on the original system (we had used a lot of the same wording) and some improvements on our new choices (“bulk-edit” rather than “multi-edit”). However, it seemed like the testing created more questions than it answered. We realized that we would need ongoing support from the users due to the complexity of the application and processes.

 

Working Sessions

Our need for ongoing decision-making and process alignment from our business partners initiated what we called “working sessions.” About once per month, we would take a look at upcoming user stories and determine what questions we had about them. Most of the time, we were not sure which direction to take for a solution because one group always seemed to do it differently than the others. 

We gathered members of the Scrum team in the same room as representatives from all of the different Flight Test groups and would hash out the problems, coming to an agreeable solution in the room together. These sessions ended up being an invaluable resource throughout the project for obtaining multiple perspectives as well as gaining buy-in and advocacy for decisions made.

Deployment & Outcome

The entire project took almost a year to complete the agreed-upon Minimum Viable Product, with enhancements scheduled soon after the initial launch. We were able to deploy 2 additional interim releases to get the product into users’ hands and gather feedback. Much of this feedback was either incorporated by the final launch or will be in the coming enhancements.

Having a centralized repository for certification requirements and standards saves countless hours across many roles and opens up the opportunity for more robust reporting and data analysis in the future. As one of our users put it:

“FTMS has the speed and flexibility to support the planning, execution and analysis of tests across a diverse set of flight test disciplines, while maintaining enough structure so that any FTE in any group can quickly and efficiently get up to speed.”

Final Home screen

Final Home screen

 

Final Details screen