Aaron ButlerCreative Design
Product · UX DesignMicrosoft Federal

Wargaming Engine

Next-generation warfighting simulation based on the first-ever digitization of the Joint Operation Planning Toolkit for USINDOPACOM. Utilizing the Unreal Engine and the 3D geospatial platform, Cesium.

RoleSr. Creative Technologist
Year2022 – 2023
StatusNDA — limited detail
Skills
PRODUCTUI/UXUNREAL
01
Overview

Alpha to Federal

When Studio Alpha was shut down, the simulation project it had been supporting toward the end, Stormbreaker, transferred over to Microsoft Federal. Myself, the rest of the creative team, and some of the engineers moved with it. My responsibilities stayed largely the same: UI/UX and Unreal Engine design work for the simulation half of a project being built for military planners.

NDA notice

Due to the project being under a limited NDA, every artifact on this page has been recreated for this case study to align with the publicly available JP 5-0 documentation that Planners work from. The feature focus is also narrowed down to some interaction designs and a variation of the SmartCard I brought over from Studio Alpha.
02
Challenge

Digitizing traditional methods

Military planners have worked with pen and paper and disconnected third-party tools for decades. The process is well established: plans are built in PowerPoint, presented in PowerPoint, then printed and stored in binders on a shelf. That makes reviewing, cataloging, and referencing past plans harder than it needs to be, and wargaming one could take upwards of 16 months to organize and run. Stormbreaker's goal was to digitize the JP 5-0 process and drastically streamline the whole experience.
Joint Publication 5-0, Joint Planning — the public doctrine the whole planning process is built around.
Joint Publication 5-0, Joint Planning — the public doctrine the whole planning process is built around.
The same process run at table scale, with physical markers standing in for units. U.S. Marine Corps photo by Cpl. Marc Imprevert.
The same process run at table scale, with physical markers standing in for units. U.S. Marine Corps photo by Cpl. Marc Imprevert.
03
Process

Smart Card Design

These are mockups of proposed solutions, validated either internally during exploration or directly with customers.
The SmartCard came over from Studio Alpha: a customizable, data-driven card carrying the information relevant to the plan being built, drawn from what the planner had already set up in earlier steps.
A planner could drop one SmartCard onto the grid and build a hierarchy of objects from it. The card offers the correct object types depending on which side tab is used. Each object card can be customized further if a planner needs more or less data.

SmartCard design

A flow showing the intended interaction of using the tabs to create a new SmartCard, as well as the placement and grid-snapping aspect.
A flow showing the intended interaction of using the tabs to create a new SmartCard, as well as the placement and grid-snapping aspect.
A high-fidelity mockup showcasing the use of my SmartCards to create a hierarchy layout. Team creation occurs on the left nav. Right nav is the Entity panel listing all currently placed objects.
A high-fidelity mockup showcasing the use of my SmartCards to create a hierarchy layout. Team creation occurs on the left nav. Right nav is the Entity panel listing all currently placed objects.

Operational area creation ideation

Custom areas were something planners kept raising, so the work started on a napkin while a customer talked me through how they do it now and what they wished they could do instead.
During my first TEM (Technical Exchange Meeting) I sketched these on my iPad while planners walked me through how they create custom areas today. As they described the current process, I drew how it might look and work once digitized. They loved it, and after some more feedback we moved forward with the design.
During my first TEM (Technical Exchange Meeting) I sketched these on my iPad while planners walked me through how they create custom areas today. As they described the current process, I drew how it might look and work once digitized. They loved it, and after some more feedback we moved forward with the design.
A high-fidelity mockup, recreated for this portfolio, showing a more refined version of the napkin sketch. Planners had the freedom to create as many areas of operation as needed and could create custom shapes by dragging points around the map or by entering precise coordinates for each point if they had that information already. Another feature planners appreciated was being able to attach reference images to an area to supply additional information.
A high-fidelity mockup, recreated for this portfolio, showing a more refined version of the napkin sketch. Planners had the freedom to create as many areas of operation as needed and could create custom shapes by dragging points around the map or by entering precise coordinates for each point if they had that information already. Another feature planners appreciated was being able to attach reference images to an area to supply additional information.

SmartCard creation prototype

This interactive Figma prototype creates two SmartCards. The first is created vertically, below the existing card; the second horizontally, to its right. The point of a prototype like this was to demo the interaction to potential users and get their feedback. This version carries a text hint to give direction from the start.
Best viewed full screen. It doesn't work on mobile at the moment, since the interaction relies on hover.
Create a new SmartCard from an existing SmartCard

Drag & place object groups

Placing objects is the main action when setting up a scenario, and these objects usually come in groups. The below motion study shows a group of objects being placed at once from the left nav. After which one single object can be selected and moved independently.
Motion test created entirely in Figma for this portfolio showcase showing interactions for dragging and placing a group of objects from the left nav onto the play space and then moving an individual object after.

Embedding object interaction mockup

Embedding objects into other objects was something planners would do countless times throughout the creation and testing of a plan. On a map holding hundreds or thousands of objects, selecting one or more and embedding them into a location had to be painless and intuitive. Locations holding embedded objects show the count in a signifier at the corner, and hovering over a location pops up a window listing everything inside, for quick access.
Selecting an object and embedding it into a location, with the embedded amount visible on the location.
Selecting an object and embedding it into a location, with the embedded amount visible on the location.
04
Outcome

How it ended

SMX pulled the project from Microsoft Federal and brought it entirely in house. That ended my Allovus contract at Microsoft, along with the rest of the team's. A month or so later, the previous director of Studio Alpha, who had since joined SMX as project director to continue Stormbreaker, hired me and the two other designers to carry on the work.