Developing products during this time of crisis was uniquely challenging for a couple of reasons:
- Every problem we came across was urgent in its own sense
- Visibility and scrutiny on work delivered was higher than usual, which also meant that the appetite for risks and tolerance for hiccups was very low
- We didn’t have the luxury of time on our side and results needed to be delivered “yesterday”
- We were working 100% remote for the first time while coming together as new teams
These constraints led us to ask ourselves:
How do we accelerate innovation and cultivate a culture of rapid prototyping and iteration in the government? More importantly, how do we build useful digital services quickly without compromising the quality and value to the public in a time of crisis?
Despite intense timelines, we ended up launching new digital products and services from ideation to production in less than two weeks. Looking back, lean and agile product development proved to be more essential than ever in these constraints. Specifically, Kaeli and I arrived at the following lessons that product managers and technologists can apply to effectively build products and services and bring them to production quickly. We go into details with anecdotes from our experiences below but here’s the short story:
- Start by digging into the problem space
- Build a strong coalition of support and partnerships — especially with those on the front lines
- Build your “2-pizza” team to stay nimble
- Don’t let perfect be the enemy of the good
1. Start by digging into the problem space
By spending time on user research, including deep dives with VA call centers and multiple rounds of interviews with Veterans, our team at VA Office of the Chief Technology Officer (VA CTO) learned that the majority of calls to VA were about a handful of the same, VA-specific frequently asked questions related to COVID-19 (e.g., “how can I switch my scheduled VA healthcare appointments to telehealth appointments?”). We developed the VA coronavirus chatbot as an automated way to deliver this information to Veterans without requiring a phone call. During peak usage, the VA coronavirus chatbot handled twice as many COVID-19 related queries as the VA’s national call center.
2. Build a strong coalition of support and partnerships—especially with those on the front lines
Likhitha: Given the short amount of time to address the identified challenge, we couldn’t wait for all of our insights to be learned solely via user research. We had to diversify our sources of insight by getting connected to entities directly plugged in with frontline workers. By sharing our understanding of the problem space, we were able to seek people on the front lines who can partner with us and support us. We got creative and tapped into second-degree learnings by identifying non-profits and academic entities who work regularly on problems faced by healthcare providers and patients. Overall, our coalition of support and partnerships included stakeholders for buy-in, leaders for approval, and partners for collaboration. What makes a coalition strong is how you earn trust and build relationships, as that is crucial for influencing without authority. We had to also accelerate internal processes to ship faster, and having this strong support from leaders and stakeholders from involved agencies enabled us to cut through a lot of red tape.
3. Build your “2-pizza team” to stay nimble
Likhitha: In order to move fast and deliver quickly, building a small, lean team of empowered contributors is essential. The “2-pizza team” rule is an infamous rule of thumb in the technology world, and it’s a handy measure for this — if the team can’t be fed with two pizzas, then it’s too big. The rationale is that as your team size grows, so do the number of links that require managing. Keeping the immediate team small allows for more effective communication, coordination and execution, and staves off symptoms of inefficiency like “too many cooks in the kitchen.” In order to keep the team effective, ensuring there is transparency, and establishing clear roles and responsibilities was also critical. Our immediate team of eight used a number of virtual collaboration tools to consistently workshop and communicate no matter our location; all of which also played a big role in maintaining transparency. Establishing who does what by when and identifying owners, reviewers, collaborators, and approvers upfront kept things clear as we moved forward.
Kaeli: Key to the speedy delivery (the VA COVID-19 screener was launched in just 12 days!) of multiple COVID-19-related tools from VA has been not only the “2 pizza” team size but also the fact that we had those tech teams in-house. VA has a dedicated tech team (the Digital Experience Product Office, made of designers, content strategists, engineers, product managers) focused on delivering digital products with a modern, shared VA.gov platform. Having a team like this on hand means you don’t have to worry about contract management, waiting for task orders, onboarding new teams, negotiating scope, or waiting for access to systems. Plus, the entrepreneurial mindset of the team was key for quick delivery. The heavy-lift required to get this infrastructure and in-house tech team in place turned out to be a great investment that allowed the VA CTO team to respond rapidly to the urgent needs of Veterans.
4. Don’t let perfect be the enemy of the good
“If you’re not embarrassed by the first version of your product, you’ve launched too late.”—Reid Hoffman, an American entrepreneur
Likhitha: It’s easy to get hung up on wanting to ship a perfect product from the get-go, be it for precision or for risk aversion. In the wise words of Reid Hoffman, an American entrepreneur, “If you’re not embarrassed by the first version of your product, you’ve launched too late.” By waiting to ship the perfect product, we’d be wasting time instead of actually getting the product in the hands of real users through which we can further learn and iterate. Creating a culture for iteration rather than striving for perfection was critical — this mindset had to be adopted by our immediate team and leaders supporting us. We knew going in that what we put out on Day 1 wouldn’t be perfect; we prepared ourselves to iterate quickly and employed mechanisms where we could collect and incorporate user feedback. As we kicked off the effort, we declared a set of guiding principles and “ship-it must-haves” to align towards this mindset. Having these criteria pre-established also helped us stay focused on priorities and stick to our immediate goals. Our “ship-it must-haves” were the following:
- We have validated user needs and have reasonable confidence that the right content is in place.
- We meet HHS and HRSA compliance and launch requirements.
- We adhere to the latest web design standards. In order to create a beautiful and modern website, we leveraged the U.S. Web Design System (USWDS) to easily adopt mobile-friendly design standards.
- Website content including links are reviewed and signed off by source-of-truth owners.
- Website can withstand high-traffic, and we are operationally ready.
- We ensure there is a way for website users to send us feedback.
Kaeli: An important part of this piece of advice is “don’t reinvent the wheel.” Even though we had the in-house tech team available who could have built the VA coronavirus chatbot themselves, we saved precious time by starting with a commercial off-the-shelf chatbot framework. There were some minor trade-offs in customizability, but it got the job done and addressed the pressing need to get information to Veterans quickly.
Are you passionate about the civic impact of human-centered design and product development? Interested in using your expertise for public good? Learn more about PIF at our website, and follow us on Twitter and LinkedIn to find the latest work from our fellows.
Have feedback or questions? Send us an email »