October 2021
As organizations move their computing from on-premises to the cloud, they realize that leveraging cloud-native security tools can provide additional cost savings and business benefits to their security infrastructure. Azure network security customers reduced their total cost of ownership of security tools, improved the cost and time-to-value of their development processes through development, security, and operations (DevSecOps), and reduced their risk of a material security breach by 30%.
Azure network security offers a suite of cloud-native security tools to protect Azure workloads while automating network management, implementing DevSecOps practices, and reducing the risk of a material security breach.
Microsoft commissioned Forrester Consulting to conduct a Total Economic ImpactTM (TEI) study and examine the potential return on investment (ROI) enterprises may realize by deploying Azure network security. The purpose of this study is to provide readers with a framework to evaluate the potential financial impact of Azure network security on their organizations.
To better understand the benefits, costs, and risks associated with this investment, Forrester interviewed four customers with experience using Azure network security. For the purposes of this study, Forrester aggregated the experiences of the interviewed customers and combined the results into a single composite organization.
Prior to using Azure network security, the interviewees’ organizations were utilizing on-premises security tools to protect either on-premises computing environments or nascent cloud workloads. However, the inflexibility and hands-on nature of these tools led to increased time burdens on IT and other inefficiencies that prevented IT professionals from focusing on higher value work.
After the investment in Azure network security, interviewed customers reduced their total cost of ownership related to security infrastructure, established DevSecOps processes, reduced their risk of material security breaches, and reduced the burden on IT to manage networks and upgrades, allowing these teams to focus on more strategic workstreams.
Quantified benefits. Risk-adjusted present value (PV) quantified benefits include:
Azure network security enabled organizations to implement infrastructure-as-code practices, incorporating security directly into application development workflows and speeding development and time-to-market of applications. With the adoption of DevSecOps workflows, security moved to being an enabler of development speed rather than a gate.
Organizations reduced their total cost of ownership of on-premises security tools by 25% when protecting 20% of their organization’s total computing with Azure network security. Interviewees saved costs directly related to decommissioned on-premises security tools as well as time costs to maintain this infrastructure and from vendor management.
Azure network security provides automated network security upgrades and improved visibility of the environment. This improves the overall security environment of Azure workloads and reduces the likelihood of experiencing external and internal costs associated with a breach.
Azure network security improved the efficiency of IT teams delivering network-related work. It reduced firewall management by 80%, security policy management by 15%, and security audit process by 96% without decreasing vulnerabilities.
Unquantified benefits. Benefits that are not quantified for this study include:
Owing to its ease of use and enablement of IT teams to do more strategic work, some interviewed customers experienced improved quality of job applicants and improved retention of already hired IT professionals after implementing Azure network security.
Interviewed customers described working with Microsoft support closely to influence new Azure network security products that would further enhance their security posture and optimize their network-related workstreams.
Costs. Risk-adjusted PV costs include:
Azure consumption fees are based on the number of workloads Azure network security protects. They are typically based on units per hour with a variable cost based on network traffic. For the composite organization, total Azure network security fees amounts to under $130,000 annually.
Azure network security requires approximately 80 hours of work each for 4 IT FTEs to implement each service. On an ongoing basis, 40 hours per week are needed to manage Azure network security services.
The customer interviews and financial analysis found that a composite organization experiences benefits of $2.23M over three years versus costs of $840.3K, adding up to a net present value (NPV) of $1.39M and an ROI of 165%.
The objective of the framework is to identify the cost, benefit, flexibility, and risk factors that affect the investment decision. Forrester took a multistep approach to evaluate the impact that Azure network security can have on an organization.
Interviewed Microsoft stakeholders and Forrester analysts to gather data relative to Azure network security.
Interviewed four decision-makers at organizations using Azure network security to obtain data with respect to costs, benefits, and risks.
Designed a composite organization based on characteristics of the interviewed organizations.
Constructed a financial model representative of the interviews using the TEI methodology and risk-adjusted the financial model based on issues and concerns of the interviewed organizations.
Employed four fundamental elements of TEI in modeling the investment impact: benefits, costs, flexibility, and risks. Given the increasing sophistication of ROI analyses related to IT investments, Forrester’s TEI methodology provides a complete picture of the total economic impact of purchase decisions. Please see Appendix A for additional information on the TEI methodology.
Readers should be aware of the following:
This study is commissioned by Microsoft and delivered by Forrester Consulting. It is not meant to be used as a competitive analysis.
Forrester makes no assumptions as to the potential ROI that other organizations will receive. Forrester strongly advises that readers use their own estimates within the framework provided in the study to determine the appropriateness of an investment in Azure network security.
Microsoft reviewed and provided feedback to Forrester, but Forrester maintains editorial control over the study and its findings and does not accept changes to the study that contradict Forrester’s findings or obscure the meaning of the study.
Microsoft provided the customer names for the interviews but did not participate in the interviews.
Industry | Region | Interviewee | Azure network security services | |||
---|---|---|---|---|---|---|
Professional services | EMEA | Senior network analyst | DDos Protection Azure Firewall Azure Front Door Azure WAF |
|||
Education | US | VP of applications and infrastructure | DDos Protection Azure Firewall Azure WAF |
|||
Technology | US | Chief information security officer; chief solutions architect | DDos Protection Azure WAF |
|||
Professional services | US | Enterprise infrastructure architect; assistant director and cloud engineer | DDos Protection Azure Firewall Azure Front Door Azure WAF |
|||
|
Before investing in Azure network security, the interviewees’ organizations were either not invested in the cloud or in the early stages of their journey to becoming cloud-first. Those interviewees’ organizations who had not yet invested in the cloud ran traditional on-premises security appliances in their data centers to meet their security needs. Interviewees’ organizations who had started migrating to the cloud utilized cloud implementations of their on-premises security solutions to protect cloud workloads while also mimicking data center practices for their cloud environments.
The interviewees’ organizations struggled with common challenges, including:
These prior environments were difficult and expensive when it came to scaling to meet organizational needs. As on-premises computing scaled, organizations would go through the same procurement processes to secure additional security appliances. This incurred a time cost and required organizations to build predictions for growth of computing resources into their security investments. This led to constant overinvestment in security capabilities to ensure adequate protection. Also, this infrastructure could not scale down if organizational needs decreased, resulting in a sunk cost with no risk mitigation benefit.
Interviewees’ organizations faced additional expenses managing their security and undertaking regular workstreams. With physical security appliances on-premises, organizations’ teams spent a good amount of their time running manual security-related processes like scripting and patching.
Given that the organizations themselves were responsible for management of their on-premises infrastructure, certain workstreams like patching were not completed on schedule. Sometimes, this was due to limited resources being available for patching work and other times it was due to the unreliability of the physical hardware. The regular failure to keep up with updates meant an increased security risk.
The interviewees’ organizations searched for a solution that could:
Based on the interviews, Forrester constructed a TEI framework, a composite company, and a ROI analysis that illustrates the areas financially affected. The composite organization is representative of the four companies that Forrester interviewed and is used to present the aggregate financial analysis in the next section. The composite organization has the following characteristics:
The global business-to-business organization employs 75,000 full-time employees and generates $15 billion in revenue annually. It has recently begun its journey to becoming a cloud-first business. Previously, it regularly invested $1.6 million in security infrastructure for a three-to-five-year term. It experiences an average of 3.1 material security breaches annually, which causes 3.6 hours of lost time to 10% of employees.
The organization has decided to invest in four Azure network security services: Distributed Denial-of-Service (DDoS) Protection, Azure Firewall, Azure Front Door, and Azure Web Application Firewall. The composite migrates 10% of its computing to Azure in Year 1 with an additional 5% moved in the following years for a total of 20% of organizational computing happening in Azure by Year 3.
Ref. | Benefit | Year 1 | Year 2 | Year 3 | Total | Present Value |
---|---|---|---|---|---|---|
Atr | Improved development efficiency and time-to-value of applications | $300,450 | $450,675 | $600,899 | $1,352,024 | $1,097,059 |
Btr | Reduced cost of legacy technologies | $16,848 | $124,848 | $542,448 | $684,144 | $526,046 |
Ctr | Reduced risk of security breach and improvement to productivity | $118,820 | $146,336 | $173,852 | $439,007 | $359,574 |
Dtr | Improved efficiency of IT teams | $99,198 | $99,198 | $99,198 | $297,594 | $246,691 |
Total benefits (risk-adjusted) | $535,316 | $821,056 | $1,416,398 | $2,772,769 | $2,229,370 | |
|
Interviewed customers described enhanced application development practices after investing in Azure network security. Azure network security services enabled interviewees’ organizations to:
For the composite organization, Forrester estimates:
The improvement to development efficiency and time-to-value of developed applications will vary with:
To account for these risks, Forrester adjusted this benefit downward by 10%, yielding a three-year, risk-adjusted total PV (discounted at 10%) of nearly $1.1 million.
Ref. | Metric | Source | Year 1 | Year 2 | Year 3 | ||
---|---|---|---|---|---|---|---|
A1 | Prior total months to complete a development project | Interviews | 1.5 | 1.5 | 1.5 | ||
A2 | New total months to complete a development project | Interviews | 0.5 | 0.5 | 0.5 | ||
A3 | Reduction in total project time (months) | A1-A2 | 1 | 1 | 1 | ||
A4 | Reduction in development hours | 2,000/12*A3 | 167 | 167 | 167 | ||
A5 | Average development team size | Composite | 3 | 3 | 3 | ||
A6 | Fully burdened hourly rate per developer | Composite | $100 | $100 | $100 | ||
A7 | Productivity recapture rate | Forrester | 50% | 50% | 50% | ||
A8 | Reduced labor costs per project | A4*A5*A6*A7 | $25,050 | $25,050 | $25,050 | ||
A9 | Average annual revenue per development project | Composite | $1,000,000 | $1,000,000 | $1,000,000 | ||
A10 | Average monthly revenue per development project | A9/12 | $83,333 | $83,333 | $83,333 | ||
A11 | Additional revenue from improved development time | A10*A3 | $83,333 | $83,333 | $83,333 | ||
A12 | Development project completed annually | Composite | 10 | 15 | 20 | ||
A13 | Profit margin | Composite | 10% | 10% | 10% | ||
At | Improved development efficiency and time-to-value of applications | (A8*A12)+(A11*A12*A13) | $333,833 | $500,750 | $667,666 | ||
Risk adjustment | ↓10% | ||||||
Atr | Improved development efficiency and time-to-value of applications (risk-adjusted) | $300,450 | $450,675 | $600,899 | |||
Three-year total: $1,352,024 | Three-year present value: $1,097,059 | ||||||
|
Interviewees shared that as their organizations moved from on-premises computing to cloud computing, their on-premises security appliances were decommissioned in favor of cloud-native security tools like Azure network security. This enabled the interviewees’ organizations to avoid the cost of reinvesting in three-to-five-year contracts for their security appliances and additional costs from running more agents and services in the cloud with third-party tools.
Interviewees also described eliminating IT workstreams related to managing and upgrading security appliances on-premises. The VP of applications and infrastructure from the education industry stated, “We were able to redirect work previously dedicated to configuring load balancers and patching, basically your garden variety care and feeding of these devices to additional cloud deployment, creating a snowballing effect for our cloud migration.”
Interviewees also noted that their organizations experienced cost savings related to vendor management. By consolidating security under a single vendor for their cloud workloads, organizations spent less time managing integrations or dealing with finger pointing when something went wrong. As the chief solution architect from the technology industry shared: “We no longer need to manage multiple third parties for integrations. With Azure, integrations are just part of the platform. So, it makes it easy to not only manage vendor relationships but also do overall management of services.”
For the composite organization, Forrester estimates:
The reduced cost legacy technologies will vary with:
To account for these risks, Forrester adjusted this benefit downward by 10%, yielding a three-year, risk-adjusted total PV of $526,046.
Ref. | Metric | Source | Year 1 | Year 2 | Year 3 | ||
---|---|---|---|---|---|---|---|
B1 | Cost of on-premises security infrastructure and associated maintenance fees | Interviews; Forrester |
$2,320,000 | ||||
B2 | Reduction in cost from Azure network security | Composite | 20% | ||||
B3 | Reduced fees from decommissioned technologies | B1*B2 | $0 | $0 | $464,000 | ||
B4 | Reallocation of FTEs from infrastructure maintenance work | Interviews | 1 | 1 | |||
B5 | Annual cost of one IT professional | Composite | $120,000 | $120,000 | |||
B6 | Reduced cost of maintaining decommissioned technologies | B4*B5 | $0 | $120,000 | $120,000 | ||
B7 | Prior hours dedicated to vendor management | Interviews | 320 | 320 | 320 | ||
B8 | New hours dedicated to vendor management | Interviews | 8 | 8 | 8 | ||
B9 | Fully burdened hourly rate for IT employees | Forrester | $60 | $60 | $60 | ||
B10 | Reduced time cost of vendor management from consolidation | (B6-B7)*B8 | $18,720 | $18,720 | $18,720 | ||
Bt | Reduced cost of legacy technologies | B3+B6+B10 | $18,720 | $138,720 | $602,720 | ||
Risk adjustment | ↓10% | ||||||
Btr | Reduced cost of legacy technologies (risk- adjusted) | $16,848 | $124,848 | $542,448 | |||
Three-year total: $684,144 | Three-year present value: $526,046 | ||||||
|
After investing in Azure network security, interviewees reduced exposure to security threats and improved security posture. These improvements stemmed from the following:
Interviewees’ organizations also experienced reduced downtime due to security breaches after deploying Azure network security services. The VP of applications and infrastructure from the education industry stated: “Even though it’s in the cloud, these things are not 100%. Despite that, we’ve experienced only one unplanned outage with regards to Azure over the last two years, while we’ve had three in that similar timeframe with on-prem and at least a half dozen with [another public cloud platform].”
For the composite organization, Forrester estimates:
The reduced risk of a security breach and improvement to productivity will vary with:
To account for these risks, Forrester adjusted this benefit downward by 10%, yielding a three-year, risk-adjusted total PV of $359,574.
Ref. | Metric | Source | Year 1 | Year 2 | Year 3 | ||
---|---|---|---|---|---|---|---|
C1 | Average annual number of material breaches | Forrester | 3.1 | 3.1 | 3.1 | ||
C2 | Average total internal and external costs of a material breach | Forrester | $657,494 | $657,494 | $657,494 | ||
C3 | Percentage of organization protected by Azure network security | Interviews | 10% | 15% | 20% | ||
C4 | Percentage risk improvement from Azure network security | Interviews | 30% | 30% | 30% | ||
C5 | Reduced risk of a security breach | C1*C2*C3*C4 | $61,147 | $91,720 | $122,294 | ||
C6 | Prior downtime hours from breach per employee annually | Composite | 3.6 | 3.6 | 3.6 | ||
C7 | Number of employees affected | Composite | 7,500 | 7,500 | 7,500 | ||
C8 | Average fully burdened hourly rate per employee | Forrester | $35 | $35 | $35 | ||
C9 | Productivity recapture rate | Forrester | 25% | 25% | 25% | ||
C10 | Improved productivity from reduced downtime | C6*C7*C8*C9*C4 | $70,875 | $70,875 | $70,875 | ||
Ct | Reduced risk of security breach and improvement to productivity | C5+C10 | $132,022 | $162,595 | $193,169 | ||
Risk adjustment | ↓10% | ||||||
Ctr | Reduced risk of security breach and improvement to productivity (risk-adjusted) | $118,820 | $146,336 | $173,852 | |||
Three-year total: $439,007 | Three-year present value: $359,574 | ||||||
|
Lastly, the interviewees reported that Azure network security reduced the time cost of network-related security operations that the Azure platform didn’t automate. While patching and upgrading were automated on Azure and application-related security became codified in DevOps practices, organizations described three key areas where network professionals' work was reduced but not eliminated. This included:
For the composite organization, Forrester estimates:
The improved efficiency of IT teams may vary with:
To account for these risks, Forrester adjusted this benefit downward by 10%, yielding a three-year, risk-adjusted total PV of $246,691.
Ref. | Metric | Source | Year 1 | Year 2 | Year 3 | ||
---|---|---|---|---|---|---|---|
D1 | IT labor time saved managing firewalls | 2,000 hours*80% reduction | 1,600 | 1,600 | 1,600 | ||
D2 | IT labor time saved managing policy | 300 hours*15% reduction | 45 | 45 | 45 | ||
D3 | IT labor time saved on audit process | 24 hours*2 FTEs*4 quarters | 192 | 192 | 192 | ||
D4 | Hourly cost of IT professional | A10 | $60 | $60 | $60 | ||
Dt | Improved efficiency of IT teams | (D1+D2+D3)*D4 | $110,220 | $110,220 | $110,220 | ||
Risk adjustment | ↓10% | ||||||
Dtr | Improved efficiency of IT teams (risk-adjusted) | $99,198 | $99,198 | $99,198 | |||
Three-year total: $297,594 | Three-year present value: $246,691 | ||||||
|
Additional benefits that interviewees experienced but were not able to quantify include:
Some interviewees’ organizations leveraged Azure network security and experienced an improvement in the quality of job applicants for open positions. The VP of applications and infrastructure from education stated: “First of all, there has been a significant draw for open positions. Now the market knows that the work is on Azure, I get much higher-quality candidates. And so, there’s definitely a drop that way. Second, the folks I have working on Azure, they’re so excited to be working on the technology that it’s a significant drop in attrition.”
Regarding Microsoft support, the enterprise infrastructure architect from professional services shared: “We’re seeing them take a lot of our ideas back to the product groups. Specifically on networking, we are seeing a lot of the things that we asked for come to market and it’s happening exponentially faster.”
The value of flexibility is unique to each customer. There are multiple scenarios in which a customer might implement Azure network security and later realize additional uses and business opportunities, including:
The VP of applications and infrastructure from education stated: “Our migration to Azure was almost perfect from an agile perspective. When we tackled this migration, I felt like we were really enabled from the stability of the environment, from the availability of the tools to integration of those tools. I think it was really quite fantastic.”
Flexibility would also be quantified when evaluated as part of a specific project (described in more detail in Appendix A).
Ref. | Cost | Initial | Year 1 | Year 2 | Year 3 | Total | Present Value |
---|---|---|---|---|---|---|---|
Etr | Total Azure consumption fees | $0 | $171,917 | $171,917 | $171,917 | $515,750 | $427,532 |
Ftr | Cost of implementation and ongoing management | $84,480 | $132,000 | $132,000 | $132,000 | $480,480 | $412,744 |
Total costs (risk-adjusted) | $84,480 | $303,917 | $303,917 | $303,917 | $996,230 | $840,276 | |
|
Azure network security fees are based on a number of factors, such as the number of workloads protected based on units per hour and a variable cost based on network traffic. For the composite organization, Forrester uses the average spend per Azure network security service for the composite’s industry.
For the composite organization, Forrester estimates:
The total cost from Azure consumption fees will vary with:
To account for these risks, Forrester adjusted this cost upward by 10%, yielding a three-year, risk-adjusted total PV (discounted at 10%) of $427,532.
Ref. | Metric | Source | Initial | Year 1 | Year 2 | Year 3 | |
---|---|---|---|---|---|---|---|
E1 | Azure DDoS Protections fees | $70,584 | $70,584 | $70,584 | |||
E2 | Azure Firewall fees | $33,948 | $33,948 | $33,948 | |||
E3 | Azure Front Door Service fees | $6,960 | $6,960 | $6,960 | |||
E4 | Azure Web Application Firewall fees | $44,796 | $44,796 | $44,796 | |||
Et | Total Azure consumption fees | E1+E2+E3+E4 | $0 | $156,288 | $156,288 | $156,288 | |
Risk adjustment | ↑10% | ||||||
Etr | Total Azure consumption fees (risk-adjusted) | $0 | $171,917 | $171,917 | $171,917 | ||
Three-year total: $515,750 | Three-year present value: $427,532 | ||||||
|
Interviewees described incurring internal implementation and ongoing management time costs for each of the four services deployed. The average deployment for each service required four FTEs to work 80 hours each. For all solutions, interviewees’ organizations required 10 FTEs spending 10% of their time on ongoing management.
For the composite organization, Forrester estimates:
The total cost of implementation and ongoing management will vary with:
To account for these risks, Forrester adjusted this cost upward by 10%, yielding a three-year, risk-adjusted total PV of $412,744.
Ref. | Metric | Source | Initial | Year 1 | Year 2 | Year 3 | |
---|---|---|---|---|---|---|---|
F1 | Total hours to implement per solution | Interviews | 1,280 | ||||
F2 | Total annual hours to manage on an ongoing basis | Interviews | 2,000 | 2,000 | 2,000 | ||
F3 | Fully burdened hourly rate for IT professional | $60 | $60 | $60 | $60 | ||
Ft | Cost of implementation and ongoing management | Initial: F1*F3; F2*F3 | $76,800 | $120,000 | $120,000 | $120,000 | |
Risk adjustment | ↑10% | ||||||
Ftr | Cost of implementation and ongoing management (risk-adjusted) | $84,480 | $132,000 | $132,000 | $132,000 | ||
Three-year total: $480,480 | Three-year present value: $412,744 | ||||||
|
These risk-adjusted ROI, NPV, and payback period values are determined by applying risk-adjustment factors to the unadjusted results in each Benefit and Cost section.
Initial | Year 1 | Year 2 | Year 3 | Total | Present Value | |
---|---|---|---|---|---|---|
Total costs | ($84,480) | ($303,917) | ($303,917) | ($303,917) | ($996,230) | ($840,276) |
Total benefits | $0 | $535,316 | $821,056 | $1,416,398 | $2,772,769 | $2,229,370 |
Net benefits | ($84,480) | $231,399 | $517,139 | $1,112,481 | $1,776,539 | $1,389,094 |
ROI | 165% | |||||
Payback period (months) | <6 months | |||||
|
The initial investment column contains costs incurred at “time 0” or at the beginning of Year 1 that are not discounted. All other cash flows are discounted using the discount rate at the end of the year. PV calculations are calculated for each total cost and benefit estimate. NPV calculations in the summary tables are the sum of the initial investment and the discounted cash flows in each year. Sums and present value calculations of the Total Benefits, Total Costs, and Cash Flow tables may not exactly add up, as some rounding may occur.
Total Economic Impact is a methodology developed by Forrester Research that enhances a company’s technology decision-making processes and assists vendors in communicating the value proposition of their products and services to clients. The TEI methodology helps companies demonstrate, justify, and realize the tangible value of IT initiatives to both senior management and other key business stakeholders.
Benefits represent the value delivered to the business by the product. The TEI methodology places equal weight on the measure of benefits and the measure of costs, allowing for a full examination of the effect of the technology on the entire organization.
Costs consider all expenses necessary to deliver the proposed value, or benefits, of the product. The cost category within TEI captures incremental costs over the existing environment for ongoing costs associated with the solution.
Flexibility represents the strategic value that can be obtained for some future additional investment building on top of the initial investment already made. Having the ability to capture that benefit has a PV that can be estimated.
Risks measure the uncertainty of benefit and cost estimates given: 1) the likelihood that estimates will meet original projections and 2) the likelihood that estimates will be tracked over time. TEI risk factors are based on “triangular distribution.”