December 2016 Web Server Survey

In the December 2016 survey we received responses from 1,739,031,487 sites and 6,169,471 web-facing computers; this reflects a large increase of 302 million sites, but a small loss of 55,900 computers.

All three of the largest server vendors gained sites this month, with growth concentrated at a handful of lesser-known web hosting providers. These changes have triggered large jumps in market share, with nginx (+3.2 percentage points) and Microsoft (+1.6 p.p.) gaining, and Apache losing (-2.2 p.p.).

The growth in number of sites was not reflected in other metrics this month, however, with small drops being seen in both the total number of web-facing computers (-0.9%) and the number of active sites (-0.8%).

Nginx was the only major web server vendor to experience gains across all metrics this month, including active sites, web-facing computers, and the million busiest sites. It now stands only 390,000 computers (6 percentage points) behind second place Microsoft, having surpassed Microsoft in terms of active sites in January 2012, and the top million busiest sites in May 2013.

Previously the 10th most commonly seen web server in terms of active sites, “”, has vanished this month after the website builder began using the Cloudflare CDN service. Cloudflare uses a customised version of nginx (cloudflare-nginx), that powered over 3.6 million active sites in the December survey.

Looking back over 2016, the total number of sites seen in the survey has grown significantly, from 900 million in January to 1.7 billion in December. Much of this growth can be attributed to Microsoft, which has gained more than 520 million hostnames and risen from 28.95% market share to 45.07%. However, the more stable active sites metric shows nginx grew the most this year, having increased by 4.8 million active sites and 2.85 percentage points of market share over the course of 2016.

The year also saw the notable rise of OpenResty: in January, OpenResty was being used by 760,000 sites, 200,000 active sites, and just 3,100 web-facing computers; but in September, switched from using nginx to OpenResty for millions of Tumblr blogs. The number of sites using OpenResty in December is now nearly 15 million, the number of active sites is 5.8 million, and the number of web-facing computers seen running OpenResty has increased to nearly 8,000. The server is now the 9th most popular by number of web-facing computers.

Microsoft’s newest web server software, IIS 10.0, was released this year although it is yet to make a significant impact in the number of sites. Windows Server 2016, the primary operating system for running IIS 10.0 was only fully released in October after months of preview releases; the December 2016 survey finds the operating system being used on 5,800 web-facing computers to host 18,250 sites.

Another notable arrival during 2016 were the hundreds of thousands of Western Digital My Cloud personal storage devices. These Network Attached Storage (NAS) devices run an Apache web server and each has a hostname on the domain. The fact that these devices are placed in end-users' homes, using less-stable home Internet connections, and more commonly powered off than a typical web server has increased the volatility of the Apache web-facing computer data. The December 2016 survey found 680,000 sites for these devices.

Total number of websites

Web server market share

DeveloperNovember 2016PercentDecember 2016PercentChange
Continue reading

November 2016 Web Server Survey

In the November 2016 survey we received responses from 1,436,724,046 sites and 6,225,374 web-facing computers, reflecting a gain of 7 million sites and 81,000 computers.

nginx was the only major vendor to gain hostnames this month, increasing its site count by 6.1 million, while Apache and Microsoft lost 16.6 million and 12.4 million.

Outweighing the existing major vendors, LiteSpeed demonstrated the largest hostname growth after it gained more than 40 million sites – a remarkable 740% increase. LiteSpeed's growth included 38 million existing sites that were hosted by OVH, and previously using Taobao's Tengine web server, which consequently suffered the largest loss of sites this month. The sites involved in this movement—nearly all of which make use of the .science TLD—are now hosted by Amazon Web Services. As a result of these changes, LiteSpeed's market share of sites has leapt from 0.39% to 3.29%, taking it from 10th to 4th place – while Tengine has been displaced to 5th.

Using the less-volatile web-facing computers metric, Apache showed the largest growth this month with an increase of 39,900 computers, while nginx was not too far behind with net growth of 32,881. Despite LiteSpeed's large hostname growth, it gained only a modest sum of 312 computers (+3.4%), making it the 7th largest vendor by this metric.

OpenResty gained significant traction in September after millions of Tumblr blogs switched from using nginx. This month, OpenResty gained a further 560 web-facing computers (+7.8%), taking its total up to 7,700. It also gained half a million more sites, but not all of the new sites are used by Tumblr blogs this time, which indicates growing interest amongst other users. More than a tenth of the new sites found using OpenResty in November are being used to serve PHPWind forum installations hosted by Raksmart in China, and thousands more new OpenResty sites are found at the likes of Fastly, DigitalOcean and Amazon Web Services.

Microsoft's latest server software, IIS 10.0, has yet to make significant inroads on the web, with the total number of sites using it still floating around 10,000; however, its primary platform—Windows Server 2016—has only been available since October. Preview releases have been available for several months, though, and so the number of web-facing computers using Windows Server 2016 has gradually been creeping up. Netcraft found a total of 4,347 Windows Server 2016 computers in the November survey.

Total number of websites

Web server market share

DeveloperOctober 2016PercentNovember 2016PercentChange
Continue reading

October 2016 Web Server Survey

In the October 2016 survey we received responses from 1,429,331,486 sites and 6,144,093 web-facing computers. This reflects a large increase of 144 million sites, and a more modest increase of 25,300 computers.

Microsoft once again saw the largest increase of web sites this month, gaining 95 million. Apache and nginx made up the majority of the remainder of web site growth, gaining 25 million and 11 million. Despite Microsoft’s large gain of web sites, it lost both web-facing computers (-17,700) and active sites (-1.2 million).

Apache saw the largest increase of active sites this month, gaining 1.8 million, while nginx gained 400,000, the second largest growth. These gains, coupled with Microsoft’s loss of 1.2 million active sites, led to Microsoft’s share of active sites dropping to 9.27%, the first time that it has fallen below 10%. Apache increased its market share by 0.19 percentage points and continues to dominate, now with 46.30% of the active sites.

The largest increase of web-facing computers was made by nginx, gaining 20,000. Despite now having more than twice as many active sites as Microsoft, nginx remains in third place by number of web-facing computers with 17.41% of the market, compared to Microsoft’s 24.91%. Apache leads, running on 45.97% of all web-facing computers, however, both Apache and Microsoft are gradually losing market share to nginx.

Within the million busiest sites, the long-term trend is the ascent of nginx, at the expense of both Apache and Microsoft. This month continues that trend, with Apache losing 0.13 percentage points, Microsoft losing 0.14, and nginx gaining 0.20. However, Apache still leads by a significant margin over second-placed nginx, with 146,000 more of the million busiest sites using Apache.

Total number of websites

Web server market share

DeveloperSeptember 2016PercentOctober 2016PercentChange
Continue reading

September 2016 Web Server Survey

In the September 2016 survey we received responses from 1,285,759,146 sites and 6,118,785 web-facing computers, reflecting large gains in both metrics: 132 million additional sites, and 138,000 more computers.

Microsoft made up the majority of this month's website growth, with the largest gain of 97 million sites, although it showed only modest increases of 5,200 web-facing computers and 693,000 active sites.

Apache was responsible for most of this month's additional web-facing computers, increasing its count by 87,000 to 2.8 million (+3.2%). Similarly, nginx made a 3.0% gain of 30,000 computers. However, Microsoft's 0.3% gain was not enough to stop its share falling by half a percentage point to 25.3% as a result of the gains made by Apache and nginx.

Although nginx made a healthy gain in web-facing computers, it lost more than 5 million active sites and 5,600 sites within the top-million. 27.6% of the busiest million sites now use nginx (-0.56 pp from last month), while Apache retains its lead with a 42.5% share.

Along with nginx, all of the major web server vendors suffered losses within the top million sites, largely due to the growth of OpenResty this month. More than 10,000 of the top million sites are now using OpenResty, compared with fewer than 4,000 last month, after millions of Tumblr blogs switched from nginx. As well as, — the home of the Basecamp web-based project management tool — ranks amongst the most visited sites to use OpenResty.

Tumblr's adoption of OpenResty has caused the web server to leap up the rankings to become the seventh largest web server vendor by websites, and fifth by active sites. This month, 87% of all OpenResty sites appear under the domain.

Although most OpenResty sites reside under the domain, the number of unique domains using OpenResty also increased noticeably this month.

Although most OpenResty sites reside under the domain, the number of unique domains using OpenResty also increased noticeably this month.

Switching from nginx to OpenResty is not such a paradigm shift as moving to, say, Apache or Microsoft IIS. The OpenResty web application platform is built around the standard nginx core, which offers some familiarity, as well as allowing the use of third-party nginx modules. One of the key additional features provided by OpenResty is the integration of the LuaJIT compiler and many Lua libraries – this gives scope for high performance web applications to be run completely within the bundled nginx server, where developers can take advantage of non-blocking I/O.

Another web server that has gained prominence over the past year is Cowboy, a small and fast modular HTTP server written in Erlang. Optimised for low latency and low memory usage, it is currently the fifth most common web server software installed on web-facing computers that accept HTTP connections. Most of the computers used by Cowboy servers are powered by the Heroku Cloud Application Platform and hosted at Amazon Web Services.

Total number of websites

Web server market share

DeveloperAugust 2016PercentSeptember 2016PercentChange
Continue reading

August 2016 Web Server Survey

In the August 2016 survey we received responses from 1,153,659,413 sites and 5,980,524 web-facing computers. This reflects an increase of 80 million sites, but a loss of 78,000 computers.

While the overall number of sites increased this month, this growth was not felt evenly by each web server vendor: Microsoft gained the largest number of sites with an increase of 66 million, while second-placed Apache lost 41 million sites. Tengine, the nginx-based web server from Chinese online shopping giant Taobao, gained 28 million sites.

Whilst there were large changes in total number of sites, these were accompanied by much more modest changes in active sites – a more stable metric designed to ignore automatically generated bulk content. Apache and Microsoft both suffered small drops in the number of active sites, -0.5% and -0.8% respectively, whilst Tengine and nginx gained 120,000 (7.3%) and 81,000 (0.2%).

The majority of this month’s drop in web facing computers were running Apache, with a decrease of just over 107,000 (3.8%) using the open-source server. One of the primary contributors to this drop was the loss of a large number of consumer-NAS devices running Apache. While these devices have steadily increased in number since the start of 2016, this month has seen a marked decline. These devices are mostly connected via home internet lines and are therefore likely to come and go from month to month. As a result, the Apache losses this month are spread over a large number of consumer ISPs. On the other hand, Apache continued to see growth amongst web hosting providers.

A gain of 24,000 web-facing computers for nginx, the largest gain in web facing computers this month, once more boosts its market share, which now stands at 17.0%. Microsoft also experienced a small increase in market share, despite its loss of 4,000 web-facing computers, given Apache’s large loss this month.

Windows Server 2016 — which will be the main platform for Microsoft IIS 10.0 — is edging closer to its official launch at Microsoft's Ignite conference in September. In the meantime, developers can try out many of the new features in IIS 10 by either installing the latest Windows Server 2016 Technical Preview 5, or by installing the self-contained IIS 10.0 Express on Windows 7 SP1 or later.

More than 11,000 websites are already using Microsoft IIS 10.0, with almost all of these sites using a version of Windows Server 2016.

The previous month saw two new releases of the mainline version of nginx, mostly incorporating bug fixes and feature additions, while the release of Apache 2.4.23 addressed a security issue which could have allowed clients to gain unauthorised access to protected resources if a server was configured to use HTTP/2.

Several web servers were also updated following the disclosure of a set of vulnerabilities dubbed httpoxy. These vulnerabilities can affect web applications running in CGI or CGI-compatible environments.

The vulnerability stems from a simple namespace conflict where the client-provided HTTP Proxy header was placed into an HTTP_PROXY environment variable as is the custom for CGI applications; but where HTTP_PROXY was trusted by the application and used to configure an outgoing proxy.

This type of vulnerability was first discovered in libwww-perl more than 15 years ago, but in July it was found to be still exploitable in PHP and many other modern languages and libraries. Successful exploitation of these issues could allow a remote attacker to proxy outgoing HTTP requests made by a vulnerable web application, which may expose sensitive data.

To mitigate the httpoxy vulnerability, Apache 2.4.24-dev avoids populating the HTTP_PROXY variable from a Proxy header in httpd CGI environments. Similar mitigations have also been implemented in Lighttpd 1.4.41 and LiteSpeed, while nginx and Varnish have published mitigation advice.

Total number of websites

Web server market share

DeveloperJuly 2016PercentAugust 2016PercentChange
Continue reading

July 2016 Web Server Survey

In the July 2016 survey we received responses from 1,073,777,722 sites and 6,058,513 web-facing computers. This reflects an increase of 28 million sites and 107,000 computers.

Microsoft and Apache continue to fluctuate between 1st and 2nd places for total number of websites, with Microsoft retaking the lead again this month after an increase of 36 million sites, and the loss of 20 million Apache sites. However, it is only in the hostnames metric that Microsoft leads, with Apache coming out on top by a considerable margin in all other areas - active sites, domains, IP addresses and web-facing computers.

Looking at the number of active sites, a more stable metric created by Netcraft to ignore automatically generated bulk content, Apache leads with a 46.4% market share. nginx is the second most popular vendor, with a 21.8% market share, and is the only major vendor to consistently gain share in recent months. A similar percentage of both Apache’s and nginx’s sites are deemed to be active, 23.7% of Apache sites and 22.1% for nginx. In comparison, only 4.5% of sites using Microsoft server software are considered active, leaving Microsoft in 3rd place by this active sites metric with a 9.8% market share.

Apache, Microsoft and nginx all gained web-facing computers this month; however, nginx once again saw the only increase in market share. nginx gained 46,000 computers, a growth of 4.8% on last month, and now stands just shy of 1 million web-facing computers. Apache and Microsoft gained 31,000 and 11,000 computers.

nginx also continues to gain market share among the top million busiest websites, where it is now used by 27.9% of sites. Apache, while still holding a dominant position, continues to slowly lose market share, falling 0.55 percentage points to 43.2%.

Total number of websites

Web server market share

DeveloperJune 2016PercentJuly 2016PercentChange
Continue reading