Having trouble reading this email? Read online, Follow us on Twitter & Facebook, or Subscribe via RSS

In the September 2016 survey we received responses from 1,285,759,146 sites and 6,118,785 web-facing computers, reflecting large gains in both metrics: 132 million additional sites, and 138,000 more computers.

Microsoft made up the majority of this month's website growth, with the largest gain of 97 million sites, although it showed only modest increases of 5,200 web-facing computers and 693,000 active sites.

Apache was responsible for most of this month's additional web-facing computers, increasing its count by 87,000 to 2.8 million (+3.2%). Similarly, nginx made a 3.0% gain of 30,000 computers. However, Microsoft's 0.3% gain was not enough to stop its share falling by half a percentage point to 25.3% as a result of the gains made by Apache and nginx.

Although nginx made a healthy gain in web-facing computers, it lost more than 5 million active sites and 5,600 sites within the top-million. 27.6% of the busiest million sites now use nginx (-0.56 pp from last month), while Apache retains its lead with a 42.5% share.

Along with nginx, all of the major web server vendors suffered losses within the top million sites, largely due to the growth of OpenResty this month. More than 10,000 of the top million sites are now using OpenResty, compared with fewer than 4,000 last month, after millions of Tumblr blogs switched from nginx. As well as tumblr.com, basecamp.com — the home of the Basecamp web-based project management tool — ranks amongst the most visited sites to use OpenResty.

Tumblr's adoption of OpenResty has caused the web server to leap up the rankings to become the seventh largest web server vendor by websites, and fifth by active sites. This month, 87% of all OpenResty sites appear under the tumblr.com domain.

Although most OpenResty sites reside under the tumblr.com domain, the number of unique domains using OpenResty also increased noticeably this month.

Although most OpenResty sites reside under the tumblr.com domain, the number of unique domains using OpenResty also increased noticeably this month.

Switching from nginx to OpenResty is not such a paradigm shift as moving to, say, Apache or Microsoft IIS. The OpenResty web application platform is built around the standard nginx core, which offers some familiarity, as well as allowing the use of third-party nginx modules. One of the key additional features provided by OpenResty is the integration of the LuaJIT compiler and many Lua libraries – this gives scope for high performance web applications to be run completely within the bundled nginx server, where developers can take advantage of non-blocking I/O.

Another web server that has gained prominence over the past year is Cowboy, a small and fast modular HTTP server written in Erlang. Optimised for low latency and low memory usage, it is currently the fifth most common web server software installed on web-facing computers that accept HTTP connections. Most of the computers used by Cowboy servers are powered by the Heroku Cloud Application Platform and hosted at Amazon Web Services.

Total number of websites

Web server market share

DeveloperAugust 2016PercentSeptember 2016PercentChange
Microsoft445,105,75538.58%542,498,79642.19%3.61
Apache300,028,83226.01%316,042,28924.58%-1.43
nginx181,606,29715.74%186,529,03814.51%-1.23
Google22,111,4311.92%21,467,7291.67%-0.25
Web server market share for active sites

DeveloperAugust 2016PercentSeptember 2016PercentChange
Apache80,179,26946.34%80,274,07046.11%-0.23
nginx37,918,63521.92%32,364,05118.59%-3.33
Microsoft16,922,3249.78%17,615,03710.12%0.34
Google14,918,4948.62%14,302,5038.22%-0.41

For more information see Active Sites

Web server market share for top million busiest sites

DeveloperAugust 2016PercentSeptember 2016PercentChange
Apache427,90042.79%425,28942.53%-0.26
nginx281,58928.16%275,96627.60%-0.56
Microsoft109,22110.92%108,86910.89%-0.04
Google20,5952.06%19,8251.98%-0.08
Web server market share for computers

DeveloperAugust 2016PercentSeptember 2016PercentChange
Apache2,725,12945.57%2,811,94845.96%0.39
Microsoft1,543,21625.80%1,548,45025.31%-0.50
nginx1,019,10917.04%1,049,44917.15%0.11
Posted by Netcraft on 19th September, 2016 in Web Server Survey
Rank Performance Graph OS Outage
hh:mm:ss
Failed
Req%
DNS Connect First
byte
Total
1 Datapipe Linux 0:00:00 0.000 0.134 0.012 0.024 0.030
2 EveryCity SmartOS 0:00:00 0.008 0.100 0.065 0.131 0.131
3 Qube Managed Services Linux 0:00:00 0.013 0.129 0.059 0.119 0.119
4 CWCS Linux 0:00:00 0.013 0.197 0.071 0.147 0.147
5 Netcetera Linux 0:00:00 0.029 0.084 0.082 0.168 0.168
6 Aruba Windows Server 2012 0:00:00 0.034 0.186 0.083 0.175 0.175
7 Lightcrest unknown 0:00:00 0.042 0.142 0.012 0.029 0.051
8 Pair Networks FreeBSD 0:00:00 0.042 0.226 0.069 0.138 0.138
9 ServerStack Linux 0:00:00 0.046 0.112 0.061 0.122 0.122
10 XILO Communications Ltd. Linux 0:00:00 0.046 0.204 0.068 0.134 0.134

See full table

Returning to the top spot for the fourth time this year was Datapipe, without a single failed request, and an average connection time of just 0.012 seconds. Datapipe has managed to feature in the top ten for seven out of eight months so far this year and has maintained a 100% uptime record over the past ten years. In July, Datapipe announced an expansion of its presence in Europe with the opening of a new data centre in Moscow, becoming its 21st data centre worldwide.

In second place with just two failed requests was EveryCity, ranking in the top ten for a third consecutive month, and making its fourth appearance in the top ten this year. Based in London, EveryCity specialises in managed cloud hosting, and has maintained a 100% uptime over the last 6 months.

Third place this month goes to Qube Managed Services, who narrowly beat CWCS with the same number of failed requests but faster connection time. Placing in the top ten for the third month in a row, Qube has data centres in London, New York, and Zurich, offering cloud services, managed services, and colocation.

Linux continues to be the predominantly used operating system, powering six of the top ten company sites. However for the first time since June 2015, one of the top 10 was running on Windows.

Netcraft measures and makes available the response times of around forty leading hosting providers' sites. The performance measurements are made at fifteen minute intervals from separate points around the internet, and averages are calculated over the immediately preceding 24 hour period.

From a customer's point of view, the percentage of failed requests is more pertinent than outages on hosting companies' own sites, as this gives a pointer to reliability of routing, and this is why we choose to rank our table by fewest failed requests, rather than shortest periods of outage. In the event the number of failed requests are equal then sites are ranked by average connection times.

Information on the measurement process and current measurements is available.

Posted by Netcraft on 6th September, 2016 in Hosting, Performance

In the August 2016 survey we received responses from 1,153,659,413 sites and 5,980,524 web-facing computers. This reflects an increase of 80 million sites, but a loss of 78,000 computers.

While the overall number of sites increased this month, this growth was not felt evenly by each web server vendor: Microsoft gained the largest number of sites with an increase of 66 million, while second-placed Apache lost 41 million sites. Tengine, the nginx-based web server from Chinese online shopping giant Taobao, gained 28 million sites.

Whilst there were large changes in total number of sites, these were accompanied by much more modest changes in active sites – a more stable metric designed to ignore automatically generated bulk content. Apache and Microsoft both suffered small drops in the number of active sites, -0.5% and -0.8% respectively, whilst Tengine and nginx gained 120,000 (7.3%) and 81,000 (0.2%).

The majority of this month’s drop in web facing computers were running Apache, with a decrease of just over 107,000 (3.8%) using the open-source server. One of the primary contributors to this drop was the loss of a large number of consumer-NAS devices running Apache. While these devices have steadily increased in number since the start of 2016, this month has seen a marked decline. These devices are mostly connected via home internet lines and are therefore likely to come and go from month to month. As a result, the Apache losses this month are spread over a large number of consumer ISPs. On the other hand, Apache continued to see growth amongst web hosting providers.

A gain of 24,000 web-facing computers for nginx, the largest gain in web facing computers this month, once more boosts its market share, which now stands at 17.0%. Microsoft also experienced a small increase in market share, despite its loss of 4,000 web-facing computers, given Apache’s large loss this month.

Windows Server 2016 — which will be the main platform for Microsoft IIS 10.0 — is edging closer to its official launch at Microsoft's Ignite conference in September. In the meantime, developers can try out many of the new features in IIS 10 by either installing the latest Windows Server 2016 Technical Preview 5, or by installing the self-contained IIS 10.0 Express on Windows 7 SP1 or later.

More than 11,000 websites are already using Microsoft IIS 10.0, with almost all of these sites using a version of Windows Server 2016.

The previous month saw two new releases of the mainline version of nginx, mostly incorporating bug fixes and feature additions, while the release of Apache 2.4.23 addressed a security issue which could have allowed clients to gain unauthorised access to protected resources if a server was configured to use HTTP/2.

Several web servers were also updated following the disclosure of a set of vulnerabilities dubbed httpoxy. These vulnerabilities can affect web applications running in CGI or CGI-compatible environments.

The vulnerability stems from a simple namespace conflict where the client-provided HTTP Proxy header was placed into an HTTP_PROXY environment variable as is the custom for CGI applications; but where HTTP_PROXY was trusted by the application and used to configure an outgoing proxy.

This type of vulnerability was first discovered in libwww-perl more than 15 years ago, but in July it was found to be still exploitable in PHP and many other modern languages and libraries. Successful exploitation of these issues could allow a remote attacker to proxy outgoing HTTP requests made by a vulnerable web application, which may expose sensitive data.

To mitigate the httpoxy vulnerability, Apache 2.4.24-dev avoids populating the HTTP_PROXY variable from a Proxy header in httpd CGI environments. Similar mitigations have also been implemented in Lighttpd 1.4.41 and LiteSpeed, while nginx and Varnish have published mitigation advice.

Total number of websites

Web server market share

DeveloperJuly 2016PercentAugust 2016PercentChange
Microsoft378,655,75935.26%445,105,75538.58%3.32
Apache340,551,07431.72%300,028,83226.01%-5.71
nginx170,896,71615.92%181,606,29715.74%-0.17
Google22,552,9012.10%22,111,4311.92%-0.18
Web server market share for active sites

DeveloperJuly 2016PercentAugust 2016PercentChange
Apache80,607,09646.41%80,179,26946.34%-0.07
nginx37,837,33921.79%37,918,63521.92%0.13
Microsoft17,054,1669.82%16,922,3249.78%-0.04
Google14,859,5178.56%14,918,4948.62%0.07

For more information see Active Sites

Web server market share for top million busiest sites

DeveloperJuly 2016PercentAugust 2016PercentChange
Apache431,80943.18%427,90042.79%-0.39
nginx279,04927.90%281,58928.16%0.25
Microsoft110,20211.02%109,22110.92%-0.10
Google20,6812.07%20,5952.06%-0.01
Web server market share for computers

DeveloperJuly 2016PercentAugust 2016PercentChange
Apache2,832,38446.75%2,725,12945.57%-1.18
Microsoft1,547,44325.54%1,543,21625.80%0.26
nginx994,72116.42%1,019,10917.04%0.62
Posted by Netcraft on 24th August, 2016 in Web Server Survey
Rank Performance Graph OS Outage
hh:mm:ss
Failed
Req%
DNS Connect First
byte
Total
1 XILO Communications Ltd. Linux 0:00:00 0.008 0.206 0.065 0.131 0.131
2 Hyve Managed Hosting Linux 0:00:00 0.013 0.086 0.059 0.122 0.122
3 EveryCity SmartOS 0:00:00 0.013 0.107 0.063 0.125 0.125
4 Qube Managed Services Linux 0:00:00 0.017 0.135 0.059 0.118 0.118
5 ServerStack Linux 0:00:00 0.017 0.120 0.062 0.124 0.124
6 Webair Internet Development Linux 0:00:00 0.025 0.147 0.053 0.105 0.107
7 Datapipe Linux 0:00:00 0.029 0.140 0.011 0.024 0.030
8 Memset Linux 0:00:00 0.034 0.146 0.062 0.197 0.322
9 Swishmail FreeBSD 0:00:00 0.038 0.140 0.059 0.118 0.159
10 CWCS Linux 0:00:00 0.038 0.198 0.073 0.146 0.147

See full table

XILO Communications Ltd has moved up the table to become the most reliable hosting company site in July, with only two failed requests. This is the sixth time this year that XILO has appeared in the top ten, including two second places. XILO offers services from shared hosting to dedicated servers and operates from the UK.

Second place for July went to Hyve Managed Hosting, with only three failed requests and an average connect time of 0.059 seconds. Also based in the UK, Hyve Managed Hosting offers a wide range of cloud based hosting solutions, and has recently become a hosting partner for the Kentico CMS.

Third place was taken by EveryCity, with a marginally slower average connect time than Hyve of 0.063 seconds. This is the second time that EveryCity has made it into the top ten since its ISO27001 accreditation in March, and its 2-year uptime now stands at 99.998%.

After measurement from multiple geographical locations, UK-based organisations took the top four spots for July. The absence of Windows operating systems from the top ten has also continued, with the last appearance being in June 2015.

Netcraft measures and makes available the response times of around forty leading hosting providers' sites. The performance measurements are made at fifteen minute intervals from separate points around the internet, and averages are calculated over the immediately preceding 24 hour period.

From a customer's point of view, the percentage of failed requests is more pertinent than outages on hosting companies' own sites, as this gives a pointer to reliability of routing, and this is why we choose to rank our table by fewest failed requests, rather than shortest periods of outage. In the event the number of failed requests are equal then sites are ranked by average connection times.

Information on the measurement process and current measurements is available.

Posted by Netcraft on 3rd August, 2016 in Hosting, Performance

In the July 2016 survey we received responses from 1,073,777,722 sites and 6,058,513 web-facing computers. This reflects an increase of 28 million sites and 107,000 computers.

Microsoft and Apache continue to fluctuate between 1st and 2nd places for total number of websites, with Microsoft retaking the lead again this month after an increase of 36 million sites, and the loss of 20 million Apache sites. However, it is only in the hostnames metric that Microsoft leads, with Apache coming out on top by a considerable margin in all other areas - active sites, domains, IP addresses and web-facing computers.

Looking at the number of active sites, a more stable metric created by Netcraft to ignore automatically generated bulk content, Apache leads with a 46.4% market share. nginx is the second most popular vendor, with a 21.8% market share, and is the only major vendor to consistently gain share in recent months. A similar percentage of both Apache’s and nginx’s sites are deemed to be active, 23.7% of Apache sites and 22.1% for nginx. In comparison, only 4.5% of sites using Microsoft server software are considered active, leaving Microsoft in 3rd place by this active sites metric with a 9.8% market share.

Apache, Microsoft and nginx all gained web-facing computers this month; however, nginx once again saw the only increase in market share. nginx gained 46,000 computers, a growth of 4.8% on last month, and now stands just shy of 1 million web-facing computers. Apache and Microsoft gained 31,000 and 11,000 computers.

nginx also continues to gain market share among the top million busiest websites, where it is now used by 27.9% of sites. Apache, while still holding a dominant position, continues to slowly lose market share, falling 0.55 percentage points to 43.2%.

Total number of websites

Web server market share

DeveloperJune 2016PercentJuly 2016PercentChange
Microsoft342,605,66632.77%378,655,75935.26%2.50
Apache360,458,01834.48%340,551,07431.72%-2.76
nginx169,316,54716.19%170,896,71615.92%-0.28
Google21,662,6732.07%22,552,9012.10%0.03
Web server market share for active sites

DeveloperJune 2016PercentJuly 2016PercentChange
Apache80,372,47147.07%80,607,09646.41%-0.66
nginx36,632,01021.46%37,837,33921.79%0.33
Microsoft16,501,9049.67%17,054,1669.82%0.15
Google14,370,6078.42%14,859,5178.56%0.14

For more information see Active Sites

Web server market share for top million busiest sites

DeveloperJune 2016PercentJuly 2016PercentChange
Apache437,29643.73%431,80943.18%-0.55
nginx276,09527.61%279,04927.90%0.30
Microsoft110,84611.08%110,20211.02%-0.06
Google20,8592.09%20,6812.07%-0.02
Web server market share for computers

DeveloperJune 2016PercentJuly 2016PercentChange
Apache2,801,68947.07%2,832,38446.75%-0.32
Microsoft1,535,97125.81%1,547,44325.54%-0.27
nginx948,91915.94%994,72116.42%0.47
Posted by Netcraft on 19th July, 2016 in Web Server Survey

Subscription Details

To Subscribe: Go to http://www.netcraft.com/about-netcraft/email-subscription/
To Unsubscribe: Go to http://www.netcraft.com/cgi-bin/unsubscription