In the January 2019 survey we received responses from 1,518,207,412 sites, 228,607,903 unique domains, and 8,209,715 web-facing computers. This reflects a loss of 138 million sites, and gains of 768.9k domains, and 61.9k web-facing computers.

The vast majority of the loss of sites this month was seen for those using Microsoft web server software — dropping by 203 million sites (-29%). While much of this loss was concentrated at a single hosting provider and made up of automatically generated sites, Microsoft suffered losses in all metrics this month, albeit with much smaller reductions elsewhere. While Microsoft lost more than two hundred million sites in a single month, the net loss of domains was just 89k. Much of this drop can be attributed to IIS 6.0 and 7.5, while the latest version 10.0 saw a gain of 89k domains, and IIS 8.5 gained 164k.

nginx continues to gain market share in the web-facing computer metric, with the largest increase of 47k computers this month being more than double that of Apache's 21k gain. In the domains market nginx remains at somewhat of a plateau, with a loss of 144k domains taking its market share down to 22.7% — just 0.2pp higher than its share in April 2018. The largest factor this month — a single domain parking company, Bodis, moving all of its parked sites over to OpenResty. While the survey tracks these two products separately, OpenResty makes uses of the nginx core, integrating it with additional Lua-based modules.

Apache experienced a large gain in the domains metric this month with an increase of 245k. However, even with the losses seen for both Microsoft and nginx, it was not enough to boost Apache's market share which remains at 32.5%. The largest gain in domains came again for Cloudflare with an increase of 500k. Cloudflare predominantly uses its own server software originally based on nginx. OpenResty also saw greater gains than the market leader Apache, increasing by 388k with help from the movement of sites from nginx at Bodis.

Apache has released an update to httpd 2.4.38 to address an "important" remote DoS vulnerability, which allowed remote attackers to trigger an infinite loop through client-initiated renegotiation on servers using httpd 2.4.37 and OpenSSL version 1.1.1 or later. This is the first "important" level security issue in Apache HTTP Server since July 2017.

Continue reading

In the December 2018 survey we received responses from 1,656,556,205 sites, 227,839,033 unique domains, and 8,147,795 web-facing computers. This reflects a gain of 4.37 million sites, 1.09 million domains, and 98.9k web-facing computers.

Whilst Apache's server software remains the market leader in most metrics, its share continues to erode in favour of competing products. In December 2018, Apache's flagship server product, httpd, saw a net decrease of 938k domains (-1.27% from last month), 28.6 million sites (-8.43%), and 848k active sites (-1.49%). Whilst another Apache product, known as Coyote, grew by 151k domains this month (+32.6%), the majority of the increase is attributable to parking pages, rather than sites with unique content. Apache's share of the top million sites has been falling steadily over the past few years, and is now down to 33.04%. Although it still holds the largest share, its margin is rapidly shrinking, and its dominance will likely be challenged by nginx in a year's time. Despite these losses, the number of web-facing computers running Apache software does, however, continue to grow, with an increase of 22.8k (+0.73%) this month.

nginx showed the fastest growth, having increased its domain count by 624k (+1.21%) this month. It also saw a 247k increase in active sites (+0.60%) — whereas Microsoft and Apache both saw losses — and has consistently seen large increases in its web-facing computer count. nginx has now reached 2.28 million web-facing computers, a significant 39.9% growth over the past 12 months compared to Apache's 4.98% and Microsoft's 1.93% over the same period. nginx saw two new releases in during November, fixing three CVEs, as well as introducing a few minor features and bug fixes.

Microsoft's server software holds the greatest market share when it comes to total number of sites. With over 688 million, it now has more sites than nginx (358 million) and Apache (314 million) combined, representing 41.53% of the market. This month Microsoft experienced an increase of 35.9 million sites and 246k domains. Much of the domain increase was seen at Amazon (+146k) and GoDaddy (+189k). Microsoft presently powers 9.33% of the world's top one million websites. Microsoft's top million share has seen some fluctuation over the year, with a slight decrease of 0.13pp this month, but only 0.30pp over 12 months.

Some of the large increase in overall domains this month can be seen at Cloudflare, which predominantly uses its own server software originally based on nginx. 8.20 million domains are currently served from servers identifying themselves as Cloudflare — 373k more than last month. At Google, usage of GSE (Google Servlet Engine) dropped massively from 897k domains down to 228k in favour of another google server, GHS, which is often used purely for redirects.

Continue reading

In the November 2018 survey we received responses from 1,652,185,816 sites, 226,752,928 unique domains, and 8,048,899 web-facing computers. This reflects a loss of 21.3 million sites, but a gain of 1.7 million domains and 121 thousand web-facing computers.

The largest contributor to the increase in domains this month came from sites running on Microsoft server software, with an additional 1.18 million domains. The growth was concentrated at GoDaddy on domains running IIS 7.5.x, which took up 1.16 million of the increase. In addition to newly detected IIS domains, and a movement of some domains from nginx, many existing domains running previously unknown IIS versions also reported as IIS 7.5.x this month, resulting in the total number of domains for this version almost doubling to reach 12.7 million. This makes IIS 7.5.x the most common version seen by the survey, 2.7 million domains ahead of the newer 8.5.x version in second place, which first saw release in 2013. Despite the large gain in domains, Microsoft experienced losses in most other metrics, including a significant loss of 3.14 million active sites. Many of the domains gained at GoDaddy are likely to be holding pages, contributing only a small increase to the number of IIS active sites hosted at the company.

nginx experienced the largest loss in domains this month of 560 thousand, largely caused by a drop of just over 1 million domains at GoDaddy. Nginx has been experiencing a steady rise in market share by domains for many years, however this has now remained relatively static for the last 6-months at 23%. nginx remains just under 3 percentage points behind Microsoft’s 26% market share. Meanwhile though, nginx has continued to show strong growth in web-facing computers, with the largest increase this month of 51 thousand. Here its steady market share increases have shown no such pause, and it holds almost 28% of the market. Apache and Microsoft followed some way behind in web-facing computer gains, with increases of 13 thousand and 12 thousand, both experiencing small losses in market share as a result.

Continue reading

In the October 2018 survey we received responses from 1,673,535,333 sites, 225,042,277 unique domains, and 7,927,795 web-facing computers. This reflects a gain of 31 million sites, 2.4 million domains and 142 thousand web-facing computers.

Nginx contributed the majority of this month's growth in terms of both domains and web-facing computers. Over 1.6 million additional domains were running nginx this month, taking its total up to 52 million. Combined with a loss of 444 thousand domains using Microsoft web server software, nginx now stands only 5 million domains behind Microsoft's second place spot. Apache remains in the lead, a further 18 million domains ahead. Despite regular gains in absolute numbers, including an increase of 200 thousand this month, Apache is continuing to experience a steady decline in market share. In terms of web-facing computers, nginx's gain of 70 thousand was almost twice that of Apache and Microsoft combined, which increased by 19 thousand and 16 thousand computers respectively.

Apache's active sites market share took a large hit this month, dropping over 8 percentage points down to 30%. The loss of 13 million active sites was concentrated at the Skyrock blogging platform, where sites stopped including a server banner for HTTP requests this month, meaning they are included in the "Other" category. However, the HTTPS version of these sites still appear to be running on Apache web servers returning 'Server: Apache' headers.

OpenResty gained 160 thousand domains (+6%), ratcheting up its total to 3 million, overtaking LiteSpeed at 2.9 million domains and becoming the fifth largest web server by number of domains. The OpenResty web platform integrates the standard nginx core with a LuaJIT compiler and a number of Lua libraries and third-party modules to run powerful web applications within the web server itself.

Netcraft's Web Server Survey continues to see strong growth among many of the new gTLDs. The .app and .icu gTLDs have shown the greatest gains among new TLDs launching in the last 6-months. The number of domains responding in this month's survey increased by 11 thousand since September for Google's .app domain, to over 236 thousand domains. Registrations for .icu domains (short for "I See You") increased by 10 thousand since September, a 30% increase to 42 thousand domains. This growth for .icu has also seen the number of active sites more than double, to just over 6 thousand.

Continue reading

In the September 2018 survey we received responses from 1,642,339,233 sites, 222,628,534 unique domains, and 7,785,976 web-facing computers. This reflects gains of 1.1 million unique domains and 28,000 web-facing computers, but a loss of 19 million sites.

Despite the overall increase in number of unique domains this month, all of the major web server vendors experienced losses. The largest gains in September came from lesser known server software — Pepyaka increased by just over 2 million domains, and DPS increased by 893k domains — with both returning to previously seen usage levels after a couple of months of near absence from the survey.

DPS (Data Protection Server), currently the 11th largest server by domains, is used exclusively by GoDaddy to host customer sites that have been created with its Website Builder tool. Last month saw a temporary swing on a single GoDaddy IP Address from DPS to Microsoft, accounting for both last month's Microsoft gains, and this month's loss.

Pepyaka, now the 7th largest server by domains, was last seen in the survey in large volumes in June 2018, being primarily used by Wix web development platform on Amazon AWS infrastructure. Wix has been a long-time user of nginx, and originally moved all user traffic to the commercial NGINX Plus product to future-proof its load balancing needs. The version numbering used by Pepyaka (currently 1.13.10) combined with Wix's previous usage of nginx suggests that it could be based on the March 2018 mainline version of nginx. The loss of Pepyaka from the survey two months ago coincided with Wix moving its customers' sites from Amazon to Cogent Communications. The return of Pepyaka in the September survey coincides with a similar movement of its customers' sites from Cogent Communications to a combination of Wix's own and Google's infrastructure.

In the web-facing computer market, nginx was the only major web server vendor to experience a gain this month, with an increase of over 41,000 (+2%). Unusually both Apache and Microsoft saw a small loss in absolute numbers of web-facing computers this month, dropping 4,900 and 9,500, in addition to their on-going gradual declines in market share. This has resulted in nginx's market share rising to 27.0%.

Continue reading

In the August 2018 survey we received responses from 1,661,467,123 sites, 221,524,704 unique domains, and 7,758,309 web-facing computers. This reflects a loss of 2.21 million sites, but a gain of 952k domains and 23.9k web-facing computers.

While the Apache web server remains the current leading platform in terms of its total number of domains, computers, active sites, and its proportion of the top million busiest sites, it continues to lose market share. All of Apache's figures decreased this month, continuing a slow long-term decline in most metrics. However, Apache continues to experience long-term growth in the absolute number of web-facing computers of approximately 200k per year, but is still losing overall market share. Over the past 12 months, Apache's usage amongst the top million sites has steadily decreased from 39.1% to 34.8%, and the number of domains using its server software has fallen from 83.7 to 75.3 million.

Microsoft's web servers power the largest share of sites, increasing its total from 670 to 675 million this month, representing a 40.65% share. Microsoft servers also experienced the largest growth in terms of domains this month, with an increase of 1.74%, adding just short of a million additional domains to reach a total of 58.4 million. The vast majority of sites using Microsoft web servers run IIS 7.x, which accounts for over 500 million sites. In comparison, IIS 8.x can only be found on around 50 million sites. Despite this, IIS 7.x and 8.x can both be seen on a similar number of computers—562k and 529k respectively. A large portion of IIS 7.x's larger site count can be attributed to link farming, where many sites are often hosted on just a few computers.

Although nginx doesn't yet lead in any metric, it continues to show significant growth. Whereas Apache and Microsoft servers have both lost active sites, nginx has been gaining in numbers, having increased 17.9% over the past year up to 41.9 million—a 22.67% market share. nginx has also increased its total number of web-facing computers by 41.0% over the past 12 months to reach 2.06 million, whereas Apache's and Microsoft's totals have seen comparatively little change of +7.9% and -0.16% respectively. Long-term nginx growth can be seen in all metrics except for the less stable site count. Over the past 12 months, nginx has gained 20.2% more domains, increasing its total to 50.9 million to hold a 23.00% share.

Web giants doing it their way

Apache, Microsoft, and nginx have each achieved their widespread popularity in the server market due to their general availability, but many large companies in the web industry choose to roll out their own solutions. Web giants such as Google, Cloudflare, Alibaba, and Amazon have each turned to creating or modifying their own specialised server implementations to suit their own unique requirements.

Google's custom server software operates on over 23.1 million hostnames and 2.0 million domains. Google open sourced part of its software, the Google Servlet Engine, at the end of 2008, but the software has not received any official public updates in 9 years. Despite this, servers identifying themselves as "GSE" make up over 75% of the active sites hosted by Google itself, with a large portion of those sites constituting Google's Blogger service (blogspot.com). In fact, the Google Servlet Engine was identified on 13.9 million active sites, which is 2.4 million more than all of Microsoft's server software combined, granting it third place in this metric, behind only Apache and nginx.

Taobao, China's largest online marketplace and part of Alibaba Group, developed their own fork of nginx. The fork, known as Tengine, was released back to the community as open source, leading to wider adoption. Tengine now runs on 56.8 million sites, making it the fourth most popular web server by this metric, despite it having only 1.2 million domains.

Cloudflare uses its own custom stack in order to provide content for 18.2 million sites and 6.7 million domains. Cloudflare historically identified their servers as "cloudflare-nginx", however in early 2018 Cloudflare transitioned to identifying their servers as simply "cloudflare" due to the ongoing evolution of their stack. These "cloudflare" servers are now the fourth most commonly identified in terms of total domains.

Continue reading