September 2021 Web Server Survey
29th September, 2021
In the September 2021 survey we received responses from 1,188,038,392 sites across 264,360,621 unique domains and 11,368,033 web-facing computers. This reflects a loss of 23.4 million sites, but a gain of 627,000 domains and 40,300 computers.
The largest increase in both unique domains and active sites was seen by LiteSpeed this month, with gains of 571,000 (+9.3%) domains and 458,000 (+6.0%) active sites. Much of this increase was concentrated at a single hosting provider, NameCheap, where there were corresponding drops in the numbers of domains and active sites using Apache. As a result, LiteSpeed’s market share in the domains metric increased by 0.21 percentage points to 2.6%.
Cloudflare also saw strong growth in domains, with an increase of 519,000 resulting in a small increase in its market share to 7.90%. Amongst the million busiest websites Cloudflare had substantially the biggest increase in use, leaving it with an 18.0% market share. It is now just 44,000 sites or 4.4 percentage points of market share behind nginx in second position.
Other server vendors to see increases in terms of unique domains include OpenResty which grew by 314,000 domains, and market leader nginx which grew by 195,000. Despite having only the fourth largest growth this month, nginx maintained its 29.8% market share.
The number of web-facing computers using nginx has increased once again, whilst both Apache and Microsoft lost both in absolute numbers and market share. This month nginx saw an increase of 40,800 raising its market share to 37.2%. Apache and Microsoft each lost 0.24 percentage points of market share to leave them with 30.8% and 11.9% shares. LiteSpeed gained 4,660 computers (+5.9%).
| Developer | August 2021 | Percent | September 2021 | Percent | Change |
|---|---|---|---|---|---|
| nginx | 441,930,791 | 36.48% | 422,211,703 | 35.54% | -0.94 |
| Apache | 305,180,858 | 25.19% | 295,667,361 | 24.89% | -0.30 |
| OpenResty | 75,516,218 | 6.23% | 77,052,370 | 6.49% | 0.25 |
| Cloudflare | 55,830,630 | 4.61% | 56,362,363 | 4.74% | 0.14 |
Most Reliable Hosting Company Sites in August 2021
3rd September, 2021
| Rank | Performance Graph | OS | Outage hh:mm:ss |
Failed Req% |
DNS | Connect | First byte |
Total |
|---|---|---|---|---|---|---|---|---|
| 1 | www.choopa.com | Linux | 0:00:00 | 0.000 | 0.262 | 0.003 | 0.020 | 0.020 |
| 2 | Aruba | Linux | 0:00:00 | 0.000 | 0.412 | 0.005 | 0.026 | 0.026 |
| 3 | Bigstep | Linux | 0:00:00 | 0.000 | 0.200 | 0.062 | 0.125 | 0.125 |
| 4 | CWCS Managed Hosting | Linux | 0:00:00 | 0.000 | 0.250 | 0.068 | 0.134 | 0.134 |
| 5 | Hyve Managed Hosting | Linux | 0:00:00 | 0.000 | 0.143 | 0.073 | 0.148 | 0.148 |
| 6 | ServerStack | Linux | 0:00:00 | 0.000 | 0.214 | 0.100 | 0.201 | 0.201 |
| 7 | www.flexential.com | Linux | 0:00:00 | 0.000 | 0.248 | 0.104 | 0.208 | 0.208 |
| 8 | Pair Networks | Linux | 0:00:00 | 0.000 | 0.369 | 0.118 | 0.235 | 0.235 |
| 9 | GoDaddy.com Inc | Linux | 0:00:00 | 0.007 | 0.415 | 0.005 | 0.025 | 0.027 |
| 10 | Rackspace | Linux | 0:00:00 | 0.007 | 0.485 | 0.007 | 0.017 | 0.017 |
In August 2021, Choopa had the most reliable hosting company site: it responded to all of Netcraft’s requests, with an average connection time of 3ms. Choopa has appeared in the top 10 table five times in 2021 so far, also coming top in February and April of this year. Customers can choose from a range of cloud and managed solutions as well as register domain names.
Aruba, Bigstep and CWCS Managed Hosting appear in second, third and fourth places. Aruba came close to Choopa in average connection time, averaging 5ms. Bigstep and CWCS Managed Hosting were both slower, averaging 62ms and 68ms.
Aruba provides hosting, cloud and digital signature services, fiber optic internet, digital preservation, and much more, with data centers across Europe in the UK, Germany, Czechia, Poland, Italy and France.
Bigstep’s bare metal cloud hosting provides the flexibility of cloud hosting without the associated overhead and performance reductions of virtualization. The bare metal offerings are available in data centres in the UK and Romania.
CWCS provides dedicated servers along with cloud services, as well as a variety of other solutions. CWCS has data centres across the UK, as well as North America.
All of the top 10 hosting company sites used Linux in August, making Linux clearly dominant in the top 10 throughout this year.
Prankster acquires Taliban Government domain amidst gov.af limbo
2nd September, 2021
The US and others may have withdrawn from Afghanistan, but many Afghan Government websites and email addresses under the .gov.af top-level domain are still very much dependent on services hosted outside of the country – mostly in the US.
By taking control of Afghanistan, the Taliban has inherited these government domains and now shares web hosting and mail servers with several other governments around the world, including the UK Government. In many cases, emails sent to .gov.af domains will be routed through US-hosted servers, presenting intelligence opportunities if the new Taliban government were to continue using them.
Afghanistan's Internet: who has control of what?
30th August, 2021
Bagram, formerly the site of the largest US military base in Afghanistan.
Over the past few weeks, the Taliban have taken control of substantially the whole of Afghanistan, with just Kabul Airport and the Panjshir Valley presently controlled by the US Military and the National Resistance Front of Afghanistan respectively.
Yet the situation with Afghanistan’s internet infrastructure is quite different to what anyone following the mainstream media might reasonably expect, as Afghanistan’s key internet resources – domains, IP addresses, routing and government communications – are controlled by a diverse set of entities subject to Western jurisdictions.
Who is in control of the .af domain?
Presently, .af’s DNS is run using Anycast DNS
services
from Packet Clearing House, a San Francisco based
not-for-profit organisation, and Gransy, a Czech
registrar and registry services provider. Packet Clearing House provides free
Anycast DNS services to
“developing-country ccTLD registries”, and Gransy provides free Anycast DNS
services to ccTLDs with fewer than
10,000 domains – .af has around 6K domains and is well within Gransy’s
criteria for a free service.
August 2021 Web Server Survey
25th August, 2021
In the August 2021 survey we received responses from 1,211,444,849 sites across 263,733,974 unique domains and 11,327,711 web-facing computers. This reflects a loss of 4.99 million sites, but a gain of 1.64 million domains and 67,600 computers.
The number of unique domains powered by the nginx web server grew by more than a million this month, while Apache's count fell by 916,000. This has extended nginx's lead in the domains metric, giving it a 29.8% share compared with Apache's 25.5%.
OpenResty gained 234,000 domains, but its market share remained static at 14.5%, while Cloudflare gained 726,000 domains and increased its market share to 7.72%.
The number of web-facing computers using nginx has continued to increase, this month by 49,000 (+1.18%). There are now 4.19 million web-facing computers running nginx, compared with 3.52 million that run Apache. Microsoft follows in third place with 1.38 million computers.
The web-facing computers metric has painted a remarkably stable trend over the past several years, as is evident in the graph below, with both Microsoft and Apache steadily falling while nginx has progressively climbed to first overtake Microsoft in 2017, and then Apache during 2020. There has also been a rise in "Other" web servers, which includes several nginx-based spinoffs such as OpenResty and Tengine.
Websites in Afghanistan
The Taliban offensive in Afghanistan has obvious potential to upset the country's internet infrastructure, but the extent of any changes may be limited. Afghanistan has had a relatively small presence on the web throughout the past 20 years, and many of its sites were already hosted outside of the country and used generic top-level domains to avoid interference from the Taliban.
This month's survey found only 8,031 websites hosted in Afghanistan, and 23,205 sites that use Afghanistan's .af country-code top-level domain (ccTLD). More than two-thirds of the latter are hosted in the US, and more than 2,000 are hosted in Germany – although any site that relies on a .af domain would still be vulnerable to interruption by the country's new government, should it desire.
Nearly 1,000 of the .af sites are Afghan Government websites that fall under the .gov.af second-level domain – such as president.gov.af and kabul.gov.af – but surprisingly, less than half of these are hosted in Afghanistan, with the rest being hosted in the US, Germany, Singapore, France, Canada, UK, Netherlands, Ireland and India.
Even more surprisingly, dozens of the .gov.af sites hosted in the US and Germany are used to host webmail services, potentially putting Afghan Government communications in easy reach of external intelligence agencies.
Other vendor and hosting news
- Microsoft has announced the general availability of Azure Government Top Secret. The new air-gapped Azure regions are intended to handle national security workloads at the US Top Secret level.
- Microsoft also announced its new Azure Healthcare APIs, which provide pipelines to manage protected health information data at scale.
- Statistics collected by Azure DDoS Protection showed a shift towards attacks against web applications in the first half of 2021.
- Apache Tomcat 10.0.10 was released on 5 August, followed by Tomcat 10.1.0-M4 (alpha) and Tomcat 9.0.52 on 6 August, and Tomcat 8.5.70 on 16 August. All four of these releases correct the regression of an HTTP/2 flow control bug in their previous versions.
- OpenResty 1.19.9.1 was released on 6 August. This version of the web platform based on nginx and LuaJIT now uses nginx 1.19.9 (a mainline release from 30 March) as its core, and also includes some LuaJIT fixes.
| Developer | July 2021 | Percent | August 2021 | Percent | Change |
|---|---|---|---|---|---|
| nginx | 444,524,631 | 36.54% | 441,930,791 | 36.48% | -0.06 |
| Apache | 311,567,368 | 25.61% | 305,180,858 | 25.19% | -0.42 |
| OpenResty | 75,464,874 | 6.20% | 75,516,218 | 6.23% | 0.03 |
| Cloudflare | 54,611,856 | 4.49% | 55,830,630 | 4.61% | 0.12 |
FluBot Android malware now targets UK banks
24th August, 2021
FluBot has built up a community of compromised Android phones in the UK since April and in the past 24 hours has commenced monetising them by sending overlays for British Banks.
FluBot first appeared in 2020, targeting mainly Spanish banks, but recently it has spread its reach, with Australian, German and Polish banks all affected within the last few weeks. UK banks are now firmly in its sights, with HSBC and Santander the first to be affected, and Lloyds and Halifax following shortly after.