Over the last two years the most common reason for a Hosting Provider making the news was when the company went bust. Hoswever, outside of the mainstream newsflow, some companies have been growing strongly.

A table of the Hosting Providers who grew the fastest during 2002 is provided as an excerpt from our Hosting Provider Server Count. Companies are included in the filter if they started 2002 with more than 500 servers, finished with at least 1000, and grew at a rate of better than 33% year on year. This removes hosters which can show a significant percentage increase simply by virtue of starting small.

Of the top 4 companies in the table 3 have recently issued their financial results for 2002 which confirm their continued growth. (1&1 Internet , Colt , HostEurope ).

The top of the table shows that fast growth in the hosting industry is closely linked to providing good value at a low price. 1&1 and Host Europe both offer extremely cheap shared hosting packages, while Rackshack has more or less defined the market for low-cost dedicated servers. Colt is often amongst the cheapest quotes for bandwidth in the cities in which it operates.

Several of the leading dedicated server companies have produced annual growth over 40%. Additionally, many of the larger telecoms companies are showing good rates of growth of web servers on their networks, in part from Hosting Resellers and DSL and Cable connections as well as their own hosting operations.

Limitations of the Hosting Provider Server Count include the following;

• Only sites found by the Web Server Survey will be included. The number of hosts found running internet web sites by the Web Server Survey is large [over 40 million in April 2003], but not exhaustive.
• Sites are attributed to companies by performing a reverse DNS lookup on each responding ip address in the Web Server Survey. If reverse DNS lookups have not been configured or otherwise fail, the count for the company will correspondingly reduced. To mitigate this we provide an additional view of the data compiled by Netblock registration. In practice the most successful hosting companies seem to set up reverse DNS correctly.
• Backend machines such as database servers not running web sites will not be counted, as they are unseen from the Internet.
• At most one server will be counted for each site. Round robin DNS, reverse web proxies, load balancing products like Cisco Local Director and BIG-IP and some connection level firewalls hide multiple web servers behind a single hostname.

Full details of the Hosting Provider Server Count are available.

Netcraft has developed a technique for identifying the number of computers [rather than IP addresses] acting as web servers on the internet, and attributes these computers to hosting locations by reverse DNS lookups.

This provides an independent view, with a consistent methodology worldwide, on the numbers of web servers, the rate of growth over time, and the operating systems and web server technology used at each hosting provider worldwide.

The dataset is useful to hosting providers for competitive analysis, mergers and acquisitions, identifying international markets for organic expansion, and also to any organization selling to the hosting industry.

It is presented as an Excel spreadsheet where the user may pivot by country, operating system, hosting model [dedicated, shared, bulk/domain registry as calculated from the ratio of sites to servers], and drill down to inspect absolute numbers, rate of growth and technology deployed at individual companies.

The Netcraft Web Server Survey is a survey of Web Server software usage on Internet connected computers. We collect and collate as many hostnames providing an http service as we can find, and systematically poll each one with an HTTP request for the server name.

In the April 2003 survey we received responses from 40,100,739 sites.

Note that this graph shows only Operating Systems serving less than 40,000 hostnames

The number of sites running Windows Server 2003 has overtaken Solaris 9, in spite of the fact that Windows Server 2003 does not launch until later on this month.

Solaris 9 launched in May 2002. However, Sun seems to take relaxed view about envangelising new operating system versions; even www.sun.com is still running Solaris 8. www.microsoft.com is at the opposite end of the product advocacy spectrum and started running Windows 2003 last July.

www.sun.com is now reporting its server signature as "SunONE WebServer 6.0". We think that this is simply part of the rebranding of the web server away from Netscape-Enterprise, rather than a new product.

www.coke.com appears to have switched from AIX to Linux, but in fact this is a feature of it starting to use the Akamai network for its front page.

Some notable Netscape-Enterprise sites have switched to Apache based servers, including the Vatican, Kellogg's and NASA. Kellogg's also seem to have insourced their site back from IBM.

NASA are now running something called "NASA_Webserver/2003 (NASA) mod_jk/1.2.1-beta-1" on Novell Netware. We think that this is likely to be a locally modified Apache running behind a Novell ICS reverse proxy server. In contrast to Kellogg's, NASA appear to have moved the site off their own network to AT&T.

Meanwhile, www.walmart.com have made a change to their server signature to make it appear less obviously like a copy of Apache with a hand edited server header, and more like Microsoft-IIS. We speculate that forthcoming site enhancements at Walmart may include changing the name of the JServSessionId cookie.

Although JSP has a tiny fraction of the installed base of PHP and ASP, and numbers of specialist servlet web servers are completely dwarfed by Apache and Microsoft-IIS, Java related technology has a much bigger impact on the Web than the raw site numbers suggest. Over the last year JSP has been the fastest growing scripting technology after ASP.NET. JSP sites are often bigger, more complex, and better funded and run by larger organisations than sites using the more common scripting technologies.

The higher investment on these sites makes them attractive targets for hosting and site development companies, while the relatively large number of players in the application server market means that they are likely recipients of competitive upgrade offers. With Windows 2003 launching later on this month and providing some application server functionality out of the box, it is also likely that Java based sites will be strenuously encouraged to evaluate the .Net Framework.

Tracking sites using Java based application servers is not straightforward, and often requires inspection of the site content. In particular, sites using Microsoft-IIS or Netscape-Enterprise as a web server may be running servlet engines that do not provide a signature in the HTTP server header and tracking these servers has to be done through analysis of the site content.

With the proviso that a better and more accurate view can be had by taking more content from the site, and that sites using Servlet Engines with Apache, Microsoft and SunONE web servers would be not be included by this view, it is still possible to take a quick and simple view of what is going on from the HTTP server headers.

Netcraft is now publishing articles via an RSS feed which is available at http://news.netcraft.com/index.rdf.

Postings to the mailing list will also become more frequent, with articles continuing to cover technology adoption, security, hosting, and Netcraft services.

The Apache Project have announced that versions of Apache/2.0 up to and including Apache/2.0.44 are vulnerable to a denial of service attack. To fix the problem, the project has released Apache/2.0.45 which is available for download.

People running Apache servers should note that the vulnerability only applies to Apache/2.0 and not Apache/1.3. In this respect the bug is not a big threat to the stability of the web - it is a denial of service rather than a remote compromise and the number of sites running Apache/2.0 is relatively small. Almost 99% of Apache sites are on Apache/1.3 or earlier.

Since we started the Web Server Survey in 1995, a longstanding theme of Netcraft's internet exploration work has been the issue of how best to reassure webmasters and systems administrators that requests they may see originating from Netcraft's network are benign, and do not in any way convey aggressive intent.

Earlier today an RFC was published by Internet pioneer Steve Bellovin which addresses this scenario. Bellovin's idea is that the sender's intentions, whether good or bad, should be stated directly in the TCP header information using a security flag [termed the "evil bit" by Bellovin]. It is intended that network protection devices such as routers, firewalls and Intrusion Detection Systems should defend their networks against packets where the evil bit is set, but otherwise assume that traffic is benign. Groups aligning themselves with RFC 3514 include the FreeBSD project, [who have already coded an implementation] and the nmap scanner.