Fair Use: Please note that use of the Netcraft Blog is subject to our Fair Use and Copyright policies. For more information, please visit http://news.netcraft.com/fair-use-copyright, or email info@netcraft.com.

  1. June 2010 Web Server Survey

    In the June 2010 survey we received responses from 206,956,723 sites.

    This month's numbers show a mixed picture with two of the five major web servers gaining hostnames in the last month and the other three recording losses.  A similar trend was recorded for active sites.

    The largest increase in the number of hostnames served was for Google, which gained 3M due to increased activity at Blogger. The other web server to do better this month than last was Microsoft which served 1.8M more hostnames, 1.2M in the United States.  This was not the result of a single increase, but  significant growth at Microsoft Corp, GoDaddy Inc and VPLS Inc.

    nginx was the largest overall loser of hostnames, serving 2.2M fewer than last month. 1.6M of this loss came in China as a result of drops at China Telecom, China Unicom and the Data Communications Bureau of Tianjin Province; the result of stale blogs at sohu.com, blogbus.com and hexun.com being expired from the survey.

    Apache served 871k fewer hostnames worldwide and although not the largest overall loser, this figure actually masks much larger changes that occurred in individual countries.  The most significant took place in opposing directions in the United States and the United Kingdom. Apache served 2M more hostnames in the UK this month as a result of colossal growth at Real International Business Co, which saw an increase of more than 1.9M hostnames. However, all of the new hostnames attributed to them in the survey resolve to a single IP address. Meanwhile, in the US, Apache lost 3M hostnames at ThePlanet.com resulting in an overall loss of 2.5M in the country. The vast majority of these expired sites are due to Netcraft expiring stale accounts on the xorg.pl redirection service out of the survey.

    Total Sites Across All Domains August 1995 - June 2010

    Total Sites Across All Domains, August 1995 - March 2010

    Market Share for Top Servers Across All Domains August 1995 - June 2010

    Graph of market share for top servers across all domains, August 1995 - March 2010


    Developer May 2010 Percent June 2010 Percent Change
    Apache 112,663,533 54.68% 111,792,321 54.02% -0.67
    Microsoft 52,062,154 25.27% 53,865,345 26.03% 0.76
    Google 12,357,212 6.00% 15,375,950 7.43% 1.43
    nginx 13,490,726 6.55% 11,264,229 5.44% -1.11
    lighttpd 1,869,658 0.91% 1,704,797 0.82% -0.08

    (more...)

    Posted by Netcraft Admin on 16th June, 2010 in Web Server Survey Share

  2. iPad: New incentive for phishing site reporters

    As of 1st June 2010, the Netcraft Toolbar community has helped to block over 3 million phishing attacks worldwide. We incentivise phishing reports from the Toolbar community, and have now added the iPad to our list of incentives:

    Netcraft Mug(after 100 validated phishing reports)
    Netcraft Polo Shirt(after 400)
    Targus Laptop Backpack(after 1,000)
    iPad(after 5,000)

    On reaching 5,000 validated reports you become eligible for a monthly competition to incentivise large reporters.

    To report phishing sites to us, please use the form at http://toolbar.netcraft.com/report_url, or forward any phishing URLs or emails you receive to scam@netcraft.com.

    The Netcraft Toolbar, which is available for Firefox, serves as a giant neighbourhood watch scheme for the Internet. Members who encounter a phishing fraud can act to defend the larger community of users against the attack. Once the first recipients of a phishing mail have reported the attack URL, it is blocked for toolbar users who subsequently access the URL and widely disseminated attacks simply mean that the phishing attack will be reported and blocked sooner.


    Changes to Netcraft phishing report processing:

    Until recently we have rejected reports for URLs which were already blocked by the Netcraft Toolbar. We now accept reports on URLs which are already blocked if the phishing URL targets a different company to any previously accepted reports.

    For example, if we receive a report of a phishing URL at http://[example-domain]/directory/paypal targeting PayPal customers and we decide to block all URLs beginning with http://[example-domain]/directory/ a subsequent report of the URL http://[example-domain-here]/directory/HSBC targeting HSBC customers will now be accepted even though access to that URL is already blocked by our Toolbar.

    Each accepted report counts towards your incentives. Therefore, when you see a site with multiple phishing URLs targeting multiple companies, please report them all!


    Posted by Jason Robins on 11th June, 2010 in Netcraft Services Share

  3. Twitter still affected by networking error

    Twitter suffered from some noticeable site availability issues last night, and is still running at a higher than usual latency this morning:

    Twitter identified the cause of the incident as an "error with networking equipment", which caused the site to run noticeably slowly, sometimes even causing the fail whale to come out for a swim.

    A few hours later, an update revealed that the networking problem had not quite gone away, although the site does appear to be fully functional now. Features such as searching, sidebar data and profile image uploads were temporarily disabled last night to try and stabilize the site's performance.

    Netcraft's live uptime graphs for twitter.com can be viewed here.

    Posted by Paul Mutton on 10th June, 2010 in Performance Share

  4. Most Reliable Hosting Company Sites in May 2010

    Rank Company site OS Outage hh:mm:ss Failed Req% DNS Connect First byte Total
    1 New York Internet FreeBSD 0:00:00 0.011 0.155 0.085 0.182 0.441
    2 INetU unknown 0:00:00 0.015 0.080 0.060 0.133 0.335
    3 DataPipe FreeBSD 0:00:00 0.022 0.059 0.011 0.023 0.033
    4 Multacom FreeBSD 0:00:00 0.022 0.219 0.082 0.164 0.396
    5 Rackspace Linux 0:00:00 0.022 0.106 0.088 0.175 0.175
    6 One.com Linux 0:00:00 0.026 0.369 0.083 0.166 0.166
    7 www.navisite.com Linux 0:00:00 0.026 0.244 0.092 0.185 0.378
    8 iWeb Technologies Linux 0:00:00 0.030 0.096 0.064 0.128 0.128
    9 www.acens.com Linux 0:00:00 0.030 0.221 0.097 0.423 0.735
    10 www.aruba.it Windows Server 2003 0:00:00 0.034 0.858 0.089 0.180 0.180
    See full table

    The most reliable hosting company site in May was New York Internet, responding to all but three of Netcraft's requests. It was served by Apache running on FreeBSD.

    Established in 1996, New York Internet is located near Wall Street and maintains its own data centers. The company's core services include dedicated servers, colocation and virtual web hosting.

    INetU came a close second with just four failed requests.

    INetU is an enterprise managed hosting company located in Allentown, PA. They have been in business since 1996 and notably offer a 100% uptime service level guarantee. Managed services provided by INetU include MySQL and MS SQL database clusters, Exchange servers, virtualization and firewalls. Their clients include Fortune 500 companies such as Microsoft, Intel, Northrop Grumman and Canon.

    Five of May's top ten most reliable sites used Linux, while three ran on FreeBSD and one on Windows Server 2003.

    Netcraft measures and makes available the response times of around forty leading hosting providers' sites. The performance measurements are made at fifteen minute intervals from separate points around the internet, and averages are calculated over the immediately preceding 24 hour period.

    From a customer's point of view, the percentage of failed requests is more pertinent than outages on hosting companies' own sites, as this gives a pointer to reliability of routing, and this is why we choose to rank our table by fewest failed requests, rather than shortest periods of outage.

    Information on the measurement process and current measurements is available.

    Posted by Tom Robertshaw on 8th June, 2010 in Performance Share