In the September 2004 survey we received responses from 54,407,216 sites. The prevailing trends continue - rapid Internet growth of more than 1 million sites a month, and little change in market share among the leading web servers.

The static nature of the web server market is news in itself. The market shares for Apache and Microsoft have shown little change since November 2003, when shifts by domain registrars Register.com and Network Solutions contributed to a 2.8 percent one-month share gain for Apache. That is the longest period of market share stability in the history of our survey, as illustrated by our long-term trends graphic.

The trend remains intact despite the Download.Ject security event in June, which affected sites running Microsoft IIS 5.0 on Windows 2000. The incident appears to have spurred upgrades from Win2K to Windows Server 2003, rather than any noticeable shift toward Apache.

Total Sites Across All Domains August 1995 - September 2004

Total Sites Across All Domains, August 1995 - September 2004

Graph of market share for top servers across all domains, August 1995 - September 2004

Top Developers
DeveloperAugust 2004PercentSeptember 2004PercentChange
Apache3611222067.703691572167.850.15
Microsoft1131141421.211150275621.14-0.07
Sun16759403.1416715603.07-0.07
Zeus7447341.407503351.38-0.02
Posted by wss at 31 August 2004 in Web Server Survey | Print this Page
When the U.S. Justice Department stepped up its investigation of cybercrime, it found spam originating from an unexpected source: hundreds of powerful computers at the Department of Defense and the U.S. Senate. The machines were "zombies" that had been compromised by hackers and integrated into bot networks that can be remotely controlled to send spam or launch distributed denial of service attacks.

The Senate's computers have previously been criticized for lax security that allowed Republican political operatives to obtain confidential Democratic memos, which were then leaked to the press.

Posted by Rich Miller at 31 August 2004 in Security | Print this Page
The gigabyte is becoming the new storage benchmark for shared hosting accounts, as providers seek to compete on features like server space and bandwidth, rather than price. Go Daddy today expanded its shared hosting plans, offering 1 gigabyte of web server space on accounts priced at $9.95 a month. The move comes a week after Yahoo upgraded its shared hosting plans to include 2 gigabytes of storage in its $11.95 "starter" package.

Pair Networks, another large shared hosting provider, increased its storage allowances earlier this month to offer 1 gigabyte plans for the first time, limiting them to its premium webmaster-level accounts. That followed a similar move by Hostway, which doubled the server space on all its plans, pushing its platinum plan to 1.2 gigabytes of storage. 1&1 Internet currently offers 1 gigabyte on its $9.99 a month plan in the U.S. market, and 1.5 gigs on the equivalent plan in the UK.

Posted by Rich Miller at 24 August 2004 in Hosting | Print this Page
When the Indian ship State of Nagaland dropped anchor in the Sri Lankan port of Colombo Sunday, its crew probably expected it to be a routine event. Instead, the ship is being detained in Colombo under court order, with Sri Lanka Telecom asserting that its anchor severed the island nation's connection to the Internet.

"We have lost connectivity to global Internet due to failure in the international submarine cable system," SLT said in a statement, adding that a satellite uplink was being used to restore connectivity, but was only able to provide "limited capacity." The telecom provider said 800,000 customers were without Internet access, and attributed the cable failure to the State of Nagaland's anchor. The damage could take several more days to repair, the company said.

Posted by Rich Miller at 24 August 2004 in Performance | Print this Page
After days of intermittent performance problems, the BlogAds web site is experiencing an extended outage. BlogAds operates an advertising network for weblogs, and has seen a marked increase in traffic in recent months amid surging advertiser interest in blogs.

BlogAds Site Performance

Posted by Rich Miller at 24 August 2004 in Performance | Print this Page
Today's initial public offering by Google has been touted as a bellwether of investor confidence in Internet companies. It arrives as web hosting appears to be back in favor on Wall Street, with Business Week recently anointing the U.S. hosting industry "one of the hottest sectors in tech today."

Speculation about hosting IPOs is natural, since many of the industry's strongest recent performers are privately held, including Go Daddy, Rackspace, EV1Servers and The Planet. But the history of public companies and hosting is a tortured one, featuring more bankruptcies and dashed hopes than breakout successes. Despite Google's 20 percent jump in today's first day of trading, prospective hosting IPO prospects are treading carefully, weighing the pros and cons of public ownership amid market conditions that have caused several tech companies to postpone offerings.

Go Daddy President Bob Parsons discounts reports that the company is preparing for a public stock offering. "Sure, we think about it," said Parsons. "Do we expect to go public in the near future? No, we don't. But we're always looking at all our options."

Posted by Rich Miller at 19 August 2004 in Hosting | Print this Page
Will Yahoo's new $9.95 domain pricing prompt any other major players to adjust their pricing? Domain prices have been stable in recent months, a trend that continued when Yahoo dropped its pricing from $35 a year for a .com registration to $14.70 in late June.

But domain names are a price-sensitive business, in which discounters have succeeded in capturing the lion's share of sales, at the expense of full-price registrars such as Register.com and Network Solutions. The most successful player in the domain market is currently Go Daddy, which gained nearly half a million hostnames from March to July. Go Daddy currently prices a new .com domain at $8.95 a year, just a dollar less than Yahoo.

"Anytime someone the size of Yahoo does anything, you have to pay attention," said Bob Parsons, president and founder of Go Daddy, who is keeping a careful eye on competitors. "We looked at (pricing) when 1&1 entered the U.S. market," said Parsons. When 1&1 Internet launched its American unit in January with $5.99 domains, Go Daddy lowered its .com price to $7.95 for several months. Both providers are currently offering aggressive discounts on .us domains, which are priced at $2.99 at 1&1 and $4.95 at Go Daddy.

Retail Domain Name Prices, August 2004
Company One-year
.com price
 Primary Business  Primary Region
1&1 Internet AG $5.99 Mixed Hosting Europe
EV1Servers $6.49 Dedicated Hosting America
Hostway $6.95 Shared Hosting America
Web.com $6.95 Mixed Hosting America
AIT Domains $6.95 Mixed Hosting America
DomainSite $6.99 Domain Registrar America
Go Daddy Inc $8.95 Domain Registrar America
Yahoo $9.95 Shared Hosting America
RegisterFly $9.99 Domain Registrar America
Dotster $14.95 Domain Registrar America
FastHosts $16.37 Mixed Hosting Europe
Pipex $16.57 Mixed Hosting Europe
eNom $29.95 Domain Registrar America
Network Solutions $34.99 Domain Registrar America
Register.com $35.00 Domain Registrar America

Posted by Rich Miller at 18 August 2004 in Hosting | Print this Page

Ranking by Failed Requests and Connection time,
July 1st - 31st 2004

hoster_performance_july04.PNG

During July all of the hosters monitored experienced some failed requests, with three sites Pair Networks, Kattare.com, and Cee-Kay. sharing first place.

Operating systems used by the ten most reliable sites was quite mixed, with four running Linux, four FreeBSD and two Windows (Datapipe on Windows 2003 and EasyNet on Windows 2000).

Posted by mandy at 17 August 2004 in Performance | Print this Page
Yahoo has begun selling domain names for $9.95 as part of an aggressive move to expand its presence in domains and small business web hosting. Yahoo is also beefing up its shared hosting accounts, offering 2 gigabytes of server space and 2 gigabytes of e-mail storage with its $11.95 a month "starter" hosting package.

With 304,000 active sites and 600,000 hostnames, Yahoo is already a major player in small business hosting, with its turnkey online stores proving popular with e-commerce beginners. It previously sold domains for $35, adopting lower pricing in late June on a trial basis. It will continue to work with wholesale domain provider Melbourne IT.

"We think domains are an important on-ramp to the (small business) market," said Rich Riley, the vice president and general manager of Yahoo Small Business. "In looking at the domain market, we realized there was a great opportunity to increase our market share in this important sector."

Posted by Rich Miller at 17 August 2004 in Hosting | Print this Page
The web site for the FreeBSD operating system has been offline today. The outage for freebsd.org, which lasted approximately 20 hours, was caused by a hardware failure, according to representatives of the FreeBSD team.

FreeBSD.org Web Site Performance

A dynamically updating chart can be found here.
Posted by Rich Miller at 14 August 2004 in Performance | Print this Page
Leading U.S. weather web sites are managing a crush of web traffic from Internet users tracking the path of Hurricane Charley, which battered Florida Friday with winds reaching 145 miles per hour Friday, and is now making a second landfall along the East Coast in South Carolina.

Performance of Major Weather SitesThe Weather Channel web site at Weather.com had some reliability problems in the moments immediately preceding Charley's landfall Friday afternoon, but soon stabilized. The network offers round-the-clock coverage of weather, and experiences its largest audiences during major hurricanes. Its web site is hosted by UUnet, a unit of MCI.

The National Hurricane Center, the U.S. government's central source for hurricane information, has been available throughout the storm. The NHC site is hosted on government servers at the National Oceanic & Atmospheric Administration (NOAA).

Posted by Rich Miller at 14 August 2004 in Performance | Print this Page
The average phishing web site is online for about 54 hours, according to June data from the AntiPhishing Working Group (APWG), but some have been able to remain online for more than two weeks before being shut down or abandoned.

As awareness of phishing grows among consumers, hosting providers and law enforcement officials, the operating window for phishing crews is likely to shrink. But anti-phishing efforts haven't stemmed the continued growth of these scams, which combine technology and trickery to steal login information for web banking and online retail sites. There were 1,422 separate phishing scams in June, according to the APWG, a 52 percent increase from May. Nearly 500 attacks targeted Citibank alone.

Posted by Rich Miller at 14 August 2004 in Hosting, Security | Print this Page
Bruce Schneier, founder and CTO of Counterpane Internet Security, is one of the world's foremost security experts and author of the influential books Applied Cryptography, Secrets & Lies and Beyond Fear. His free monthly newsletter, Crypto-Gram, has over 100,000 readers. Interviewed by Glyn Moody, he discusses the lack of accountability of software companies, security through diversity, and why he would rather re-write Windows than TCP/IP.

Q. You've said that Applied Cryptography described a "mathematical utopia" of algorithms and protocols: what was the attraction of that utopia for you?

A. Cryptographic security comes from mathematics, not from people and not from machines. Mathematical security is available to everyone, both the weak and the powerful alike, and gives ordinary people a very powerful tool to protect their privacy. That's the cryptographic ideal of security.

Q. To what extent is the Internet and its global linking of computers together to blame for the destruction of that utopia?

A. They're entirely to blame, although "blame" is not really the right word. Cryptography worked well in the era of radios and telegraphs, where the threat was eavesdropping and mathematical cryptography could protect absolutely. But in the world of computers and networks, the threats are more complex and involve software and system vulnerabilities. Cryptography is much less able to provide security in this new world; that's the cryptographic reality of security.

Q. In Secrets & Lies you wrote that you had an epiphany about security in April 1999: can you say what it was?

A. As a cryptographic consultant, I did a lot of work analyzing operating systems. Invariably I would break them, but almost never would I break the mathematical cryptography. I eventually realized that cryptography is the strongest part of a very weak system, and that the system aspects around the cryptography - the software, the operating system, the network, the user interface, etc. - are much more important.

Q. One of the ideas in your book Secrets & Lies is that at the root of the computer security problems we face today is the lack of accountability by software manufacturers for their faulty products: why do you think that they have managed to evade the responsibility - unlike everyone else - despite the scale of the damage and the associated profits?

Posted by Glyn Moody at 13 August 2004 in Interviews | Print this Page
The consolidation of Europe's web hosting industry continued this week as VIA Net.Works announced that it is buying PSINet Europe for 18 million Euros (about $22.1 million). The deal follows on the heels of Via's acquisition of France's Amen/Agarik in January, one of numerous 2004 mergers in the European market .

Amsterdam-based VIA Net.Works hosts about 204k hostnames, and says it will add 4,000 new customers by buying PSINet Europe from majority owner Israel Corporation Limited. VIA will take over PSINet Europe operations in Belgium, France, Germany, the Netherlands and Switzerland, but PSINet Europe's U.K. operations are not part of the acquisition.

Posted by Rich Miller at 11 August 2004 in Hosting | Print this Page
Microsoft has shelved its bCentral brand and is now offering shared web hosting and domains directly to small businesses under the Microsoft name. The bCentral initiative had been the focus of Microsoft's small business strategy since 2000.

The www.bcentral.com domain now redirects to the new Microsoft Small Business Center, which offers shared hosting accounts starting at $29.95 a month, with domain names available for $20 a year. Existing bCentral customers will see no change in services, according to the frequently asked questions about the changes. Microsoft says more than 2 million customers have used bCentral services.

Posted by Rich Miller at 10 August 2004 in Hosting | Print this Page
Recent phishing-related security problems for Internet Explorer have prompted more than a few Windows users to sample alternative browers, including Firefox, the new open source browser from the Mozilla Project, as well as Opera.

But it turns out Internet Explorer isn't the only browser vulnerable to spoofing. On July 30 a published exploit demonstrated how to convincingly spoof a secure web site (in this case PayPal) in Firefox and Mozilla by using XML to alter the browser interface (Note: The spoof doesn't work in IE).

Posted by Rich Miller at 10 August 2004 in Security | Print this Page
Security problems involving banner advertising networks go beyond the recent distributed denial of service (DDoS) attack on DoubleClick. Banner networks, with their ability to place code on hundreds of outside sites, offer a vehicle for the rapid distribution of trojans and other malware, as well as a way to deface web pages. In a troubling development, phishing scams have recently demonstrated the ability to install keylogging trojans via banner ads.

The attack on DoubleClick caused performance problems for the network's clients. But in recent weeks, several smaller banner networks have been used to inject malicious code into web sites. In each case, the banner code serves as the trigger for a string of exploit scripts that trick Internet Explorer into downloading malware or spyware.

Posted by Rich Miller at 6 August 2004 in Security | Print this Page

In a column a few months ago, I looked at the range of anti-spam measures that were being developed. It seems appropriate to review how things have progressed since then. Although the graph of spam as a percentage of total email appears to be flattening it is still rising: even if it flattens further, Internet users are still faced with a future where the vast majority of their email is unwanted, to say nothing of offensive and downright dangerous.

As many predicted, anti-spam legislation – both in the US and European Union - has proved a damp squib. It is true that lawsuits have been filed (and some even won), but these are mainly to make the companies concerned look good Internet citizens. The effect on the thousands of small-scale, anonymous spammers operating from faraway countries is zero.

More promising are moves on the technical front to combine two similar approaches to dealing with one aspect of spam, that of address spoofing. The idea is simple – which makes it more likely to succeed. Those sending email register lists of their servers that can legitimately do so; when a message is sent, recipients can check whether the purported email address corresponds to the real server of origin. If it does not, it is likely to be spam.

The idea seems to have surfaced first in a 2002 memo from Paul Vixie, the principal architect of the BIND program. It was picked up later by Pobox.com's Meng Weng Wong, who formulated what became Sender Policy Framework (SPF). There is an explanation of how it works as well as a FAQ.

Posted by Glyn Moody at 5 August 2004 in Around the Net | Print this Page
The LinuxWorld Expo in San Francisco is the center of the Linux universe this week, celebrating the best Linux apps and advancing the cause of Linux in business. If you can't be at the Moscone Center, you can read the latest conference news at the LinuxWorld Expo web site, which naturally is powered by ... Windows Server 2003.

Linux enthusiasts are not alone in finding their "World" running on Microsoft software, as the Mac World Expo is also hosted on Windows Server 2003.

Posted by Rich Miller at 4 August 2004 in Dogfood | Print this Page
MyHosting.com CEO and President Tony Yustein is passionate and opinionated about Windows web hosting. A former regional director for Microsoft, Yustein founded Toronto's SoftCom Technology in 1997, and has built it into a significant player in both web hosting and webmail. In an interview with Rich Miller, Yustein shares his views on Microsoft's approach to hosting and security, and the road ahead for webmail and spam.

Q. In April MyHosting.com introduced a "blended hosting environment" for shared hosting customers that includes both Windows and Linux accounts within a single plan. You'd previously been a Windows-only provider. What led you to add Linux hosting, and to adopt this particular approach?

A. Simply put, demand from our customers. Our experience with our customers showed us that it's not the operating system which drives their choices, but the availability of the applications. Most popular web applications are either in Perl or PHP and use MySQL. We had two options: either install Perl, PHP and MySQL on Windows platform, or offer our customers the native platform which these tools are developed on. This is the main reason we decided to offer a native Linux offering at no additional cost to our web hosting customers. So they get 2 for the price of 1, both Windows Server 2003 and Linux under the same account.

Posted by Rich Miller at 4 August 2004 in Interviews | Print this Page

July was a strong month for hosting companies in the Netherlands, four of whom experienced one-month growth of 23 percent or more, as measured by our Hosting Provider Switching Analysis. New sites accounted for nearly all the growth at NXS, Leaseweb and ProServe BV, while NETHolding/Garnier Projects gained 3k hostnames from yet another Dutch provider, BIT.

New.net, which offers domain names outside the ICANN top-level domain (TLD) system, had the largest one-month improvement, as measured by percent growth in hostnames. New.net domains (which include .shop, .xxx, .ltd and .mp3) aren't recognized by the centralized domain name system, but are accessible to customers of partner ISPs or those who have downloaded software enabling New.net domains. New.net claims that 174 million Internet users worldwide are able to access sites using its domains.

Top Hosting Providers By Percentage Growth, June 04 to July 04
Hosting Company June 04 July 04 Growth %
Growth
Primary
Country
New.net 47,944 78,878 30,934 64.5% United States
ChinaNetCom 46,515 73,800 27,285 58.7% China
NectarTech 25,372 38,176 12,804 50.5% United States
Garnier Projects, NL 10,380 15,642 5,082 49.0% Netherlands
Host Basket NV 11,757 16,169 4,412 37.5% Belgium
NXS 17,616 22,245 4,629 26.3% Netherlands
B-one.nu 11,757 16,169 8,441 25.9% Denmark
Leasweb 41,490 51,372 9,882 23.8% Netherlands
ProServe BV 40,038 49,517 9,479 23.8% Netherlands
IKP/GTS 14,848 18,283 3,415 23.0% Poland

Posted by Rich Miller at 3 August 2004 in Hosting | Print this Page

In the heady early days of the Internet as a mass medium – the mid 1990s, say – one of the key acronyms was VOD: Video On Demand. The idea was that this wonderful new Information Superhighway (another phrase very much of that era) would mainly be used for downloading video content. It never happened – in part because people found using the hyperlinked Web a much richer experience, and also because the average bandwidth was simply insufficient.

But the VOD idea was not totally wrong. One of the drivers of Internet uptake among some users – the younger ones – was downloading music. The key breakthrough was the MP3 compression technology, since this allowed a complete song to be downloaded in a reasonable time even with the existing connection speeds.

MP3 is in fact a relatively old idea – a classic case of a solution in search of a problem. Although it has established itself as the de facto standard for music compression, things have moved on. For example, an updated version of MP3 called MP3Pro has been developed. A free player and encoder are available, but relatively few products support it.

Both MP3 and MP3Pro are proprietary standards. This has led to the creation of a completely free alternative, called Ogg Vorbis. Industry backing for the group behind Ogg Vorbis has come from the streaming company RealNetworks. The latter has awarded one of its Helix Community Grants to promote the format as part of its open source Helix platform.

Posted by Glyn Moody at 2 August 2004 in Around the Net | Print this Page

In the August 2004 survey we received responses from 53,341,867 sites, a gain of more than 1.2 million sites from July. The August increased marked the sixth time in the past year that the survey has shown a monthly gain exceeding 1 million sites. In the last 12 months, the Internet has grown by 10.2 million hostnames.

Market share remained steady among major web servers, with Apache making modest gains of 0.3 percent in hostnames and just under 0.2 percent in active sites. Microsoft's market share remains steady in the wake of a security event in June connected to Microsoft-IIS 5.0. As was noted last month, previous headline-grabbing worms and security events have had little direct impact on web server market share.

Total Sites Across All Domains August 1995 - August 2004

Total Sites Across All Domains, August 1995 - August 2004

Graph of market share for top servers across all domains, August 1995 - August 2004

Top Developers
DeveloperJuly 2004PercentAugust 2004PercentChange
Apache3512214667.373611222067.700.33
Microsoft1111566021.321131141421.21-0.11
Sun16566713.1816759403.14-0.04
Zeus7547211.457447341.40-0.05
Posted by wss at 1 August 2004 in Web Server Survey | Print this Page