The Apache Web Server Project is now 10 years old, as noted over the weekend by Roy Fielding, a co-founder of the open source development project. "Ten years ago today, the Apache Group decloaked with the creation of the new-httpd archive and initial accounts on hyperreal.org," Fielding noted on the apache-httpd-dev mailing list.

Apache hit another milestone earlier this month when our Web Server Survey found 40 million sites now running on the Apache server, which powers nearly 70 percent of web sites.

Apache was detected on 658 sites in the initial Netcraft survey in August 1995, just six months after the project's launch, when its 3.5 percent market share was dwarfed by software from NCSA (57 percent) and CERN (19.7 percent). The Apache server reached 10 million sites in June 2000, 20 million in November 2001 and 30 million in November 2003.

In an interview with Netcraft last year, Apache co-founder Brian Behlendorf assessed the remarkable growth. "I imagine most of the growth continues to be either with the small mom-n-pop companies, or web hosting ISPs, or internationally - all places where price sensitivity is high, where the economic downturn is still causing budgets to be hurt, and there's willingness to consider an Open Source approach to solving a given problem," said Behlendorf. "I imagine the rise of related Apache projects, like the continued rise in use of mod_perl and Tomcat and our friends over at PHP, have only increased the confidence in using the web server for mission-critical situations."

Posted by Rich Miller at 28 February 2005 in Web Server Survey | Print this Page
At least four sites targeted by Artists Against 419 and its Mugu Marauder screensaver are now offline, although some target sites remain available. The Mugu Marauder is designed to exhaust bandwidth allotments for financial scam sites with repeated image requests.

Artists Against 419 targets web sites it has connected with advance fee (419) scams involving international money transfers. The group uses web applications and organized "flashmobs" of web users to target sites that remain online after hosting firms and law enforcement have been contacted.

When the Mugu Marauder was launched on Feb. 7, Netcraft began monitoring five sites on the list of target URLs published by Artists Against 419. Four of the five are now offline, with crownsecuritiesandfinance.com (removed from DNS) and www.firstglobaltrust.com (account terminated by web host) shutting down within days. Three sites housed at Chinese hosts lasted longer. Abbeytrustonline.com and bancoplatinum-online.com, housed at fz.fj.cn, became inaccessible last week. Swissroyallbank.com remains available on the Fujian Province Network, and continues on the Muru Marauder target list.

Abbey Trust web site performance
Swiss Royall Bank site performance

Posted by Rich Miller at 28 February 2005 in Performance | Print this Page

The development teams for Firefox and Opera have updated the browsers to address URL spoofing using Internationalized Domain Names (IDN), allowing users to visit IDN domains but be protected from phishing attacks. The attacks do not affect Microsoft's Internet Explorer, the most widely-used web browser, which does not support IDN names.

Firefox 1.0.1 will display IDNs as punycode in the browser's address bar, allowing users to detect phishing attacks using potentially deceptive uses of IDNs. The new approach can be seen on the original demo demonstrated by the Shmoo Group, which uses a Unicode link to display www.theshmoogroup.com in the status bar of affected browsers, but sent users to www.xn--theshmogroup-bgk.com. The status bar now displays the unspoofed URL:

Firefox 1.0 IDN Spoofing in Forefox 1.0

Firefox 1.0.1 IDN Spoofing in Forefox 1.0.1

Posted by Rich Miller at 27 February 2005 in Security | Print this Page
An update of phpBB has been released to address new security holes in the open source application. The disclosure comes on the heels of several recent security incidents involving phpBB, which is among the web's most popular web forum programs.

"One of the potential exploits addressed in this release could be serious in certain situations and thus we urge all users to upgrade to this release as soon as possible," the phpBB Group said in its advisory. The security fixes address multiple bugs that disclose the full path to system files in phpBB, which is powered by the PHP server-side scripting language. A vulnerability reported by iDefense could, under some configurations, allow malicious users to view system files.

Posted by Rich Miller at 22 February 2005 in Security | Print this Page
The free online encyclopedia Wikipedia has been knocked offline by a power outage in its data center. While the servers hosting the site were down only a short time, much of the site's content remained offline as Wikimedia staff worked on properly restoring data from MySQL databases.

"At about 14:15 PST some circuit breakers were tripped in the colocation facility where our servers are housed," WikiPedia reported in a message to users. "Although the facility has a well-stocked generator, this took out power to places inside the facility, including the switch that connects us to the network and all our servers. The sticky point is the database servers, where all the important stuff is."

Posted by Rich Miller at 22 February 2005 in Performance | Print this Page

Internet marketing firm Marchex Inc. has finalized a deal to pay a whopping $164.2 million for Name Development Ltd., which displays keyword advertising across a portfolio of more than 100,000 domains. The deal, along with the recent sale of a misspelled domain name for $112,000, offers evidence that mistyped URLs and other "accidental traffic" have become big business.

The pricetag on the sale of Name Development is more than the $155 million paid by SAVVIS Communications to acquire Cable & Wireless America, and nearly as much as the $176 million Freenet paid for the hosting operations of Germany's Tect AG. SAVVIS gained about 350K hostnames in the C&W deal, while Freenet acquired 2.2 million hostnames from Tect.

Posted by Rich Miller at 22 February 2005 in Around the Net | Print this Page
The Mozilla development team said today that it will disable a browser feature that allows URL spoofing and could leave users open to scams. Upcoming releases of the Firefox and Mozilla browsers will turn off support for Internationalized Domain Names (IDN) by default to protect users from the spoofing, which works in current versions of Firefox, Mozilla, Opera and the Safari browser for Macs. The affected browsers support IDN, while Microsoft's Internet Explorer does not.

The spoof exploits flaws in how the browsers interpret Unicode, a broad character set used in IDN that allows URLs to include non-English characters. Unicode can be used to craft "homographic" attacks, in which two different combinations of characters in an HTML link can display the same URL in the browser, but send users to different sites. URL spoofing exploits are useful to Internet phishing scams, making it easier to trick victims into sharing sensitive information with bogus web sites constructed by fraudsters.

Posted by Rich Miller at 15 February 2005 in Security | Print this Page
In another telecom merger with a huge hosting component, Verizon will acquire MCI for $6.7 billion, the two companies said today. As with last month's SBC-AT&T deal, the early headlines focus on consumer and business telecom issues and MCI's 15 million voice customers. But Verizon will also acquire the world's ninth-largest web hosting operation, as MCI houses 878K hostnames - more than hosting specialists The Planet, Interland or SAVVIS.

That huge hosting business isn't entirely a holdover from the dot-com days, either. In the last year MCI has added 213K hostnames for 33 percent growth. Only eight other companies have added more hostnames during the same period, with MCI's hosting growth outpacing that of Yahoo, Hostway and Tect AG, among others. The former WorldCom has added more than 61K hostnames in the past two months alone.

Posted by Rich Miller at 14 February 2005 in Hosting | Print this Page
The software updating sites for Microsoft and Symantec have performed smoothly over the past week in delivering critical security updates to millions of users. The updates were notable for the number of products and users affected, and the serious risks faced by unpatched systems, including remote exploits. Thus, while we highlight a non-outage, it's hardly a non-event.

Windows Update Site Performance

Symantec LiveUpdate Site Performance

Posted by Rich Miller at 14 February 2005 in Performance | Print this Page
Go Daddy's Super Bowl ad strategy has generated enormous media coverage and web traffic, providing a textbook example of how businesses can leverage the popularity of weblogs and Internet marketing. The ad marked a branding breakthrough for the company, which benefitted from blog-driven buzz around several aspects of its campaign.

Perhaps the biggest boost for Go Daddy was provided by NFL executives, who pressured Fox to cancel a scheduled second showing of the company's edgy commercial, launching hundreds of news stories (a Google news search finds more than 2,700 stories mentioning Go Daddy) and probably saving the company the $2.4 million fee in the process. Minutes after the game's conclusion, Go Daddy CEO Bob Parsons used his personal weblog to break the news of the ad's cancellation.

Posted by Rich Miller at 14 February 2005 in Hosting | Print this Page
The BitTorrent hub LokiTorrent has been shut down by a lawsuit from the Motion Picture Association of America (MPAA), with the eight-hour outage earlier today turning out to be the prelude to a closure. The site came back online briefly with BitTorrent-related content, but within hours that had been replaced by a notice from the MPAA.

"There are websites that provide legal downloads. This is not one of them," reads the new front page of lokitorrent.com. "This website has been permanently shut down by court order because it facilitates the illegal downloading of copyrighted motion pictures." An MPAA press release said LokiTorrent operator Edward Webber agreed to pay "a substantial settlement with even greater financial penalties for any further such actions," and was under court order to provide the MPAA with logs and server data.

Posted by Rich Miller at 11 February 2005 in Around the Net | Print this Page
The BitTorrent hub LokiTorrent has been offline for an extended period today. LokiTorrent, which is among the sites facing lawsuits over the use of BitTorrent in illegal file sharing, recently was listed for sale on the domain auction site Sedo. The site has more than 680,000 registered members, and in recent weeks has been averaging 185,000 visitors per day

Web site performnce for lokitorrent

A dynamically upgrading chart of www.lokitorrent.com is available here.

Posted by Rich Miller at 10 February 2005 in Performance | Print this Page
Hosting companies continue to slash prices on domain names in an effort to attract new small business customers. The latest price cut comes from Netfirms, a Toronto hosting provider that has begun selling domain names for $4.95 a year. That price undercuts Yahoo's $4.98 promotional rate, as well as 1&1 Internet's one-year .com price of $5.99, previously the lowest non-promotional pricing.

Netfirms specializes in hosting for the small business market, and currently hosts about 51,000 hostnames. Its domain policy allows up to five domains to be registered from the same billing address at the $4.95 price.

Retail Domain Name Prices, February 2005
Company One-year
.com price
 Primary Business  Primary Region
Netfirms $4.95 Shared Hosting America
Yahoo $4.98 Shared Hosting America
1&1 Internet AG $5.99 Mixed Hosting Europe
EV1Servers $6.49 Dedicated Hosting America
Hostway $6.95 Shared Hosting America
Stargate $6.95 Shared Hosting America
Interland $7.95 Mixed Hosting America
Web.com $7.95 Mixed Hosting America
AIT Domains $7.99 Mixed Hosting America
Go Daddy Inc $8.95 Domain Registrar America
RegisterFly $9.99 Domain Registrar America
Netcetera $13.00 Mixed Hosting Europe
Dotster $14.95 Domain Registrar America
FastHosts/UKReg $16.53 Mixed Hosting Europe
Pipex/123Reg $16.73 Mixed Hosting Europe
Network Solutions $34.99 Domain Registrar America
Register.com $35.00 Domain Registrar America
Posted by Rich Miller at 9 February 2005 in Hosting | Print this Page
The web site of anti-spyware activist Ben Edelman is back online after an extended outage, apparently caused by a distributed denial of service (DDoS) attack. Edelman's research documents the methods used to install adware and spyware programs, and has been used in legal cases against providers of advertising software.

"For much of Monday and Tuesday, as well as several hours last week, all of benedelman.org was unreachable," Edelman writes. "My prior web host, Globat, tells me I was the target of the biggest DDoS attack they've ever suffered - some 600MB+/second."

Posted by Rich Miller at 9 February 2005 in Performance, Security | Print this Page
The server hosting the main site for the phpBB bulletin board has been cracked, leaving the development team locked out of its primary server. The open source project's web site was compromised using a vulnerability in a separate program, AWStats, which was announced Jan. 17 and has also been used to hack several popular weblogs in recent days.

The phpBB.com site blamed the intrusion on "a group of politically motivated hackers" wishing to publicize an agenda. "While the group who did this say they changed only a single password, we have lost all access to the server, " the phpBB.com team states. "This means we cannot access the system even in single user mode." The compromised server is being shipped from the project's data center to its server manager, meaning the site is unlikely to be restored immediately.

Posted by Rich Miller at 8 February 2005 in Security | Print this Page
A sampling of Super Bowl advertisers' web sites shows few problems from traffic generated by ads in the NFL championship game, which was watched by as many as 145 million viewers in the U.S.

The exception is the web site for War of the Worlds, the upcoming Steven Spielberg film adaptation of H.G. Wells' tale about a Martian invasion of earth. The performance of waroftheworlds.com was stable Sunday night, but slowed dramatically at the start of the U.S. business day Monday, suggesting a flurry of "morning-after" visits.

Web site performance for waroftheworlds.com

Posted by Rich Miller at 7 February 2005 in Performance | Print this Page
All non-Microsoft browers include a flaw that allows URL spoofing using Unicode characters, which can be exploited by phishing scams seeking to steal login information for online banking accounts. The spoofing flaw, which is demonstrated on the web site of the Shmoo Group, works in the Firefox, Mozilla and Opera browsers, as well as the Safari browser for Macs.

The spoof exploits flaws in how the browsers interpret Unicode characters. A link using Unicode characters to replace the letter "a" in "Paypal" will display as www.paypal.com in the browser, but send users to www.xn--pypal-4ve.com - which then displays "www.paypal.com" in its address bar. A similar spoof works on SSL-enabled URLs (https) commonly used on banking and e-commerce sites.

Posted by Rich Miller at 7 February 2005 in Security | Print this Page

Several UK betting sites have experienced lengthy outages today as betting action mounts ahead of Sunday's Super Bowl. The simultaneous downtime at UK Betting and TotalBet were preceded by a similar period of slowed response time at early Friday.

(UPDATE, Feb. 8: In our initial post we indicated that UKBetting and TotalBet are hosted at Prolexic, which specializes in defending against distributed denial of service (DDoS) attacks. Prolexic hosts IP addresses for UKBetting and TotalBet, but does not host customer servers or web files. Its systems deflect DDoS attacks, forwarding legitimate traffic to clients' servers. "Our network operated at 100% uptime during the entire Super Bowl week including the entire time during the reported Totalbet/UK Betting failure," said Prolexic CTO Barrett Lyon, who said the outage was caused by technical failures elsewhere, and not related to a DDoS attack.)

Betting sites are frequent targets of scams that seek payoffs by threatening a site operator with DDoS attacks, which gain leverage when timed to heavy betting events, when downtime is more costly. It is estimated that online betting sites will handle at least at $450 million in wagers on Sunday's game between the New England Patriots and Philadelphia Eagles.

suptotalbet.png

supukbetting.png

Netcraft is monitoring the performance of twenty leading UK Internet Gambling Sites, with dynamically updating graphs available here.

Posted by Rich Miller at 5 February 2005 in Performance, Security | Print this Page
How does Google plan to use its new status as a domain registrar? Speculation abounds. One of the most intriguing theories, outlined at Datamonitor, is that Google will use its access to the list of recently sold domains to clean up its search results, resetting a site's "PageRank" when its domain changes hands.

That would be consistent with Google's indication that it will use its ICANN accreditation to "learn more about the Internet's domain name system ... While we have no plans to register domains at this time, we believe this information can help us increase the quality of our search results," the company said in a statement. As a public company, Google is unlikely to publicly misstate its intentions, lest it face scrutiny from regulators and investors.

Even if it doesn't enter the registry business, Google's plans could affect the price of domain sales on the secondary market. The strategy outlined by Datamonitor, citing "a source claiming knowledge of Google's plans," would make it more difficult for domain owners to benefit from a strong Google ranking when they sell a domain.

Posted by Rich Miller at 2 February 2005 in Hosting | Print this Page

Ranking by Failed Requests and Connection time,
January 1st - 31st 2005

Datapipe, which was the most reliable hosting provider for the second half of 2004, got the new year off to a strong start with a faultless performance in January, with no failed requests from any of our measurement points. It was the first flawless month for a hosting provider since last March, when German hoster Komplex had zero failures.

Datapipe's web site is powered by Windows Server 2003. This month's top 10 includes four sites running on Linux, two on Windows Server 2003, two on FreeBSD, one on Solaris 9, and one site (Interland) on Windows 2000.

Hoster Performance January 2005

Posted by mandy at 1 February 2005 in Hosting | Print this Page

February 2005 Web Server Survey Finds 40 Million Sites on Apache

In the February 2005 survey we received responses from 59,100,880 sites, an increase of 906,044 sites from last month.

This month's survey marks a significant milestone for Apache, which now serves more than 40 million sites. The open source Apache server reached 10 million sites in June 2000, 20 million in November 2001 and 30 million in November 2003. Apache was detected on 658 domains in the initial Netcraft survey in August 1995, when its 3.5 percent market share was dwarfed by software from NCSA (57 percent) and CERN (19.7).

Apache seems to have regained momentum in its ongoing battle for market share with Microsoft. After nearly no change in server market share in 2004, Apache extended its lead over Microsoft by 1 percent last month and another 0.4 percent this month, and now runs on 68.8 percent of web sites, compared to 20.9 percent for Windows servers.

Total Sites Across All Domains August 1995 - February 2005

Total Sites Across All Domains, August 1995 - February 2005

Graph of market share for top servers across all domains, August 1995 - February 2005

Top Developers
DeveloperJanuary 2005PercentFebruary 2005PercentChange
Apache3982136868.434068114068.830.40
Microsoft1213744620.861232211120.85-0.01
Sun18300083.1418357183.11-0.03
Zeus6901931.196185991.05-0.14
Posted by wss at 1 February 2005 in Web Server Survey | Print this Page