Stepping up its campaign against the Linux operating system, Microsoft has released file and Web serving benchmark results that, it claims, show that Linux on the mainframe lags behind Windows 2003 on Intel systems in terms of performance for the money.
Microsoft ran the benchmark tests in response to what it believes were IBM's unsubstantiated claims about the benefits of running Linux on its mainframe hardware, according to Microsoft General Manager of Platform Strategy Martin Taylor.
"IBM was making some claims and customers were trying to figure some things out and didn't have the facts in front of them," he said. Taylor, who recently became Microsoft's Linux point man, has promised to focus on facts instead of emotional arguments when criticising Linux and open source.
The benchmark results appear to be a first effort in that direction.
It will not be the last. The company has also commissioned Forrester Research to prepare a study comparing Windows to Linux, according to a Microsoft spokesperson who declined to comment on the specifics of the report.
The benchmark results discredited IBM's contention that a z900 mainframe processor running Linux could perform as well as three or four Intel processors running Windows at the same clock speed, Taylor said.
"One Linux image on one zSeries CPU performed at about the same as Windows NT 4 on one 900MHz Intel processor," he said. "Windows 2003 outperformed it. No question."
However, Microsoft was unable to reveal at least one important fact relating to today's numbers: the source of IBM's alleged claim that a z900 processor running Linux could perform as well as three or four Intel processors running Windows.
Microsoft maintains that the claim is being made to customers by IBM sales staff, but it was unable to provide any evidence of this.
An IBM spokesman contacted about the issue knew nothing about this specific claim.
One industry observer welcomed Microsoft's benchmark numbers.
"God help me for saying this, but I think Microsoft has made a genuine contribution here," IT consultant, Rudy de Haas, said.
De Haas has written about Linux's performance on the mainframe under the pseudonym Paul Murphy.
He has criticised IBM in the past for not providing information on Linux's mainframe performance. The numbers, though they did not come from an ideal source, were significant, he said.
"There are several things you could use to raise questions about what (Microsoft) did, but the real bottom line is that no one else has done it," de Haas said.
The reason Linux mainframe benchmarks are so scarce is that they simply may not matter to customers, according to IDC analyst Dan Kusnetzky.
"The bigger question is, why would people consider putting Linux on the mainframe?" he said. "Performance might be a secondary or tertiary issue. It may be an attempt to lower the cost of maintenance, and the raw performance may have been good enough for the task at hand."
IBM has no plans to begin running Linux performance benchmarks for the mainframe, the IBM spokesman said. "We typically don't run industry standard performance benchmarks for any software on the mainframe," he said. "The value of the mainframe is based on its ability to securely run multiple applications on a single platform as opposed to purely seeking outstanding performance of one application on a single platform."
Microsoft's benchmarks were conducted by the Veritest division of Lionbridge Technologies under contract from Microsoft. They can be found here: http://www.veritest.com/clients/reports/microsoft/default.asp?visitor=X