Today, at the 2017 Open Compute Project U.S. Summit, Microsoft unveiled some significant announcements around their hyperscale cloud hardware design, which they first announced in November as Project Olympus. With the explosion of growth in cloud computing, Microsoft is hoping to reduce the costs of their Azure expansion by creating universal platforms in collaboration with the Open Compute Project. Project Olympus is more than just a server standard though. It consists of a universal motherboard, power supplies, 1U and 2U server chassis, power distribution, and more. Microsoft isn’t the first company to want to go down this road, and it makes a lot of sense to cut costs by creating standards when you are buying equipment on the level of Azure.

The company made several big announcements today, with the first one coming somewhat as a surprise, but when you read between the lines, it makes a lot of sense. Microsoft is partnering with Qualcomm and Cavium to bring ARM based servers to Azure. This is a pretty big shift for the company, since they have focused more on x86 computing, and changing to a new ISA is never a small task, so Microsoft is clearly serious about this move.

Microsoft Distinguished Engineer Leendert van Doorn expanded on why the company is exploring this option in a blog post today. Clearly ARM has made some progress in the server world over the last few years, and Microsoft feels it’s the right time to bring some of that capability to their own datacenters. I think one of the key takeaways is that Microsoft wants to shape the hardware capabilities to the workload, and with an open platform like ARM, this can make a lot of sense for certain workloads. He points out that search and indexing, storage, databases, big data, and machine learning, are all named as potential workloads, and in cloud computing, these are all significant in their own right.

Qualcomm Centriq 2400 Platform

Microsoft already has a version of Windows Server running on ARM, and they’ve announced that both of their partners will be demonstrating this internal use port of Windows Server, first with Qualcomm with their Centriq 2400 processor, with 48 cores on Samsung’s 10nm FinFET process. Cavium will be running on their second generation ThunderX2 platform. Our own Johan De Gelas did a thorough investigation of the original ThunderX platform in June 2016 and it is certainly worth a read. The takeaways were that Cavium needed to do a lot of work on power management, and they had some big performance bottlenecks, so they offered inferior performance per watt compared to a Xeon D, but better than advertised single-threaded performance with SPEC 2006 results only 1/3 the Xeon results, rather than the 1/5 that was advertised. If Cavium has fixed some of the issues, especially power consumption, the new ThunderX2 might be a compelling solution for specific tasks.

Cavium ThunderX2 Platform

That is really the kicker though. The ARM platform, if properly executed, should be a good solution for some specific tasks, and if Microsoft can work with the platform makers to shape the hardware to fit specific tasks, but still be more general purpose than an ASIC, but at this time, it’s unlikely to be a serious threat to Intel’s monopoly on the datacenter at the moment. Intel has a pretty sizeable advantage in IPC, and especially on single-threaded workloads, so x86 isn’t going anywhere yet. What really matters is how Qualcomm and Cavium can execute on their platforms, and where they price them, since the end goal for Microsoft with this change is certainly, at least to some extent, to put pressure on Intel’s pricing for their datacenter equipment.

Back on the x86 side, Microsoft also had some announcements there as well. AMD will also be collaborating with Microsoft to include their Naples processor into Project Olympus, which is their new server processor based on the “Zen” architecture. Although much of the news today has been around the ARM announcement, this is arguably the bigger play. Ryzen has already shown it is very competitive with Core, and Naples could be very strong competition for Xeon. We’ll have to wait for the launch to know for sure.

Microsoft didn’t abandon Intel either, and they announced close collaboration with Intel as well. This will be not only for Intel’s general purpose CPUs, but also for Intel’s FPGA accelerators and Nervana support. Microsoft already has FPGAs in Azure, so adding them to Project Olympus is a no-brainer.

Microsoft also announced a partnership with NVIDIA today, bringing the HGX-1 hyperscale GPU accelerator to Project Olympus. HGX-1 is targeted at AI cloud computing, which is certainly an area where there has been tremendous growth. Each HGX-1 will be powered by eight NVIDIA Tesla P100 GPUs, each with 3584 Stream Processors, based on the GP100 chip, and a new switching design based on NVIDIA NVLink and PCIe which allows a CPU to connect to any number of GPUs dynamically. NVIDIA states the HGX-1 provides up to 100x faster deep learning performance compared to CPU-based servers.

This is a pretty substantial update today for Project Olympus, and it looks to be an incredibly modular platform. Anyone reading that Microsoft is dropping Intel for ARM in Azure is misunderstanding this goal. Looking at the platform as a whole, it is abundantly clear that Microsoft wants a platform that can be designed to work with any workload, and still offer optimal performance, and efficiency. Some tasks will be best on ARM, some on x86, while GPUs will be leveraged for performance gains where possible, and FPGAs being utilized for other tasks. When you look at computing on the scale of something like Azure, it only makes sense to dedicate hardware to specific workloads, since you’ll certainly have enough different workloads to make the initial effort worthwhile, and that isn’t always the case when looking at small business, medium business, or even most enterprise workloads.

Source: Microsoft Azure Blog


Comments Locked


View All Comments

  • eddman - Saturday, March 11, 2017 - link

    Stop polluting the comment section. This isn't a political website.
  • Bullwinkle J Moose - Saturday, March 11, 2017 - link

    "Stop polluting the comment section. This isn't a political website."
    I feel your pain....
    But without looking at the consequences of the damage caused from backdoors and spyware in Windows, do we really have a reason to fix it?

    So what if it destroys National Security, that just Political Propaganda!
  • eddman - Saturday, March 11, 2017 - link

    Just remove yourself and go to one of the many random political portals out there.
  • Bullwinkle J Moose - Saturday, March 11, 2017 - link

    you can remove yourself if you do not wish to discuss technology or its implications at a tech site regardless of whether you feel those implications might be political or otherwise

    Not discussing the problem does not fix the problem nor does it stop criminals from creating these problems by hiding them in technology

    The CORRECT answer is to discuss these problems on tech sites as well as political sites, otherwise people like you would simply tell me not to discuss this tech problem at a political site
  • eddman - Saturday, March 11, 2017 - link

    A tech site is not the place for you to spam political nonsense.

    If you want to do something useful go join an NGO or start a real life campaign instead of spamming in a tech site's echo chamber.

    People like you only shout yet do nothing.
  • bull2760 - Sunday, March 12, 2017 - link

    Was this before you were abducted by aliens? You want secure disconnect your computer from the internet, go back to using a typewriter. If your not connected you can't get hacked. If you want to continue using the internet and everything it has to offer than stop bitching and accept shit the way it is. Every OS has vulnerabilities stop using Microsoft if you don't like it, you have a choice.
  • Bullwinkle J Moose - Sunday, March 12, 2017 - link

    If everything in Windows "IS NOT" spyware......
    Lets get rid of it!

    I have no use for closed source DRM that cannot be uninstalled

    Since I am not using it, lets get rid of it instead of making it a crime to bypass or remove

    Why is it a crime to remove something I am not using if it is not spyware?

    I don't use Windows activation so lets get rid of that too!
    If it's not spyware, what good is it?
    It could not possibly stop piracy without spying and yet you say it is not spyware?????
    Please explain further...
    We are here to learn from your superior intelligence (op)

    I have no need for a 32 digit key identifier on any encrypted Bitlocker disks and neither does Microsoft or anyone else unless it is used to identify the encryption key to open the disk

    If that isn't for spying, get rid of it!

    Why is there a hidden globally unique identifier on every thumb drive you format with Windows 10?
    If it's not spyware, there is no use for it, so get rid of it

    Why do you collect info on every single CD/DVD and Bluray played and grant yourselves acces to ALL file on my drives if it is not spyware
    I have no use for that so get rid of it

    or show us how to remove all this crap you claim is not spyware but is of no use to me

    I can block ALL Microsoft component in my aftermarket Windows XP firewall and still allow my 3rd party browser to surf the Internet

    I cannot do that in Windows 7/8 or 10
    Why is there a constant connection to Microsoft servers if I have no use for them?

    We all await your brilliant insights into the intricacies of this "non-spyware" that cannot be removed under penalty of Law that I have no use for
  • eddman - Sunday, March 12, 2017 - link

    Go get a banana while you're at it.
  • Bullwinkle J Moose - Sunday, March 12, 2017 - link

    always ridicule
    Never address the topic with evidence
    divert from the topic at hand

    you have learned well shill minion!
    you may now advance to propaganda 101
  • eddman - Monday, March 13, 2017 - link

    Keep trolling. Greatness awaits you. /s

Log in

Don't have an account? Sign up now