January

Happy New Year!

I have summarized a couple of 2015 predictions, wish-lists and trends at the beginning of the year for you below. Of course they represent my personal beliefs about where the IT and Storage industry will be heading in the next 12 months - so feel free to disagree!

First let me revisit the state of the art in HDD capacity as of January 2015, here's a great writeup of what is available today: As you can see, we are rapidly approaching the 10 TB capacity limit - but data access performance remains an ever bigger problem with those huge disk drives. Related to that, RAID protection becomes less practical with every TB we add for single drives, so the industry is looking into new ways to protect data as you can read here!
And for the SSD segment of enterprise storage, read the 2015 wish list for AFA's (all-flash arrays).


Second, here's a number of analyst predictions for top 2015 storage trends and market developments:
Hot storage technologies for 2015 (most notably Cloud-based disaster recovery or DRaaS among them) and top storage start-ups (many of them supporting flavors of SSDs to maximize performance)  to watch this year!
And lastly from the NetApp CTO and industry veteran Jay Kidd, here's his personal view on 2015 trends.

Third: meet "Docker", the next big thing after hypervisors! Or as is explained in this paragraph on docker.com: "Docker is an open platform for developers and sysadmins to build, ship, and run distributed applications". It may be a smart thing to start to learn about Docker early in 2015 - so I have listed the link to a four part summary/basic overview from "The Register" here. Enjoy!

December

It has been a busy time for me and while I have continuously followed what's going on in the IT market, I did not have time to sit down and digest. So before 2014 is over, let's have a look at some recent news and how they fit into current trends:
If I had to summarize what I see going on right now is three major areas of excitement and start-up-activity:

• Converged and Hyper-Converged Systems, goes hand in hand with the "software defined datacenter" topics and the Server-side SAN solutions.
• Flash Storage and the question how a future "memory" or "storage" hierarchy will look like?
• Cloud and all kinds of "managed services". Combined with the question which parts of IT will be on-premises - and what will be off-premises in a future scenario?

Along these lines, here's a writeup of recent news: The article here is a great analysis by industry veteran Jon Toigo about the new storage hype around server-SANs and the proclaimed death of the storage array as we know it. He states that "...there's no such thing as a true storage network, at least not one that fits the ISO model of networks. We have storage fabrics with switched DAS (SANs), and we have DAS with thin file server appliances (NAS). So, the idea that virtual servers won't work with anything but server-side direct attachment is silly."

It's impossible to understand server-SANs without knowing some details about VMware VVOLs (and here), VSANs (see also here), and most recently EVO:Rail.  Check the respective links for an explanation of each!
Please see my blogpost from Sept. 2013 as well, plus a great comparison of Hyper-Converged solutions here!

So while VSANs let's you control direct attached server storage from VMware, VVOLs provides a new construct (beyond NAS and LUNs) to manage external/SAN storage from VMware. And EVO.Rail (based on VSAN technology) is a complete software bundle from VMware which enables vendors (Dell, HP, and others have announced intents) to build their own "hyper-converged" appliances.

Reminds me of good old days of IBM mainframes where the "IO subsystem" was defined and under control of the base operating system. VMware obviously wants to gain control over the storage side of the datacenter and -in my opinion- they have a fair chance of winning that bet.

On to Flash: Combining the converged and flash hype will result in solutions like the one here: "Nutanix introduced a new all-flash storage appliance and a new feature that enables continuous availability across data centers."
And last week from Flash-leader PureStorage:  "Pure and Cisco have dreamed up FlashStack converged infrastructure (CI). This is a combination of combine Pure’s 400 Series arrays, Cisco UCS Blade Servers, Nexus switches, VMware vSphere 5 and Horizon 6".
However, this is mostly an unilateral attempt from Pure to hook up with CISCO - you will not find that specific solution on the CISCO CVD (CISCO validated design) site. No surprise; as they already have Invicta (to be integrated into UCS) and have created solutions with Nimble as well.

Closing todays comments with very recent news on AWS (Amazon web services):
"Amazon added storage features at its AWS re:Invent conference in November. They include support for larger and faster volumes on its Elastic Block Store (EBS). The enhancements center on solid-state drive (SSD)-backed EBS, which was launched back in June in all AWS regions. Amazon calls SSD EBS the fastest-adopted service in its Amazon Web Services portfolio."

What if - someday we may start over with a very disruptive and new way of computing? While dating back to Summer, the vision of "The Machine" sounds somewhat appealing to me!

September

Networking news this month: Will 25 Gbps Ethernet be the next speed of choice? Read here why there's a couple good reasons to think so: "The next generation of Intel "Grantley" CPUs are due to ship in the third quarter, and servers with these processors will be able to forward data faster than 10 Gbit/s. In the high-density server farms of cloud providers like Google and Microsoft, using multiple 10 GbE would require twice as many Ethernet switches with their associated space, power, and cooling costs."

And on the Fibre Channel side of the market, CISCO quietly (and maybe reluctantly?) roles out a bunch of 16 Gbps products:
A new low-cost 16 Gbps switch (MDS9148S) and a smaller model of the MDS 9710 director (MDS 9106), a 192-port director in a 9U form factor!

August

Lazy summer days - mostly wet and rainy this year. So lots of time to read blogs and follow the IT News-tickers!

Here's what I found to be interesting news in the last couple weeks - sorted by "level of excitement".
First sighting of phase-change memory (PCM) for commercial use in SSD's: at the 2014 "Flash Summit Conference" HGST (subsidiary of Western Digital) did showcase a blazingly fast SSD device not based on Flash memory but PCM, as Computerworld reports here:
" The device, which can be plugged into a server's PCIe slot like any SSD, isn't a new storage product but a platform for demonstrating a low-latency interface that the company developed with future solid-state media in mind. It implemented the experimental communications protocol in a Linux driver on the server and in the SSD's embedded software."
"Where NAND Flash takes about 70 microseconds to respond to a request for data, PCM can do so in about 1 microsecond. However, it will take two to three years of hardware development before PCM gets dense and cheap enough to compete head-on with flash"

Also read the stories on that same subject in "The Register" and the related HGST Press Release.

As noted above, new low-latency technology like PCM will require new architectures and will have to reside "right next to the CPU" to actually take advantage of the available speed!
To that end, HGST has developed a new low-latency interface dubbed "DC express". 
Watch this excellent 15' video clip here!

So you should really think of PCM as a lower cost DRAM rather than a high performance Flash Array. Will be interesting how this will affect "storage tiers"!?

Now, don't count Flash SSD's out yet: As reported here, there is a whole family of bigger (up to 1.6TB) and faster (12 Gbit/s SAS) SSD's entering the market these days!

July

It's about time to resume blogging and edit an update to my Blog. I have been "out of IT" for a few month - between Jobs - and now back to the grind.

One of my off-IT activities: Travel Maui

Good thing is that I realized during my time off: there's plenty of great things to do and think outside of IT; sad thing is, I also realized that only in IT, I have enough marketable skills to be able to pay my bills.
So back to IT business...
Topic today is pretty straightforward. Cloud and Flash!
I think those are pretty much the buzzwords that, as someone looking into our industry in summer 2014 would realize, are discussed most frequently.

Now looking at these trends and the technologies cooking in the labs, I've come to the conclusion that the two can be combined in what I believe to be a true statement:
"By 2020, all data will be either stored on Flash or in the Cloud"
There's a couple reasons why I think this statement may become true, listed below are a couple market and technology trends from the last couple weeks which seem to point into that direction.
But the very basic physical reason for it is "latency": Response time for any IO from the cloud is always measured in milliseconds (at least - try a PING if you don't agree) while response time for any IO from a Flash System is always measured in microseconds. Means that Flash will always sit either in the server or right next to it (next like: a couple meters away)!

Let's start with Flash: See these two great articles about function and design of all-flash arrays  (by George Crump of Storage Switzerland) vs. advantages of hybrid storage arrays (by HDS CTO Hu Yoshida). And then add this news from the Samsung lab (Samsung being the #1 provider of NAND Flash) about first shipments of 3D Flash.

On to the Cloud: As the Register article here states: "CIOs will likely increasingly say: dump the data center hardware ship and ship the data up into the cloud."
A couple vendors actually announced functions and plans to that end in the past couple weeks: Netapp ties in with the Microsoft Azure cloud (more details here);
while mighty EMC announced (among a flood of other solutions, plans, products, and the intend to acquire Twinstrata) the availability of a cloud gateway option for the new VMAX3.

As discussed above, cloud data storage will most likely not be based on relatively expensive and fast Flash technology for the years to come. The most obvious candidate for efficient, cheap and reliable cloud storage is rotating disks - HDD. And a second, surprising -but also likely candidate- is good old Tape!
In case you missed the May announcement about IBM's 154TB-Tape demo: Listen to the details here!

April

Well, some of you know that I'm on a two month sabbatical now - away from my previous job at IBM.
So I have not been following the storage market very closely these days - but have focused on other (more?) important things in life - like mountain biking and enjoying hikes with my family.

The great thing is that we had a beautiful spring this year in Zurich with lots of sunshine and warm weather, as you can see in the weather report for March here!

Still, there was a couple things that caught my attention and they are around SDN (software defined networking): While I was doing online research and was trying to figure out, where the industry is going in relation to this topic, I found a great series of blog posts and articles over at the InformationWeek site (thanks folks!).

I have summarized these for you:
First, start here with an industry overview and download the SDN market report (login required).
Then, you can read a detailed analysis by vendor - what their strategies and solutions are:
Part 2: CISCO, Arista and HP
 Details for CISCO ACI (application centric infrastructure), part 1 and part 2.
Part 3: Juniper, Brocade, Dell
Part 4: VMware, Avaya

March

Two major topics today: Object storage and cloud. And YES, I believe the two are in fact very closely related: Objects (defined as unstructured and permanent, unchanged data) seem to be by far the best fit for data to be stored in the cloud!
To get us started - and if your are like myself still trying to come to grips with the object Hype - here's a great Object Storage 101 for your reference (thanks George Crump!)

And Chris Mellor -over at the Register- points out that object storage is ".. headed towards mainstream status, with ViPR, Black Pearl and EVault leading the way. Others, though, held back. As of the year end, we saw IBM doing nothing much with objects, NetApp apparently standing still with its StorageGRID, and Dell exiting the field." Read the details here!

Now, expanding the focus and looking beyond objects and storage only, using cloud services may not be the nirvana many CxO's are dreaming about: Forbes recently had a great article about this and made the point very well by listing the following checkmark items for cloud management:

This means that at any moment a CIO must be able to answer the following questions:

1. Are all the applications and services in our control running properly?
2. Are all the applications and services running in the cloud or as SaaS running properly?
3. Is there a network problem in the network under our control?
4. Is there a network problem in the public Internet?
5. Is there a network problem in the network of the cloud or SaaS provider?

I like numbers 2. and 4.!

Still, cloud becomes more popular and less expensive by the week - as the most recent price war between the cloud "behemoths" Amazon and Microsoft shows: