Multi-Client iSCSI Evaluation

As virtualization becomes more and more popular even in home / power user settings, the importance of the iSCSI feature set of any COTS NAS can't be overstated. Starting with our ioSafe 1513+ review, we have started devoting a separate section (in the reviews of NAS units targeting SMBs and SMEs) to the evaluation of iSCSI performance. Since we have already looked at the way iSCSI LUNs are implemented in DSM in the ioSafe 1513+ review, it won't be discussed in detail.

We evaluated the performance of the DS1815+ with file-based LUNs as well as configuring a RAID-5 disk group in multiple LUNs mode and single LUN mode. The standard IOMeter benchmarks that we used for multi-client CIFS evaluation were utilized for iSCSI evaluation also. The main difference to note is that the CIFS evaluation was performed on a mounted network share, while the iSCSI evaluation was done on a 'clean physical disk' (from the viewpoint of the virtual machine).

Performance Numbers

The four IOMeter traces were run on the physical disk manifested by mapping the iSCSI target on each VM. The benchmarking started with one VM accessing the NAS. The number of VMs simultaneously playing out the trace was incremented one by one till we had all 25 VMs in the fray. Detailed listings of the IOMeter benchmark numbers (including IOPS and maximum response times) for each configuration are linked below:

Synology DS1815+ - Multiple LUNs (Regular Files) Multi-Client iSCSI Performance - 100% Sequential Reads

 

Synology DS1815+ - Multiple LUNs (Regular Files) Multi-Client iSCSI Performance - Max Throughput - 50% Reads

 

Synology DS1815+ - Multiple LUNs (Regular Files) Multi-Client iSCSI Performance - Random 8K - 70% Reads

 

Synology DS1815+ - Multiple LUNs (Regular Files) Multi-Client iSCSI Performance - Real Life - 65% Reads

Since the number of NAS units that we have put through this evaluation is limited, we have a couple of 4-bay NAS units in the comparison drop-downs above. Unfortunately, we have no graphs for apples-to-apples comparison. That said, we do see the 'single LUN on RAID' mode delivering the best performance. For some strange reason, the multiple LUNs on RAID configuration is never able to take advantage of the bonded network ports. Even the simultaneous multi-client sequential reads test always stay below 125 MBps.

File-based LUNs give maximum flexibility - thin provisioning, support for VMWare VAAI and Windows ODX. The latest versions of DSM have improved on the iSCSI feature set quite a bit. Synology's competitors have a bit of catching up to do in the iSCSI feature set area.

As more NAS units are processed, we hope this section will provide readers with a way to quickly get an idea of the competitive performance of a particular NAS unit when it comes to iSCSI support.

Multi-Client Performance - CIFS on Windows Encryption Support Evaluation
Comments Locked

65 Comments

View All Comments

  • stevenrix - Thursday, November 20, 2014 - link

    I actually own the DS1812+. I was going to build my own NAS but I wanted a hardware solution for the RAID, because software RAID is just too slow. Then I could not find the right type of tower I wanted for the drives, that was another issue, then I was not able to expand the RAID on the fly if I wanted to add more drives or even build a dynamic partition, so I decided to go with that solution instead. I haven't got one single problem with my unit that just reached 1 year now.
    There are far better solution in NAS but their price is extremely expensive, starting at 50K like the Equal Logics. This solution is for SMB or people like me that don't want to spend time on assembling parts for a NAS. Also for a good NAS with good parts might cost more money: just the RAID card in hardware (PERC 6 or 7) is $300 and some NAS run with Xeons procs.
  • meyergru - Sunday, November 23, 2014 - link

    I have read the reviews about the Synology NAS devices with Avoton CPUs (DS1815+ and DS415+). Having bought one now myself, I wonder how far they have been tested.

    I got the impression from former Anandtech articles about the new Avoton CPUs, that NAS devices equipped with those should be able to encrypt data with virtually no performance impact. The reviews proved that point, so I bought one.

    However, Synology offers only eCryptFS, which does not work via NFS and exhibits the file names and directory structures in the clear - also, the maximum filename lengths are truncated to 143 characters. Thus, using it for general backup purposes is somewhat pointless.

    On a side note, it is a shame that the Synology kernel configuration does not even include the dm-crypt.ko and cryptoloop.ko modules and that there are no userspace cryptsetup or losetup executables. This limits the usefulness of the Synology Avoton line of products to almost zilch.

    Also, the GPL sources under http://sourceforge.net/projects/dsgpl are out of date. There is no 5.1 version, which would contain the neccessary tools for the new Avoton machines like the DS1815+ and the DS415+. Thus, there is no self-cure for the situation, either.

    This is the kind of improvement hints I have grown accustomed to in Anandtech reviews, but no word of it in the final words of these ones.
  • name99 - Tuesday, November 25, 2014 - link

    "Bay Trail is proving very effective in tablets"
    Seriously? Proof ...
    Being used for such well known brands as Teclast and Onda and Voyo is not "proving very effective".

    Intel's goal for 2014 was 40 million tablets. I'm guessing, since we haven't heard much since that goal was set (but we have heard about the 2014 billion dollar losses in their mobile division, complementing the 2013 billion dollar losses) that they didn't QUITE make that...

    The Foxconn (oops, sorry, "Nokia") iPad mini clone MAY change that --- but that won't ship for another three months, and I expect Apple have a plan in the wings the moment they feel any pressure at the low-end to drop the A5 iPad mini, move the iPad mini 2 down to that price slot, and, if necessary, slide in an A8 based iPaid mini 4 at the high end...

    Meanwhile Lenovo was so impressed with Bay Trail that they dropped it from the Yoga for the (much more expensive) Broadwell-Y, not that that has done them any good...
  • yuanshec - Tuesday, November 25, 2014 - link

    I recently search for a NAS and find this category is actually the most overpriced stuffs in the consumer market nowadays. There are not much hard technology needed to build one and the actual cost is not expensive. And I don't see much power saving compare to a dedicated computer with RAID, and this is not quiet at all. The only possible reason that this high price tag existed is there are not many players (yet) on the market.I would suggested waiting one more year and see what happens. Compared to this, even Macs or iPhone are not overpriced at all...
  • agodzilla - Friday, August 19, 2016 - link

    Synology DS1815+ only SATA / 1.5 Gbps speed will be news

    in the spec DS1815+ have sata2 * 8
    but slot 7 and slot 8 can't over the 1.5 Gbps (SATA1)
    even SSD still can't over the 1.5 Gbps (150MB/s)
    they not tell this problem before consumer buy it,is illegal in your country?

    if the consumer know slot 7 and slot 8 can't over the 1.5 Gbps,they maybe not buy this product
    this is our test video https://youtu.be/YDyEZKT_nAQ

    you can confirm by yourself ,if you have DS1815+

    and DS1813+ same problem ,is so many years

    this will be big news,make Synology say sorry and compensate

Log in

Don't have an account? Sign up now