ONTAP 9.5 has been announced!

There are a few things in life that are certain… death, taxes and a new ONTAP release every 6 months!

ONTAP 9.5 was just officially announced at Insight 2018, and this blog will give you the technical breakdown of all the new goodness. We’ll have a new podcast up soon to cover it as well.

If you’re going to be at Insight (Las Vegas or Barcelona), or if you want to review sessions after the event, you can check out the following session:

1214-2 – What’s On Tap in the Next Major Release of NetApp ONTAP

What’s new?

Generally speaking, new stuff in ONTAP comes in the following forms:

  • New features
  • Enhanced features
  • Bug fixes

With the 6 month cadence, features are often phased in, with new features being released with stability as the top priority. Feature parity comes in chunks in later releases. Bug fixes are a part of every ONTAP release.

So, let’s start with…

New Features

ONTAP 9.5 continues the emphasis on the “modern datacenter” with a slew of new features that help enable higher performance and better resiliency, as well as extending your storage stack beyond on-premises and into a true global architecture.

SnapMirror Synchronous

SnapMirror Synchronous adds the ability to replicate – at a volume level – data cross a WAN connection (RTT <10ms – distance of ~150km) with zero Recovery Point Objective (RPO) and near-zero Recovery Time Objective (RTO). This helps address regulatory and industry mandated needs for synchronous replication.

sms-png

SnapMirror Synchronous will have two different modes available in the initial release.

Full Synchronous

This is the default mode and guarantees zero application data loss between sites by disallowing writes if the SnapMirror Synchronous replication fails for any reason. This provides the “zero RPO” guarantee.

Relaxed Synchronous

Alternatively, relaxed mode allows application writes to continue to a primary site if the SnapMirror Synchronous relationship fails. Once the relationship is able to resume, resync will automatically occur.

In the initial release of SnapMirror Synchronous, NFSv3, iSCSI and FCP will be supported. Licensing will be capacity-based, in addition to the base SnapMirror license.

FlexCache Volumes

One thing I’ve heard fairly often is “how can I serve NAS data across multiple sites while still honoring locking mechanisms?” Previously, the only way to accomplish this was by way of a 3rd party NAS lock orchestrator. Now, in ONTAP 9.5, NAS data can be shared across multiple global sites with performance as if the NAS data was local with FlexCache volumes and provides a true global namespace for ONTAP.

flexcache

FlexCache volumes are sparsely populated volumes that can be cached on the same cluster or a different cluster as the origin volumes to accelerate data access. FlexCache volumes are created on FlexGroup volumes and can cache reads, writes and metadata.  Writes are currently using write-around for locking orchestration at the origin. FlexCache volumes can also help offload mount points to avoid hot spots. Initially, NFSv3 will be the only supported protocol, but future releases will enable more data protocol support.

BGP routing support

The networking stack in ONTAP is getting a bit of a makeover in ONTAP 9.5 as well. Previously, data LIFs in ONTAP were hosted on a single physical port, which lived on a single physical node. Load balancing was done via layer 2 (L2) hashing, which wasn’t super efficient, as hash collisions would leave ports underutilized or even completely unused! When storage nodes have 40GB and 100GB ports, that can be an expensive waste of resources. Additionally, the L2 architecture meant that additional layer 3 (l3) switches needed to be in place to provide proper network traffic distribution.

ONTAP 9.5 introduces support for L3 routing via the Border Gateway Protocol (BGP), which allows ONTAP to automatically load balance traffic based on routing metrics, rather than L2 hashes. Additionally, this allows data LIFs to become Virtual IPs (VIPs) that can live anywhere in the network, which adds better redundancy for IP failover events, and avoids inactive links. This also eliminates the need for L3 switching infrastructure, which reduces overall CapEx and OpEx networking costs.

bgp

ONTAP 9.5 is further modernizing the datacenter by modernizing its networking stack.

Logical Space Accounting

ONTAP 9.4 introduced a way to report storage efficiency savings to storage administrators, but to mask those savings to users. For example, if a user is writing to a 10TB volume and 6TB of data has been written to the volume, but storage efficiencies have saved 2TB, then ONTAP can report the actual 6TB of capacity back to users, rather than the 4TB used by way of space savings. This provides storage administrators a way to charge back properly to end users and helps prevent overruns of storage capacity.

ONTAP 9.5 ups the game by integrating logical space accounting into quota enforcement, which not only displays the logical space used, but also prevents new writes once a quota has been reached based on the logical space used.

logical-space

MAX Data

While this was announced a couple months ago, MAX Data officially makes its debut alongside ONTAP 9.5. This is a server-side software product that lives outside of ONTAP. We covered it on the Tech ONTAP Podcast in Episode 154.

MAX Data offers ultra-low latency (think sub 10 microsecond) and more Ops/second with server-side software-based memory acceleration that leverages persistent memory such as NVDIMM and Optane Memory as they become available. Based on the Plexistor technology that NetApp acquired last year, MAX Data also offers enterprise-class data resiliency with MAX Recovery technology, for high availability and faster data recovery.

MAX Data can help accelerate database applications like Oracle, Cassandra, MongoDB and a variety of other Linux-based applications.

maxdata

NetApp Data Availability Services (NDAS)

While not technically an ONTAP feature (though there are ONTAP elements such as the NDAS proxy and copy-to-cloud APIs), NetApp Data Availability Services is an integral part of the NetApp Data Fabric. It’s a cloud-resident orchestration app that simplifies hybrid cloud data protection workflows behind a single pane of glass. It’s also an intuitive search catalog for easy file and volume restores and leverages intelligent S3 object storage in AWS for lower cost solutions for backing up your ONTAP data. For more information, see https://www.netapp.com/ndas.

ndas

Feature Enhancements

NVMe over FC – Industry’s only HA failover story for NVMeoFC namespaces via asymmetric namespace access (ANA), which is a NVMe standard that NetApp helped develop.

Storage efficiencies – Up to 15% more storage efficiencies seen with compression improvements.

FlexGroup volumes – New functionality such as FabricPool support, quota enforcement and qtree statistics open up a whole new set of workloads that can leverage FlexGroup volumes, such as home directories.

SnapLock – SnapLock adds feature enhancements such as Unified SnapMirror engine support, resync without data loss, clock synchronization in software defined ONTAP and 1,023 snapshot support.

MetroCluster (MCC) – ONTAP 9.5 adds support for SVM-DR and ONTAP Select with MetroCluster, increases the supported distance for MCC IP to 700km(!), and expands the platforms supported for use with MCC IP to the A300 and FAS8200 series.

Advertisements

ONTAP 9.3 is now GA!

ONTAP 9 is on a new cadence model, which brings a new release every 6 months.

Today, ONTAP 9.3GA is available here!

http://mysupport.netapp.com/NOW/download/software/ontap/9.3

ONTAP 9.3 was announced at NetApp Insight 2017 in Las Vegas and was covered at a high level by Jeff Baxter in the following blog:

Announcing NetApp ONTAP 9.3: The Next Step in Modernizing Your Data Management

Jeff has a follow-up infographic here:

https://blog.netapp.com/10-good-reasons-to-upgrade-to-ontap-9-3-infographic/

I also did a brief video summary here:

We also did a podcast with ONTAP Chief Evangelist Jeff Baxter (@baxontap) and ONTAP SVP Octavian Tanase (@octav) here:

For info on what GA means, see:

http://mysupport.netapp.com/NOW/products/ontap_releasemodel/

Also, check out the documentation center:

docs.netapp.com/ontap-9/index.jsp

The general theme around ONTAP 9.3 is modernization of the data center. Here’s a high level list of features, with more detail on some of them later in this blog.

Security enhancements

Simplicity innovations

  • MongoDB support added to application provisioning
  • Simplified data protection flows in System Manager
  • Guided cluster setup and expansion
  • Adaptive QoS

Performance and efficiency improvements

  • Up to 30% performance improvement for specific workloads via WAFL improvements, parallelization and flash optimizations
  • Automatic schedules for deduplication
  • Backgroup inline aggregate deduplication (AFF only; automatic schedule only)

NetApp FlexGroup volume features

This is covered in more detail in What’s New for NetApp FlexGroup Volumes in ONTAP 9.3?

  • Qtrees
  • Antivirus
  • Volume autogrow
  • SnapVault/Unified SnapMirror
  • SMB Change/notify
  • QoS Maximums
  • Improved automated load balancing logic

Data Fabric additions

  • SolidFire to ONTAP SnapMirror
  • MetroCluster over IP

Now, let’s look at a few of the features in a bit more detail. If you have things you want covered more, leave a comment.

Multifactor Authentication (MFA)

Traditionally, to log in to an ONTAP system as an admin, all you needed was a username and password and you’d get root-level access to all storage virtual machines in a cluster. If you’re the benevolent storage admin, that’s great! If you’re a hostile actor, great!* (*unless you’re the benevolent storage admin… then, not so great)

ONTAP 9.3 introduces the ability to configure an external Identity Provider (IdP) server to interact with OnCommand System Manager and Unified Manager to require a key to be passed in addition to a username and password. Initial support for IdP will include Microsoft Active Directory Federation Services and Shibboleth.

MFA

For the command line, the multifactor portion would be passed by way of SSH keys currently. We cover MFA in the following Tech ONTAP podcast:

SnapLock Enhancements

SnapLock is a NetApp ONTAP feature that provides data compliance for businesses that need to preserve data for regulatory reasons, such as HIPAA standards (SnapLock compliance) or for internal requirements, such as needing to preserve records (SnapLock enterprise).

ONTAP 9.3 provides a few enhancements to SnapLock, including one that isn’t available from any storage provider currently.

legal-hold.png

Legal hold is useful in the event that a court has ordered specific documents to be preserved for an ongoing case or investigation. This can be applied to multiple files and remains in effect until you choose to remove it.

event-based

Event-based retention allows storage administrators to set protections on data based on defined events, such as an employee leaving the company (to avoid disgruntled deletions), or for insurance use cases (such as death of a policy holder).

vol-append.png

Volume append mode is the SnapLock feature I alluded to, where no one else can currently accomplish this. Essentially, it’s for media workloads (audio and video) and will write-protect the portion of the files that have already been streamed and allow appending to those files after they’ve been protected. It’s kind of like having a CD-R on  your storage system.

Performance improvements

improve-perf

Every release of ONTAP strives to improve performance in some way. ONTAP 9.3 introduces performance enhancements (mostly for SAN)/block via the following changes:

  • Read latency reductions via WAFL optimizations for All Flash FAS SAN (block) systems
  • Better parallelization for all workloads on mid-range and high-end systems (FAS and AFF) to deliver more throughput/IOPS at lower latencies
  • Parallelization of the iSCSI layer to allow iSCSI to use more cores (best results on 20 core or higher systems)

The following graphs show some examples of that performance improvement versus ONTAP 9.2.

a700-fcp

a700-iscsi

Adaptive Quality of Service (QoS)

Adaptive QoS is a way for storage administrators to allow ONTAP to manage the number of IOPS per TB of volume space without the need to intervene. You simply set a service level class and let ONTAP control the rest.

The graphic below shows how it works.

adaptive-qos

We cover QoS minimums and performance enhancements in the following Tech ONTAP podcast:

MetroCluster over IP

MetroCluster is a way for clusters to operate in a high availability manner over long distances. (hundreds of kilometers) Traditionally, MetroCluster has been done over fiber channel networks due to low latency requirements needed to guarantee writes can be committed to both sites.

However, now that IP networks are getting more robust, ONTAP is able to support MetroCluster over IP, which provides the following benefits:

  • Reduced CapEx and OpEx (no more dedicated fiber channel networks, cards, bridges)
  • Simplicty of management (use existing IP networks)

mcc-ip.png

The ONTAP 9.3 release is going to be a limited release for this feature, with the following caveats:

  • A700, FAS9000 only
  • 100km limit
  • Dedicated ISL with extended VLAN currently required
  • 1 iWARP card per node

We cover MetroCluster over IP in this podcast:

SolidFire to ONTAP SnapMirror

A few years back, the concept of a data fabric (where all of your data can be moved anywhere with the click of a button) was introduced.

That vision continued this year with the inclusion of SnapMirror from SolidFire (and NetApp HCI systems) to ONTAP.

sf-snapmirror.png

ONTAP 9.3 will allow storage administrators to implement a disaster recovery plan for their SolidFire systems.

This includes the following:

  • Baseline and incremental replication using NetApp SnapMirror from SolidFire to ONTAP
  • Failover storage to ONTAP for disaster recovery
  • Failback storage from ONTAP to SolidFire
    • Only for LUNs replicated from SolidFire
    • Replication from ONTAP to SolidFire only for failback

That covers a deeper look at some of the new ONTAP 9.3 features. Feel free to comment if you want to learn more about these features, or any not listed in the overview.

ONTAP 9.3RC1 is now available!

ONTAP 9.3 was announced at NetApp Insight 2017 in Las Vegas and was covered at a high level by Jeff Baxter in the following blog:

Announcing NetApp ONTAP 9.3: The Next Step in Modernizing Your Data Management

I also did a brief video summary here:

We also did a podcast with ONTAP Chief Evangelist Jeff Baxter (@baxontap) and ONTAP SVP Octavian Tanase (@octav) here:

ONTAP releases are delivered every 6 months, with the odd numbered releases landing around time for Insight. Now, the first release candidate for 9.3 is available here:

http://mysupport.netapp.com/NOW/download/software/ontap/9.3RC1

For info on what a release candidate is, see:

http://mysupport.netapp.com/NOW/products/ontap_releasemodel/

Also, check out the documentation center:

docs.netapp.com/ontap-9/index.jsp

The general theme around ONTAP 9.3 is modernization of the data center. I cover this at Insight in session 30682-2, which is available as a recording from Las Vegas for those with a login. If you’re going to Insight in Berlin, feel free to add it to your schedule builder. Here’s a high level list of features, with more detail on some of them later in this blog.

Security enhancements

Simplicity innovations

  • MongoDB support added to application provisioning
  • Simplified data protection flows in System Manager
  • Guided cluster setup and expansion
  • Adaptive QoS

Performance and efficiency improvements

  • Up to 30% performance improvement for specific workloads via WAFL improvements, parallelization and flash optimizations
  • Automatic schedules for deduplication
  • Backgroup inline aggregate deduplication (AFF only; automatic schedule only)

NetApp FlexGroup volume features

This is covered in more detail in What’s New for NetApp FlexGroup Volumes in ONTAP 9.3?

  • Qtrees
  • Antivirus
  • Volume autogrow
  • SnapVault/Unified SnapMirror
  • SMB Change/notify
  • QoS Maximums
  • Improved automated load balancing logic

Data Fabric additions

  • SolidFire to ONTAP SnapMirror
  • MetroCluster over IP

Now, let’s look at a few of the features in a bit more detail. If you have things you want covered more, leave a comment.

Multifactor Authentication (MFA)

Traditionally, to log in to an ONTAP system as an admin, all you needed was a username and password and you’d get root-level access to all storage virtual machines in a cluster. If you’re the benevolent storage admin, that’s great! If you’re a hostile actor, great!* (*unless you’re the benevolent storage admin… then, not so great)

ONTAP 9.3 introduces the ability to configure an external Identity Provider (IdP) server to interact with OnCommand System Manager and Unified Manager to require a key to be passed in addition to a username and password. Initial support for IdP will include Microsoft Active Directory Federation Services and Shibboleth.

MFA

For the command line, the multifactor portion would be passed by way of SSH keys currently.

SnapLock Enhancements

SnapLock is a NetApp ONTAP feature that provides data compliance for businesses that need to preserve data for regulatory reasons, such as HIPAA standards (SnapLock compliance) or for internal requirements, such as needing to preserve records (SnapLock enterprise).

ONTAP 9.3 provides a few enhancements to SnapLock, including one that isn’t available from any storage provider currently.

legal-hold.png

Legal hold is useful in the event that a court has ordered specific documents to be preserved for an ongoing case or investigation. This can be applied to multiple files and remains in effect until you choose to remove it.

event-based

Event-based retention allows storage administrators to set protections on data based on defined events, such as an employee leaving the company (to avoid disgruntled deletions), or for insurance use cases (such as death of a policy holder).

vol-append.png

Volume append mode is the SnapLock feature I alluded to, where no one else can currently accomplish this. Essentially, it’s for media workloads (audio and video) and will write-protect the portion of the files that have already been streamed and allow appending to those files after they’ve been protected. It’s kind of like having a CD-R on  your storage system.

Performance improvements

improve-perf

Every release of ONTAP strives to improve performance in some way. ONTAP 9.3 introduces performance enhancements (mostly for SAN)/block via the following changes:

  • Read latency reductions via WAFL optimizations for All Flash FAS SAN (block) systems
  • Better parallelization for all workloads on mid-range and high-end systems (FAS and AFF) to deliver more throughput/IOPS at lower latencies
  • Parallelization of the iSCSI layer to allow iSCSI to use more cores (best results on 20 core or higher systems)

The following graphs show some examples of that performance improvement versus ONTAP 9.2.

a700-fcp

a700-iscsi

Adaptive Quality of Service (QoS)

Adaptive QoS is a way for storage administrators to allow ONTAP to manage the number of IOPS per TB of volume space without the need to intervene. You simply set a service level class and let ONTAP control the rest.

The graphic below shows how it works.

adaptive-qos

MetroCluster over IP

MetroCluster is a way for clusters to operate in a high availability manner over long distances. (hundreds of kilometers) Traditionally, MetroCluster has been done over fiber channel networks due to low latency requirements needed to guarantee writes can be committed to both sites.

However, now that IP networks are getting more robust, ONTAP is able to support MetroCluster over IP, which provides the following benefits:

  • Reduced CapEx and OpEx (no more dedicated fiber channel networks, cards, bridges)
  • Simplicty of management (use existing IP networks)

mcc-ip.png

The ONTAP 9.3 release is going to be a limited release for this feature, with the following caveats:

  • A700, FAS9000 only
  • 100km limit
  • Dedicated ISL with extended VLAN currently required
  • 1 iWARP card per node

SolidFire to ONTAP SnapMirror

A few years back, the concept of a data fabric (where all of your data can be moved anywhere with the click of a button) was introduced.

That vision continued this year with the inclusion of SnapMirror from SolidFire (and NetApp HCI systems) to ONTAP.

sf-snapmirror.png

ONTAP 9.3 will allow storage administrators to implement a disaster recovery plan for their SolidFire systems.

This includes the following:

  • Baseline and incremental replication using NetApp SnapMirror from SolidFire to ONTAP
  • Failover storage to ONTAP for disaster recovery
  • Failback storage from ONTAP to SolidFire
    • Only for LUNs replicated from SolidFire
    • Replication from ONTAP to SolidFire only for failback

That covers a deeper look at some of the new ONTAP 9.3 features. Feel free to comment if you want to learn more about these features, or any not listed in the overview.

Behind the Scenes: Episode 43 – ONTAP 9 Data Protection Features

Welcome to the Episode 43 version of the new series called “Behind the Scenes of the NetApp Tech ONTAP Podcast.”

This is yet another in the series of episodes for ONTAP 9 month on the podcast.

ontap9week

This week, we invited a couple of our TMEs to talk about Data Protection features in ONTAP 9. Siddharth Agrawal (@siddharth_145) and Mike Worthen (@worthenmichael) discuss MetroCluster, SnapMirror Enhancements and the addition of SnapLock support

We had Mike Worthen live in the studio, and he’s a bit of a loose cannon. We had to keep telling him to stop banging on the table. Sid was a bit more subdued, but he was also connecting via Skype, so who knows what he was up to over there.

Finding the Podcast

The podcast is all finished and up for listening. You can find it on iTunes or SoundCloud or by going to techontappodcast.com.

Also, if you don’t like using iTunes or SoundCloud, we just added the podcast to Stitcher.

http://www.stitcher.com/podcast/tech-ontap-podcast?refid=stpr

I also recently got asked how to leverage RSS for the podcast. You can do that here:

http://feeds.soundcloud.com/users/soundcloud:users:164421460/sounds.rss

Check out the podcast episode here:

June 2016 – ONTAP 9 Month on the Tech ONTAP Podcast!

A couple weeks ago, I hinted at some news that was coming to the Tech ONTAP Podcast in June. Now, that news is finally here – ONTAP 9 has been announced!

ontap9week

We kicked off the month with an interview with Lee Caswell, the VP of Product and Solutions Marketing at NetApp to talk about why NetApp decided to go with the new ONTAP 9 version rather than another 8.x release, as well as how the ONTAP software release cadences are changing.

You can listen to that here:

The entire month is listed under a playlist here:

What changed?

this-a-job-for-datafabric

With the new release, there is a focus on the following:

Simplicity

  • New AFF deployment templates for Oracle, VDI, SQL to speed up set up (<10 minute set up)
  • Improved and re-vamped management GUIs (Dave Morera does a nice job covering this)
  • Unified data management across on-prem (flash and disk) and cloud datacenters

Maximizing Data Center Agility

Improved Performance

  • 20x faster response times
  • Up to 60% more IOPs than 8.3.1

There’s also a series of new features being offered in ONTAP 9. We discussed some of those with Lee Caswell (see his blog here), but we will also be covering them in upcoming episodes this month.

For a short list of the new features:

  • Support for 15TB SSD
  • Inline data compaction
  • SnapLock® software for data compliance
  • RAID-TEC triple-parity protection
  • Headroom for visibility of performance capacity
  • MetroCluster enhancements
  • Onboard key manager (Included for FREE)
  • FlexGroups (PVR only in 9.0)
  • Workgroup mode for CIFS/SMB

A few of the NetApp A-Team Members wrote up some blogs for the new stuff:

Upcoming schedule

group-4-2016

The following is the tentative podcast schedule for the rest of the month, where we talk about all things ONTAP 9!

Week of June 3: Lee Caswell on “Why ONTAP 9”; ONTAP 9 overview with a special SolidFire announcement in a mini-podcast! (2.5 podcasts in one week!)
June 10: ONTAP 9 features: Data Protection
June 17: ONTAP 9 features: Flash Perf
June 24: ONTAP 9 features: ONTAP Select and SAN
June 30: ONTAP 9 features: FlexGroups
July 4: ONTAP 9 features: Manageability Tools

Stay tuned for great things!