Databases and Storage: The New Frontier

    By: Leighton Nelson on Jun 04, 2018

    As database and storage administrators and engineers, it is important to understand the effect that storage has on databases and the impact of storage performance.

    It is important to understand that databases are an extension of your storage and requires a holistic view when designing and managing solutions that use the database. This tip gives an overview of the Oracle database storage landscape — past, present and future. It’s not meant as in-depth technical treatment of the topic, but opens the door for more discussion and engagement about database storage.


    Both storage and databases continue to evolve, albeit at different paces. About a decade ago, the enterprise storage of choice was the Storage Area Network, or SAN array. At about the same time, the current release of Oracle was 10gR1, which introduced Automatic Storage Management (ASM), provided mirroring and striping capabilities for data files.

    Database sizes were typically in the hundreds of gigabytes. With the current database release of Oracle 12c, new storage features such as Automatic Data Optimization (ADO) and Heat Maps have been introduced to enable automatic and intelligent storage tiering within the database.

    Data growth has also exploded and sizes ranging from tens to hundreds of terabytes are now common. Features such as advanced compression (with hybrid columnar compression with Oracle ZFS appliance or Exadata) can significantly reduce the amount of storage required. Additionally, when it comes to data resilience, the landscape has also significantly changed from the use of magnetic tape devices such as LTO to highly available disk-based solutions with de-duplication and replication.

    We’ve also witnessed the proliferation of server virtualization for improving hardware efficiency. Given the evolution rate of these technologies. it becomes increasingly important for storage management professionals to keep up arm themselves with the knowledge needed to work effectively.


    When it comes to storage performance, we’re often bombarded by three specs: latency, bandwidth and IOPS. But does this tell the whole story? The short answer is “No.” Each application has its own I/O requirements that are not captured by vendor benchmarks. Data access workloads (random versus sequential) and ratios, I/O sizes all play apart in storage performance. Your data warehouse on fiber-attached SAN arrays with rotating disks may give excellent performance (throughput and bandwidth), but your OLTP workload for an online application on the same array may totally suck! Can you say “latency?”

    How can one truly measure storage performance? For seasoned Oracle database professionals, the answer may seem obvious: response times. But which metrics are relevant for measurement when storage is involved? The Oracle database has a well-instrumented wait interface. However, it is not perfect due to the nature of sampling.

    That said, tools such as Automatic Workload Repository (AWR) and Statspack can provide a wealth of information about database performance and I/O metrics (including histograms). From a back-end storage perspective, there are tools from storage vendors that provide relevant metrics. Some vendors such even provide plug-ins for Oracle Enterprise Manager Cloud Control 12c to enable central collection and reporting of storage metrics.

    Speaking of measurement: You can find great tools to benchmark your Oracle database storage such as SLOB and fio.


    Until a few years ago, rotating disks had all but dominated enterprise storage. While not a brand-new technology, flash storage has started to proliferate the IT infrastructure in the form of SSD and, more recently, all-flash arrays. Flash provides low-latency I/O. Traditional hard-disk have service times in the milliseconds while that of flash is typically in the nanoseconds. Does that mean that you should dump all your disks for a flash-based solution? Probably not.

    While flash is great at providing random I/O, spinning disk is still OK for sequential I/O. While moving all your redo logs to Flash may improve response times, it may not give you the best bang for your buck, especially if there are other I/O bottlenecks. There are other issues such as durability and resilience that affect Flash, but these are becoming non-issues as the technology improves.

    Software is the New Hardware

    What’s next for database storage? Flash technology is now becoming mainstream, and the industry is looking toward [hyper] converged infrastructure. Yes, another marketing buzzword. In a nutshell, converged infrastructure involves putting storage, network and computing resources in a single hardware unit. It’s no surprise that storage has followed suit in the form of software-defined-storage (SDS) and storage virtual machines (SVM).

    As an example, some vendors virtualize storage controllers in software. This allows for an agnostic storage back-end (i.e., DAS, SAN/FC, NFS). Interestingly, Oracle has continued to implement more storage related features at the database layer (e.g., Flex ASM, ACFS aka Cloud Filesystem — a POSIX compliant general purpose filesystem that includes Snapshots, Replication along with DBFS and Direct NFS).

    By virtualizing hardware, storage resources businesses can become more agile (yes, another buzzword) and efficient.

    What’s Next?

    With the new storage frontier upon us, how does one keep up and learn more about their database storage?

    The IOUG Storage SIG is a great way to keep on what’s going on in the world of Oracle and database storage. There are whitepapers and webinars from Oracle product managers, partners and end-users. Also, check out the references section for links to whitepapers, articles and blogs from notable experts in the Oracle community.


    Kevin Closson (SLOB author):

    Flashdba: “Storage for DBAs.”

    James Morle: “Scaling Oracle 8i.”

    Frits Hoogland:

    Michael Webster:

    Kyle Hailey: “Lies, Damned Lies, and I/O Statistics.”

    Lonny Niederstadt: “sql.sasquatch.”


    Leighton Nelson works as an instructor at Delphix, providing education to customers for Delphix Virtualization and Masking products. He has more than a decade of experience working in various data roles including database administrator, developer and consultant with Oracle, MS SQL Server and MySQL among others.

    Nelson holds a Bachelor of Science degree in Computer Science, Oracle 11g RAC Expert, Oracle Database 12c and VMware VCA-DCV certifications as well as Oracle ACE recognition. He is also a co-author on Expert Oracle Enterprise Manager 12c published by Apress.

    Released: June 4, 2018, 9:08 am | Updated: June 12, 2018, 7:41 am
    Keywords: IOUGenius | dba | storage

    Copyright © 2018 Communication Center. All Rights Reserved
    All material, files, logos and trademarks within this site are properties of their respective organizations.
    Terms of Service - Privacy Policy - Contact

    Independent Oracle Users Group
    330 N. Wabash Ave., Suite 2000, Chicago, IL 60611
    phone: 312-245-1579 | email:

    IOUG Logo

    Copyright © 1993-2018 by the Independent Oracle Users Group
    Terms of Use | Privacy Policy