We Need to “Tune” the Database

Regardless of your infrastructure whether you are running in the cloud or on-premise, there will always be a need to “tune your Database”.  I use the double quotes because this phrase seems to be a catch all statement used for a myriad of underlying issues. A seemingly obvious question; Is it really the Database that is under-performing or is it in fact some use case that is being forced to take the long way around?  

The short-term response normally consists of adding a few indexes here and there, but this only seems to befit specific use cases and maybe improves the efficiency slightly.

Nine times out of ten the medium-term response is to upgrade to the next level of infrastructure, be it the next generation of hardware or the next type of Virtual Machine or Instance.  This is in the hope that more CPU Power or memory will improve or mask the issue. A solution that typically only lasts for a few months.

Well, you may have successfully migrated or upgraded your system from A to B, but have things improved by the magnitude you had envisioned.  Or have some processes even degraded? In all honesty, we see these band-aid solutions and outcomes all the time.

So, what is the long-term approach?  Let’s take a step back and review the common situations enterprises find themselves.

  1. Your datasets have grown from Gigabytes to Terabytes in just a few years or even months
  2. You have heavily customised your out-of-the-box applications
  3. No one is looking at the distribution of the data

Could the performance problems be due to how the data is being accessed and retrieved?  Maybe the set of queries that process the monthly billing run or produce the scheduled reports are now two years old and are no longer appropriate for the volume, type or method by which the data is stored. Other than re-writing the application code what else can be done?

One of our first activities is to focus on the Data Management.  It seems to me we are constantly being told how important data is for business but does your organisation have a clearly defined:

  • Data Architecture
  • Data Design
  • Data Partitioning Strategy
  • Data Archival Strategy
  • Data Clustering Strategy

These Data Management fundamentals should form the basis of every successful operation, especially now with the expectation of Big Data and Machine Learning.  It is imperative that we get the basics right, because without good foundations how do we expect to reach the next level!

Consult with Fusion Professional to discover how our best practices can ensure your enterprise data management is not holding you back.

Fusion Insights

Our Client is a well-known Australian freight logistics company, operating in railway freight and shipping.  The company embarked on a…

MORE INFORMATION

Data warehouse management and data analytics always had the challenge to decide what data to store and for how long…

MORE INFORMATION

Cloud computing is becoming a preferred storage platform for IT managers and organisations in general. In Australia alone, 31 percent…

MORE INFORMATION

Serving your customer in the best possible, most efficient way should always be the major goal of any organisation. The…

MORE INFORMATION

Moving out from proprietary software seems like a daredevil act, considering the possible data security issues some open source databases…

MORE INFORMATION

The Challenge Complex IT environments can pose significant technical risk that, if not managed adequately, have the potential of major…

MORE INFORMATION

Fusion Professionals has signed a partnership agreement with Waterline Data ( https://www.waterlinedata.com/ ) the leading provider of Information Catalogs and…

MORE INFORMATION

Most people do not like change. As much as possible, they want things to stay the same that is why,…

MORE INFORMATION

Regardless of your infrastructure whether you are running in the cloud or on-premise, there will always be a need to…

MORE INFORMATION

Data Analytics tools provide Data Scientists and Data Engineers with the instruments to find patterns in data and provide business…

MORE INFORMATION

Fusion Professionals held its Fusion Meld 2018 event last Thursday, the 17th of May at the Terrace Hotel in North…

MORE INFORMATION

Over the past 10 years, data has grown into a behemoth that dominates business intelligence. A huge percentage of the…

MORE INFORMATION

A data lab is a well-equipped environment that allows organisations to explore and examine new ideas by combining new data…

MORE INFORMATION

Technology is changing our world at a rapid rate. For companies to stay competitive they must adapt to the changing…

MORE INFORMATION

Another 12 months passes and the AWS Summit rolls into town, now hosted at the new impressive Sydney ICC!   So what…

MORE INFORMATION

DevOps has well and truly arrived. Having a team combining development and operations is superseding the traditional model where these…

MORE INFORMATION

We may not know it, but we’re consuming huge amounts of data every day. Whether it’s through Siri, Google, Microsoft,…

MORE INFORMATION

Fusion Professionals, a Sydney-based IT consulting firm and a Gold level member of the Oracle Partner Network (OPN) today announced…

MORE INFORMATION

This week Fusion Professionals held their annual summit at the Rag & Famish hotel in North Sydney. The summit is…

MORE INFORMATION

Working with a large, well-resourced enterprise has many benefits –  including having the scope to look at new ways of…

MORE INFORMATION