We Need to “Tune” the Database

Regardless of your infrastructure whether you are running in the cloud or on-premise, there will always be a need to “tune your Database”.  I use the double quotes because this phrase seems to be a catch all statement used for a myriad of underlying issues. A seemingly obvious question; Is it really the Database that is under-performing or is it in fact some use case that is being forced to take the long way around?  

The short-term response normally consists of adding a few indexes here and there, but this only seems to befit specific use cases and maybe improves the efficiency slightly.

Nine times out of ten the medium-term response is to upgrade to the next level of infrastructure, be it the next generation of hardware or the next type of Virtual Machine or Instance.  This is in the hope that more CPU Power or memory will improve or mask the issue. A solution that typically only lasts for a few months.

Well, you may have successfully migrated or upgraded your system from A to B, but have things improved by the magnitude you had envisioned.  Or have some processes even degraded? In all honesty, we see these band-aid solutions and outcomes all the time.

So, what is the long-term approach?  Let’s take a step back and review the common situations enterprises find themselves.

  1. Your datasets have grown from Gigabytes to Terabytes in just a few years or even months
  2. You have heavily customised your out-of-the-box applications
  3. No one is looking at the distribution of the data

Could the performance problems be due to how the data is being accessed and retrieved?  Maybe the set of queries that process the monthly billing run or produce the scheduled reports are now two years old and are no longer appropriate for the volume, type or method by which the data is stored. Other than re-writing the application code what else can be done?

One of our first activities is to focus on the Data Management.  It seems to me we are constantly being told how important data is for business but does your organisation have a clearly defined:

  • Data Architecture
  • Data Design
  • Data Partitioning Strategy
  • Data Archival Strategy
  • Data Clustering Strategy

These Data Management fundamentals should form the basis of every successful operation, especially now with the expectation of Big Data and Machine Learning.  It is imperative that we get the basics right, because without good foundations how do we expect to reach the next level!

Consult with Fusion Professional to discover how our best practices can ensure your enterprise data management is not holding you back.

Fusion Insights

Statistical language models apply probability distributions to a sequence of words. These models are finding increasing use as natural language…

MORE INFORMATION

Challenges The Company, one of Australia’s largest and fastest growing Telco companies had 2 primary SharePoint environments that had different…

MORE INFORMATION

Containerization allows applications to run on any machine- anytime, anywhere so long as they are compatible. By virtualizing your OS,…

MORE INFORMATION

So you’ve finally decided that the cloud is safer than corporate data centers and digital assets and you’ve chosen to…

MORE INFORMATION

Building a system that houses your organisation’s data can be daunting, especially now that data acquisition is growing rapidly. The…

MORE INFORMATION

Human-to-machine communication has not yet been perfected, but enterprises are already beginning to integrate this groundbreaking technology into their operations,…

MORE INFORMATION

Fusion Professionals has signed a partnership agreement with MapR Technologies, provider of the industry’s leading data platform for AI and…

MORE INFORMATION

“Big data is at the foundation of all of the megatrends that are happening today, from social to mobile to…

MORE INFORMATION

In recent years data volumes have been increasing dramatically. This has created major challenges for traditional analytics platforms in terms…

MORE INFORMATION

With the increasing volumes of data that can be cost effectively stored in the cloud, comes increasing responsibility. The current…

MORE INFORMATION

With the advancement of technology and abundance of data your business receives on a daily basis, companies are now in…

MORE INFORMATION

Fusion Professionals held its annual Fusion Summit last Thursday the 18th of October at the Rag and Famish Hotel in…

MORE INFORMATION

The Client is one of major NSW government departments providing services to public. The Department had been experiencing performance issues…

MORE INFORMATION

Though its conception dates back to 1979, containers made their mark as much needed, major technology assets in 2000. Digital…

MORE INFORMATION

Objective The intelligent mobile app-based lending system is a new field, blending recent technical developments in mobile phones and Artificial…

MORE INFORMATION

Our Client is a well-known Australian freight logistics company, operating in railway freight and shipping.  The company embarked on a…

MORE INFORMATION

Data warehouse management and data analytics always had the challenge to decide what data to store and for how long…

MORE INFORMATION

Cloud computing is becoming a preferred storage platform for IT managers and organisations in general. In Australia alone, 31 percent…

MORE INFORMATION

Serving your customer in the best possible, most efficient way should always be the major goal of any organisation. The…

MORE INFORMATION

Moving out from proprietary software seems like a daredevil act, considering the possible data security issues some open source databases…

MORE INFORMATION