Event : Fusion Executive Breakfast – Data Innovation (22-Aug-2017)
Fusion Professionals and Australian research and advisory firm BigInsights, recently hosted an industry breakfast to discuss how organisations can capitalise on the Big Data movement and deliver real time business insights through data analytics.
Keynote speakers included Achim Drescher, Principal Data Architect, from Fusion Professionals and Raj Dalal, Founder and Principal of BigInsights. Achim presented the evolution of data analytics and what to expect with Big Data in the next five years. Mr Dalal provided insights into the catalyst of the data-driven change and delivered examples of organisations leading the way in Big Data.
BUT WHAT IS BIG DATA?
Big Data comes in the form of both structured and unstructured datasets that are available in a continuous stream. These large volumes of data represent opportunities and threats for organisations, used wisely they can provide near real time data insights, used frivolously they can become data swamps and very expensive to maintain and analyse. Big Data provides the potential for organisations to act faster and provide better service to customers.
To keep a competitive advantage, organisations must adapt to a more personalised customer experience by using Big Data wisely. With new technology offering faster insights and processing ability, now is the optimum time to leverage the capabilities of data.
THE 3RD WAVE OF DATA ANALYTICS
Over 30 years ago, businesses were driven by people where data was collected and stored by departments. Newspapers, television and billboards were the main means of connecting with customers. With the information age, data warehouses brought operations, data insights and departments together with computers and technology such as social media and Smartphones have continued the wave. This is gathering momentum empowered by cloud platforms and the emergence of Artificial Intelligence. In the next 5 years, real time customer analytics driven by Big Data will be common practice.
Early innovators such as Alibaba, Airbnb and Uber have all developed large data models to welcome the third wave of data analytics. Fusion Professionals foresee that in 3-5 years, all organisations will be using similar data models.
For example, airline systems ingest booking data in real time with up to 3,000 fields (flights, people, locations etc.) and up to 2,000 records of repeating structures. With an average of 20 transactions per second and up to 80 transactions per second in peak times, airline booking systems require a comprehensive architecture including a Data Lake feed by multiple data streams, a structured service layer, API, data visualisation tools and data replication to process this volume of information.
The below infographic is a high-level architecture example of an airline booking. This is an overview of structural requirements and architecture needed for Big Data.
Australia has more users on Facebook compared to the United States and also ranks in the top three countries when it comes to mobile broadband usage. From the rise of the humble smartphone, every click made, every swipe taken has been stored. The challenge for organisations today, is how to effectively manage this continuous stream of data to inform business decisions. The early innovators are using data science to deliver hyper-personalised customer experiences. Increasing competition and consumer behaviour is forcing companies to look to data for competitive advantage. More so now than ever, data analytics is the key to digital transformation.
The opportunity for data analytics lies in customer intimacy, operational excellence (predictive maintenance and fraud reduction) and product excellence. 70% of data analytics projects have centered around the customer experience, but it’s now evolving with a need and continued emergence of Artificial Intelligence (AI) to support the ‘next generation’ platforms.
An example of one organisation spearheading operational excellence through Big Data is Lineage Logistics in the United States. They identified their warehouse was running out of space for new orders. For space efficiency, using Big Data, they evaluated stock movements over time and thus, reconfigured the warehouse racks to have three common spaces instead of one (i.e. tall, medium and small racks). As a result, they saw a 25% increase in warehouse density at 10% the cost of building a new warehouse.
Another example is Barclays Africa who have been using machine learning and data analytics, underpinned by Big Data, to increase customer engagement. With 12 million customers in 13 countries, their challenge was predicting when customers used their ATMs. They implemented a propensity model capability, which was developed as part of an end-to-end solution that determined the optimum time to contact a customer. With this model, they could predict the shortfall in bank accounts based on customers’ historical spending pattern. They alerted customers via an SMS on the next steps to take so they didn’t default on their account.
SUCCESS FACTORS OF A BIG DATA STRATEGY
But what does this mean for SME’s and how can they use Big Data? Fusion Professionals have developed the following factors that need to be taken into consideration to successfully implement Big Data and Data Lakes:
- Clearly defined vision for data and retention;
- Data should be of value;
- Effective visualisation of large data volumes;
- Variety of data types and subject areas (structured/unstructured);
- Consider the velocity of data flows and the retention period;
- Volume of data (cost vs benefit); and
- Veracity – accuracy of data.
By 2020, Big Data and Data Lakes will be common practice for all organisations. Not only to store data, but search and visualise data in a more seamless way with real time capability. This is what the future holds for the next 3-5 years.
“The best way to get started, is to get going!” Contact Fusion Professionals today to discover how we can optimise your platform and leverage Big Data to drive better business insights. Call us on +61 2 8569 0272 to find out more.
Another 12 months passes and the AWS Summit rolls into town, now hosted at the new impressive Sydney ICC! So what…MORE INFORMATION
DevOps has well and truly arrived. Having a team combining development and operations is superseding the traditional model where these…MORE INFORMATION
We may not know it, but we’re consuming huge amounts of data every day. Whether it’s through Siri, Google, Microsoft,…MORE INFORMATION
Fusion Professionals, a Sydney-based IT consulting firm and a Gold level member of the Oracle Partner Network (OPN) today announced…MORE INFORMATION
This week Fusion Professionals held their annual summit at the Rag & Famish hotel in North Sydney. The summit is…MORE INFORMATION
Working with a large, well-resourced enterprise has many benefits – including having the scope to look at new ways of…MORE INFORMATION
Who doesn’t like some certainty in their lives?! It’s human nature to crave it. So, when we are lining up…MORE INFORMATION
Building a business case is a familiar and routine process for any IT investment project. But is there a possibility…MORE INFORMATION
Fusion Professionals and Australian research and advisory firm BigInsights, recently hosted an industry breakfast to discuss how organisations can capitalise…MORE INFORMATION
Are you considering taking advantage of the Amazon Web Services (AWS) platform but are concerned about the risks involved in…MORE INFORMATION
Fusion Professionals is a proud sponsor of the Nikola Tesla – Unlimited Mind Exhibition in Sydney. For the very first…MORE INFORMATION
Large Australian Airline with over 30,000 employees and more than 6000 daily flights. OBJECTIVES In the Airline industry booking data…MORE INFORMATION
It’s been a while since Oracle held a business event in Sydney but the recent Oracle Modern Business Experience (MBX)…MORE INFORMATION
The Client is a Government electricity distributor, providing the safe and reliable supply of electricity to 2.4 million people in…MORE INFORMATION
The “WannaCry” ransomware campaign has targeted a number of organisations internationally including the UK’s National Health Service and Spanish telecommunications…MORE INFORMATION
The Client is an Australian freight logistics company, operating in railway freight and shipping. The company embarked on a major…MORE INFORMATION
The end customer of any technology solution expects a seamless service delivery. They shouldn’t be the ones to alert you…MORE INFORMATION
The Client is a Government Health Organisation, operating in providing World-class, patient-centred and digitally enabled healthcare with the goal “‘the…MORE INFORMATION
Technology platforms are the critical middle layer of the traditional technology stack. They rely on the infrastructure which supports them…MORE INFORMATION
Don’t ignore the critical platform layer – and its potential contribution to system downtime Cloud technology is fuelling change in…MORE INFORMATION