The Importance of Orchestration in DataOps: Insights by Basil Faruqui, BMC

### The Importance of Data Operationalization and the Role of DataOps

In the world of enterprise, data plays a crucial role, and its effective utilization is often linked to the involvement of CEOs in data initiatives. However, a significant challenge arises when it comes to bringing data projects into production. According to Gartner’s assessment in 2016, only 15% of data projects actually make it to the production stage. This is where the concept of operationalization comes in, helping organizations transform their data into a viable digital transformation strategy. Data operationalization builds upon the foundation laid by DevOps and is considered essential for successful data initiatives.

#### The Consequences of Lack of Data and Analytics Operationalization Framework

Gartner warns that organizations that fail to establish a sustainable data and analytics operationalization framework by 2024 will experience setbacks in their initiatives, lasting up to two years. This highlights the criticality of having a well-defined operationalization process in place. Good orchestration is key in making operationalization successful.

#### The Role of Control-M in Data Operationalization

Control-M, developed by BMC, is a vital tool in the orchestration of data operationalization processes. Control-M has been used by organizations for over three decades to facilitate the execution of batch jobs and optimize complex operations such as supply chain management. With the increasing complexity of technology landscapes, including on-premises, cloud, and SaaS-based orchestration, BMC launched BMC Helix Control-M in 2020, enabling organizations to keep up with evolving technologies and consumption models.

#### A Case Study: Hershey’s Use of Control-M for Data Operationalization

Hershey’s, a renowned food manufacturer known for its complex supply chain, heavily relies on Control-M for its operations. From running time-sensitive holiday campaigns to making important decisions regarding product shipments, Hershey’s leverages data-driven insights. Data ingestion is performed by extracting data from various systems of record, both internal and external to the company. This data is then processed using AI and ML algorithms within massive data lakes. The insights generated are presented to business executives through analytics dashboards and reports, empowering them to make informed decisions. Control-M plays a crucial role in connecting various systems, such as SAP, which continuously update with workflows, ensuring seamless data pipeline orchestration.

#### DataOps, Orchestration, and the Future

While DataOps is a critical component of BMC’s strategy, it is not the only focus. Orchestration plays a vital role in ensuring the efficient flow of data throughout the operationalization process. BMC recognizes the complexity of the AI and ML space, with various tools and capabilities constantly emerging from vendors like AWS, Azure, and Google. To keep up with the ever-evolving landscape, orchestration solutions must integrate seamlessly with new technologies, providing customers with the ability to rapidly test and adopt new tools without reinventing the orchestration process each time.

As organizations continue to embrace AI, ML, and big data, the importance of data operationalization and orchestration will only increase. Solutions like Control-M from BMC enable organizations to effectively manage their data pipelines, automate processes, and unlock the full potential of their data for successful digital transformation.