Analytics header

Showing posts with label machine learning. Show all posts
Showing posts with label machine learning. Show all posts

Tuesday, June 17, 2025

How Holonic Dreams are Becoming Manufacturing Realities

Let me tell you, there are few things more thrilling than seeing a concept you poured your heart into decades ago slowly coming to life in ways you barely dared to dream. For me, that feeling hits hard with the incredible capabilities of AI in general, and specifically, Generative AI . These aren't just buzzwords; they're fundamentally reshaping how we think about digital manufacturing (or whatever the latest term is). While Generative AI is phenomenal for creating content, designing new products, or even simulating complex processes, its true power in manufacturing often lies in its ability to empower something even more profound - Multi-Agent systems. This is the realization of Holonic concepts in a composable manner to enable agile manufacturing with Agentic AI .

When I see these advancements I am just mesmerized and my mind goes back to the 1990s. That’s when my journey into this future really began, deeply immersed in the world of Holonic Manufacturing Systems (HMS) and the emerging field of multi-agent systems.

Back then, I was a young researcher PhD working a methodology and architecture for Holonic manufacturing systems in collaboration with other like minded researchers as part of global consortium. It wasn’t just an academic exercise; it was a burning ambition to make manufacturing truly agile and resilient. I envisioned a factory floor that wasn't a rigid, top-down hierarchy, but a vibrant, decentralized network of intelligent, collaborative entities – what we called "holons."

The Holonic Vision: A Glimpse into the Future I Believed In

Imagine a shop floor where every machine, every production cell, every product, wasn't just a passive component but an intelligent "holon" – a self-contained, self-regulating unit. They would have their own smarts, making decisions, talking to each other, and collectively adapting to whatever curveball the market threw at them. Koestler's concept of a "holon" – simultaneously a whole and a part – perfectly captured this idea of distributed intelligence.

The benefits? Oh, they were clear and seemed a world away but yet an eerily anticipatory need of the current political and economic circumstances.
  • Agility beyond belief : Reconfiguring production lines in a flash, launching new products on a dime, responding to customer demands with unprecedented speed.
  • Built-in resilience : If one holon stumbled, the others would dynamically pick up the slack, re-routing operations to keep things flowing. Downtime issue would be a distant memory.
  • Seamless scalability : Adding new machines or processes would be like plugging in a new module, effortlessly integrating into the intelligent network.
  • Optimization from within : Local decisions by these smart holons would ripple up to optimize the entire system, far surpassing anything a central, rigid control system could ever hope to achieve.
This wasn't just theory; it was a blueprint for a manufacturing revolution.

We are Still Waiting for a Digital Manufacturing's Breakthrough

The holonic concept was the perfect architectural dream, but the engine to power it, multi-agent systems, was still in its infancy. My research in the 90's focused on how to design these agent systems, how to give them that holonic spirit, but the reality was that our ambition ran ahead of the available technology. We were hitting walls. The computational power needed to run complex agent logic on shop-floor controllers was simply astronomical for the time. Getting a multitude of agents to communicate reliably and securely across a factory? That was a networking nightmare. And then the AI capabilities were nascent, a whisper of potential, compared to the what we wield in our hands today."

Those were exhilarating times for pure research, pushing the theoretical limits of what manufacturing could be. But bringing it to large-scale industrial reality? That was a bridge too far. Until now ...

Today's Reality: AI and Digital Infrastructure can Unleashing the Holonic Dream

Fast forward to today, and the technological landscape has dramatically evolved. The convergence of several critical advancements has not only rendered the holonic vision achievable but has propelled it into operational realms previously unimaginable:
  1. Advanced AI and Machine Learning Capabilities : Modern Artificial Intelligence and Machine Learning algorithms now provide the sophisticated analytical and cognitive capabilities for individual software agents. These algorithms enable agents to learn from large-scale industrial datasets, execute robust predictive analytics with high precision, and achieve adaptive process optimization in real-time. This represents a fundamental shift from deterministic, rule-based systems to dynamic, self-optimizing intelligence.
  2. The Industrial Internet of Things (IIoT) as the Network of Agents, Powered by Agentic AI : This is where the core holonic vision finds its full realization. The Industrial Internet of Things (IIoT) is not merely a collection of connected devices; it forms the very network of agents. The IIoT nodes themselves are designed as autonomous, intelligent agents . Each smart device, each sensor, each piece of equipment can be made to act as a data acquisition point and, crucially, as a decentralized intelligent entity. The emergence of Agentic AI imbues these IIoT nodes with advanced capabilities for complex task decomposition, strategic planning, execution, and critical self-reflection. This synergy of IIoT as the foundational agent network and Agentic AI providing the cognitive layer directly mirrors the autonomous and cooperative principles fundamental to our original holonic concepts, enabling seamless interoperable collaboration across the manufacturing ecosystem. 

Futuristic Use Cases Becoming Reality: Empowering the Digital Twin for Tomorrow's Factory


For all these visions to truly become reality, we needed more than just powerful tech; we needed a concept that can effectively by applied to the realities of a physical operation. Here we can use a Digital Twin approach to represent the reality of the operation and build a foundational model with a set of constructs that aligned perfectly with the holonic principles I’d spent years researching.
This is also where Agentic AI enters the stage, becoming the intelligence that breathes life into this digital replica. My research from the 90s proposed a consistent model for these foundational constructs, embodying them as intelligent Product, Order, and Resource agents (or holons). This was the blueprint for how the real-world manufacturing elements could become autonomous, cooperative entities within the digital twin.

Let's step into this future for a moment, and I’ll paint a picture of what a manufacturing operation truly looks like when its digital twin is powered by these agentic principles, or in other words a next generation paradigm shifting composable manufacturing system . In this world, a work order isn't just data on a screen; it instantly awakens an intelligent Order Agent within the digital twin - or plainly the manufacturing system. This agent immediately gets to work, dynamically negotiating with Resource Agents —the digital representations of machines, tooling, even the specific human expertise required—to secure optimal production slots and materials in the virtual space, which then collaboratively drives actions in the physical factory assisting operators in orchestrating the operation.

As raw materials enter the facility, each component, or even the nascent product itself, manifests as a Product Agent within this digital twin. This agent carries its own unique digital identity and manufacturing instructions, literally guiding operators to route its counterpart through the physical production line. It's constantly communicating its status and needs within the digital twin, ensuring it receives the precise processing at each stage in the real world. If a specific machine (a Resource Agent ) suddenly reports a slight anomaly – say, a bearing starting to warm up – its built-in intelligence within the digital twin instantly flags it. Instead of waiting for a catastrophic failure, the line's collective intelligence, orchestrated by operators using the various software agents operating within this digital twin environment, might subtly re-route the physical Product Agent to an alternative, readily available machine. Or, better yet, the affected Resource Agent might even initiate a precise, self-healing routine or schedule a just-in-time, predictive maintenance intervention, ensuring that the issue is resolved before it impacts production, all while the Order Agent helps ensure deadlines are still met.

Quality control isn't a post-production check; it's baked into every micro-decision. Product Agents and Resource Agents , leveraging their digital twin data, are continuously monitoring parameters, spotting the tiniest deviation, and triggering immediate corrective actions to ensure "right first time". This seamless, autonomous orchestration – where products find their way, orders fulfill themselves, and machines manage their own well-being, all empowered through the precise, real-time fidelity of their digital twins – transforms the factory into a living, breathing, self-optimizing organism. It’s a level of agility, efficiency, and resilience that felt like pure science fiction in the 90s, but is now can become our tangible reality.

This leads us to an operational reality where the use cases that may seem futuristic are in fact possible , for example:
  • Self-Optimizing Production Lines : Imagine entire lines monitoring themselves, sniffing out bottlenecks, predicting breakdowns, and then autonomously re-routing production or tweaking parameters to keep output optimal. Empowering human operators with currently unimaginable support in orchestrating operations.
  • Dynamic Resource Allocation : Agents negotiating for machines, tools, and materials in real-time, ensuring every asset is utilized perfectly, eliminating idle time. Elevating scheduling and dispatching to unheard of levels of effectiveness and accuracy. 
  • Predictive Maintenance and Self-Healing Systems : No more waiting for a breakdown. Agents predict failures with incredible accuracy and can even kick off self-repair routines or proactive maintenance, slashing downtime and costs.
  • Enhanced Quality Control : Agents tirelessly monitoring processes and product quality, spotting deviations instantly and triggering immediate corrective actions. This is "right first time" manufacturing, every time.
  • Boosted Compliance : Automated data collection, precise procedure execution, immutable digital records – agentic systems dramatically reduce human error and guarantee adherence to the toughest regulations.
  • Unparalleled Traceability : Every single action, every decision by an agent, meticulously recorded. Audit trails become pristine, investigations swift and clear.
  • Driving "Right First Time" : By minimizing variability and providing real-time feedback, these systems help ensure products meet quality specs from the outset, slashing costly rework.
  • Accelerated Innovation : With more efficient, reliable processes, companies can pour more resources into R&D, bringing life-saving drugs or mission-critical components to market faster.
The journey from the elegant theories of holonic manufacturing systems to the practical, jaw-dropping capabilities of Agentic AI has been long, but intensely rewarding. What started as pure academic curiosity, exploring the power of decentralized, intelligent control, has now become the very bedrock of digital transformation in manufacturing. We’re no longer just imagining; we are actively building factories that learn, adapt, and optimize themselves , powered by the incredible, collaborative intelligence of software agents, physical machines, and empowered humans. It's a testament to the enduring power of fundamental research, a strategic commitment to true digital transformation, and the relentless, accelerating pace of technological innovation.

But hold on, not so fast. Here’s where my passion often turns to frustration. We have the technology today, and more is coming fast – innovation is accelerating at an exponential rate! Yet, a fundamental problem persists in manufacturing: so many companies still don't grasp that adopting digital technology demands a profound transformation , not just a simple upgrade.

The Agility Forum , a 1990 initiative to transform manufacturing, proclaimed that we need to thrive in an environment where change is the only constant. In today's volatile business landscape – marked by unprecedented geopolitical shifts, rapid market fluctuations, and increasingly fragile global supply chains – this is not longer a theory; it's the raw truth of survival. While our research in the 90s certainly anticipated a future of greater dynamism and the critical need for manufacturing systems to adapt , even we couldn't have fully foreseen the sheer velocity and breadth of the disruptions we face now.

This intense, continuous flux means leveraging that change, embracing agility itself, as your ultimate competitive advantage. The sheer ability to adapt, to pivot swiftly, and to continuously evolve your operations is precisely what will differentiate leaders from those left behind. In this dynamic landscape, digital transformation is not a static one time event, nor is it a project with a defined end; it is a continuous process of adaptation to changing business and technological environments - hence we need to start talking about Continuous Transformation .

The core issue isn’t the lack of innovative tools; it’s the mental, organizational, and cultural shift required to truly embrace them - yes its still really about people . Real digital manufacturing means rethinking everything – your processes, your workflows, even how you do business. It’s a complete reimagining, and that's precisely why the original holonic concepts, now enabled by modern tech, offer the inspiration for a breakthrough path. Embrace this paradigm shift, or risk being outmaneuvered by those who do. The future of manufacturing is intelligent, interconnected, and increasingly autonomous, built directly on the visionary concepts laid down decades ago.

Sunday, August 18, 2024

About Accountants and Production Managers: ERP vs. MES

This is a rewrite of a whitepaper that I published in 2004 based on a long and frustrating MES selection process where the "can I use my ERP as MES" misunderstanding went rampant. I find that the discussion is still very relevant today and the topic gets even more confusing with some of the emerging digital technologies in this space. So this is an attempt to bring more clarity...

About ERP and MES

With today’s increasingly accelerating manufacturing technology innovation, digital transformation is critical for staying competitive. Among the key systems that have traditionally driven manufacturing operations are Manufacturing Execution Systems (MES) and Enterprise Resource Planning (ERP) systems. The myriad of opinions and discussion on these concept in the context of digital transformation and therefore understanding the differences between these two systems is crucial. In addition, as digital technologies continue to advance, the lines between MES and ERP are increasingly blurring, especially with the advent of No-Code democratization and Frontline Operations Platforms. I have found that and effective ways to conceptualize this is through the analogy of a production manager and a company accountant.


The Accountant: ERP’s Role in Manufacturing

In the last decade ERP systems have seen massive proliferation into many businesses, including manufacturing businesses. These businesses have invested heavily in ERP systems and today struggle to realize payback from these investments. In the case of manufacturing businesses, realizing ROI is logically focused on the production floor, an area in which ERPs are traditionally considered weak.

As the ERP market becomes increasingly saturated, vendors are looking for ways to increase revenue and expand their footprint. ERP vendors have turned their attention to shop floor management and manufacturing execution systems (MES). By adding MES functionality, they can increase license revenue. 

Consider the role of an accountant in a manufacturing company. The accountant manages financial records, oversees budgets, handles payroll, and ensures that all financial transactions comply with regulations. Their work involves high-level data analysis, financial forecasting, and strategic decision-making that influences the entire organization. This is akin to the role of an ERP system.

At their core, ERP systems are advanced accounting information management systems, they are enterprise-wide management tools designed to integrate various functions across a business. In manufacturing, ERP systems handle tasks such as procurement, inventory management, finance, human resources, and supply chain operations. They provide planning tools like Material Requirements Planning (MRP) and Manufacturing Resource Planning (MRP II), which help companies predict future resource needs based on historical data and forecasts.

However, despite their comprehensive nature, ERP systems are not designed to manage the real-time, dynamic environment of the production floor. They excel at providing a broad, strategic view but lack the granular control needed to manage the intricacies of manufacturing processes. Just as an accountant isn’t equipped to manage the day-to-day operations on the production floor, an ERP system isn’t designed to handle the real-time demands of production management.

The Production Manager: MES’s Role on the Shop Floor

MESs have evolved to address the inherently complex production management functions. An MES is a specialized system focused on the shop floor, where it manages real-time production activities. It coordinates equipment, workers, materials, and processes to ensure that production is carried out according to plan. Unlike ERP systems, MES operates in real-time, responding instantly to changes and ensuring that production goals are met. It tracks production data minute by minute, making it possible to identify and correct issues as they arise.

Imagine the role of a production manager. This person is in the thick of things, ensuring that production runs smoothly and efficiently. They manage workers, monitor machines, and make real-time decisions to keep everything on track. The production manager is intimately familiar with the production process, knows when to adjust schedules, and reacts quickly to any disruptions. This role exemplifies what an MES does in a manufacturing environment.

While ERP provides a high-level overview of production schedules and resources, MES is concerned with execution ensuring that production is executed as planned. MES is deeply integrated with the physical aspects of manufacturing, enabling it to manage the nuances of the production process that ERP systems cannot.

Differences Between MES and ERP


Aspect

ERP 

(Enterprise Resource Planning)

MES 

(Manufacturing Execution System)

Scope and Focus

Covers a wide range of business functions across the entire enterprise. Designed for strategic planning and resource management across departments.

Specifically focused on the production floor, with deeper engagement in executing production processes, equipment monitoring, and labor management.


Data and Time Frame

Deals with high-level, aggregated data, often historical or forecast-based and financially biased. Works on a broader timeframe for long-term planning and decision-making.


Operates in real-time, handling detailed, granular data from the shop floor, responding immediately to production needs.

Integration and Flexibility

Integrates various business functions but often lacks the flexibility needed for real-time adjustments on the production floor.

Highly flexible and adaptable to the dynamic environment of manufacturing. Integrates with machinery, sensors, and other shop floor systems.

Decision-Making

Supports strategic, long-term decision-making at the corporate level, focusing on overall financial business performance and resource allocation.

Highly flexible and adaptable to the dynamic environment of manufacturing. Integrates with machinery, sensors, and other shop floor systems.



Blurring the Lines: How Digital Technologies Are Redefining MES and ERP


As digital transformation continues to reshape manufacturing, the era of traditional monolithic MES may be coming to an end. New technologies and platforms are presenting a different way to solve the shop floor management coordination challenge. Based on the foundations of MES these new solution incorporate advanced digital technologies such as No-Code, IIoT (Industrial Internet of Things), machine learning, AI-driven analytics, Generative AI and enhanced user interfaces. They offer a more holistic view of manufacturing operations, providing real-time insights that empower workers on the shop floor to make data-driven decisions.

Unlike traditional monolithic MES, which focused solely on production execution, the new breed of technologies leading with the Frontline Operations Platforms encompass a broader range of activities, including quality control, maintenance, lab operations, inventory management, and workforce training. This transformation is a direct response to the growing need for systems that not only manage production but also integrate seamlessly with other digital tools and platforms to enhance overall operational efficiency. It also aligns with the broader digital paradigm, where the goal is not just to automate existing processes but to create a more connected, intelligent, and responsive manufacturing environment. The integration capabilities of Frontline Operations Platforms enable a seamless flow of information between the shop floor and the enterprise level, blurring the traditional lines between MES and ERP.

Several key trends are driving this convergence:

1. IIoT and Real-Time Data Integration:

The proliferation of IIoT devices on the shop floor allows for the real-time collection and analysis of data. This data can be fed into both MES and ERP systems, enabling more informed decision-making across all levels of the organization. For instance, real-time production data captured by IIoT sensors can be used by the ERP system to adjust supply chain logistics or by the MES to optimize production schedules on the fly.

2. Advanced Analytics and AI:

Machine learning and AI are increasingly being used to analyze the vast amounts of data generated by manufacturing processes. These technologies enable predictive maintenance, demand forecasting, and process optimization, functions that traditionally belonged to either MES or ERP. The use of advanced analytics allows these systems to overlap, as both can now contribute to strategic and operational decision-making.

3. Human Centric Platforms:

The new no-code platforms take a human centric approach that break down the traditional process centric solution. They allow to build solution that can be used across manufacturing modalities and also allow to combine MES and ERP functionalities blurring the lines between the two. The new solutions provide a democratized platform for managing all operational process. Workers on the shop floor, managers, and executives can all access the same platform, though with different levels of detail and control, depending on their role.

4. Cloud Computing and Edge Computing:

The shift towards cloud-based solutions and edge computing is enabling greater integration and scalability of MES and ERP systems. Cloud computing allows for centralized data management, making it easier to integrate MES and ERP data. Edge computing, on the other hand, brings computational power closer to the production site, enabling real-time data processing and decision-making that benefits both MES and ERP functions.

5. Interoperability and Open Standards:

Increasingly, manufacturers are adopting interoperable systems that can communicate with each other through open standards. This trend is making it easier to integrate MES and ERP systems, allowing for a more seamless exchange of data and better collaboration between different departments.

The Future: A Converged System for Manufacturing Excellence

The convergence of MES and ERP functionalities into more integrated platforms represents the future of manufacturing. As these systems continue to evolve, they will offer manufacturers the ability to manage both high-level strategic planning and detailed operational execution through a single, cohesive platform. This convergence will enable a more agile and responsive manufacturing process, better equipped to meet the demands of the modern market. The systems are working together more closely than ever, driven by advancements in digital technology that empower manufacturers to achieve new levels of efficiency, flexibility, and innovation.

In Summary...

In the rapidly changing landscape of manufacturing, understanding the distinct yet increasingly interconnected roles of ERP and MES systems is crucial. As digital technologies continue to advance, these systems are evolving and converging, offering manufacturers a powerful toolset for driving operational excellence. The transformation of MES into Frontline Operations Platforms exemplifies this convergence, blurring the lines between strategic planning and operational execution. By embracing these integrated platforms, manufacturers can unlock new opportunities for efficiency, agility, and competitiveness, setting the stage for a new era of manufacturing excellence in the digital age.

Yet, it is naive and risky to assume that one of these systems can be extended to effectively do the other’s job. Similarly, one would not assign an accountant to be a production manager, or vice versa. Each might be an expert in his own field, yet it takes a completely different set of skills, expertise and knowledge to effectively tackle each task.


Saturday, July 8, 2023

To Data Model or not to Data Model Part II - What to Data Model

The previous post about Data Models included a bit of a long winded discussion of why strict monolithic data models are not the alternative in the new paradigm. The main conclusion was that rather than focus on design of a strict data model for all of manufacturing lets step back and understand the problem that needs to be solved. The discussion is a bit theoretic and that is why I am compelled to go one level of detail deeper in an attempt to clarify some of the concepts. 

What do we need to help us in the transformation journey to maturity, how can we achieve Visibility, Transparency, Predictive Capacity and Adaptability? We need to shift the thinking from "what is the correct data model?" to "what do we need to become  predictive, and adaptable?". First of all we need more data, start digitizing your operation - the majority of the data we need is still on paper and diverse electronic documents and spreadsheets. Second, and this is the topic of this post, understand the informational elements of your operation and define a loose data dictionary that supports your digitization initiatives and citizen developers. With that and modern and emerging technologies for data analysis including AI/ML you will be able to gain the required insights and intelligence without a strict standardized monolithic relational data model. This will allow freedom within an organization for people to capture data without having to spend immense efforts in curating and micro managing how the data is stored and structured. Remember democratization and citizen development are a key enabler of digital transformation, their creative abilities with no-code technologies is the fastest way to digitize and instrument the operations. Get more digital data fast, its more important than how its structured and don't forget variety, multi media etc.

In my close to 30 years of studying the manufacturing domain it has become clear that there are just a few main and critical informational elements to a manufacturing operation. With that in mind I recommend an approach that uses generalization to help create transparency and interpretability but still allow for flexibility for specific use cases and varying degrees of complexity. The following generalization allows for a top down perspective into the complexity of a manufacturing operation. 


With this thinking, data about the artifacts represents the current status of each artifact, a single unique set of data (e.g. a row in a table). The processes that impact the artifact are captured in a historical record, a set of data for each significant transaction that transformed the state of the artifact (e.g. a running log). This results in a data set that represents real world artifact in a one to one relationship while everything that has happened to this artifact is captured in logs.  

If you create simple templates that allow contextualization of data at the source based on these simple rules you can with modern analytics tools rapidly get the insights that you need to mature digitally. I find that it works for both human driven analytics, from charting and graphing in Excel to Tableau, Sigma or whatever tool you prefer. Taking this even further you can super charge that with AI/ML driven analytics. I urge you to try, the good and easy thing is that the effort to build and use something like this with modern operational platforms is minimal compared to a building and using a complex relational data model. 

I also find that this model and generalization is a helpful tool to rapidly gain an understanding of a specific manufacturing operation. In fact I use it as a mental model when I do plant walk-thrus (Gemba walk) after which digital improvement ideas to observed operational challenges can be defined much faster and accurately. If you look closely many of the prevailing standards have the similar generalization but unfortunately have been overengineered past the point where they are practical.

Quickly understanding how a specific manufacturing system operates, from the machine to line and to the plant levels is the basis of digitization, its secret to gaining Visibility, Transparency, Predictive Capacity and Adaptability. Remember that is what we are after, the technology is just a means. If we can make it easier, more democratic, and adopted by the frontline masses then the network effect kicks-in and transformation happens faster, we gain productivity faster and we are well on our way to cross the digital divide.

Sunday, March 11, 2018

My head is in the Cloud

I have spent the last 2 months coming up to speed with SaaS, The Cloud, Big Data and advanced analytics. Wow, I am amazed at how far technology has come. In the last 7 years it seems I have moved further and further away from software technology with my increasing operational responsibilities. I did my best to follow the general trends and progress but really never in enough depth. I knew there was something “big” happening but kept thinking “I know what is going on…”, “I should have a general understanding…”. When I stopped to really understand how far some of these technologies, we group under the “Industry 4.0” umbrella, have come I found it quite astounding!

The power of artificial intelligence (AI) and machine learning (ML) algorithms that are able find patterns we never knew existed in vast amounts and use this information to predict future behavior is amazing. Stories such as the one where Target (the retail store) was able to identify a girl as pregnant before her dad knew, stand as proof. I have also found the ease at which data can send data to the Cloud is just hard to understand. We have been fighting the connectivity and data contextualization problem for such a long time that its hard to believe it can be done any other way. If we take a breather, step out of the ditch and take a look around then we can quickly realize - we don’t need to do this anymore! Data can be collected by software agents running on everything from a server to a sensor and configured through a digital twin. There is no need to format, convert, transform or contextualize the collected data. In fact the AI and ML algorithms work best if we keep it unstructured and the smaller the data sets the better.

This is all very exciting and the more I think about how we can use these technologies the more more encouraged I am that we can achieve true manufacturing intelligence. The ability to have a real time picture of everything that is going on in our manufacturing plant is simple and achievable. On top of that we can discover relationships between processes and artifacts that we never imagined existed, and use these to improve, to better operate, and maybe stop the great firefight that is operating a plant. We can transform the daily operational meetings to something akin of a weather forecast - wouldn’t that be something to watch?