Illusion of Control

Aug 6, 2024

Change often assumes control, yet unpredictability prevails. Embracing emergence over illusion fosters adaptation in an ever-shifting world.

Introduction

Analysing the illusion of control across three domains

Change initiatives, whether pursued at the personal level through self-improvement efforts, within organizations via strategic transformations, or across societies through policy reforms or social movements, are frequently predicated on an assumption of control. This assumption posits that human agents—individuals, leaders, or institutions—can meticulously design, execute, and predict outcomes through rational planning and structured interventions (Kotter, 1995).

Such a perspective aligns with a classical, mechanistic worldview, where systems are presumed to operate like machines with predictable responses to inputs. However, this belief often proves illusory when confronted with the inherent complexity, nonlinearity, and unpredictability of real-world systems (Prigogine & Stengers, 1984). This article critically examines the illusion of control across personal, organizational, and societal domains, drawing on thermodynamic principles (Prigogine & Nicolis, 1977), philosophical insights (Heisenberg, 1958/2007; Gödel, 1962), organizational theory (Boonstra, 2003; Senge, 1990), and complexity science (Shaw, 2002; Zuijderhoudt, 2007).

By synthesizing these perspectives, it challenges deterministic paradigms and proposes an adaptive, emergent approach to transformation. The current date, April 6, 2025, situates this discussion within an era of rapid technological and social flux, amplifying its relevance.



See the full version on your computer.



7 Steps to Make it worse

While fostering successful change requires adaptability, intentionally disrupting or “messing up” change initiatives can reveal the fragility of control-based approaches. Here are seven strategies to derail transformation efforts across personal, organizational, and societal contexts:

1. Insist on Rigid Plans:
Enforce unyielding schedules, ignoring feedback (Kotter, 1995).

2. Suppress Fluctuations:
Stifle deviations—personal insights, employee ideas—halting emergence (Prigogine & Nicolis, 1977).

3. Centralize Decisions:
Concentrate power, blocking decentralized order (Zuijderhoudt et al., 2002).

4. Ignore External Influences:
Dismiss relationships or trends, inviting failure (Boonstra, 2000).

5. Overemphasize Predictability:
Reject uncertainty for false certainty (Heisenberg, 1958/2007).

Theoretical Foundations:

Non-Equilibrium Dynamics

The scientific basis for rethinking control stems from non-equilibrium thermodynamics, pioneered by Ilya Prigogine. In their seminal work, Prigogine and Nicolis (1977) demonstrated that systems far from thermodynamic equilibrium—those experiencing significant energy and material flows—do not merely degrade into disorder but can spontaneously self-organize into complex configurations, termed dissipative structures. These structures emerge through fluctuations—small, random perturbations—that amplify under specific conditions, driving the system into a new state (Prigogine, 1977).

For example, the Bénard instability shows a fluid heated from below forming hexagonal convection cells, an ordered pattern arising from chaotic thermal movements (Glansdorff & Prigogine, 1971). This process is probabilistic, irreversible, and sensitive to initial conditions, contrasting with classical physics’ reversible, deterministic laws (Prigogine & Stengers, 1996). Prigogine (2009) emphasized that entropy, traditionally a measure of disorder, becomes a generative force in open systems, driving evolution through dissipation.

Extending this to complex systems, Kondepudi and Prigogine (2014) illustrated how biological and social entities evolve similarly, resisting reduction to simple causality. Philosophically, Prigogine and Stengers (1984) challenged the Newtonian paradigm of timeless predictability, arguing that time’s arrow and creative chaos redefine change as an emergent process, not a controlled outcome, with profound implications for human endeavors.

6. Silence Dialogue:
Cut off conversation, stunting self-organization (Shaw, 2002).

7. Rush Without Reflection:
Force speed, amplifying breakdowns (Senge, 1999). These thwart adaptation, proving control’s limits (Prigogine & Stengers, 1984).

Philosophical Corollaries

Uncertainty and Incompleteness

Prigogine’s insights resonate with philosophical frameworks exposing limits to certainty. Heisenberg (1958/2007) articulated the uncertainty principle, showing that at the quantum level, measuring a particle’s position precludes precision in its momentum (Δx * Δp ≥ ħ/2), undermining deterministic predictability. Heisenberg (1973) extended this epistemologically, suggesting reality eludes complete grasp, a view echoing Prigogine’s irreversible dynamics (Géhéniau & Prigogine, 1986). Similarly, Gödel (1962) proved that within any sufficiently complex formal system, there exist unprovable true statements, revealing intrinsic knowledge gaps (Gödel, 1930/1962).

Gigerenzer et al. (1989) traced how probability reshaped science and life, from actuarial tables to quantum mechanics, eroding absolute mastery. These corollaries—uncertainty, incompleteness, and probabilistic reasoning—suggest that change in human systems, like physical ones, defies full control, relying instead on contingent, emergent interactions (Prigogine & Stengers, 1996).

Personal Change:

The Fallacy of Absolute Agency

At the personal level, individuals often assume transformation—overcoming habits, improving health, or advancing careers—relies on willpower and planning (Boonstra, 2000). Yet, external influences frequently prove decisive. Prigogine (1969) likened personal change to dissipative systems, where internal efforts (energy inputs) meet environmental flows (relationships, crises), producing unpredictable outcomes.

Boonstra (2003) argued that change is nonlinear, driven by interplay and improvisation, not rigid execution. For instance, someone quitting smoking might plan meticulously, but a serendipitous encounter or health scare triggers the shift (Zuijderhoudt, 2007). Zuijderhoudt (2007) suggested that unsolvable dilemmas require synergy with external systems, not isolated control, aligning with Prigogine’s fluctuation-driven emergence (Prigogine & Nicolis, 1977).

A professional seeking work-life balance might set boundaries, only to find a mentor’s advice or family event more transformative (Boonstra & Elving, 2009), illustrating that agency operates within a broader, dissipative context where outcomes are emergent (Senge, 1990).

Organizational Change:

The Limits of Planned Transformation

Organizations often pursue change through structured models, assuming leaders can engineer outcomes. Kotter (1995) outlined eight steps—urgency, coalitions, vision, communication, action, wins, consolidation, anchoring—implying a linear path, while Pettigrew (1988) stressed aligning content, context, and process. Yet, Kotter (1995) noted a 70% failure rate, signaling a gap between plans and reality.

Prigogine and Stengers (1984) explained this: organizations, as open systems, exhibit dissipative dynamics, where perturbations—resistance, market shifts—amplify unpredictably (Prigogine, 2009). Boonstra and Elving (2009) critiqued mechanistic approaches, viewing change as an art emerging from dialogue, not a technical fix. Senge (1990) advocated learning organizations adapting through systems thinking, while Scharmer et al. (2002) emphasized collective awareness over directives.

Shaw (2002) saw change in shifting conversations, not imposed plans. A firm adopting lean principles might fail under top-down control but succeed via frontline experiments (Boonstra, 2003), reflecting self-organization (Prigogine & Nicolis, 1977). Leaders must foster conditions—dialogue, experimentation—rather than dictate, challenging control-centric paradigms (Cuijpers, 2008).

Societal Change:

The Unpredictability of Collective Evolution

Societally, control is assumed in policies and revolutions with predictable trajectories.Yet, reforms like economic stimulus or climate plans face unforeseen resistance (Kondepudi & Prigogine, 2014). Historical shifts, such as the Industrial Revolution’s unintended urban sprawl, defy planning (Prigogine & Stengers, 1984).

Prigogine (Géhéniau & Prigogine, 1986) linked societal evolution to dissipative structures, driven by energy flows—technology, demographics—resisting linear forecasts. Zuijderhoudt et al. (2002) described a “logic of chaos,” where order emerges decentrally, not from authority. Boonstra (2019) declared planned change obsolete, favoring adaptive inspiration (Boonstra, 2020).

The Arab Spring’s spiral from protest to chaos exemplifies this—a vendor’s act amplifying into upheaval (Prigogine, 1977). Renewable energy transitions blend policy with grassroots shifts, beyond centralized control (Kondepudi & Prigogine, 2014). Flexible governance is essential, recognizing change as emergent (Boonstra, 2003).

Reconciling Control and Emergence:

A New Paradigm

The persistent illusion of control does not render intentional action obsolete; rather, it demands a fundamental reorientation from domination to facilitation, a shift grounded in both theoretical insight and practical application. Prigogine (2009) argued that change agents should focus on creating conditions for self-organization, amplifying constructive fluctuations rather than suppressing them to fit predetermined molds. This approach recognizes that systems—whether personal psyches, organizational structures, or societal frameworks—evolve through dynamic interactions that cannot be fully scripted (Prigogine & Nicolis, 1977).

Quinn and Cameron (1988) proposed embracing the paradox of control versus emergence as a strategic framework, suggesting that effective change management balances structured intent with adaptive flexibility. For individuals, this might mean establishing personal goals—such as improving fitness or mastering a skill—while remaining open to unexpected influences like a friend’s encouragement or a sudden life event that reframes priorities (Zuijderhoudt, 2007). Boonstra (2000) illustrated this with the metaphor of “walking on water,” where success hinges on navigating fluid, unpredictable currents rather than enforcing a rigid path.

In organizational contexts, this paradigm shift translates into leadership that sets a clear vision yet fosters a culture of innovation and dialogue. Senge (1990) highlighted how learning organizations thrive by leveraging systems thinking, allowing emergent patterns—like employee-driven innovations—to shape outcomes rather than relying solely on top-down directives. Scharmer et al. (2002) extended this, advocating for “presencing”—a state of collective awareness that taps into emerging futures—over traditional command structures.

A practical example is seen in technology firms where policies like “20% time” for personal projects have yielded breakthroughs such as email platforms, demonstrating how structured freedom catalyzes creativity (Senge, 1999). Boonstra and Elving (2009) further argued that change is an art form, requiring leaders to act as facilitators who nurture conversational spaces, as Shaw (2002) suggested, rather than architects imposing blueprints. This aligns with Prigogine’s dissipative dynamics, where small perturbations—employee feedback, market shifts—can amplify into transformative shifts if allowed to flourish (Prigogine & Stengers, 1984).

Societally, reconciling control and emergence calls for adaptive governance that integrates intentional policy with responsiveness to grassroots movements and unforeseen developments. Boonstra (2020) emphasized playful, inspirational approaches over rigid planning, as seen in agile regulatory frameworks that adjust to technological or demographic shifts (Boonstra, 2019).

For instance, Denmark’s energy transition blends government incentives with citizen-led renewable projects, adapting to emergent trends rather than enforcing a static agenda (Kondepudi & Prigogine, 2014). Cuijpers (2013) provided empirical grounding, showing that leadership development programs succeed when blending structured interventions with flexibility, allowing participants to co-create outcomes. This resonates with Heisenberg’s (1973) philosophical stance that acknowledging uncertainty enhances purposeful action, not undermines it, by fostering resilience over brittle certainty.

This new paradigm also requires a mindset shift: viewing uncertainty not as a barrier but as a generative force. Prigogine and Stengers (1996) framed chaos as a source of order, a principle mirrored in Senge’s (1999) “dance of change,” where iterative adaptation sustains momentum—evident in organizations like Toyota, where continuous improvement emerges from employee experimentation rather than fixed plans (Cuijpers, 2008).

Zuijderhoudt (2007) added that synergy—connecting individual efforts to broader systems—unlocks potential that control alone stifles. Across scales, this approach demands humility, patience, and a willingness to relinquish the illusion of mastery, replacing it with a collaborative dance with complexity, where intent guides but does not dictate (Boonstra, 2003).

Implications and Future Directions

The implications of dismantling the illusion of control are far-reaching, reshaping how change is approached across domains. For individuals, it suggests a profound shift from self-reliance to interdependence, embracing vulnerability and external catalysts as integral to growth. A smoker’s cessation might hinge on community support or an unexpected trigger, not just willpower (Boonstra, 2000), challenging the myth of the solitary hero.

This implies a need for personal strategies that prioritize relational networks and adaptability—perhaps through mentorship, peer groups, or openness to serendipity—over rigid self-discipline (Zuijderhoudt, 2007). Psychologically, it aligns with accepting uncertainty as a creative space, fostering resilience in an unpredictable world (Heisenberg, 1973).

Organizationally, the implications point to cultures of experimentation and dialogue, where leaders act as enablers rather than dictators. Senge (1990) argued that learning organizations outlast rigid ones, as seen in firms like Netflix, which pivoted from mail-order to streaming through adaptive foresight, versus Kodak, which clung to control and faltered (Pettigrew, 1988).

This requires rethinking leadership training to emphasize facilitation skills—listening, synthesizing emergent ideas, and tolerating ambiguity—over traditional command models (Cuijpers, 2013). It also suggests redesigning organizational structures to be flatter and more responsive, enabling rapid feedback loops that mirror dissipative systems (Prigogine & Nicolis, 1977). The failure of many change initiatives (Kotter, 1995) underscores the cost of ignoring this, pushing for a shift from hierarchical silos to networked adaptability.

At the societal level, the implications demand governance that mirrors natural systems—flexible, participatory, and emergent. Boonstra (2019) declared planned change “truly over,” advocating for policies that inspire through play and responsiveness, as in New Zealand’s agile COVID-19 response versus slower, rigid strategies elsewhere (Boonstra, 2020).

This suggests a move toward decentralized decision-making, integrating citizen input and real-time data, akin to dissipative structures adapting to energy flows (Kondepudi & Prigogine, 2014). It also implies redefining success—not as hitting fixed targets but as fostering resilience and evolution, a lesson from ecological systems (Prigogine & Stengers, 1984).

Future directions for research and practice are rich with possibility. Developing tools like complexity modeling or agent-based simulations could bridge control and emergence, offering predictive yet adaptive frameworks (Shaw, 2002). Empirical studies might quantify how fluctuations—personal epiphanies, organizational innovations, societal protests—drive transformation, testing Prigogine’s theories in human contexts (Prigogine, 1977). Interdisciplinary approaches, merging thermodynamics, psychology, and sociology, could refine change models, exploring how entropy fuels creativity across scales (Prigogine, 2009).

Practically, pilot programs—personal coaching circles, organizational labs, or participatory policy forums—could test this paradigm, measuring outcomes against control-based methods (Cuijpers, 2008). Ethically, this shift raises questions about power, agency, and equity in emergent systems, warranting philosophical inquiry (Heisenberg, 1958/2007). As technology accelerates change by April 6, 2025, these directions promise a science and practice of transformation attuned to complexity.

Conclusion

The illusion of control, deeply entrenched in a mechanistic worldview, falters against the irreducible complexity of human systems (Prigogine & Stengers, 1984). Thermodynamic principles reveal change as an emergent, probabilistic process, where dissipative structures arise from chaos, not command (Prigogine & Nicolis, 1977; Prigogine, 2009).

Philosophically, uncertainty and incompleteness underscore the limits of mastery, framing change as a dance with the unknown (Heisenberg, 1958/2007; Gödel, 1962). Organizational and complexity theories reinforce this, showing that adaptation trumps rigid planning across personal quests, corporate shifts, and societal upheavals (Boonstra, 2003; Senge, 1990; Shaw, 2002). This article has traced these threads—from personal habits reshaped by unexpected allies, to organizations reborn through dialogue, to societies evolving through decentralized flux—revealing a consistent pattern: control is a mirage, emergence the reality.

Advocating a paradigm shift, this analysis calls for facilitating self-organization over enforcing domination, a stance both pragmatic and profound (Prigogine & Stengers, 1996). It demands a reorientation of intent—from predicting outcomes to nurturing conditions for growth—across scales (Zuijderhoudt, 2007). For individuals, it’s about weaving personal goals into life’s unpredictable tapestry; for organizations, building systems that breathe and adapt; for societies, crafting governance that bends with collective will (Senge, 1999; Boonstra, 2020).

This is not a surrender to chaos but a collaboration with it, rooted in the humility that true transformation eludes our grasp yet thrives in our openness (Heisenberg, 1973). As we stand on April 6, 2025, amid technological and social turbulence, this shift—from controlling to co-creating with uncertainty—is not just strategic but existential, offering a resilient path through the complexities of personal growth, organizational renewal, and societal evolution.

References:

Boonstra, J. J. (2000). Lopen over water: Over dynamiek van organiseren, vernieuwen en leren [Inaugural address]. Amsterdam University Press.
Boonstra, J. J. (2003). Dynamics of organizational change and learning: Reflections and perspectives. Utrecht/Amsterdam, The Netherlands: Sioo, Interuniversity Centre for Organizational Development and Learning.
Boonstra, J. J. (2005). Dynamics of organizational change and learning. In J. J. Boonstra (Ed.), Psychology of management in organizations (pp. 1–25). Wiley Publishers.
Boonstra, J. J. (2019). Geplande verandering is nu echt voorbij. Management Boek.
Boonstra, J. J. (2020, December). De toekomst van organisatieontwikkeling: Inspiratie bieden door spel en speelsheid. Tijdschrift voor Ontwikkeling in Organisaties, 4, 66–67.
Boonstra, J. J., & de Caluwé, L. (2006). Intervenieren en veranderen: Zoeken naar betekenis in interacties. M&O, 3(4), 5–33.
Boonstra, J. J., & Elving, W. J. L. (2009). Veranderen als kunstje, kunde of kunst: De praktijk gespiegeld aan de theorie. In W. Brouwer, D. van Dongen, M. Haarhuis, A. de Regt, R. Schra, & J. Verhoef (Eds.), Veranderkunst: Communicatiemanagement in praktisch perspectief (pp. 195–218). Van Gorcum.
Cuijpers, P. H. M. (2008). Professional learning processes: A comprehensive action research towards a coaching policy within a foundation for voluntary and protection youth care [Unpublished action research].
Géhéniau, J., & Prigogine, I. (1986). The birth of time. Foundations of Physics, 16(5), 437–443.
Gigerenzer, G., Hoffrage, U., & Kleinbölting, H. (1989). The empire of chance: How probability changed science and everyday life. Cambridge University Press.
Glansdorff, P., & Prigogine, I. (1971). Thermodynamic theory of structure, stability and fluctuations. Wiley.
Gödel, K. (1930). Ein formales mathematisches System ist nicht konsistent oder unvollständig. [Original unpublished work, cited in later translations].
Gödel, K. (1962). On formally undecidable propositions of Principia Mathematica and related systems (B. Meltzer, Trans.). Basic Books.
Heisenberg, W. K. (1958/2007). Physics and philosophy: The revolution in modern science (Full-text ed.). HarperCollins.
Heisenberg, W. K. (1973). Scientific truth and religious truth. CrossCurrents, 24(4), 463–473.
Heisenberg, W. K., & Euler, H. (1936). Zur Theorie der ‘Schauer’ in der Höhenstrahlung. Zeitschrift für Physik, 101(9–10), 533–540.
Kondepudi, D., & Prigogine, I. (2014). Modern thermodynamics: From heat engines to dissipative structures (2nd ed.). Wiley.
Kotter, J. P. (1995). Leading change: Why transformation efforts fail. Harvard Business Review, 73(2), 59–67.
Pettigrew, A. M. (Ed.). (1988). The management of strategic change. Blackwell.
Prigogine, I. (1969). Structure, dissipation and life. In M. Marois (Ed.), Theoretical physics and biology (pp. 23–52). North-Holland.
Prigogine, I. (1977). Time, structure and fluctuation [Nobel Prize in Chemistry Lecture]. Université Libre de Bruxelles, University of Texas at Austin, Stockholm.
Prigogine, I. (2009). Dissipative structures, dynamics and entropy. International Journal of Quantum Chemistry, 9(S1), 443–456.
Prigogine, I., & Nicolis, G. (1977). Self-organization in non-equilibrium systems. Wiley.
Prigogine, I., & Stengers, I. (1984). Order out of chaos: Man’s new dialogue with nature. Bantam Books.
Prigogine, I., & Stengers, I. (1996). The end of certainty: Time, chaos, and the new laws of nature [La fin des certitudes]. The Free Press.
Quinn, R. E., & Cameron, K. S. (1988). Paradox and transformation: Toward a theory of change in organization and management. Ballinger Publishing Co.
Scharmer, C. O., Arthur, W. B., Day, J., Jaworski, J., Jung, M., Nonaka, I., & Senge, P. M. (2002). Illuminating the blind spot: Leadership in the context of emerging worlds. McKinsey-Society.
Senge, P. M. (1990). The fifth discipline: The art & practice of the learning organization. Doubleday.
Senge, P. M. (1999). The dance of change: The challenges of sustaining momentum in learning organizations (1st ed.). Currency, Doubleday.
Shaw, P. (2002). Changing conversations in organizations: A complexity approach to change. Routledge.
Zuijderhoudt, R. W. L. (2007). Op zoek naar synergie: Omgaan met onoplosbare problemen [In search of synergy: Dealing with unsolvable problems]. University of Amsterdam.
Zuijderhoudt, R. W. L., Wobben, J. J., Have ten, S., & Busato, V. (2002). De logica van chaos in veranderingsprocessen. Holland Management Review, 82, 59–67.