Business Ecology Initiative & Service-Oriented Solution

Michael Poulin

1001st Scheherazade's Story about SOA

user-pic
Vote 0 Votes

Myths and ferry tails about SOA are all around us, it isn't a secret. However, one respectful Analyst, who is very well known in the SOA community for ebizQ, told us a story that deserves a title of a Strategic Programme on SOA for Programmers unless it is not just an advanced populist shout aimed to lead programmers (to get popularity) against an IT and enterprise management. Well, every programmer knows better than CEO/CTO how to manage IT - it is a bearded story but with modern technology buzz it shines differently. I can tell you another story about the same mindset: from the history we know that once, in one country (thanks Lord), the least successful people raised a slogan: "Each housewife should be able to manage the country" (probably, they concluded that if a housewife could manage her own household, she could manage a group of households known as a country). As a result, we had a Soviet nightmare for the decades...

OK, it is the time to tell you the story and to take a look into its possible consequences. Here it is: "These days, as demonstrated through the power of social networking, employees and professionals have the impetus for organizational change. They are closest to the customers, they know what's needed to do their jobs better. The creation and proliferation of services via SOA needs to be a bottom-up movement. CEOs, CFOs and CIOs need to set the tone and vision, then get out of the way."

I'm going to offer you my analysis of this story having in my IT background many years in such roles as a tester, programmer, researcher, Tech Lead, Architect, Enterprise Architect and a Head of Architecture. For now, let me ask you a question, which I'll answer at the end of this article: What is the most important thing in any IT?

The words used in the story are tricky and the author can always say that I have misunderstood him. Yes, I take this risk and continue because if could misunderstand, other can do the same, which is not god for SOA at all. For example, what is meant by 'the impetus for organizational change'? Is this an intention to change (it is an old news) or it is a force, power to change? In the latter case, if this statement justifiable or, again, a desire is taken as a reality?

Let's assume for a moment that the extract "as demonstrated through the power of social networking, employees and professionals have the impetus for organizational change. They are closest to the customers, they know what's needed to do their jobs better" is true (i.e., isn't a bold proclamation). We'll play a quick scenario based on it and challenge it with simple questions to see if it can sustain an elementary critic.

The scenario: in a mid-to-large size company, which can afford internal IT department as well as Marketing, Sales and other regular enterprise divisions, a programmer approaches CIO and says: "I participate in a social network with some of our potential consumers (he or she thinks - they are the 'potential consumers') and I've found what they need now. I can run a project and deliver this thing; please, sign the budget request for $100K now (and "then get out of the way")". My wild guess is that this would be the last chance for that programmer to approach the CIO... Would you agree?

The questions: what does mean "They are closest to the customers"? Who and how verified this? How reliable this information is? Who, at the end, checked that this information is not a marketing crap pushed by the competitor to turn the company's attention with the help of such' socially networked' employee? Oh, the programmer did not think about such possibility... For my years in IT I learnt that it is better not doing things at all if you cannot or may not do them professionally.

Moreover, the statement "they know what's needed to do their jobs better" does not justify or defend the conclusion "The creation and proliferation of services via SOA needs to be a bottom-up movement" to any degree. (I cannot resist admitting that I love the expression "proliferation of services via SOA"!) The problem with the aforementioned conclusion is in that is has been set out of the context. Yes, there are industries like media, education, research and alike where "a bottom-up movement" can provide more benefits than risks to the business. However, there are other industries like healthcare, banking, telecommunication, finance, gas/electricity, defense and similar where one of the major requirements is the end-to-end integrity over the activities in the business domain, where the risks must be mitigated right away and where immediate consumer needs not necessary sit in line with the trends and strategic movements. Thus, I can say that, in general, the given conclusion is wrong until it proofs right for healthcare, banking, telecommunication, finance, gas/electricity, defense at least.

Recently, I had an 'opportunity' to learn the lesson from the "SOA ... bottom-up movement". Well, to be honest, I do not really know was it SOA design or not but it looked very much like the SOA one. In the spring of this year, the Royal Opera House (ROH) was selling tickets for the series of performance from the Russian Ballet. You can imagine the agiotage in London around such event. In anticipation of a high demand, the ROH offered a Web Site to sell the tickets. The Web Site demonstrated the use of modern technologies and a lot of features that made me to believe into the services behind the Web pages. In addition to the information about the performances and option to choose your 'future' seats, the Site offered you to get into a queue to the booking-office page. The queue ran relatively fast and it took me about 40 min. to pass from the number 700+ to 10. Everything was fine up to me moment I got an invitation to buy the tickets. When I hit the button, the Web Site became frozen. In a while (enough long to make me nervous), I was invited to try again (well, I did not expect the system throughput in the ROH similar to Yahoo! and I was pleased to re-submit my request.)

I was thrown to the back of the queue and my new number was 1600+. With almost lost hope, I rushed to the real booking office and found a relatively short queue there. To my surprise, almost everybody in that queue talked about the situation I just experienced with the ROH Web Site. Some people were patient enough to be turned around twice. If we disregard the version that the resetting into the on-line queue was done deliberately, I can say with high probability that it was a problem of bottom-up design of the Web Site. Why? Because in only bottom-up approach one function does not care about another function, that in only bottom-up approach there is nobody, not even a component, responsible for the integral cohesiveness of the capabilities tied into the functional solution (in the top-down approach this integrity is the start, the middle and the end points of each design step because the designers are responsible for the final result rather than for each individual feature implementation. The latter may be thrown away and replaced by the analogous one - this is the SOA 'law' regardless the developers' like or dislike, and this 'law' is guarded by the Architects and Managers).

Described case is very typical for the bottom-up SOA implementation. In bottom-up approach, the program is the key. All attention is put onto the program functionality and its testing. The integration is limited to the interactions via pre-defined interfaces. In the top-down approach, the keys are the application and its context, i.e. the surrounding programs with their constraints. They are tested together: if a Queue Service should handle 1000 concurrent requests while the Buying Service can work with only 100 simultaneous processes, the Buying Service will be automatically tested against the 1000 requests (in conjunction with the Queue Service) and the throughput bugs will be caught in testing, not in production in front of thousands of customers.

Finally, I think that instead of calling for an organisational "revolution" in technology on the basis of social networking, the respectful Analyst would better examine if such socialites can handle the results of the re-organisation, what they know about the business, production, accounting, law, finance and other mandatory restraints of providing services at the enterprise level. SOA was 'born' in Technology, nobody argues about this. However, in several years, the 'baby' grew and moved off the nest into the business world. Good parents understand this and become proud of the child; not that good parents continue claiming and enforcing their 'ownership' on the child and, usually, fail.

The IT departments exist not to please programmers (and to provide them with the pay-checks) but to satisfy the corporate Business. This primitive truth leads to the answer to my question asked at the beginning of the article. The answer to this question is - the Money. This is the pragmatism of the world we live in, and individual enthusiasm and creativity never won the competition against money at the end of the game (so far). I do not have objections to the social networking but I cannot accept when it is applied to everything reasonless; this creates nothing but a mess and confusion. No social networking is able to compete with the top-down architecture, including the service-oriented architecture, until this networking can 'show the money' to the business and to protect the consumers from trivial mistakes I described in the real life 'ticket selling' example.

Book Announce.JPG

5 Comments

| Leave a comment
user-pic

Fully agree with your analysis. I have been also blaming about the bottom-up apprach, which seems to be the only allowed today, and any attempt to get a start from a high vision and worry about the bigger things before, is neglected. Top IT executives looks prety much worried about technical benefits, ignoring functional outcomes. They understand their responsibility finish there.

I regret that SOA world looks more about WSDLs, BPELs, UDDIs, X-Various... when, from my point of view, it should begin in policys, primes, accounts, balance sheets, customers, providers, value chains, reports, purchases, sales, production items, procurement... not adhoc, but at the level of standardization. And, only when this is clear, then go to the technical artifacts. Market does not see to allow this vision. Even current IT roles does not fit these requirements.

But, the question is, assuming that we are in a capitalist market economy (is not it?), and that market is able to regenerate itself, so it can be driven by people which is able to apply the right vision on things, why there is not room for top-dowm vision. For me, response is simple: currently we are not driven by market forces but by something else. And I would not expect changes on this for a long time. As a consequence IT becomes a commodity, just like plumbing or stationery.

Now, stop complaining. I miss a different functional stack approach on how to create a company architecture, where layers can be ordered by functional outcome (business value) rather than by technical nature (as TOGAF). Something as:

0. We probably have more technical artifacts that we need, but we do not really know how to use them. I think we need to progress in the functional side before identifying requirements for new technical artifacts,

1. Understand high vision and create/standardize functional models,

2. Understand that SOA and BPM can not be just a thin layer on top of an accidental/chaotic set of components (expecting to be reusable, interoperable and blablabla...), but a consequence of having strong semantic/ontology middleware, probably backed on KM/semantic technologies (please, I am not spaaking about OWL, do not care the technical representation now). This should be the foundation of the company services, no matter if they will be consumed by humans or machines,

3. On top of this semantic middleware (2), a layer for machine consumed services enabling the semantic web 3.0, and truly semantic interoperability (the so-called "extended company"),

4. On top of this semantic middleware (2), the current SOA/BPM layer, human oriented and customized for company necessities. Only here is the current SOA.

From my point of view, next work is in middleware, but not at pure integration level (as seems to be understood today), but to create a foundation layer, probably backed on semantic technologies.

The problem would be how to deliver short term outcome, need to rewrite lots of technical artifacts and probably restructure IT roles. Otherwise, IT today looks in a cul-de-sac.

Michael, I have still find time to read "Ladder to SOE" to see if changes my mind,

Regards,

Adolfo

Adolfo, thank you for very constructive comments. I agree with many points in them and, first of all, with the role you put for semantic approach.

To me, the situation with IT Management and its view on SOA may change only if they would be forced by Business (and related dollars, euros or pounds). This is why I concentrate now on the Business SOA. The latter has to overtake Value Chain and process-centric concepts in Business replacing them with Value Networks and service-centric concepts. To start real top-down approach, IT needs to get from under the Operational Business and interact with the enterprise Strategic Business directly; IT has to start addressing business tasks not the business implementation (processes) of the tasks. But this is a different story.

user-pic

Thanks Michael for your thoughts,

>> IT has to start addressing business tasks not
>> the business implementation (processes) of the
>> tasks

about this "different story", honestly I do not think the problem is CEOs/CIOs lack of vision, conservative mentality, short-term approaches, fear of computers replacing humans... Unfortunately, the issue is much more complicated than that.

I think, all this comes, as in many areas other than IT, as a consequence of a lack of "market freedom/competitiveness", as current market, almosr everywhere, is driven by money and governments. CEOs, CIOs and companies just work under the Prissioners Dilemma: do the same or die. I think it should be possible correlate degree of innovation vs economic freedom. I have not read any article trying to address this issue in the IT world. Maybe is beacuse is a tricky issue to raise.

Solution is far beyond of IT and IT people. Is in the society, in politics, ethics... I am afraid. The consecuence is: bottom-up.

Regards,

Adolfo

> assumes that competitiveness has to facilitate more effective (from business perspective) methods of conducting business. > has demonstrated during last crisis that: if you do the same, you die. BTW, this is one of the basic start-points for SOA adoption in Business. The CEOs, CIOs afraid of any changes because of Value Chain rule resulted in the process-centric mindset. If this mindset has a capability to transform and to recall what the company is doing instead of how it is doing, there is a chance for SOA in Business and IT.

Yes, “Solution is far beyond of IT and IT people. It is in the society, in politics, ethics...�. Do not be afraid because the only thing people do “in the society, in politics, ethics� is service each other. The Business is service-oriented in its essence; we need to do only one thing- to formalise and clarify this trivial idea and promote our proposals around it.

user-pic

Hi Michael,

>> the only thing people do “in the society, in
>> politics, ethics� is service each other

When societies work, yes. But I am afraid, this is just one of the sides, and is not that clear that we want this one.

I think we are approaching to the other side, where people, wants to be served by each other.

And, in this second emotional society, different rules apply, but we only see the ***effects***. This second society does not need high performing companies because competitiviness is just not required, but punished.

A example in real life: I do not think banks today make their money from their customers. Probably you could apply the same to a lot of other industries.

I suppose, every moment in history is a blend of both sides, but we are getting closer to this other now, and how IT and innovation fits in society in every moment is consequence of this, I think. However, this is far beyond of IT scope (but maybe SOA should start here).

Sorry for the blend of ideas. Just to try to show how I see this "different story". Regards,

Adolfo

Leave a comment

In this blog, Michael Poulin writes about business and technology ideas, concepts, methodologies and solutions leading to service-oriented enterprise, the primary instrument for obtaining business objectives in fast-changing environments.

Michael Poulin

Michael Poulin is an enterprise-level solution architect working in the financial industry in the U.K. and the United States.

He specializes in building bridges between business needs and technology capabilities with emphasis on business and technical efficiency, scalability, robustness and manageability. He writes about service orientation, application security and use of modern technologies for solving business problems. He contributes to OASIS SOA standards as an independent member and is listed in the the international "Who's Who of Information Technology" for 2001. View more

Subscribe

 Subscribe in a reader

Recently Commented On

Categories

Tag Cloud

'Navigating the SOA Standards Landscape, 1471, abstraction, ACM, active service, Adaptive, ADM, adopt changes, aggregate service, AIA, Amazon, analysis, API, application, Application Integration Architecture, architect, Architect, architectural mission, architecture, Architecture, architercture, AWS failure, Azure, B-SOA, BAWG, BEI, Best Practice, bottom-up, BPEL, BPM, brokerage, Brokering, brokering, bus, Busienss, busienss case, business, Business, Business Architect, Business Architecture, business architecture, Business architecture, Business Architecture Working Group, business concerns, business data, Business Ecology, business efficiency, business model, business operational model, business organisation, Business Platform Division, business process, Business Process Designer, Business Requirements, business risk, business service, Business service, Business SOA, business value, business view, business-centric, Business-IT problem, BuTechCon, Canonical Schema, capability, Case, CBDI, CBM, Centralization, choreography, CIO, Cloud, cloud, Cloud Computing, Cloud of Clouds, COBA, Collaboration, collaboration, collaboreation, commodity, component, Composite Application, composition, concept, Conciliator, consumer, contract, COSMIC, cost, cost estimate, cost of ounership, cost of ownership, coupling, crisis, CRUD, culture, Cutter Consortium, data ownership, data service, data store, DDD, decision logic, decomposition, definition, demand, design, Design Pattern, development, discipline, distributed orchestration, Domain, domain, Domain Aggregate, Domain Events, Domain Service-Oriented Modelling, DOSOM, DOSOSM, driver, Dynamic Process Edition, EA, EC2, ecosystem, EDA, efficiency, end-to-end, enemy, enterprise, Enterprise, Enterprise Architect, Enterprise Architectural Framework, Enterprise Architecture, enterprise architecture, ERP, ESB, event, Event, execution context, Execution Context, expertise, explicit, failure, fake, feature, Flexibilit, flexibility, FPA, FSM, Full Functional Points, Functional Points, functionality, functionality model, future, Gartner, goal, Governance, governance, granularity, harmonization, Healthcare, how to, IBM, identiy credential, IEEE, IEEE 1471, IFPUG, implementation, implicit, intangible, intangible value, Integration-Oriented Architecture, intent, interface, interface orientation, Inventory, investment, IOA, IT, IT Architect, IT Operation Support, IT organisation, IT without the IT Department, ITIL, Java, Ladder to SOE, leasable Cloud, lease, Loose coupling, Lost in Translation, Malik, management, Management, Manifesto, market, MDA, Michrosoft, Microsoft, Mike Rosen, model, Model-Driven Approach, modelling, Navigating the SOA Standards Landscape Around Architecture, navigation, OASIS, OASIS SOA RA, OASIS SOA RAF, OASIS SOA Reference Architecture Foundation, OASIS SOA RM, ODBC, OMG, ONA, Ontology, OO, Open Group, Oracle, orchestration, organizational change, outsourcing, ownership, participant, pattern, patterns, people, planning, policy, principle, principle of separation of concerns, principles, Principles, priority, Private, Private Cloud, process, Process, process-oriented, process-orineted, process-service, project, Provisioning, Pub/Sub, Public, Public Cloud, Public Cloud Busienss Requirements, QCon, RA, RAF, re-composition, Real World Effect, Real World SOA, redundancy, Referemce Architecture, Reference Architecture, Reference Architecture Foundation for SOA, Reference Model, Registry, rent, rentable Cloud, Repository, reuse, RIA, risk, RM, ROI, RPC, rules engine, RWE, SCA, scalability, Schema, security, semantics, Service, service, Service Autonomy, Service Composability, service contract, Service Contract, service description, Service Description, Service Discoverability, Service Execution Context, service orientation, Service Orientation, Service Oriented Enterprise, Service Relative Autonomy, Service Reusability, service semantic, Service Separation of Concerns, Service State Management, Service Statelessness, service-oriented, service-oriented eco-system, Service-Oriented Enterprise, service-oriented enterprise, service-oriented environment, ServiceContract, seven properties that differentiate emergent architecture from the traditional approach to EA, shared interface, shared library, simple, situational, sizing, SLA, SO, SO environment, SO Principles, SOA, SOA Manifesto, SOA standard, SOA-RAF, SoaML, SOBA, social, social networking, SOE, SOEA, software, solution SOA, SOMA, Spring, stakeholder, standard, Standard, study, subject, Summit, supply, supply chain, support, system, T-SOA, tangible, tangible value, Technical, Technical Architect, Technical Architects, Technical Architecture, technical capabilities, Technical SOA, technology, Technology, tendency, The Open Group, TOGAF, TOGAF 9.0, top-down, transparency, UI, UI Mediator, unstructured, use, Value Chain, Value Network, Value Networks, view, view model, viewpoint, vision, VNA, VPEC-T, WCF/WF, Web, Web 2.0, Web Service, Web Services, WebSphere, WS-CDL, WSDL, ZapFlash, ZapThink,

Monthly Archives

Blogs

ADVERTISEMENT