Remember the hassle of attaching peripherals in the days before USB ports Remember the anguish of developing applications for competing OS interfaces before HTML We fixed those problems, and whaddya know, we moved on to others.
"Complexity grows over time," says Bryson Koehler, chief information and technology officer (CITO) of The Weather Company in Atlanta. "Systems are built to do one thing, and then they're modified, morphed and bastardized to do things they were never meant to do."
Complexity occurs when technologies overlap one another -- "when you add new stuff but keep the old instead of getting rid of it," agrees Dee Burger, North America CEO of Capgemini Consulting.
Even as recently as three years ago, Burger says, "people thought they could do massive replacements of technology" -- say, move everything to SaaS applications in the cloud -- "but now we're seeing way more adding of technology rather than replacing." Just consider how many new collaboration tools the enterprise has embraced without replacing or reducing email.
The result can be a tangle of overlapping, redundant systems that costs money, slows innovation and hinders organizations from identifying new business opportunities.
"I've been in discussions with CIOs who want to replace something, but they can't be sure of what would happen if they did," Burger says. They're reluctant to find out what kind of chaos would ensue. But "sometimes you just have to turn something off and see who yells."
Computerworld spoke with five CIOs who did just that and lived to tell the tale. Read on for their advice on how to tackle complexity and emerge with a more efficient, agile and auditable technology stack.
The tangled webs we weave
How does complexity grow in an organization -- and why Sometimes there are demands from the business to move quickly, but not necessarily practically or prudently. Sometimes there are systems left over from mergers, acquisitions and internal reorganizations that haven't been sunsetted. Sometimes systems multiply as CIOs try to keep the lights on and innovate simultaneously.
"Complexity is the result of a diversity of footprints, of tools, of workforce," says Christopher Rence, CIO of Digital River, a provider of e-commerce, payments and marketing services for merchants. Rence knows whereof he speaks: He's lived through three acquisitions in the last four years, and has seen the residue of the 20 acquisitions that the company has experienced since 1994.
"One company we acquired had nothing but white-label hardware. It didn't have an asset value, but it was doing a lot of processing," Rence recalls. In preparation for conducting a strategic migration of the data through a gateway into a SaaS solution, "we had to do a full inventory of what those homegrown products were doing," says Rence. "It required understanding some of the undocumented knowledge. We had to sit down with the programmer who originally wrote the integration scripts and ask him to create industry-standard processes and APIs so they could be reusable and repeatable."
(Of course, not all complexity is bad. Some sophisticated, enterprise-wide systems are necessarily complex by nature, as CIOs discuss in Simple on the surface, complex underneath).
From 13 data centers to one (in the cloud)
The Weather Company's Koehler traces complexity's origins to illogical architectures -- multiple systems performing similar functions, too many layers of a stack serving extraneous purposes.
Koehler spent the last three years trying to get rid of "a highly complex and illogical environment" -- the product of multiple mergers and acquisitions -- "that made operations costly, risky and difficult to change."
The Weather Company had 13 interdependent data centers (11 in the U.S., one in Asia, and one in Europe). "If one application needed data in another data center to work, we weren't lowering risk. We were increasing it by spreading out our dependencies," Koehler explains. "There were also four forecasting systems, each one producing a different result." His team whittled that down to one forecasting system, a common API platform for sending data out to partners, and a consolidated cloud-based approach for infrastructure.
"Moving our forecasting system to Amazon's infrastructure several years ago saved us seven figures over the lifespan of the technology investment that we would have had to make," says Koehler. Even better, it made his group more agile. "We inverted the ratio of time spent on maintenance from 80% to 30%. You have to get yourself in shape before you can innovate."
That agility brought other value, he notes. His company's widget became the default source for weather on all Apple devices running iOS 8. "If we'd tried to do it in the old model of bespoke systems and custom solutions, I doubt Apple would have had the confidence in us if we couldn't work with the same speed and agility that they do."
Consolidating Web hosting and ad sales
Like Koehler, Atish Banerjea, CIO of NBCUniversal, encountered a high level of complexity that developed, he says, under the previous ownership when divisions deployed a lot of shadow IT.
When Banerjea arrived at NBCUniversal in December 2012, his team partnered with ad sales to consolidate 19 different advertising selling applications into one. The result is a much higher level of efficiency. "We've built tools so we can see inventory across units. We have a much more accurate inventory of what we can sell. We can do forecasting faster, and it's helped us improve pricing."
Similarly, each division had its own Web hosting provider. NBCUniversal's technology team led an effort to consolidate all of the 200 Web properties onto one platform. "Across all of our consolidation initiatives, we have saved tens of millions of dollars," Banerjea says.
Consolidating a panoply of old systems not only gives you technology that's easier to audit, it also makes it easier to roll out new systems. "When you have so many points of integration and dependency, it makes it that much more difficult to find out how and where errors occur," says Henry Jenkins, director of information services at Huntington Hospital in Pasadena, Calif. "By reducing complexity, you have fewer mistakes and more repeatable outcomes with little variance. When something does go wrong, less complexity makes it easier to figure out what went wrong, correct the root cause, and move on."
In the healthcare industry, the conversion to electronic medical records is a challenge. "But we have an opportunity to have a more complete medical record that follows the patient," says Jenkins. "Now through data integration and analytics, we can reduce complexity. Instead of rooting around in twenty different departments and 100 different spreadsheets, we can improve outcomes by making better decisions with more accurate information."
How to keep complexity from coming back
Unless there is a concerted effort, usually done through enterprise architects, to ensure there's an appropriate swap of applications -- that is, an old application is actually replaced, not augmented -- complexity will spread like mold in an old bathroom. And it will do it in the same way -- behind the walls and under the floors, unseen and insidious. That's why CIOs who do the work of simplification must also put in place safeguards against that seepage.
"If you don't have a proper function to manage it, complexity will come back again," NBCUniversal's Banerjea warns. That's why he brings his enterprise architecture team into every budget meeting with a "living, breathing framework of our inventory across all our units." If one division proposes something new, the EA team is there to identify commonalities. With visibility across the company's tech stacks, "We can see when we can leverage an application for multiple uses and avoid starting from scratch."
CIOs have to bring a lot of capabilities to their job, but in the case of fighting complexity, the operative word is courage. "You have to be committed to dealing with the pain," says Capgemini's Burger. "You don't do it tepidly. You have to have a full commitment to making the change, because it will help you move to a fundamentally new place. Change management isn't tied to an event anymore. It has to be a core ability for CIOs."
Koehler concurs. "People get us into this mess, and it becomes hard to get us out, because we get attached emotionally to the systems we build. It becomes painful to go through the exercise of decommissioning or consolidating. It boils down to having courage -- the courage to call somebody's baby ugly, turn it off, and force good decisions throughout the life of that new system."