30 Years of IT Transformation: EMCWorld 36 hours in…


Just finished up Joe Tucci’s keynote. I’ll mention i am already a fan of Joe’s. He’s made great decisions, he’s personable to employees, partners, and employees alike, and he’s built a great organization. However today I became an uber fan. Joe took aprox 15,000 people through a tour of the last 30 years of IT transformation. he talked about what it was like writing in assembler (that’s right he was assembler dude). What it was like being part of the 20 companies that were defining the MF industry. Then he took us through the client/server era, how he executed on assoc’d market conditions and finished up with the converging world we now live in. Joe explained in common terms why EMC is doubling down with Cloud, Big Data, and Trust as our go forward model. He also mentioned that this is completely impossible journey without our partners.

OK you’re thinking what’s my point.. and I’ll tell you. Its pretty damn rare to have a guy with that tenture, that breadth and depth of experience, with a “common man’s” persona, still this invested and leading a company with so much potential during such a large inflection point in the market. Similar to remembering where you were standing during 9/11, it hit this was an important moment. I did a “save as” to my squissy grey hard drive. I’ve seen McDermott, I’ve seen Elison, I’ve seen many CEO’s address their ecosystem, Joe is rising to an extraordinary guy.

Enough on that let me hit a couple high points from the show

Global Partner Summit – yesterday (yes Sunday) We kicked off the first annual GPS. It was a little like going to a start up’s new show. There were some learning moments throughout the day, but all in all the team did a great job. Biggest point I can make? 3,000 people turned out on a weekend event with a purchased ticket. Companies like Accenture and Cap Gemini brought 50 or more people to the show. The prime message was, we know we’re not perfect, but we are absolutely dependant on our partners for success. We want to invest, we want to continue to get strategic, and there were several examples of how EMC and the partner ecosystem have gone big together. Frankly I think this is one of the most exciting areas of growth within EMC. Our investment was obvious through our executive attendance. Tucci, Gelsinger, Sakac, Breen on down were all in attendance for the event.

PRODUCTS FOR EVERYONE – Pat must be going crazy, we are announcing 42 new products at the show this week. Unbelievable. You sit in the audience as they start going through vfcache, project thunder, XtremeIO acquisition, integrating with fastVP, new VMAX, New VMAX Service Provider edition, isilon Mavrick’s release (this one is really cool) and you realize we’re on hyper drive (no punt intended). EMC is attacking the opportunity with furvor, and its not alone. There are several examples where alignment is the real win. Part of the keynote included Chad Sakac demoing Landscape Virtualization Manager. I know that sounds like an EMC or VMWare product, but its actually from SAP. There is a major play with SAP to align at the management layer to take collectively consume the cloud opportunity in a short number of bites.

I need to quit typing for now and learn some more about all the new levers we have installed on the EMC go-fast machine. I’ll check back in later.

L8tr

20120521-145128.jpg

20120521-145150.jpg

20120521-145222.jpg

– The American Carnival – Sapphire, EMC World & the Spring Tradeshows


What’s your spring like, flowers and rain showers? Mine is a criss-cross journey between Orlando and Vegas as I partially attend the 8 weeks of the American Carnival.  Similar to its Brazilian counterpart in little, the American Carnival of IT is a series of software and IT companies holding their major shows starting in early April to June.  Two of the biggest events are coming over the next two weeks: SAP’s SAPPHIRENOW and EMC’s EMC World. Luckily… they are not in the same place (complete sarcasm).  Sunday I head to Orlando, then travel to EMC World in Vegas for the following week.  Its maddening excitement as I prepare to present and participate in at least 80 or so meetings that will define many of the plans we will use to execute over the next 12 months.  The goal is simple: risk something, leverage another, and try not to pick up any poundage from the food.

What’s interesting this year is it’s been about 18 months since we saw Oracle get into the hardware business, SAP get into the in-memory business, and EMC proclaim is dominance in “Cloud Meets Big Data”. Though Oracle has had a rocky time of it as they engaged the majority of their partners in warfare, they did kick off a crossover buying binge that is changing the market. Look at HP’s acquisition of Autonomy and Vertica, look at SAP’s recent investments in Violin Memory, VMware’s investment in Cetas, IBM’s purchase of SPSS, EMC’s acquisition of Pivotal Labs.

Also let’s add into the soup pot SAP’s frontal assault on the traditional DB vendors (an eye towards Oracle) with their in-Memory database architecture, HANA. Who would have considered putting something as large as SAP on an in-memory database a few years back? Now customers have spent, I would speculate, 100’s millions investing in initial phase deployments.  Finally look at the scrappy EMC. Rewarded and punished by its impenetrable brand as the “pioneering storage giant”, has actually cracked the market’s stale perception of this firebrand turning it into a Cloud and Big Data company. Major R&D investment, acquisitions and a bit of quality marketing have worked to transform EMC into a major player at the crossroads of these two movements. 

You ask: “Is he off topic?”  maybe, but my reason is to explain where my interest lies as I pack my bag for Sapphire.  Like the point in the Hunger Games where they all pop up into the field and have a few seconds to consider their first action, how they will live or die, we are on the cusp of an epic “cage match”. There are no long term partners anymore; no one can see that far. Today it’s about who helps you for the next few steps, who wins with you as a partner contemporarily.  No one is going to respect the existing swim lanes going forward. Do you run for the margins or dive for the swords.

With that said there are some significant allegiances that seem to have a strong foreseeable future. Companies like Intel, Cisco, EMC, VMware and SAP have a shared advantage in a new world of big apps sitting on Clouds running on x86 platforms. These come together to provide better price, better performance, better flexibility and I am sure there will be more announcements across these brands about their interaction and investment.

If you’ve ever used a boogie board you know about double waves, when one wave consumes the other and creates a massive ride to the sand. Well we are really dealing with a double wave as we speak. The first wave is the Cloud. We’re started, but we’re not nearly done with the Cloud. We’re just now seeing the beginning of the main streaming of these technologies as many companies start to go into production with their Cloud platforms.  However, many have prioritized a second wave of activity to create the business justification or at least the compelling event for cloud.  From my perspective, those priorities are coming from either an effort to reach the end user or to process large amounts of data, often created by the end user (aka Mobility and Big Data Analytics). Customers want to build roadmaps that improve the business and use cloud as a transference mechanism.

My old boss always said its messy when you make laws or sausage.  We’re “moshing” cloud, VDI, mobile apps, social media, sensor nets, machine Learning, ERP, ecommerce into use cases for the business so we can better know our customers, better know our profit, or better know ourselves. I believe this means companies are exploiting the convergence of IT vendors, and customer are increasing their use of the global systems integrators to cut a path through this gnarly vine covered jungle.

That is what I’m looking for at SAPPHIRE, and EMC World. Where the use case meets the solution, and who are the vendors who are offering it up.

If you are interested in EMC being part of your developing mosh pit. Please come by to see us in Orlando or Vegas.  At EMC World you can imagine we have a presence… So, I’ll leave that topic to the many blogs that are already covering it.  Let me spend a few lines on Sapphire. EMC is an Onyx partner this year and we will have many activities to choose from.

Here’s a sample list:                

  • Big Data: Controlling Unstructured Data in the SAP Landscape, Andy Sitison & John Cooper, Monday 14th 3:00p at Partner Center Theater     (I’m introducing John who is our Chief Technologist based in Texas)
  • Virtualize SAP with EMC & VMware, Eric Walter, EMC – Monday @ 3PP, Tuesday @ Noon, and Wednesday @ 11AM, VMware Booth #1293
  • High Availability & Persistence for SAP HANA, Stefan Voss, EM, Monday @ 4pm, Tuesday @ 4pm, Wednesday @ 11am, Cisco Booth # 1185
  • Transforming SAP Apps with VCE’s VblockTM Infrastructure Platform. Monday, May 14th at 2:00pm-2:45pm, Partner Center Theater
  • Transform SAP by Replatforming to an Intel Architecture with EMC, Tuesday, May 15th at 2:00pm-2:45pm, Partner Center Theater
  • EMC, SAP & VMware: Collaboration in the cloud for customer success, Cloud Theater (Time TBD)   
  • Join us for the Vblock™ Platform Party, Monday at 4pm, Tuesday at 4pm and Wednesday at 3pm
  • Be sure to speak with our  experts at our workstations and demos to be eligible to win the Mini Cooper
  • Share your ideas at “THE CUBE”  with Dave Vellante & John Furrier.  (that team does a great job)
  • Come by the booth for a list of all the activities and micros forums.

Obrigado, I’m off to practice my Samba now…

Scale Up versus Scale Out = Cloud is the Compromise


I spend my days talking with software companies, global system integrators and luckily customers.  I’m not omniscient, but I get a good dose of the business world around mission critical apps and the growing world of Big Data.  I wanted to spend a few minutes on how I see the transformation roadmap coming together.  First we need to baseline on a couple concepts.

I.B. Normal(ized)

Let’s go back to 1979, that’s when the Oracle database originally hit the market. This was a new era. Boyce Codd’s normal form for data table relationships (aka “Relational Database”) was applied and a business revolution was a foot.  Oracle, and its contemporaries, consumed the market opportunity like bar pretzels. We found we could be more efficient and wise when we collected and analyzed data; and we did. Then in the 80’s came the Open Systems innovation wave and the IT world was never the same again.  These new normalized databases needed one thing from the infrastructure that supported them, “Scale Up” architectures that could handle the throughput, the I/O, and the user load driven through a series of new applications like MRP, then ERP.  Like feeding a blazing furnace on a coal train, these hungry systems consumed resources from a centralized location, or at least a tightly integrated small number of systems.  

Scale up meant enough power and intelligence to get everything working in unison.  The goal of the tech innovations was to increase compute power and capacity so that more data and processing could happen. We used industrialized data centers to consolidate these assets. The data centers, although expensive, allowed for efficiencies like shared resources.  The effort was a cyclical feeding of an ever growing IT monster.  Most of these systems were owned by the individual companies who needed the results the system would provide.

Eventually the market matures and new technologies and business models appear. Continuous improvement efforts lead to more efficient processes, products like virtualization allow for further consolidation and utilization, thus cost savings. Consolidation leads to companies who offer services for hosting others equip, compute requirements or even providing a service level, removing the architecture discussion from the equation.

 Scale West Young Man

In the last 10 or so years new companies like Google and Amazon appear on the scene, they are not born of the old guard. They come from a time where “Scale Up” is already heading to the retirement center, its blue hair old, and its way out of touch.  They are new and innovative enough to be bearers of change. They see the democracy of the early internet and see flat inter-connected architectures: “Scale-Out” is born.

Scale Out is the concept of splitting up big compute requirements into progressively smaller requirements and then reassembling the product. This is often referred to the process of “sharding”. You’ve seen this used on the web to decipher the human genome, when you type a security word (“Recaptcha”) and  in products like Hadoop/Map-R.  Scale out provides the ability to take big problems and distribute them to piles of non impressive, cheap commodity hardware. As a model, it gives the user and architect more flexibility to address Big Data without the war chest of a Fortune 100.  To compensate for the lack of dedicated hardened assets running these programs, they are designed to be massively parallel and massively redundant. Data is kept in redundant veins as it is distributed across the mpp network. Redundancy provides the ability to recover and reapply a job in case of failure in another part of the system. This is cool for colleges, skunk works, and even Google.

However, many companies struggle with two things. One, the effort to remediate failed hardware and two; dealing the cost of triple redundancy of the data sets, which is often required by mpp products. Imagine you have a 10 petabyte data instance, where 2/3’s is redundant data and you could increase your utilization to 60 or 80%?  You’d jump at the opportunity. These are the experiences corporations are dealing with as they adopt these new open source or their industrialized for-profit counterparts.

“…Powers UNITE!”

Today companies are trapped between scale up and scale out. Like an unfortunate person with one foot stuck in a concrete block. Most feel like they are “dragging a limb”. There is also a great deal of fatigue in corporations for transformation for transformation sake. Scale Up, though aged, is a known entity and why go to cloud if not forced to?  The answer lies in the business momentum of things like the mobile user and data analytics. They want to get to the new cool business enablement stuff. Cloud is the answer to achieve meld these competing forces:

-  Clouds are proven to be a great solution for optimizing Scale Up architectures.

  • Either through Private Cloud (internally owned)
  • Or, Public Clouds (leverage of external assets)
  • Or, some combination of Hybrid Cloud.

-  Clouds also provide a future solution for scale out  architectures.  

 
The Cloud allows for companies to develop virtual instances of things. I predict rather quickly, scale out solutions will start showing up as virtual nodes.  And, what do you do with virtual instances?  You consolidate them in a centralized, optimized way. In this case, the cloud.

For those who feel like “the Man” just stole your scale out ”commmon man” liberties, don’t fret. You can still run Cassandra on 30 discarded laptops from your local high school. There will be way more flexibility in the new model.  However, don’t be upset if you see you dad wearing your Hadoop t-shirt while he runs it in a data center. In a vote between “cool” and “stable”, corporations will always vote the latter.

Frankly I’m glad to have the wildly vast options. When trying to integrate data across various sources available within or outside the four walls, there will be a diversity of need. I don’t believe the true innovation of Scale Out means taking it all the way to the wall outlet. I believe it is in the opening of the mind to new algorithmic approaches to “biggie-size” data analytics.  If you can perform and meet your cost model with something that looks a little like a Hybrid, don’t judge. I’m good with flip flops and Allen Edmond’s in my closet. Why inject risk by throwing out all the good in the old model.

The generalized concept of SaaS is a good example of how a hybrid of Scale Out & Scale Up could work. Virtualized Scale out centralized on consolidated architecture could provide efficiencies and significantly reduce the tail-casing needed as you keep replacing devices in your hoopty-like MPP mosh pit.  Can everyone do Scale Out virtualized and centralized today?  No, but you can see it in the way the market is maturing.

Put that in your fully sharded pipes and smoke it.

“Shake Rattle and Roll” – A Singular Virtual Experience

Reblogged from Andy Sitison:

As I sat here in Richmond, Virginia today feeling the earth’s amazing power to shake rocks across state lines, I experienced my first 5.9 earthquake. It felt and sounded like someone dribbling a dumpster for what seemed like 2 minutes. All in all, no major damage to respond to and no lasting effects. Work only slowed for about 30 minutes as everyone chattered a bit.

Read more… 699 more words

In Richmond 3/26 at 11:30 at night felt the 3.1 rumble of another earthquake. I thought about searching google, I thought about looking at facebook, and settled on going to bed...

More Data, Less Wisdom


I am writing this blog to make some sense of our new data-rich world. If you collected the reading material that is spread throughout my haunts, you would find multiple copies of Wired, Time, Popular Science magazines lying around in piles, partially read, you’d find subscriptions to the Economist and Wall Street Journal, and Reuters News Pro on my ipad, a greasy spot on the glass where the twitter app sits on my iphone, you’d find my browser homepage set to popurls.com and reddit.com, a long list of blog sites like WordPress in my bookmarks and a copy of “The Hunger Games” halfway read. I’m trying to absorb all of this information and I am failing miserably!!   I don’t have time to digest it all and I actually feel like I know less than I use to. 

There is a deeply embedded function of human nature. As a society we tend to apply an ever compounding value to the familiar.  Think about Bill Cosby, the Beatle’s “Let it Be”, or the movie Casablanca. What makes them so great? Are they actually better than the comedian Ralphie May, the song “Landed” by Ben Folds, or a better movie than “The Fall” by Tarsem Singh?  I would say they are not, if judged by an audience untainted by historic exposure.  We reward those that have made it and those who have endured.  Ever had to do “Y-M-C-A” in a football stadium? Nuf said.  Instinctually this is probably brain stem activity that helps us bond and respect the ancient tribal elders. If you have achieved and endured you are rewarded with top-level celebrity status.  Elders were storytellers they effected our consumption of data. This elder archetype has been prevalent throughout our history, and as recently as the 1960’s was epitomized in the role of “trusted news anchor”.  Remember Ed Murrow or Walter Cronkite? These two men epitomized the role. Millions daily would get almost their entire world perspective from the trusted news anchor. 

In my observation, the trusted news anchor was less biased, more prescriptive and his stories more thoughtfully prepared than the “newstainment” of today. Trust is a powerful tool. It was instrumental in setting a national mood for war, or for mourning when John Kennedy was assassinated.  This enabled our country and created a commonality that was well…”familiar”.  When the news finished, whether it was good or bad, you were intent with the outcome. You felt you knew what you needed to know. 

There were super structures in the past that simplified our consumption of information in a temporal way.  We knew what we needed to know for that timeframe. You could say we chose to work with less data, but process it systematically. This has been a valid strategy, consider North Korea, or U.S.A in 1962 or 2002. Because of constraints we focused on less compared to the information orgy we are living in today. I’m not professing censorship or mind-control in the least. However I do believe these cultural and process super structures are really important and I believe these conveyances have not kept time with the growth of Big Data.

 Many of us cannot find the same feeling of closure, nor can we apply introspection in the same way. It’s also hard to file away what you learn, to use later. In the words of the Police song: “Too much information running through my brain”.  I actually feel the per unit value of information ingested, and its effect on my wisdom, is going down. So much so, I have come to the conclusion that some data is actually making me less wise; clouding my perspective, ruining the contextual assignments of data in my brain and fogging my memory of the trusty foundational constructs that I use to apply information.

I share these ramblings in an effort to bring attention to that messy grey area of context, consumption, and application. As banks process millisecond transactional activity, the retail industry data mines twitter, and groups like UNESCO do population studies like say “the correlation of secondary education on the global GDP”. We need to draw bigger conclusions we also need to draw regional conclusions, and understand the difference. We need to know when to ponder a concept and when to take action. We need work to better our consumption models so they are not consistently myopic or lost in a web aggregator’s magazine format. We need to consider how we weight information to help cull the significant from the silly. “Too much” is as inoperable as “none at all”. Better consumption will help us apply our learning to achieve and inspire. Ultimately, how do we replicate the “trusted anchor” on the grander scale of Big Data.

Taking a Seat at the Big Data Table


Today EMC made a concerted effort to lay down the “table stakes” at the Big Data table, quietly demanding respect for their bid as an anchor player in the future of Big Data. At the start of day on the tech heavy west coast, word rang out of the EMC announcement in the industry press channels. Today, EMC announced their answer to expanding collaboration between data scientists, and the acquisition of the world-class development house of Pivotal Labs.  In a world inundated by an almost endless amount of corporate-generated press releases, this was noteworthy through the noise.

 Why?  Let me give you a few points to consider. Ok first, have you ever had a need to execute a mental task or two on your computer only to find that your virus scanner was running, or the company is installing something behind the scenes and you are relegated into feeling like you are living in the Slow-mo footage at ESPN? You wait seconds if not minutes everything slows down and somewhere in the process you realize you have forgotten EVERYTHING you were doing and your creative energy is all but drained from your person. You might as well just do email now…

Well I tell you this loss is pervasive in our IT world, often we lose the ability to execute on our most brilliant ideas because of timing, multi-tasking churn, and the inability to effectively execute on collaborative activities, all before the constant rush of information again flows over our levees’ and we’re buried in the next rush of content. Like waves at the beach we only have so long between the intervaled poundings to make real progress.  So if we imagine this to be true of the basics of our business lives, now imagine the pace of predictive and/or low-latency analytics where the provisioning, processing, analysis, decision and actions have to happen in a day, or an hour, or a second, or a micro-second.  We’ve got to get better at our ability to process in the cycle-times we have. Of course to address micro-second requirements will require machine based processes, but there is an immense opportunity to refine our cycles that fall in the realm of human processing.

One of the most critical tools of human invention is timely collaboration. Humans make better decisions faster when they can leverage readily available tools, data and peers. Imagine the perfect world where you can get data when you need it, you can get advice when you ask for it, you can push a result to another for review without technical limitations, and you didn’t even have look at an email to do it.  This is the big step EMC made today by announcing “Greenplum Chorus”.

 

Greenplum Chorus is a collaborative environment that allows the users (data scientists) to self-provision space, capture, transpose, assess, and share chunks of data without approvals, requests, or IT intervention.  We’ve seen how impactful social tools like Twitter or Yelp have been. The ability to connect, share and discover has profoundly changed the world, and now we have a similar social lever to use in the advancement of data analytics.  Chorus will additionally be a landing zone for an eco-system of 3rd party offerings allowing for freedom to advance the evolving strategies of its user community.

 

WOW, if that wasn’t enough to talk about.  The acquisition of Pivotal Labs is the laser sharpened sword hidden in a gentleman’s cane.  These guys are extremely competent, experienced, and pedigreed. If you were look at their customer and collaborative projects list, it’s the who’s-who of this IT age. Technically Pivotal Labs brings to the equation, their focus on agile development tools and an invaluable resume of cloud, analytics and mobile success stories.  In addition, Pivotal Tracker is an industry leading agile development platform with hundreds of thousands of active developers currently using the platform. Akin to SAP’s purchase of Business Objects, this provides EMC with not only great technology, but an existing eco-system to embolden the go-forward plan.

 

Easy as 1-2-3

EMC Greenplum is known for their high performance data driven solutions which are cloud ready. Now you add a collaborative platform that engages the users in socially empowered self-service model, and an integration platform to pull the story together and you can see an impact player in the making.

What Happened in Vegas – SAP Insider Follow Up


ImageWell I’m back home from a trip to SAP Insider’s conference and I promised to answer a series of questions based on my conversations from the show. If you will allow me, I am going to change how I deliver on my earlier commitments.  I found my questions morphed drastically as I engaged the attendees.  Why?  well frankly I stink at being a reporter and in fairness, the show’s attendance changed this year enough that I found myself going in a different direction.

Go back four or five years ago and there were two shows called “Admin” and “BI”. They were primarily attended by BASIS teams who were dealing with infrastructure issues.  With SAP’s M&A strategy and SAP’s messaging evolution, the event has changed to reflect the new SAP. Now the show had divested to create “Cloud & Virtualization”, “Mobile”, & “Business Objects Bootcamp”.  Let’s admit it, since 2009 the economy and general show attendance has fluctuated. I am sure that has something to do with the shows coming together in a co-located venue allowing for those attending to stay in a single track or blend their experience across multiple domains.  This is not intended to be an Oracle Open World or SAPPHIRE level event, it’s not that big. In my experience the 2nd-3rd level shows tend to be better attended on the east coast.  So net-net, even with the bundling of multiple shows, the attendance was a little light this year. Additionally a show that used to be a haven for BASIS teams seems to have changed in personnel and now is a different show entirely.  I think this is important because it is a reflection on the wider changes in the SAP industry.  I have a couple of insights about this that I will explain through a discussion of those who attended amd those who didn’t.

 There were 3 types of people present at the show and 2 types surprisingly absent:

1)      PRESENT: Those who want to catch up on virtualization/Cloud.

If I generalize the group, the Cloud attendees were a more “matter of fact” group. They were either going to the cloud, had an upcoming RFP, or presented themselves in a way that they felt they needed to “catch up” with everyone and get virtualized or to the cloud.  This is an interesting dynamic given that this same time last year Cloud was the fresh buzz and only those with iron guts were talking about venturing their mission critical to the cloud.  This shows the pace of innovation in the current market and ultimately that the cloud benefits have “held” and the scary risks have subsided. This adoption is also in the face of all the HANA interest which today is not (practically) a cloud ready product. So in a careless and causal way I’ll make the broad generalization that many if not most are taking a “get to the [private, hybrid, public] cloud now and pilot HANA in the lab” approach with the assumption HANA will somehow fit into their overall architecture as they mature their programs.

 

2)      PRESENT: Those who want to deploy HANA or are active BOBJ users:  

I arrive at my statistical certainties by the scientific process of “# of questions asked” and how many people attend various session topics. Given my sample size, time of day differences, and the deviation in how much coffee I have consumed at a given time, make my prognostications suspect at best. However, let’s not let truth stand in the way of knowledge.   I would have to give the hands down vote of “topic of highest interest” to HANA. HANA sessions were packed  most attendees seemed to be staging HANA pilots or were BOBJ users who were investigating how HANA would impact BOBJ over the next few years. The Keynote given by Steve Lucas, Senior Vice President and General Manager Business Analytics at SAP was all Big Data. He talked about open source, unstructured data, Hadoop and brought it all back to SAP’s data analytics stack, which is based primarily off HANA and remnants of the Sybase.  SAP is Big Data obsessed and so are its customers.

 

3)      PRESENT: Those who are looking to deploy mobile apps that integrate with SAP

I must admit I am most impressed with SAP’s dive into the mobile market. Within just several months they have taken this global ERP company, added Big Data and integrated a mobile BYOD story as if it was always there. It’s very tight messaging, even if the technologies are still coming together in a few spots. I really enjoyed the well attended sessions on the details of the SUP.  What’s “SUP”… “dunno, What’s up with you?”  SUP is Sybase Unwired Platform. This is the API and code set that was added to SAP’s arsenal through the Sybase acquisition which allows users to write platform specific or platform agnostic applications. As they pulled back the covers at the show, it’s not perfect yet, but it does provide a solution that many of the install base can use to close down on the “last mile” (aka the mobile user).

 

4)      ABSENT: Those who’ve already began executing the Cloud

The Surprising VOID of the show was the contingent of folks who are actively deployed or who are deploying a cloud solution.  I personally/causally know many who just weren’t there. Of those I talked to before the show, I had a perspective. They said they are deep in deployment and weren’t sending anyone. What I didn’t realize was how pervasive a phenomenon this was.  I’m not saying there was no one chasing the cloud, but it was notably down and my minor investigations into this, presented a plain fact. Customers “get it” and are “doing it”. Interestingly enough, this is exactly where EMC IT is in their multi-phased process to reach Cloud-enabled ITaaS.  They too stayed home this year. Though I missed the constant discussion of Cloud, I realize a more important event has happened. In past blogs I have talked about Gladwell’s Tipping Point for the cloud. I think we’re there.  Cloud for mission critical has moved into the mainstream.

 

5)      ABSENT: Those who are making investments in Big Data other than HANA:

Another interesting attribute of this event was that the broad heterogeneous all encompassing world of Big Data is seamlessly shrunk to nothing but BOBJ and HANA (with a token Hadoop thrown in).  Ok, you may say that SAP has aggressively driven the competition away from the venue. Maybe, but that isn’t the vibe I get. Even those that come up to you in conversation, do not seem to have a vocabulary or interest that extends much further than the SAP Landscape. I attribute this to a couple of factors. One is that SAP is a big animal. It’s like a youthful trip to the amusement park. You couldn’t see the boundaries, it felt endless. I think many who build their careers on SAP, live within a large ecosystem that can consume your focus without the need to test the boundaries.

 

Secondly I think it is a function of how “new” data analytics/Big Data is to SAP. BOBJ is Business information integration technology, and before Sybase there were few who considered SAP in the realm of database management.  HANA is a fairly new concept, only appearing a few years ago.  So the SAP user community is comprised of people who haven’t traditionally been players in the pre-cursors to Big Data and thus possibly not broadly trained on the overall market.  This is not to imply an inability to execute, only that this is really new and the SAP ecosystem is evolving. It will look notably different in a couple of years.

 

So those were my major insights from SAP Insider sessions in Vegas. I hope you pulled at least one nugget from the pan. Until next time, stay informed. Adios.

VEGAS FORECAST CLOUDY , SAP INSIDER – Feb 28-March 2nd


ImageYou can tell I’m a jet setter, why? Because I am finishing up a winter cold this week that I either got from the team in LA, the folks in Boston, my trip to NYC or from my kids.  Anyway I am on the mends with excessive dosages of germ cleansers and bug killers because next week I am in Vegas for SAP Insider. As far as Vegas goes I can take it or leave it, but SAP Insider has been a staple event for me for several years. I wouldn’t want to miss it. This year they have combined 5 SAP-related, Insider sponsored events into one venue: BI, Cloud & Virtualization, Administration & Infrastructure, MOBILE, & Business Objects Boot camp.

First, let me tell you about how EMC has organized for the event (#EMCSAP). As a gold sponsor, you’re going to see a great deal of EMC around the show. We’ll be spending most of our time talking with customers around Cloud and Big Data solutions we’ve brought to market.

What you’ll find interesting this year is that much of the conversations will include “hindsight” (aka lessons learned). We’ve been busy the last couple of years taking customers into virtualization, and into the hybrid clouds. We now have the luxury of an install base that provides some direction for those who now begin the journey.

This year we’ll have 3 expert speaking sessions that should be full of content about what we’ve learned from working with our customers to reach the cloud.                                               

Date:  2/28

EMC Accelerates the Journey to Your Cloud by Replatforming to an Intel Architecture – 2:45 pm, RM 106   – Abstract:  SAP customers today are evaluating how to move to virtualization confidently and improve daily operational efficiency—while ensuring the highest levels of availability. Discover methodologies and how replatforming to x86 with can accelerate the journey to your cloud and help accelerate SAP deployments.  You will gain practical insight into what you can do today to build a virtualized, dynamic SAP infrastructure for tomorrow’s private cloud computing model.       

Date:  2/29

Reduce Costs and Improve TCO by Virtualizing SAP with EMC & VMware – 10:00 am RM 106 – Abstract:  The business benefit of cloud technologies are appealing; however, virtualizing mission critical applications carries significant risks associated with performance, security, availability and management complexity. In this session, learn how SAP and EMC are partnering to develop secure clouds that are highly scalable and available within the performance requirements of SAP applications. Key topics covered will include: Physical to Virtual computing solutions, backup consolidation with deduplication, and availability and disaster recovery in a virtual environment.  You will gain practical insight into what you can do today to build a virtualized, dynamic SAP infrastructure for tomorrow’s private cloud computing model.

Title:  Case study: EMC IT shares lessons and tips based on its enterprise virtualization initiative – 2:15pm RM 301 – Abstract: Explore EMC IT’s Journey to the Cloud and best practices on how enterprise mission critical applications like SAP are designed and deployed in virtualized datacenters. By referencing EMC’s own large scale SAP ERP global deployment, you will learn about the approach used to integrate 80+ applications into a “Common Integration Cloud”. 

I know this next line sounds like sleazy marketing, but it’s true…Last year our sessions were standing room only, so get there early for a seat. If you get there too early we promise to entertain you with brilliant conversation.  Worst case… if you miss the time slots, you can always tweet me @ASitison and I can hook you up with the presenter or just come by the booth for a handshake and some giveaways (CAN YOU SAY PLASTIC CASH!).

…OK NOW FOR MY MISSION I CHOSE TO ACCEPT…

What I like about the SAP Insider series is traditionally it is the “workers” who show up to learn and to think about new ways to address problems that they have experienced in the last year.  This is “reality” walking the halls by the thousands. This is not where people come to hear about how the next great thing that will change the world in 5 years, it’s where you hear from those who are changing their world today. And, it’s a great place for a guy like me to get a dose of what needs fixing in 2012.  

I’m going to approach the event a little differently this year.  Usually I get consumed by meetings with customers I am currently engaged with. I rarely make it pass the hotel restaurants and the tradeshow floor. This year I am going to carve off some time and take on a new mission. My iphone and I are going on a journey to capture some of the stories about the problems and solutions that everyone is solving and to document a few of the interesting ideas that are readily available in the conversations on the floor.

On my journey, I’m going to try to answer:

1)      How are companies doing and how are they leveraging SAP in their strategy?

2)      What are the major problems being solved today (i.e. cause & symptoms)?

3)      How are they solving them and how are they pacing their roadmaps (i.e. cure & dosage)

4)      What does big data look like to them and how central will SAP products like HANA and BOBJ be to their strategy?

5)      What is their cloud strategy and have they “ventured into the mist…” Do they have personal stories about chargebacks/metering, provisioning, multi-tenancy, etc?

6)      How has globalization changed their plans?

7)      What do they want from their product and integration partners?

8)      Are there trends to be identified in everyone’s collective activities?

I will leverage twitter while I am at SAP Insider (#SAPInsider). If you’re there, please reach out @ASitison and we’ll get one of those extremely weak coffees together. I’d love to hear your story. I will also monitor the social media activity for any valuable content. If you have questions you’d like me to answer while I am there send me something through Twitter and I’ll be your trained monkey. When I get back from the trip, I’ll post a summary of my findings back here on the blog site for your consumption.   Wish me luck, hunt me down (figuratively), and/or come back to see what I found out.

Monkey signing out.

Big Data: The Quiet, Quick Death of Privacy


note: use the embedded links its good stuff! :)

Last week I wrote the first of a two part blog on Big Data. I discussed the evolution of digital data, the series of initiatives that have appeared to manage data and the impact Big Data will have on our current world. Today I want to discuss another aspect of Big Data and that is information privacy.

I will start by saying I am a bit disturbed. Not by progress, because I enjoy evolving. My concerns are in the dichotomy between massive change and the blind involvement of the average human in this process. It is a common sight to see a mother driving a Lexus with a phone propped against her ear, kids pushing Facebook photos to friends, or a college student typing out a few keystrokes on twitter in the local coffee shop. We’re all active participants in massive information usage. We are also the first generation in modern history to see a permanent revocation of privacy rights. Many would say these minor losses of privacy are needed to fight terrorism or to keep up with the criminals; but I would state the changes in technology and our new found social obsessions are equal contributors to this loss of privacy.

Very few of us are considering the changes in privacy in a broad societal context. We leave most decisions to the ill prepared politicians to poke their finger in the shadows of the black box without understanding the ramifications of their actions. Or, to those who will capitalize on the opportunity. Those who will leverage this information, possibly for great or nefarious purposes. I hope you see in this article I am not here to vilify anyone or to say we need the level of privacy we have had. Instead this is a call to action for us all to think about what this all means. I’m asking you to be the “cowboy”, not the “cow”. Big Data means data everywhere; it will undoubtedly impregnate our lives for the foreseeable future.

This blog will be broken into three parts. The first part will quickly hit upon the historical rise of freedoms, the second part will focus on the current world of information collection, and finally the third part will ask the question should we care? Before diving in, I will tell you that I have no “legal chops”. This blog provides a dime store tour of some of the legality of privacy. Take it for what it’s worth.

PART ONE: A Brief History of Privacy
Today’s modern view of rights and liberties principally start in 1215 with the “Great Charter” or Magna Carta. There was little in the way of specifics defined within the big “MC” related to personal privacy, but it kicked off a vein of thought that became our current global era which has afforded more international freedoms to more people today than in any other known period of time.
From the 1200’s through the 1700’s most rights and liberties focused on the freedom of religion, incarceration, taxes, and property ownership. Virginia led the colonies in drafting the “Virginia Bill of Rights” in 1776 which later became the starter document for the federal bill of rights Using the Constitution.org site, I was able to understand that much of the momentum for our privacy and protection in the constitution, came from the findings associated with a handful trials like “Wilkes v. Wood” where Wilkes won a suit against the practice of issued royal warrants allowing appointed agents to ransack the designee’s homes and seize their books and papers. These warrants were issued against those who spoke ill of the King. The revolutionary war and our formative years as a country solidified our resolve for liberty and gave birth to a new foundation of human rights.

Going forward through the decades, America and England set many standards for personal freedoms. New legislature and case law grew in support of the concepts of privacy, “Invasion of Privacy” to be specific. Interesting enough technology played a big role in the development of privacy. Newspapers, cameras, and TVs allowed the common man to see what was happening in mass and to begin to influence the law makers and courts to better protect privacy. Examples include tort laws on invasion of privacy which allow you to sue against those who intrude on your properties. One of the biggest “rocks in the river” happened in 1961, the Fourth Amendment to the US Constitution.

“The right of the people to be secure in their persons, houses, papers, and effects, against unreasonable searches and seizures, shall not be violated, and no Warrants shall issue, but upon probable cause, supported by Oath or affirmation, and particularly describing the place to be searched, and the persons or things to be seized.”                  – Fourth Amendment to the US Constitution

The fourth amendment protects against unwarranted search and seizure. To me what is interesting is the fact that our deep seated concept of privacy is actually a fairly recent addition coming into its current form just before I was born.

It is important to point out that privacy law is subjective. Case in point: the term “of public interest” seems quite broad, but is a key point leveraged in the legal interpretation of “invasion of privacy”. Case point: celebrities have less privacy rights than the average American because of such interpretations.

So I hope I didn’t bore you in the review of our collective, traditional perspective of privacy rights. I’ll finish part one with some related quotes through history:

“But no part of the property of any individual can, with justice, be taken from him, or applied to public uses, without his own consent, or that of the representative body of the people.” – John Adams 1776

“If men through fear, fraud or mistake, should in terms renounce and give up any essential natural right, the eternal law of reason and the great end of society, would absolutely vacate such renunciation;” – John Adams 1772

“All tyranny needs to gain a foothold is for people of good conscience to remain silent. “ -Thomas Jefferson

“It all comes from, I would argue, this right to privacy that doesn’t exist in my opinion in the United States Constitution . . .” – Rick Santorum 2003

 

PART TWO: Current Events in Information Capture
One can say that up until 1990, privacy was a physical thing. A search warrant protected privacy of one’s space. You were required to have proper cause and approval to invade someone’s personal space. Today the digital world has no analog to protect your digital and physical privacy from a new wave of technologies.
In this section, let’s look at several current events that relate to the capture and use of personal information

- Carrier IQ Article, Gigcom – Carrier IQ is a product that can be preloaded on your cell phone or device that can literally capture every action and designed to send that data to some collection zone. It was engineered for the cell business to create new knowledge, and arguably profit, from the data collected. Apple quit using it in iOS5. My carrier Verizon has a policy against this product, but other carriers like Sprint and AT&T have used it in some form. This article included a poll on whether respondants would change purchase behavior based on this knowledge, at the time of writing, 82% voted they would.
- House Committee Bill on Data Retention Mandate, CNET - Here’s an excerpt from this article:
“Internet providers would be forced to keep logs of their customers’ activities for one year… 19 to 10 vote represents a victory for conservative Republicans, who made data retention their first major technology initiative after last fall’s elections, and the Justice Department officials who have quietly lobbied for the sweeping new requirements… rewrite of the bill expands the information that commercial Internet providers are required to store to include customers’ names, addresses, phone numbers, credit card numbers, bank account numbers, and temporarily-assigned IP addresses, some committee members suggested. By a 7-16 vote, the panel rejected an amendment that would have clarified that only IP addresses must be stored. [so the all data would be stored…] It represents “a data bank of every digital act by every American” that would “let us find out where every single American visited Web sites,” said Rep. Zoe Lofgren of California, who led Democratic opposition”
There is also an interesting “Government Snooping Timeline” in the article. Popularity can only be judged by the comments that follow the blog. They were damning…
- CIA Mood Ring: Monitors Twitter and Facebook, Computerworld  – The CIA monitors up to 5 million tweets as day says Computerworld. They do this to rapidly assess the global sentiment. Feeding results to various governmental recipients like the president. The article additionally states that Homeland Security is looking at guidelines for privacy rights while it monitors social media. This is self-regulating and questionable if it would be successful.
- Town Center to Monitor Christmas Shoppers w/ their Cell Phones, – These things hit close to home, my local town center “Short Pump” announced plans (http://bit.ly/sJIy3o) that they would track everyone that entered the town center via their cell phones and aggregate the data to determine shopping patterns. Though they did provide some news information on the web, the actual shopper would not be notified of this activity. Approximately 1 week later (http://bit.ly/rKkVu0) they announced they would be pulling the system out at least temporarily because of the backlash. However they imply they will be working on enhancements. I bought my presents at the competing malls this year.

- Surveillance Catalog Article, WSJ - This article and video provide a laundry list of  new hacking, monitoring, and intercept technologies. Hey maybe something for under the tree?
- CNN News – Just this morning I watched CNN where they talked about new surveillance companies providing police forces and other governmental agencies data collection and mining tools that take information from public wifi’s by penetrating laptops and devices on the network, even if they were password protected in some instances. Their next report was a discussion of drone planes and whether would we ever use them in American skies?
- SCAN VAN – Ok… if you have survived the others without a flinch, this one has to get you a little. The company American Science and Engineering has installed and is selling backscatter vans (or x-ray vans) that can be driven up and down the road visualizing all the contents of houses and/or cars. To be clear through brick walls and through clothes while you pass on the street. Here are 2 news reports that differ in the support of such technologies as appropriate. (Young Turks, FoxNews worth watching both…). Once again we all have to decide if there is a line and where that line is.

So, hopefully you now realize that data is collected in very new ways that is without a doubt invasive by traditional views of privacy, yet it feels so right as we leverage the inter-connectiveness of our personal device world.

PART THREE: What’s an Addict to Do?
In 1949 George Orwell wrote the epic book called Nineteen Eighty Four about a society ruled by an authoritarian group called “the Party”. The people were constantly watched with little to no freedoms, they are surrounded by pervasive surveillance, they were subjected to mind control, and they were perpetually in a state of war. With constant devices and 24×7 news, sometimes I feel like I am on mind control…

Whether you’re ready to grab an aluminum hat or if you’re an “out of sight out of mind” type, I hope you see the acute changes that technology has brought upon our actual privacy and thus our rights. The question is what do you do about it? Do you shut off your phone? Put down the iPad? Write your congressman? Write a blog? Change your shopping patterns? Start a new data mining company? The answer is to take action, whichever you see fit.

As a society we need to step up our societal skills. There is lots of “whitespace” to be defined today and most of us are too busy with kids, soccer games, quarterly reports, and the daily DOW to focus in on these issues. If Thomas Jefferson or George Mason had followed our lead, we wouldn’t have the America we have today. Our founding fathers were consistent in their concern in the fragility of our democracy and our freedoms. They were extremely worried we would become complacent and apathetic to our luxuries. They were right. Form an opinion and share it. Maybe privacy is overrated… Maybe privacy and freedom are loosely correlated and do not represent a causal relationship. These are the things we should be discussing. Let’s formally and proactively reach that conclusion if so.

Big Data is coming and it is a positive force and will better our lives and our economy. Yet, I don’t want others defining my future while I’m watching a hulu clip.

The opinions written of this blog are solely my own and not those of my associations.

Big Data: Data Science emerging field to support new levels of understanding


note: lots of good embedded links this time :)

Today’s blog is one of a pair of essays I’m going to write on two different perspectives associated with Big Data. I believe Big Data is notably important and impactful to the immediate future of our culture. First we’ll look at what Big Data is and the dynamics of dataology, or what most people call Data Science.

I am a latent Data Scientist.  It was probably my calling. Today I’m in the sales function of our business, but I started my career with a Masters in Database Management. I was doing C++, B-trees, Bloom filters, working with SAS  data sets and taking endless classes in statistics/economics.  Frankly, I loved it. My passion was the data structures and the insight that could be acquired by slicing the chunks.  Organized data, in its prescribed context, is real. It’s not some pundit’s opinion on the 247News.com.  It is based on facts.

 For whatever reason, I ended up going down the “line of business” systems integration path. My career led me into workflow, document management, and supply chain technologies.  These were connective and provided an immersive business process environment, but the treatment of the data was still inefficient, and disrespectful to its value.

Yes, I have been branded a “purist” in my past life, but ultimately, my focus was more on the data and the data models than on corporate profit.  I consistently ran into the walls of “good enough”.  And I realized that rich data models weren’t considered profitable endeavors by the majority of the American industry.  Instead, most wanted little snippets of data, transactional crap, when we knew so much more.

Several industry initiatives showed up: “Business Intelligence” (BI), “Information Lifecycle Management” (ILM) and “Master Data Management” (MDM) all with promise of a better strategy for data, but they were realized into purpose-built tactical systems to address specific real life problems of sales growth, regulatory submissions and company acquisitions. None of them truly structured and exploited the fundamental Intellectual Property (IP) of the data that each company has about their customers, employees, and processes.

Add to these points that we all see “the disconnect” between data points in our daily lives. Banks that don’t recognize the “savings account you” from the “home loan you”. Or, my employee electronic health records system that shows all my doctors visit records and tests, but when I take an online health risk assessment, it still asks me pages of questions about blood pressure and cholesterol.    

Well I am an optimist, and I believe that the current industry initiative called “Data Science” has structural differentiation from past trends and will likely get closer to my vision in several ways.

Data Science will be more scientific with data because:

  • Data is growing in such a manner that we are actually in trouble. We have multiple points of failure in people, process, and technology; and most industry leaders recognize it. Look at this page on the digital universe, if you don’t believe me. 
  • There is a convergence of three powerful movements.
    •  Data generating devices both personal mobile and industrial assets are creating data.
    • Global data mining and analytics is on the rise.
    • Significant improvement in data warehouse and, data analytics technologies allowing for the next level of processing.  Here’s EMC’s Big Data page as an example
  • Big Data is the aggregation and analysis of heterogeneous data sets/collectors.  The concept of big data is an important pillar in the new “Data Analytics” investments which will be pervasive over the next several years.  By definition, Big Data is not just about infinitely large purpose built databases.  It’s like a hive of bees; Big Data to me is broader, more dispersed and hierarchical in nature.  It’s funny we will know less about each individual piece of data, but in mass, we’ll know more about ourselves in many more ways.  Today these initiatives will be funded by the standard engines of power and profit, but some of the most impressive data science I have seen so far is in the scientific community.  Spend an hour watching TED Videos like Hans Rosling leveraging Microstrategy visuals on his HIV data analysis work.  Or one of my favorite books of all time, freakonomics based on the data analysis work of statistician Steven Levitt.

So, I am excited about the advancement of “Science” and “Data” in this emerging field.  EMC Corporation is showing industry leadership in this growing discipline including funding studies and an annual conference for data scientists.   EMC’s Data Science Summit (EDSS11) May 23 2011 brought together an international consortium of data scientists to help define core fundamentals and highlight the building need for resources in this field.  I applaud EMC for stepping into the proactive mentorship of the data industry. It’s a great fit for EMC and a place we need to invest in advancement.  Additionally, EMC just published a survey from the summit.

Here are some of the summary findings:

       Informed Decision-making—Only 1/3 of respondents are very confident in their company’s ability to make business decisions based on new data.

       Looming Talent Shortage—65% of data science professionals believe demand for data science talent will outpace the supply over the next 5 years – with most feeling that this supply will be most effectively sourced from new college graduates.

       Customer Insights—Only 38% of business intelligence analysts and data scientists strongly agree that their company uses data to learn more about customers.

       Lack of Data Accessibility—Only 12% of business intelligence professionals and 22% of data scientists strongly believe employees have the access to run experiments on data – undermining a company’s ability to rapidly test and validate ideas and thus its approach to innovation.

       Advanced Degrees—Data scientists are 3 times as likely as business intelligence professionals to have a Master’s or Doctoral degree.

       Higher-Level Skills—Data scientists require significantly greater business and technical skills than today’s business intelligence professional. According to the Data Science Study, they are twice as likely to apply advanced algorithms to data, but also 37% more likely to make business decisions based on that data.

 You will note in the survey that data scientists are inherently different from BI professionals.  This confirms my beliefs that we’re going somewhere more all-encompassing than a “sales report” and that we’ll spend more time and money on the submerged part of the iceberg.

If you’re interested in next year’s summit click this link EDSS12