Results

Global HR Matters and How to Get There - Why global is challenging, but critically important

Global HR Matters and How to Get There - Why global is challenging, but critically important

This is the first in a series of posts on problems and challenges that I keep hearing from HR professionals as I make the rounds in the course of my work as an analyst and strategic advisor. Let’s kick off this series with Global HR. I'll highlight trends that make Global HR so important, then examine challenges and solutions to the overall domain. 

There can be little doubt that we live in a more and more global economy. The internet has brought mankind more together than any other technology invention before. News travels around the globe faster than ever, culture is a cross border phenomena and brands have become global not over night, but over the course of a short decade.

But while information travels efficiently globally, enterprise that find themselves in the midst of the globalization trend need to ‘plant the flag’ in the countries they want to do business. Sales operations, fulfillment, customer service etc. all require customer facing activities and with that need physical presence in the countries where an enterprise wants to do business.

And with that any enterprise quickly enters the challenging area of ‘Global HR’, a term that is more than inadequate, since it doesn’t really exist…

What exists on the people side are HR professionals that understand more than one country from both a HR best practices and legislation perspective. But there is no single person in the world that knows all HR regulations and best practices, at best there are professionals who can straddle regions to a good enough detail such as Western Europe, Latin America to name a few.

On the software side, Global HR software on the contrary though, does exist, but as one can imagine it is a challenge to create and even more to maintain this kind of software. For an HR software vendor to be in the ‘Global HR’ system business, the vendor needs to understand the local content, the legislation and best practices that govern each of the countries the vendors wants to support. And despite there are a number of vendors offering ‘Global HR’ systems, none of them is truly 100% global, meaning that they support all languages, all local legislation and best practices in a single system that are happening on this world. The task itself is too big a task and the vendors look for the larger, more popular countries, where their customers and prospects want to take them. And the job doesn’t get easier for the vendor than for an enterprise, as the vendor needs to hire local experts who not only know the local country from a regulation and best practice perspective, but they need to keep monitoring their further evolution, as nothing ever stands still. But not only does a ‘Global HR’ vendor need to have the local experts, the vendor hasn’t done its job by just collecting the requirements, but needs to continuously build these requirements in the code of its products, test them, document, release and support them. Nothing trivial, but key for enterprise to understand when they look for a global HR product.

Moreover, vendors in the space need to understand the jargon and ‘lingo’ spoken in each of the supported countries. Few things turn off and confuse users more than consuming labels and messages in systems, so vendors cannot afford to look at translation of systems based on dictionary accurateness but need to pass the test of daily usage and stay on top of the lingual and cultural nuances each country’s HR practices demand.

Unfortunately the task doesn’t get easier, as the need for social, tax system and welfare reform is imminent all around the world, indeed a global phenomenon. While most of the first world economies struggle with an aging workforce and need to change legislation to support a fast growing number of retirement workers, the 2nd and 3rd world countries are both driven by a spirit of making their tax systems more competitive and simpler. In a number of 3rd world countries the task is even to introduce (and enforce) the very first tax, benefits and welfare systems. So on a worldwide level we notice an acceleration and increase of lawmaker activity that has profound effects on the legislative, statutory and regulatory frameworks under which enterprises need to operate when working on a global scale.

The good news for enterprises is though, as the task gets harder, scale gets more important, and the reason why enterprises look for Global HR vendors is, that these vendors have more scale than enterprises. And scale in this context comes from the number of people employed and paid. It is obvious that enterprise system vendors offering Global HR products will have a higher number of employees (at their customers) than even the largest enterprises can have employed across the world.

The second most prominent driver resulting in more interest in Global HR systems is the benefit enterprises have, when they achieve a global view on their in-house talent, regardless of employment location. The first world is quickly running out of people, while the 2nd and 3rd world produce more professionals that often are eager to help out in the 1st world on a project or even permanent basis. So before an enterprise cannot staff a function at all or needs to recruit from the outside, it may well look on a global level what capabilities, skills and talent it may have in other countries. With the rise of more project based activities and transformations in today’s enterprises, there is even higher demand for a global view on employees.

And lastly enterprises face cost pressure and talent shortage in the 1st world and before moving a function to another location worldwide, management needs to understand the cost of employment, the availability of talent and more from potential target markets. Nothing frustrates executives charged with global functions more than not having fast and efficient visibility into their global responsibility areas, and HR is one of the key areas. With employee related expenditures usually being the larges spending category in an enterprise it deserves attention.

The consequence of the above 3 major and most prominent trends is that enterprises are looking more and more for global HR solutions, even if they have been running a local vendor’s system, as HR leaders realize they can scale better through a vendor’s system that scales across countries, on a global scale.

And on the flipside it is becoming quickly conventional wisdom that disparate HR systems, across multiple countries are quickly becoming a burden to overall enterprise agility, as enterprises don’t have insight into what in most cases is their largest expense, people.

So no matter if motivated by the above three trends or scared by the above scenario of fragmented systems, we see an increased need and demand for Global HR solutions.


Stay tuned for Global HR Matters - How to get there - Part 2, that will focus on User Empowerment. 
Future of Work Matrix Commerce Innovation & Product-led Growth New C-Suite Data to Decisions Revenue & Growth Effectiveness Next-Generation Customer Experience Tech Optimization Leadership AI Analytics Automation CX EX Employee Experience HCM Machine Learning ML SaaS PaaS Cloud Digital Transformation Enterprise Software Enterprise IT HR Chief Customer Officer Chief People Officer Chief Human Resources Officer

Blockchain has no meaning - and that's its magic trick

Blockchain has no meaning - and that's its magic trick

What do land titles, marriage certificates, diamonds, ballots, aircraft parts and medical records have in common? They are all said to be managable in radical new ways "on the blockchain". But what does it mean to be "on the blockchain"?

To put a physical asset "on" the blockchain is a metaphorical way of saying that a thing is going to be somehow represented by a symbolic value or "token". We do this all the time of course. Almost every piece of data in every computer system stands for something else. To get a thing represented on the blockchain requires a mapping or translation. Actually it requires two.

Firstly, the asset in question needs to be represented by a blockchain token. For example, Everledger uses a public blockchain to record diamond movements. Each gemstone over a certain weight or value these days has a micrososcopic barcode etched into it; it is that barcode number which is inserted as metadata into an Everledger blockchain transaction, to represent transfer of ownership. Secondly, physical asset owners need to be registered with their respective account keys. This mapping can be pseudonymous, but buyers and sellers of diamonds for instance need to be confident that all counterparties really do control the keys they claim to.

What's unique about the native blockchain is that it works without any of these mappings.  With Bitcoin, nothing matters off the chain. Bitcoins themselves don't exist off-chain. In fact they don't exist "on" the chain either; the blockchain itself only records subtractions and additions of purely abstract balances.  

Furthermore, possession of the private key is the only thing that matters with Bitcoin. Control a wallet's private key and you control the wallet balance. The protocol doesn't care who is in control; it will simply ensure that a quantity of Bitcoin will be transferred from one balance to another, regardless of who "owns" the keys.  It's an agreed property of the system that Bitcoin is like cash; if you lose your Bitcoin private key and the balance that goes with it, then there's nothing you can do about it. There is no regulator or reserve bank to look after you and your deposits. You're on your own. 

So unlike any other serious cryptographic security system I can think of, the Bitcoin blockchain has no key management.  Bitcoin wallet private key pairs need not be mapped onto any person, nor imbued with any extrinsic significance.  They are not associated with (bound to) any real world attributes. Bitcoins have no symbolic meaning.  They are what they are.  And in fact that is blockchain's magic trick!

But make a blockchain token stand for anything in the real world and you break the spell. Symbols are defined by authorities, and, when physical goods are in play, keys and attributes can only be dependably assigned to individuals by third parties who vouch for who holds what. If you have administrators, like the folks that etch barcodes into diamonds and initially register specific stones to particular owners, you just don't need the additional overhead of the blockchain.  The blockchain exists purely to realise Bitcoin inventor Satoshi Nakamoto's express assumption that nobody in this system of electronic cash was to be trusted. Nakamoto dispelled all third parties and agents who normally are needed to map real world things into digital codes; he/she wrote in the foundational Bitcoin whitepaper (PDF) that the "main benefits [of blockchain] are lost if a third party is still required".  

Key management -- the administrative processes that make sure the right keys are in the right hands, and that they stay that way -- is simply not required by the permissionless blockchain. 

Bitcoin is often said to be anonymous, but its really special property is that it has no meaning. It's truly amazing that such a thing can have value and be relied upon, which is a testament to its ingenious architecture. Blockchain was deliberately designed for an uregulated crypto-currency. It's brilliant yet very specific to its intended trust-less environment. To re-introduce trusted processes simply undoes the security architecture.

In short, blockchain's only unique proposition is for purely digital assets. It was expressly designed to enable people to exchange electronic cash without having to know anything about each other, and without relying on (trusting) any third party. That's why blockchain involves such extravagent computing resources - they stand in place of regular administration and oversight. 

In applications where parties do need to know something about each other - like their permissions, credentials, identity, professional registration, financial bona fides, eligibility, rights to a physical asset, or even their simple uniqueness as in the case of voting - the proceses needed to establish those things trump the blockchain consensus algorithm. Wherever there is an off-chain process to tell us a user is authorized or permissioned, the on-chain consensus becomes academic. There is an easier way to work out the state of the ledger than crowd-sourcing the consensus process, pretending that there isn't an administrator in the background! 

So apart from cryptocurrency, I just don't see how any use case for the straight blockchain stacks up. 

Digital Safety, Privacy & Cybersecurity Innovation & Product-led Growth Matrix Commerce Data to Decisions AI Blockchain Chief Executive Officer Chief Financial Officer Chief Information Officer Chief Supply Chain Officer Chief Digital Officer Chief Technology Officer Chief AI Officer Chief Data Officer Chief Analytics Officer Chief Information Security Officer Chief Product Officer

CEN Member Chat: Data, Analytics, and the Internet of Things

CEN Member Chat: Data, Analytics, and the Internet of Things

Dr. Natalie Petouhoff, Constellation Research VP & Principal Analyst, covers Data, Analytics, and the Internet of Things and spells out how to avoid a blind spot. Disrupt or be disrupted.

Marketing Transformation Next-Generation Customer Experience Chief Customer Officer Chief Marketing Officer Chief Digital Officer On <iframe src="https://player.vimeo.com/video/175279371" width="640" height="360" frameborder="0" webkitallowfullscreen mozallowfullscreen allowfullscreen></iframe>
Media Name: cen-member-chat-npetouhoff-jun-2016.png

CEN Member Chat: The State of Security

CEN Member Chat: The State of Security

Steve Wilson, Constellation Research VP & Principal Analyst provides in-depth views on the state of security and where it should be to keep astute leaders informed. He provides this after highlights on Constellation Insights offered by Chris Kanaracus, Constellation Research Managing Editor. 

If you are not a Constellation Executive Network member yet, join our analysts in this private community to talk shop and solve business problems in real time. 

Digital Safety, Privacy & Cybersecurity Chief Information Officer On <iframe src="https://player.vimeo.com/video/174878639" width="640" height="360" frameborder="0" webkitallowfullscreen mozallowfullscreen allowfullscreen></iframe>
Media Name: cen-member-chat-security-swilson-052016.png

CEN Member Chat: Democratizing Big Data, BI, and Analytics

CEN Member Chat: Democratizing Big Data, BI, and Analytics

Doug Henschen, Constellation Research VP & Principal Analyst, shares his deep knowledge of Hadoop, examples of various industry use cases, and covers his latest research report after Chris Kanaracus reveals Constellation Insights' highlights. 

Data to Decisions Chief Information Officer On <iframe src="https://player.vimeo.com/video/174758308" width="640" height="387" frameborder="0" webkitallowfullscreen mozallowfullscreen allowfullscreen></iframe>
Media Name: cen-member-chatdhenschen-jul-2016.png

SuperNova Award Deadline August 8, 2016

SuperNova Award Deadline August 8, 2016

The deadline for the 2016 SuperNova Awards is August 8, 2016. In its sixth year, the Constellation SuperNova Awards will recognize nine individuals who demonstrate true leadership in digital business through their application of new and emerging technologies.

We’re searching for leaders and teams who used disruptive technolgies to transform their organizations. Special recognition will be given to projects that seek to redefine how the enterprise uses technology on a large scale.

3 Steps to Apply for a SuperNova Award:

1. Download the SuperNova Award application. Click here. Once completed, copy the text directly from this application into the webform in step #3. 

2. Create a Constellation Research account

3. Submit your application by August 8, 2016. Submit applications here.  

More resources 

Application tips

About the 2016 SuperNova Awards

Last year's winners

 

Data to Decisions Digital Safety, Privacy & Cybersecurity Future of Work Marketing Transformation Matrix Commerce New C-Suite Next-Generation Customer Experience Tech Optimization Innovation & Product-led Growth Supernova Awards AR Executive Events

Who are the IoT Global Pack Leaders? And how does their background and existing expertise bring to their IoT market offerings?

Who are the IoT Global Pack Leaders? And how does their background and existing expertise bring to their IoT market offerings?

IoT as a term defines a ubiquitous state of Internet connectivity, resulting in new forms of data driving interactions that create new competitive Business value. As is usually the case with innovative, transformation technologies, Startups have initially led the way in creating new products, markets and business cases across a wide spectrum of deployments. Now increasing market maturity as allowed a range of global corporations enter the IoT market and make their presence.

The eighteen companies listed below are World recognized market leaders in different business sectors; now they are direct competitors for a part of the overall global IoT market place. Each is using their present markets, experience, and customer base to define their IoT ‘go to market’ strategy. The resulting differences in their offerings are benefiting buyers by increasing the breadth of IoT solutions available.

IoT sensing, together with the business solution requirements for data analysis and ‘real time’ smart services are a broad technology capability that can be applied in many different scenarios. However current business cases for deployment currently usually focus on one of the following three core improvements and in turn that tends to emphasis one particular technology product approach. As an example People working outside the office ‘on the road’ would usually be reliant on ‘mobility’ as a core IoT solution feature.

Three Core Business Justifications for IoT Deployment

People who benefit from being provided with remote ‘real time’ sensing information. As the costs of sensors and network connections have continued to drop even simple schemes to stop merchandisers from making wasted journeys to vending machine contents pay off. More sophisticated deployments allow preventative maintenance to make a substantial difference to Service Engineering operations. Hotels can even ensure that Guests will enjoy fully operational facilities whilst the hotel operator can optimize costs for providing hot water, making a double gain of customer satisfaction and operational cost reduction!

Machines can have their individual performance improved, or can work in coordination with other machines more efficiently. Railway locomotives, even Farm Tractors and their attachments, now use sensors for customized operational optimization. Dynamic, responsive management of complex operations is starting to transform some industry sectors from Products into ‘Services’. At the other end of the scale simple building sensors control reflex reactions to the heat of the sun, or ensure empty parking spaces are made visible to Smart Phone Apps.

IT Systems benefit from the addition of ‘real-time’ data to their existing historical data both for direct inputs to Enterprise Applications, and to offer previously unknown data with new insights to existing Analytics. The comparison between the planned and recorded activity with the dynamics of actual events is transforming ERP capabilities in areas such Logistics, Manufacturing, or Retail. CRM and Big Data Applications often discover radically change perceptions through the previously unforeseen ‘insights’.

Value Proposition with the associated Business Case justification are by their nature highly focused, but as more and more IoT deployments take place in an enterprise then a variation of Metcalf’s law in respect of the multiplication in the value of each individual sensors data correlated with the overall picture becomes apparent. At this point it also becomes clear that the separation around People, Machine and IT Systems is now a barrier, and that a new generation of Enterprise wide function and capabilities is becoming established that requires the integration and free flow of all Enterprise IoT data.

The dangers of initial separate Buying decisions resulting in medium term Enterprise incompatibility is very real as an example using the procurement of a Building Management System and the implications makes clear.

Diagram; The inner ring of the three major initial business drivers is matched to the outer square of four boxes that contain the four capability backgrounds from which Global Corporations now contesting for a share of the IoT market are drawn. The heading ‘Services and Technology’ is less obvious than the other three and is used to describe corporations such as Amazon, Google, Microsoft, or Salesforce all of whom are competing from the provisioning of new Technology Services.

The diagram makes clear the likely, familiar relationships that will drive many enterprise buyers to towards established relationships; IT Systems buyers and Enterprise Application suppliers; Machine buyers and Industrial Systems Suppliers, both being obvious pairings. Mobility deployments have also created a certain degree of a relationship between People buyers and Telecoms suppliers, whilst ‘Services and Technology’ has the advantage of driving innovative initiatives offering a broader value to any of the buying propositions.

Exploiting existing relationships for synergistic advantages usually advantageous as long as a clear vision is maintained to ensure enterprise wide ubiquitous capabilities can be developed from the initial highly focused deployments.

It is possible to identify eighteen well known major Global Corporations that have made a significant commitment to IoT and entered the market with strategically designed products as a part of an identified business solution. There are well known names with IoT products that have not been included either because they are not a Global player even though their contribution is significant, or their strategy commitment is not clear.

There are some outstanding suppliers at a national level, such as KPN, the Dutch Telecom, who has rolled out LoRa IoT services with coverage across the whole of the Netherlands in a clear strategic commitment to the IoT market. And of course there are smaller innovative suppliers whose products may be critical success factors in Enterprise solutions. It is difficult to compile a listing to cover the diversity of this element of the IoT market. Therefore the following listings are limited to eighteen of the best known Global Corporations categorized by existing major sectors and experience, and presented alphabetically in each category.

  

Seven Players from the Services and Technology Markets;

Amazon Web Services

Cloud Services are a natural partner for IoT Services, and Amazon Web Services Internet of Things platform brings together a range of AWS services from computational and storage through to more specialized dataflow streaming and insight analysis capabilities 

Google

Has moved strongly into consumer IoT based Smart Services acquiring Home Automation leader  Nest and its installed customer based from which to expand into all aspects of the consumer IoT market. Enterprise Business strategy is less clearly differentiated around expanding Cloud Services to support IoT and the planned expansion of an IoT orientated fiber optic network across cities and business zones.

Intel

All IoT devices need processor chips, but Intel see the importance of the processor to embed IoT requirements from network types to security management. Intel has introduced specialized products such as the Quark for small-form factor appliances demanding low power computation, through to extensions to Atom range including rich graphic rendering aimed at interaction through pictures and graphics.

Microsoft

Listed under Services for its non IT enterprise application focused introduction of Azure based Services including an IoT Suite with a sophisticated and integrated set of functions; IoT Hub connection, event notification service and device management; streaming analytics service combined with machine learning; and linked Business Intelligence. Microsoft aims to add to its existing preconfigured IoT templates to broaden technology and business solutions.

PTC

Though previously identified as a supplier of modeling software and product lifecycle management (PLM) tools PTC has moved to become an IoT player through strategic acquisitions. A comprehensive solution approach combines ThingWorx, an IoT application development platform; Axeda, a cloud service for managing connected devices and processing machine-to-machine data; and Coldlight, a machine learning/artificial intelligence platform for analyzing data.

Salesforce.com

With a clear focus maintained on improving all aspects of the customer / sales engagement Salesforce.com sees IoT as being able to bring new insights to learn how customers react and behave with connected products. Salesforce.com has added IoT Cloud, a real-time processing engine named Thunder and extended Lighning to ensure that IoT is fully integrated into all aspects of Salesforce Services.

Qualcomm

In its normal role as a Semiconductor company Qualcomm has introduced a series of IoT-optimized chips named SnapDragon, that offering a variety of connectivity services and platforms. Qualcomm has acted boldly in the Software market place by taking a leading role in the Open Source AllJoyn project aimed at creating open source protocols for IoT devices.

  

Four Companies from Telecoms and Networks sector;

AT&T

The functionality of the AT&T broadband network and M2X, cloud-based data storage service has been extended with Data Flow, a specialist development portal for building IoT applications. AT&T is aiming to provide ubiquitous capability for mobile devices and states an aim to have 10 million vehicles/objects connected through its Broadband network by 2017.

Cisco

With its huge installed base and range of networking products Cisco predicts that it will be connecting up to 50 million IoT devices by 2020. Extended network IoT services range from specialized Gateways and Management to the concept of Fog Computing. This specialized IoT decentralized architecture moves data collection, storage and analysis to the network reducing network traffic and improving response times.

Samsung

As a major supplier of consumer devices Samsung states it will aim to make its range of phones, appliances, televisions, as well as industrial products all Internet connected by 2020. Samsung is also developing a range of ARM chips for its devices, together with a library of APIs to encourage the overall growth of the IoT market.

Huawei

To build on and extend their traditional market into IoT presents Huawei has launched LiteOS a micro operating system for IoT as well as joining various industry groups on standards and Open Source. Huawei believes it is well placed to be the IoT market leader in Asia as well as a powerful player in the US market.

 

Four Industrial Automation Leaders

Bosch

A prime European leader with commercial and consumer operations plus a specialization on Automotive boosted in its home market by the German car industry. Enterprise software. Less well known as a supplier of certain types of Enterprise software with IoT Cloud based data management, Bosch is also a key supporter of the European driven Internet 4.0 initiative.

GE

The prime force behind starting the US based ‘Industrial Internet of Things’ movement aimed at optimizing connected machines for manufacturing based on a huge amount of experience in Industrial Automation. GE has a very strong vision of a software driven future with IoT data integrated through Predix, GE’s advance ‘smart’ cloud-based data and analytics service that has a number of substantial industry sector transformations as case studies.

Hitachi Data Systems

HDS, the technology arm of Japanese industrial conglomerate Hitachi, and is partnering with Intel for IoT machine and industrial equipment capabilities whilst developing its own cloud-based platforms to collect and analyze IoT data. HDS believes it brings a unique combination of industrial hands-on equipment and back-end technical services to the IoT market place.

Siemens

Best known for medical equipment though a broad German conglomerate involved in a wide range of markets and products all of which could be interconnected for new value by using IoT. Siemens is using fellow German corporate SAP for its Data and Business Analysis tools, though it is developing new software for IoT under the name of the “Web of Systems.”

 

Three Companies wishing to add IoT to Enterprise Applications

Dell

The emerging IoT market is seen as an opportunity to move into ‘Integration and Services’ business as well as add IoT to its traditional enterprise hardware products. New products add endpoint connectivity for IoT devices plus back-end storage and analytics platforms for the management of IoT data. A strategic partnership with Intel resulted in a joint IoT Executive demonstration facility near San Francisco.

IBM

IoT means more Data to drive smarter services and reaction to IBM with its investments in Watson “Cognitive Reckoning”. Watson is intended to provide a cohesive integrated environment covering all aspects of IoT from cloud-based development and operating environments/services for Apps and Services including specific packages for various industry sectors.

Oracle

With the introduction of IoT Cloud and Services prepackaging for workflows services Oracle aims to make its databases and enterprise applications part of an integrated platform. The addition of IoT data input for SQL, NoSQL and Hadoop databases links Oracle Sales cloud, Service Cloud and CRM into the IoT environment. 

New C-Suite

Democratize the Data Lake: Make Big Data Accessible

Democratize the Data Lake: Make Big Data Accessible

Is your Hadoop-based data lake more like a swamp? Here’s a look at two camps of vendors in the Hadoop ecosystem that are bringing order and accessibility to big data.

The good news is that 10-year-old Hadoop is maturing quickly. The bad news is that many companies are still struggling to get beyond pilot projects and support many applications on this new data-management platform. That's why I wrote my latest report, "Democratize Big Data: How to Bring Order and Accessibility to Data Lakes."

First, let’s consider the industry leaders that are doing great things with data lakes, drawing on examples from the recent Hadoop Summit:

In financial services CapitalOne has been making waves this year, appearing at multiple events to talk about its Hadoop and Spark-based fraud-detection and its big data analytics, streaming and security work.

In retail Macy’s embraced Hadoop more than five years ago to power insights for Macys.com. Today it’s doing more sophisticated cross-channel analysis, driving personalized promotions encouraging online customers to shop in stores and in-store customers to obtain out-of-stock and online-only items at Macys.com.

In manufacturing Ford relies on Hadoop for connected car capabilities. Ford does filtering and decision-making at the sensor and car level while uploading crucial data points for centralized insight and analysis. For example, FordPass app users can remotely check their car’s fuel level, location and diagnostic error codes, but detailed data used by service technicians remains in the car’s black box.

In insurance Progressive has been a pioneer of usage-based pricing with Progressive SnapShot. The company has more than 15 billion miles’ worth of driving data in a Hadoop-based data lake, but it can drill down and offer discounts to individual policy holders based on factors such as their total miles driven, nighttime driving, and speed and breaking habits.

These examples are inspiring, but behind every breakthrough there’s been a lot of hard work. And many fast followers are still struggling. Here’s a recent sampling of criticisms I’ve heard from Hadoop users:

  • The VP of platforms and architecture at a digital marketing at advertising company said, “better data governance is the number-one priority on our Hadoop wish list.”
  • The director of analytics at a logistics firm said “Hadoop was messy on the data-lineage end. We spent months working out the details for data ingestion.”
  • A BI solutions architect at an aerospace firm said “We have three people working with Hadoop, but we have more than 150 business users who need access to the data. I’d like to see better ease of use for business users.”

These and other comments led me to publish my latest research: Democratize Big Data: How to Bring Order and Accessibility to Data Lakes.” The report explores three areas where commercial vendors are filling gaps in the Hadoop stack: data management and governance, data cataloging and metadata management, and data discovery and self-service data prep.

These three gaps are being filled by  two camps of vendors that are complementing what’s available in Hadoop. Incumbent data integration vendors focusing on the data lake include IBM, Informatica, Oracle, Pentaho/Hitachi, SnapLogic, Syncsort and Talend. Next-generation vendors that have emerged in the big data era include Alation, Collibra, Datameer, Podium Data, Paxata, Trifacta, Tamr, Waterline and Zaloni.

Both camps are bringing automation and repeatability to data lake management and governance. They’re also making the contents of the data lake more accessible and many are abstracting users from the complexities of manual coding in Pig, Hive, Spark and other open source components.

As the report explains, a data lake is not a replacement for a conventional enterprise data warehouse, but many data-processing and data-analysis workloads are shifting to this new platform. The choice among incumbents and next-generation vendors depends on the specifics of your deployment. The report offers vendor-, category- and capability-specific descriptions and selection criteria as well as big-picture advice on setting your analytic direction. Here’s a peek inside the table of contents:

  • Executive Summary
  • Broader Access Drives Insights and Actions
  • Hadoop Emerges as a Corporate Standard
  • Data Lake Success Demands a Mature Approach
  • Seek Ease of Use, Repeatability and Automation
  • Look to Next-Generation Vendors to Fill Data Lake Gaps
  • Consider Incumbents for Broader Needs
  • Recommendation: Target the Center of Analytical Gravity
  • Recommendation: Consider Consultants and System Integrators
  • Takeaways: Prevent Data Swamps and Make Big Data Accessible

Click here to download an excerpt of the report.

Related Reading:

Hadoop Summit 2016 Spotlights Enterprise Innovation, IoT Use Cases
Hadoop Hits 10 Years: Growing Up Fast
Cloudera Takes to the Cloud, Highlights Industry Use Cases


Data to Decisions Tech Optimization Chief Information Officer Chief Digital Officer

Democratize Big Data

Democratize Big Data

Hadoop emerges as the corporate standard for big data management, but success depends on governance, cataloging, and accessibility. This report examines two camps of vendors in the Hadoop ecosystem that are bringing order and accessibility to big data. Read "Democratize Big Data: How to Bring Order and Accessibility to Data Lakes"

Data to Decisions Chief Information Officer On <iframe src="https://player.vimeo.com/video/174656788?badge=0&autopause=0&player_id=0" width="1280" height="720" frameborder="0" title="Democratize Big Data" webkitallowfullscreen mozallowfullscreen allowfullscreen></iframe>

The Privacy Shield is real - the CxO repercussions

The Privacy Shield is real - the CxO repercussions

Earlier this week the EU Commission approved the Privacy Shield regulation, that is to replace the now invalid Safe Harbor agreement. With the notice being sent to the EU member states, the agreement is in place.
Important enough for privacy to take a look at this - don't miss my earlier posts on the invalidation (here) and the suggested Privacy Shield (here):

 


Not much time - here is the one slide summary:


 
 
More time? Read on:
 
The Privacy Shield agreement was necessary after the EU Courts invalidated the long term Safe Harbor Agreement between the USA and the EU. It was proposed back in February of 2016 and is now in place with few days to spare. In Europe privacy advocates and groups think that Privacy Shield is not going far enough, so the next court challenge is likely - but for now Privacy Shield is a valid agreement. 
 
What does it mean for CxOs?
 
No matter if looking at this from a people side, as CHRO or as a technology executive (CIO, CTO), the recommendation has to be clear, if an enterprise does business or plans to do business on both sides of the Atlantic:
 
 
  1. Plan / Operate local data centers:  Local data centers need to be in the near future, in case they are not yet a reality, as the only way to be compliant in the medium term.
     
  2. Separate Data / Access: The separation of data and access to data in these data centers needs to be looked at, be implemented and monitored. Expect BI / DataWarehousing etc. application to require a deeper look.
     
  3. Validate / Separate Applications: The next step will be to change existing applications - no matter if built in house or bought of the shelf, to make sure that the new modus operandi is followed and stays in place.
     
  4. Keep an eye on legislation: This will not be the last wrinkle, so CxOs should learn and not be taken by surprise (again?) by future trans-Atlantic privacy changes.
 

MyPOV

The good news for enterprises is regulatory certainty - for now. It's a good time to check internal applications on compliance and have a conversation with your SaaS vendors on compliance. If an enterprises does not have data centers on both sides of the Atlantic - it's time to get them in place, or long term write off the business on the other continent. We expect privacy regulation to keep evolving, actually on both sides of the Atlantic, with a new administration coming in the US this year. As always - start with the business acumen, and then tackle the hard parts, which is data center location and application and data segregation. The good news is - there are many data center vendors / IaaS vendors easy to get more utilization in their data centers. The bad news is - almost no SaaS vendor is ready for data separation, while allowing a legal global view, we expect it will take a few more quarters for vendors to step up to the challenge and support this in product. Till then (or new changes in transatlantic privacy) - stay tuned.   



Also follow up the view of my colleague Steve Lockstep on the topic and privacy in general here.
Find more coverage on the Constellation Research website here and checkout my magazine on Flipboard and my YouTube channel here. Oh yes and on Slideshare, here
Digital Safety, Privacy & Cybersecurity Chief Information Officer