Thursday, 31 July 2014

Here it is -> IBM InfoSphere Master Data Management V11.3

As we know InfoSphere MDM is a comprehensive suite of products and capabilities that you can use to manage the master data in an organization. With V11.3 release it goes a step ahead to Big Data Platform as well

MDM V11.3 also brings in significant improvements to the products from Installation and Configuration and performance improvements. The Big Match capability in this version combines the proven IBM MDM probabilistic matching engine & pre-built algorithms & IBM InfoSphere BigInsights for customer matching natively within Hadoop

Along with theses there are some very good integration samples with Data Explorer and Salesforce which could give jump start in the integrations between these products with IBM MDM  A much more improved documentation using Knowledge Center will help in navigation to various sections lot more easier.

Bookmarks for MDM V11.3


Reach out the MDM developerWork Community for any queries, concerns and feedback.

Sunday, 22 June 2014

Data Scientist as a role

As promised in my last blog, here is my analysis on what does a Data Scientist Role mean and why it is not a new jargon replacing Marketing Consultants or Product Manager or an IT Manager Role which some of my friends pointed out in the last blog.

Remember our teenage days when we were in probably 10th Std and this profound question was asked , Are u going take Science or Arts?.80% of my friends who mostly are Engineers would have said of course Science without a blink of their eye. Little did we know that every innovation has an artist behind that and every scientist has that artist in him which gives him that imagination to innovate. So what I am trying to make a point is that they are just two sides of a same coin.

Coming back to our Data Scientist Role, it is the best example of how a person can present data in the most creative and intuitive manner that it helps business. Also note that the KPIs are different for each business so the rules of analysis differ. The Data Scientist should be able to interpret the data using mathematical and analytical tools and understand the trends.  There is no more need to be an Engineer and learn all the programming languages like C++, java, Dot-net etc. to get a Data Scientist Role. I believe a Business person who understands the Business and can play with some tools is the best person suited for role. It is the best example of a Role which brings Art and Science together. 

As expected this answer did make the students very happy and suddenly there was lot of eagerness to know what this role entails. So I believe there are just few things which can help to make a Data Scientist:-
1.   Business knowledge and acumen in the stream where one wants to take the role
2.   Statistical and analytical tools usage to bring creativity and make sense of the big data
3.     Good communication

Lots of Universities have already started providing full time courses to specialize in this role. Saint Peter’s University in US provides a full time degree course in the same.

There is no need of being an expert on Hadoop platforms and MapReduce functions because they are just another enterprise platforms where the analytics is done. As per Heidrick & Struggles report a single company like Wipro already has around 8000 people on data science and analytics role and it is just going to grow.

Here is what  VP of Development for Big Data projects at IBM, Anjul Bhambhri says in the following blog. 

Sunday, 8 June 2014

Big data ->Big Employment

I recently visited a college for a talk on Big Data. The College had a combination of MCA and MBA students and a nice set of smart enthusiastic students with gleam in their eyes.  Now I always get excited to see this enthusiasm because I feel that energy and enthusiasm of our youth is what will make a difference to the world in the coming decade.

As we started discussing on usual Big Data topics the discussion started flowing into how this is going to create and shape new requirements and drive the technology in coming future. The most important aspect being how this huge nexus of Data is going to drive new roles in the market and the skills required for the same. Here I was actually able to touch the cord because suddenly they all were very excited on what this new role entails.

The fact that Gartner’s prediction is Big Data is going to create around 4.4 million new IT jobs globally by 2015 reflects this fact. The jobs would involve around technology to handle the data and capabilities to analyze and make sense out of this data set. By 2015 it is also predicted that 80% of the data is going to be uncertain, so in spite of us having all data available there would be a need to know and  determine how to use the data, then determining what confidence level needs to act on the data and in what context is the data available.

So the next question of course from then was what are these new jobs?

Now I had grabbed their attention fully and tried explaining how the counting of mouse clicks on an advertisement, traditional analytics and CRM and MDM data collection, mobile phone updates, and so many more combine together to keep data analysts and data engineers including the CDO and CEO and CMO and everyone concerned with accumulation of data busy and thus keep creating employment opportunities.

The newest and hottest job in Data Management is the person that can interpret such data in innovative ways for their employer, the Data Scientist.

What exactly is a Data Scientist?
“A data scientist is that unique blend of skills that can both unlock the insights of data and tell a fantastic story via the data.”

Anjul Bhambhri, Vice President of Big Data Products at IBM describes the Data Scientist role as below 
“Data scientists are part digital trend spotter and part storyteller stitching various pieces of information together. These are people or teams at organizations that sift through the explosion of data to discover what the data is telling them.” 

And that drove them to next set of question what skills are required to be a Data Scientist. And the answer made them happy and that would be in my next blog.

What does it take to be a Data Scientist? 

Sunday, 2 March 2014

IBM MDM Hybrid Style implementation

IBM MDM V11 release marked a significant change in the way MDM was being implemented in the market. It provide a solution that could support various styles of MDM by performing one single installation and that was HYBRID MDM. This support in V11 provided capability where customer could easily transition from registry to transactional style or co-exist their datasources in each of these styles and at the same time have a centralized MDM solution across the enterprise.

The concept is very simple. The customer has a set of datasources and some or most of these sources want to manage their own data. Well, they can keep on doing that in Virtual MDM (old Initiate Engine) in V11 .There are some other datasources which are transactional and all thier data and attributes are stored in the centralized MDM system. Well that is what Physical MDM (aka old DWL) is all about. But using V11, it is easily possible to move some of the data from Virtual MDM to Physical and persist is as a single unique entity by enabling a single switch during installation of IBM MDM V11.

This is a very unique capability, because there is a lot of MDM requirement in the market around this case. Look at some of the State Resident Hub requirements at State level in India for MDM. There are around 30-40 different departments supported in State Governments like Pension, Scholarship, Ration Cards and each of them want to identify the uniqueness of the resident across these datasources and at the same time keep the ownership of this data because of the propriety attributes. They could easily start with Virtual MDM and move to Physical. As and when they add new departments all of them could do these transitions.

Acquisitions are other scenario where this capability can be a huge advantage to bring in the acquired data into a centralized repository using this capability.

There will be enhancements on the hybrid MDM support in releases to come.

Some interesting links for more info

It would be interesting to know opinion and feedback on the Hybrid MDM capability in V11.