Analytics Strategist

September 25, 2007

the skill levels in data analytics

Filed under: business strategy, Datarology — Tags: , , — Huayin Wang @ 10:43 pm

Data analytics is a collection of disparate techniques and applications covering practically every fields and every industries. What holds it together as a coherent discipline is the skill set of the data analyst: the intrinsic structure, levels and connection logics of the skill components that ultimately define and delineate what data analytics currently is and will be in the future.

Data analytics is not a mature discipline. Naturally, there are widely shared confusions about what data analytics is, and particularly what are the skills and level of skills. The lack of common understanding in this has negative consequences on talent search, training and education, project management etc.

One such misunderstanding originated from mixing-up of data analytics skills with subject domain knowledge. Subject domain knowledge are things accumulated through experiences, memorized information and practices related to the subject matter. Information and insights are stored in the brain and can be readily queried without relying on external data, although originally may come from working with data. As a contrast, data analytics skills are skills of extracting intelligent information from data fresh on the spot. Without the explicit provision of data, data analytics will results in no knowledge! Taking out data is like taking out the fuel for data analysts. Comparing this Data-Driven process, the former can be called Grey-Cell-Driven process. Data are useful food for data analytics. Without data analytic skills, data are useless, just like gasoline are useless for a bicycle.

There are varying skill levels in data analytics. For starter, there are roughly 4 levels of data analytic skills:

  1. basic
  2. reporting
  3. professional
  4. expert

At level 1, basic analytic skills are mostly obtained from education and experience. It consists of comparing numbers (big/small, high/low, bigger/smaller), calculating percentage/fraction/ratio/index, reading pie-chart, bar-chart, and understanding two-way tables without relying others to translate into words. Use of excel is optional, but in general, most are able to put data into spreadsheet and do some arithmetic calculations. It does not require any programming skill.

At level 2, reporting analytic skills are generally acquired through working experience. This level includes primarily data analysis skills using excel, or analytic tools that can dump data into excel. It includes the use of formula, the use of numeric and text functions, excel macro, selection of some of the more advanced skills including pivot table, VlookUp, Regression, VBA, Solver etc. The data analytical process of breaking down and aggregating up, trending and graphing are also belong to this level. They understand the concepts of data table or dataset, where records as row and fields as columns, records subseting and filtering, some ways to measure the strength of the relationship between fields …

At level 3, the hallmark of professional data analytics skills is the ability to not only extract information but also evaluate the reliability of the extracted information. In other words, it consists of skills to extracting intelligent information, rather than just information. It also includes a much expanded set of knowledge extraction skills. At the core of it: sampling theory and experimental design, regressions and decision tree models, model development process and common validation principles, basic types of statistical distributions, significant level and p-value, distribution models of 3 basic types of fields (numeric, ordered, categorical) and proper estimation of relationship between fields of different types. Modeling and algorithm knowledge, the use of software/tools and programming languages are intrinsic to professional data analysts.

At level 4, expert data analytics are generally hard to define. Like tree branches, the higher they are the more split they are, both in directions and in varying levels. The one thing that I noticed is their sensitivity and awareness of all explicit and implicit assumptions behind the algorithms used and the general conclusions. Of course, there are many narrower data analytic fields and niches, one could be an expert in one and not in others.

It is also worth to mention that there are a few skills that related to but not part of the data analytics; among other things, it includes making an analogy, generating pretty charts or animating graphs, and last but not the least of all: the skills of selling and promoting data analytics.


Leave a Comment »

No comments yet.

RSS feed for comments on this post. TrackBack URI

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

Create a free website or blog at

%d bloggers like this: