Monthly Archives: February 2014

An Essential Collection of Useful Videos on Information Visualization

Noah Iliinsky – Data Visualizations Done Wrong – A Beautiful Collection of Stories and Tips for Success

The Four Pillars of Data Visualization

Designing Data Visualizations with Noah Iliinsky

Best Practices for Data Visualization

Seeing the Story in the Data and Learning to Effectively Communicate – Inspired by Stephen Few Principles, Visualization Guru

David McCandless: “The beauty of data visualization” – Data Detective Telling Stories From Visualization of Information

This also has a nice quiz about visualization principles.

As I collect more, I will consolidate this list.

Agile Analytics Solution Development Manifesto Inspired by …

The demands of our organization and the markets are bringing natural pressures in terms of executing projects in a limited number of weeks with the spirit of “getting done is more important, than getting it right”, a tug of war between management and the analysts, where the analysts feel that ultimately they are under fire because with that motto, only analysts are getting cooked and not the managers.

So it is not surprising all the CEOs and management groups are happy to say “getting done is more important, than getting it right”.  A good leader/CEO/analytics managers will help you make sure that the analyst gets all the resources.

However, here is a process that analytics can borrow from software development to suit analytics solution development, if followed truely and if analytics managers and thought leaders commit to it, then there is a way for analysts to deliver faster and better solutions.

I took the Agile software development and reconfigured it for analytics solution development.  All credits go to original thinkers.

Agile Analytics Process Manifesto and Team Management – Inspired by Agile Software Development Principles

The “Agile Manifesto” for software or original thinkers is here: http://en.wikipedia.org/wiki/Agile_processes

I put these with in quotes because only one thing I changed is software and replaced it with analytical solutions.

Individuals and interactions over Processes and tools

Working analytical solution over Comprehensive documentation

Customer collaboration over Contract negotiation

Responding to change over Following a plan

============ Agile Principles for Project Execution – Developing and implementing a solution ============

  1. Customer satisfaction by rapid delivery of useful project development and execution – developing and implementing solution
  2. Welcome changing requirements, even late in development
  3. Weekly Improved presentation deck or application is delivered
  4. Principal measure of progress is improved presentation deck or application
  5. Sustainable development, able to maintain a constant pace
  6. Close, daily cooperation between business people and developers
  7. Face-to-face conversation is the best form of communication (co-location) – this is our challenge.  But we agreed this is our mode of working in this new world
  8. Projects are built around motivated team leaders (Jedis), who should be trusted, and inspiring warriors, who should be encouraged and rewarded
  9. Continuous attention to technical excellence and good design
  10. Simplicity—the art of maximizing the amount of work not required—is essential
  11. Team lead manages the work processes on how to get it self-organizing depending on the situation, and may have to roll up the sleeves to broom the floor.
  12. Regular adaptation to changing circumstances and documenting the change and reformulating the output for the best possible solution and implementation attributes and communicating the buy-ins from everyone”
  13. The lucky 13 – Share the joy of learning and doing

Powerview Excel Frontend for ACCESS, SQL, WEB CONNECTED DATA is Amazing to Design a Dashboard

Is it a reasonable alternative to Tableau?  But webifying is not that easy!

I wish it could be, because this version of Powerview with Office 365, has enough punches for Tableau to be a contender.

I will come back and post the dynamic and many many ways of filtering data for different slicing and dicing activities.

Here is a screen shot.

ccc

This is for close to 31000 credit card related complaints to the government from end of 2011 upto 2/14/2014.  These data are nowadays part of www.data.gov under opendata program iniatiated by the POTUS.  In this screen shot, you see CA, FL, NJ states.  These are some of the states from where we had a large number of complaints.

The coolest thing I found is that each of these (pivot) table/graph is dynamically connected to other graphs or pivot tables; so if you slice in one graph is will show all changes in other graphs also, keeping the integrity of data to be of same baseline for all the rest of the graphs.

Also, any mashed up data sets can be called in to create these types of dashboards under powerview with in excel, leveraging powerful relational data models.

The data can also be remotely connected including cloud data (Azure market place) or web server data.

The data can be coming from other data bases such as Oracle, SAP, IBM, …

The filters are not showing up.  In the next message, I will post webified output where you can select the filters from many variables, and will be able to view, on the fly, the changes in all the graphs at once.

Creating dashboard has never been easier.

The time axis player on the left bottom is same as what is commonly first known as “gap minder” presentations, by Dr. Hans Rosling, MD.

The actual data is available at https://data.consumerfinance.gov/dataset/Credit-card-complaints/x3w3-u78g

The attached copy of the shown dashboard implementation is available on request. Send me a mail – Dashboard_Creation.xlsx.

A Video Presentation – True Positives, False Negatives, False Positives, True Negatives, Sensitivity, Specificity, ROC Curve