Remember that deeply understanding the activity by either doing it, or through rigorous work observation is where it all starts. Understanding how the activity is connected to outcomes is the foundation. 

When it comes to training and development, studying the activity, collecting the data, and synthesizing that data into metrics, especially trends over time and ratios that put it into context is far more valuable than just being presented the synthesized data.

Remember that we are all in the process of working our way up the Knowledge Management Pyramid in some way. Skipping steps leaves major holes in our Situational Awareness and therefore puts decision making at risk. This is one of the areas where Scoreboards and Scorecards fail to deliver results. 

The metrics used on scoreboards and scorecards were often first developed by someone at a higher level who:

1. Understood the connection between the activities and the outcomes expected. 
2. Understood how to collect the data that represented the activities.
3. Understood how that data was synthesized into the metric.
4. Knew what that metric should be as compared to what and when.
5. Could quickly unpack that synthesized metric into its component data and activities.
6. Understood what actions to take (or not) based on that metric and deeper investigation.
7. Build this metric into a clear accountability in a job role description – “Bring in projects at or under budget.”
8. Built this metric into a great automated information system that displays that metric quickly to everyone who needs to know it.

To someone new who is learning and developing up the organization, they won’t have all this background and experience. 

1. They will understand the accountability. 
2. They will see the metric. 
3. They won’t make consistently good decisions that improve outcomes.

Something as simple as JTD cost doesn’t even include all the same things depending on the contractor. JTD cost is only relevant if we know:

1. Total budget and
2. Current JTD percentage complete so we can 
3. Compare our JTD cost to where we should be and
4. What action to take if required including deeper investigation.

Jeff Bezos who built an exceptionally data-driven company describes how important having a skeptical view of these proxies for performance is (short video clip)

Charles Duhigg gives great examples of this in Chapter 8 (Absorbing Data) from Better, Faster, Smarter