More Metrics!

Building on my last post, we are continuing to build some new metrics.  The last post talked about resource management metrics.  Here are some other ones that we are tracking now.

Execution Metrics
# of tasks
# of tasks on time
# of tasks past due
# of tasks severely overdue
# of team members
# of opportunities to turn in status report
# of status reports turned in

Planning Metrics

Date Project Assigned
Requested Project End Date
Project End Date Original Planned
Mandated?
Date Agreed upon with Sponsor
Date Project Actually Completed

There will be much more to come as we are developing a new concept that we are titling now as "Metrics 2.0:  New Metrics for a New Project Management Era"

Do you have some unique metrics that you track?  Please share!




SRH25JZFSYVH

New Metrics: Resource Management

I have several requests from people asking about some of the metrics that I track on my projects. I am working on a new book of metrics and new ways of thinking about metrics. Here is a sneak peek of some of the types of metrics that I track:

Resource Management Metrics
# of times invited to a meeting
# of times showed up to the meeting
Participation type (called in, showed up in person, etc.)
# of issues assigned
# of risks assigned
# of issues resolved
# of risks resolved
# of issues introduced
# of risks introduced
# of tasks assigned
# of tasks completed on time
# of tasks completed past due
# of e-mails sent (by pm)
# of e-mails responded to

This takes the metrics just a bit beyond what we normally track. It is not all % complete or estimates. It is also about quality. For example, I had a very large project that had impact on multiple departments. One of the departments was finance. Right at go live, the finance department went to the project sponsor and said that the project should be stopped. The project manager (which was me) did not consult them or did not get their input on the project. Therefore, since finance was not consulted, the project should be stopped.

When I was called in to the Sponsor’s office, I stated that I had not gotten their input. What finance had stated was completely correct. However, they were not an identified stakeholder on the project and based on their project focus rating, they did not appear to want to be involved. Finance asked, “What do you mean by a project focus rating?” I explained that I track how many times I had invited them to meetings, asked for input, number of issues assigned, number of e-mails that were sent and went unresolved, and overall participation on the project. Based on the information that I had, they were invited to 47 meetings and never showed, 31 e-mails went unanswered, 3 issues were assigned that never were completed, and 2 direct requests for assistance were not answered. Since all I can do is facilitate, I took the 83 separate times to have them provide input as a sign that they did not want to participate. In the end, finance didn’t have a leg to stand on. If they wanted to have direct input, they could have. What happened is that they felt the project would not impact them and they blew off the project. When they finally saw that there was impact, the project was too far down the road.

This is a common occurrence in projects. This is why we have to look at metrics that go beyond. The point is that we have to manage more of the quality or focus of individuals on a project. In environments when there are tons of competing projects and priorities, it is a necessity to measure the amount of focus a resource gives to the project.

Hope this helps!

Rick

Creating Proper Metrics

There has been quite a bit of debate around the selection of metrics for project reporting. Most organizations simply look at the "On Time, On Budget" statement and feel that is an acceptable status. Then there are the organizations that try to invest in Earned Value which is a technique that is widely taught in project management circles. The appeal of Earned Value is the reporting of % complete and % of budget expended were not sufficient in telling executives where the project actually stood. Earned Value gives two metrics (Cost Performance Index and Schedule Performance Index) that is engineered to give a quicker and more efficient status to executives. The problem with Earned Value is that it is extremely complex to maintain and most project managers do not have adequate information (like estimated hours to complete and work completed versus hours expended) to create an accurate picture. This is where the stoplight report comes in. Most companies rely on the subjective guess and feelings of the project manager on where the project cost, budget, and quality stand. So what metrics should be reported? The list can vary based on industry and corporate culture, but the following list can help create some metrics to get you started:


• Cost and Schedule: These metrics are still important and understanding where the project stands from a budget and time perspective is still vital information. It just can't be the only information provided.

• Project Plan Quality: How many tasks show a past due start date or a past due finish date? When was the last time the project plan was updated? How many times have the dates slid or moved on the plan? These metrics will show how closely the project manager is managing the plan. Also, by publishing these metrics, it gives the project manager notice that the plan must be managed.

• Project Issues Raised: How many issues have been raised? Too many can be a sign of a project in trouble and too few can be a sign of the project not being managed appropriately.

• Project Issue Close Rate: How many have been closed by the due date? Do issues have a due date? Metrics like this one will make sure that the team is putting appropriate focus on the issues of the project.

• Risks Planned For: How many risks have been raised and planned for? Again, too many shows a risky project and too few shows one that has not been managed appropriately.

• Meeting Attendance: How many meetings have been called and how well attended were they? This helps understand the effectiveness of called meetings. If there are too many or they are not well attended, or too few, this could be a sign.

• Communication Plan Execution: How many communications did the project manager plan during the project and were they effectively communicated? For instance, if they said an issue log would be created and disseminated every Thursday, did they send one every Thursday? This will assist in ensuring that everyone is getting the information that they planned to receive for the project.

• Decisions Requested and Received: How many decisions or issues have been raised to the stakeholders and/or sponsors and how many have had appropriate decisions? This shows the attention that the key people affected by the project are paying. If a decision seems to drag or items requested are overdue, this can put the project at risk.

These are just a few items that can be tracked to paint a clearer picture of how the project is being managed and the level of trust you can put into the reports received. Utilizing a broader metric base will allow you to give a confidence level to the reports and allow you to focus on the proper problem areas. For instance, if a project does not seem to be moving, where does the blame lie? It is easy to simply blame the project manager. However, if the project manager is waiting on the CEO of the company to make decisions and the decisions have not been made, the project manager may be wary to raise a red flag. It is important to make sure that all information is level set so that the most complete picture can be painted for statuses. Then, you truly have the right information in front of you to make the proper adjustment.