How to Complete a Project Audit

The great and oft-quoted philosopher Socrates once said, "The unexamined life is not worth living." A great project manager may tell you, "The unexamined project is not worth doing." In order for a project team to assess, refine and improve its process, that process must be comprehensively and critically evaluated. Toward that end, the project audit is an invaluable tool.

Project audits are conducted to discover and then examine any issues or challenges that arise as a team works to complete its assigned task. The practical application of this fact-finding is of course to learn from experience with the goal of improving future projects. But it isn't always about finding out what went wrong. Audits can also identify and celebrate innovations and process successes, ensuring that what went right is fleshed out and built upon so that it can go even more right the next time around.

When to conduct an audit: Project audits may be done during a project or at its completion. When conducted while a project is still in progress, an audit provides on-the-ground assessment that informs the project sponsor, project manager and team of what is going well and what needs to be changed in order for the project to be completed successfully, on-time and within budget. If an audit is undertaken at the completion of the project, it becomes more of a post-mortem examination performed to define success for upcoming projects and ensure it is achieved. Regardless of an audit's timing, the process is basically the same.

Who should conduct the audit: Ideally, project audits should be conducted by an outside party bringing impartiality and a fresh perspective, but whether you choose to outsource the audit or not, confidentiality is essential for data gathering. When project team members and other stakeholders are interviewed about their experiences, they should feel comfortable speaking frankly and not fear retribution for voicing any frustrations with the process. An audit is only as comprehensive as the information on which it is based.

A project audit is comprised of three phases:

1. Research Preparation (includes defining success and developing questionnaire)


2. Deep-Dive Research


3. Reporting Findings

Research Preparation, the first phase, actually consists of about three major tasks. First, the auditor must speak with both the project sponsor and the project manager individually to determine each person's success criteria. What do they think the successfully completed project will look like? And what should the successful audit accomplish and uncover? Being clear about client expectations is of utmost importance.

After these high-level interviews, two questionnaires must be developed. The first will be distributed to each person on the project team and any key stakeholders in advance of one-on-one interviews. Ideally, this questionnaire will get the audit's interview subjects thinking (and organizing their thoughts) about the project's successes, weaknesses, challenges and opportunities.

The second questionnaire is for use during the project team interviews and should consist of open-ended questions that work to flesh out the issues the first questionnaire brought to light. Good interviews aren't just SWOT analyses; they focus on process: How did the team work together? Were meetings run efficiently? How were risks mitigated? Did information flow effectively?

Deep-Dive Research: Now that you have developed your tools, it's time to put them to use collecting data. Project auditors will need to conduct individual interviews with the project sponsor, project manager, project team members and key stakeholders, which may include vendors, suppliers, contractors and even customer representation.

In addition to your interviews, an exhaustive review of all documentation pertaining to the project is the audit's other major source of data. This document review should include basic policy items like team structure, project scope and plan, and business requirements. But it will also require delving into daily, ongoing project documentation like meeting minutes, spreadsheets, milestone reports, action items and change logs.

Be sure to speak with both internal and external stakeholders to determine what their expectations were and whether they have been met. Were the Project Quality Management and Product Quality Management plans followed and achieved? Each person you interview and document you study provides an important piece of the overall puzzle.

Reporting Your Findings is the final phase of the audit. Compile all data collected from questionnaires, interviews and project documentation. Identify and explicate the project's successes, failures, concerns and challenges. The crucial conclusion of this in-depth report should be a list of lessons learned and how to implement them going forward.

The comprehensive report should of course be delivered with a companion presentation that highlights key findings in an easily-digestible, attention-grabbing format that energizes the entire project team for the work that lies ahead – a more cohesive effort that results in greater success on future projects.

Conclusion: The project audit is certainly a beneficial, and even cathartic, exercise for all project team members. It provides a mountain of data and insight into an organization's processes and politics. However, every phase of the audit must be focused on, and work in service to, improving the next project. The project audit is a very forward-facing tool. It is only worth the resources expended when the lessons it uncovers are applied to future projects. Only then can your project audit truly be considered a success.

This article was provided by Joe Schembri with Villanova University's project management courses. Professionals interested in earning their PMP certification can take courses to prepare themselves 100% online.

CA's Clarity Version 13 - A New Standard in PPM Tools!

I finally have gotten what I have wished for!  The power of Clarity with an updated user interface. Many superstitious people think that 13 is an unlucky number.  Version 13 for CA's Clarity has been worth the wait.

I run a technology agnostic company, but I am often asked for my opinion. I have been a longtime supporter of Clarity. However, the interface for the tool has become outdated and was the biggest outstanding issue. While configurations and portlets could overcome some of the issues, there were times where it was just cumbersome. Specifically, it was difficult for the project manager to see dependencies or update the project schedules.  It was also cumbersome to add team members and make assignments. Again, with experience, there were workarounds. However, newer tools like Daptiv and @task were smoking Clarity from a user interface perspective even though they lacked the depth and configurability of Clarity. With V13, it is truly a game changer. I have been able to spend some significant time on the latest version and already have several clients on the new version. The big push for CA was establishing what they called 2.2 clicks to value.  I believe they have achieved that.  Here is my first take at some of the game changers.

In line editing - Clarity has had an edit mode which was innovative when it first came out. Project management is a spreadsheet driven industry so being able to edit like a spreadsheet is a positive thing. The old interface allowed for edit mode, but it was not aesthetically pleasing and often hard to navigate. V13 allows direct in line editing with just a click of the mouse button. It is intuitive and effective. It so reverts back to a display mode when you are done. The part that I wasn't expecting was the visual feedback of the change. Clarity has a unique ability of Being able to complete tentative schedules with an innovative view of what had changed. For example, if a date changed, Clarity would display the new date and the old date with a red strikethrough side by side. They have taken this view and applied it to the in line editing which is a fantastic feature. It also gives a visual to the user that changes have not been saved. I wish more web based apps had this functionality.

Auto Suggest Functionality - For all of the browse fields in Clarity and for those users that have very deep OBS structures, you are going to love this functionality!  If the field is a browse field, you still can click the binoculars and search and add as you are used to.  However, you can also type in the first few letters of the value that you want in the field within the in line editing and the system will offer a filtered view of selections allowing you to select the value you want.  This eliminates many clicks and is the most powerful on resource and OBS fields. This feature is worth its weight in gold.

Better assignment view. The assignment view now combines the standard view with a time-scaled view to not only see the total planned work, but a daily view of how the work is going to be executed. This is like a split window view in Microsoft Project, but more configurable and can be edited in the normal flow of a project update.

Adding team members - One of the biggest issues of pre 13 Clarity was how the team members and assignments worked.  It made sense from a logistical standpoint, but for many project managers, it was a source of frustration.  If you were inside a task and wanted to make an assignment to a person that was not on the team, there were between 20-35 clicks that had to be made.  In an open environment, this is frustrating.  However, there are several environments with very strict regulations and procedures as to who and how people can be added to the team.  To accommodate both environments, CA implemented an "Assignment Pool" field.  On a project by project basis, the setting of Team Only (current functionality) or Resource Pool (new functionality) can be selected.  If it is Resource Pool, then the entire resource pool is available to assign to a task.  This eliminates 20-30 clicks from a test case that happens often.

Dependencies - Managing dependencies in Clarity has often been difficult.  You were unable to see them and editing them again was way too many clicks.  There was an easy way to add dependencies from the Work Breakdown Structure view, but there was no visual feedback that anything happened when you clicked the button and there was no visibility in that view that showed if dependencies existed or not.  Again, this has been addressed.  From the Gantt chart view, you are able to create, edit, and view dependencies right in the Gantt chart.  It also supports drag and drop.  It goes one step further than some other tools as well.  If you hover over the dependency link, the system will show you the actual names of the predecessors and successors.  Very nice addition.

No need to export to MSP - As a power user, I would often tell clients that it was easier for me to create a plan in Microsoft Project, upload it to Clarity, and then manage it in Clarity.  For the hardcore Microsoft Project users, this is still available.  However, for 95% of the users that I have personal experience with, there is no need to export to MSP.  The ease of use of the front end and the in line editing availability in the Gantt chart removes the need to do the export.

All of the power still retained - The main reasons I have always liked Clarity are still there. The configurability and power of the tool remains.  The user interface is what received the overhaul.  It is now completely 64 bit including Java and Tomcat and supports more memory to the Java heap.  All things that will mean a boost of performance for most environments.

Favorites Bar - Another great timesaver is taking a concept that was developed in some of the earlier versions of Clarity and expanding it.  I am not sure of the exact version, but in either 8.1 or 12.0, the user had the ability to set the home page to a different view.  If I am managing a project and I find myself always navigating to a certain page, then I could set that page as my home page so that it was the first page that opened when I logged in.  CA has taken this functionality and expanded it for a full Favorites section.  It works the same way except that I can create several "bookmarks" within the tool to allow me to navigate quickly between common screens.  This is a huge boost for productivity and saves a ton of clicks from the normal navigation of the tool.

One thing still missing - There was one feature that is still desperately needed.  I was hoping it would be in this version and I am told it is in the works.  We are still unable to print a project schedule from Clarity.  For those of you that have attended my seminars you know that I am against printing the project schedule anyway.  It's not like the resources really print it, read and understand it, and can't wait until the next version is released!  However, it is a reality that we still need to print the schedules.  I hope that functionality is around the corner.  In the meantime, there are some nice reports and you can still export the plan to Workbench or Project and use their printing functionalities. 

My Conclusion - V13 is absolutely worth the wait and there are so many upsides to the new release in forms of usability and functionality that my personal recommendation is to upgrade as soon as possible.  There will always be issues and things for software to add, but this is not a wait and see release.  This is an absolute add.  There are so many advantages to this release.  In fact, I don't think I have ever been as excited about a new release of software since Microsoft Project announced change highlighting and multiple undo to MSP in 2007!  Contact your CA representatives or hit the CA support site and download the latest version now.  You will not be disappointed!  If you have been on the fence about choosing a PPM tool, this release of Clarity is a game changer.  Being technology agnostic, I have a Pros vs. Cons list for each tool that we work with. This release of Clarity has removed the current cons that I had on that list.  If you are considering a tool and have received a demo of the older version of Clarity, make sure you see this version before proceeding.  As I just told the existing users, you will not be disappointed!

Until next time!

Rick

Some Things Just Take Time.....

There is always the great debate about throwing resources at a project to try to pull off the impossible timeframe.  However, some things just take time.  When I train project managers, I use an analogy of what effort driven in Microsoft Project means.  I ask them, “Are you painting a fence or driving to Nashville?”  If you are painting a fence and it takes 8 hours to paint the fence, then it will also take the full 8 hours of time.  If you add a resource, it will still take 8 hours of effort, but will only take 4 hours of elapsed time since two people are splitting the work.  If it takes you 4 hours to drive to Nashville and you add a second person, it doesn’t mean you cut the time in half.  Now two people are spending 4 hours in the car so it doubles the amount of effort.  This is a cleaner version of the way that I used to explain this.  I used to say that you can’t always throw resources at a problem.  The example I would state is that you can’t put 9 women into a room and produce a baby in a month, some things just take time.  I used that for a couple of years and every once and a while, someone would be offended.  So I changed it to a cleaner version for most of my trainings.  However, a good friend John Ragsdale sent me this and it made me laugh.  I don’t know where this originated to give it proper credit, but to whoever pulled this together….it reminded me of when I got started.  Enjoy!

Definitions of Designations:

Project Manager is a person who thinks nine women can deliver a baby in one month.

Developer is a person who thinks it will take 18 months to deliver a baby.

Onsite Coordinator is one who thinks a single woman can deliver nine babies in one month.

Client is the one who doesn’t know why he wants a baby.

Marketing Manager is a person who thinks he can deliver a baby even if no woman or man is available.

Resource Optimization Team thinks they don’t need a man or woman; they’ll produce a child with zero resources.

Documentation Team thinks they don’t care whether the child is delivered; they’ll just document it in 9 months.

Quality Auditor is the person who is never happy with the PROCESS to produce a baby.

Tester is a person who always tells his wife that this is not the right baby.

HR Manager is a person who thinks that a donkey can deliver a human baby in 9 months.

I don't acknowledge it....therefore it doesn't exist!

Is this a reality?  I overheard a conversation last night at dinner where a guy was explaining to his friends that he has not gotten a cold in the last 15 years.  He stated that his grandmother told him that there is no such thing as a common cold.  He believed her and ever since he has never gotten a cold.  One of his friends asked, “Do you ever not feel good?”  He said, “Sometimes my nose will be stuffy or I get a sore throat or cough.  I will feel run down and will stay in bed a couple of days……but it’s not a cold!  They don’t exist!”  Call me old fashioned, but that sounds like a cold to me.
It reminded me of my top 5 favorite quotes from a sponsor.  We were running a project and the sponsor had announced to the entire customer base the completion date of the project before the project was even opened in the organization.  Her statement committed us to a 10 month project to be delivered in 4 months.  I approached the sponsor and told her that we would have to do some serious risk management on the project.  Her response is still a classic: “Rick, this project has no risk because it must be done on time!”  If we don’t acknowledge it, it must not exist.
This same denial seems to be true for sponsors when they set a project date or budget.  They often will tell a project manager, “just figure it out,” or, “just make it happen.”  As if the project manager can just wave their magic wand and a new month will be created or a bag of cash will appear.  Projects have been run this way since the beginning of time.  Why is it so misunderstood?  I like to compare projects to weight loss.  Look, I would love to take a pill at night, never have to work out, eat whatever I want, and lose weight.  The reality is that eating right and exercise is what it takes.  The sales numbers for weight loss fads, products, pills, exercise machines, etc. is staggering!  Every day I hear an ad for a new product that promised dramatic weight loss without changing and of the bad habits that lead to the weight gain in the first place.  It is this same mentality that continues to plague projects.  This mentality that if we put it out there it will happen and if we don’t acknowledge the bad stuff, it doesn’t exist is the basis of many of the organizations in business today.  Then everybody is surprised when something doesn’t go as planned.  This goes all the way back to the way the project was selected and how most likely the budget was trimmed via a spreadsheet to get it to meet an arbitrary number that feels right to the executives.  Sure we can cut 20% of this project, there was probably padding in it anyway!
Risk does exist.  Project failure is a very real and repeatable process.  Yet we continue to not acknowledge it.  For example, a project manager will be told that they do not have time to plan, the project must start now.  The project fails.  The project team does a lessons learned session and blames the lack of planning as the reason why.  Then the team will agree that more planning will be necessary.  Then the next project comes along and the same project manager is told that there is no time to plan, it must start right away!  One of the greatest things we can do as project managers is simply acknowledging that these things do exist.  Documentation and metrics capture that show these patterns is paramount.  We must acknowledge these failures.  It is the first step in resolution.
Go forth and document!
Rick