Monday, May 26, 2008

Measuring Progress

Recently I was asked to help out on a project that was not as productive as expected. My first question about where they are and where they should be, it became quickly obvious that they did not know. They perfectly knew that they are well behind but they were not able to quantify the deficiency. How could that be? All team members were always focused and working hard. So it was not a people problem, but rather a measuring problem.

How do you measure progress? There are two sides to the equation. Work to be done and completed work. Progress is the amount of the completed 'done' side in relation to the 'to be done' side. In order to have progress you need to move finished work from one side to the other. But, what means finished and when can we stick the 'done' label on something?

That gives us two entities we need. I call them 'Unit of Work' (UOW) and a definition of 'Done'.

UOW could be anything, however it needs to be well defined and understood from every single team member. The foremost important thing is that there is no miss-understanding about size, scope and dependencies. In the agile world this is a 'User Story' (US). In RUP a 'Use Case' or otherwise a requirement. Since this is about agile, I will use US in this article.

Each user story provides value to the customer and has three main attributes. These are priority, description and effort estimate. Priority is given by the customer, the customer has the right to choose what is the most important to them. The description should be done by both developers and customers to make sure that both have the same understanding. During that process the US is also estimated. The estimate can be of any unit; for simplicity lets use days. This has to be done for every wanted US for the first release. (personally I prefer story points [1])
Now we have on side of the equation, we call this the product backlog. A number of US with a description, a priority. Higher priority US are done first. Finally, the sum of all the effort estimates, in our case a number of days. Now, we can measure progress.

Progress = 100 / Total Effort Estimate * Done

Please, be aware that this is an estimate and we allow them to change. The customer even has the right add, remove or change US. But all those changes to the US product backlog will also adjust the progress as the total effort estimate will be affected. Depending if it is a date or feature driven project, you can adjust accordingly and see what the impact is.

Now, let's have a look at a definition of Done. When is something done? In the case of software one could say that something is done once the functionality is usable. Is this sufficient? I don't think so, as there are several Dones which have to be completed before a US can be labeled as Done. I call them the 4Ds.

The 4 Dones:
  1. D1: Done Implementing -- Functionality is implemented and works
  2. D2: Done Unit Testing -- Automatic unit tests can repeatably proof that code is working
  3. D3: Done Acceptance -- The customer likes what she sees and accepts it
  4. D4: Done QA -- QA signs of
The first done is what was sufficed in a pre agile world. In a TDD environment steps 1. and 2. are basically one. However, I still like to keep them separate as a mental reminder as not every team is doing TDD. As for the customer acceptance, this would typically happen in a showcase at the end of an iteration. You demo the code and answer upcoming questions. Finally, you give it to QA and they make sure it passes all acceptance criteria defined by the US. Step 4. can actually start before step 3. and maybe even be in parallel with 1. and 2.

A US can be moved from the 'to be done' side -- the product backlog -- to the completed side if a US is D4, i.e. all four done criteria have been fulfilled. Not, earlier! A story is either done or not, there is nothing in between. A story needs to have at least a 2D state to be showcased to the customer. Unfinished US are of no value to the customer.

Assuming the size of our product backlog is 100 days and as of now the sum of D4 US is 40 days we can claim to have a 40% completion. Now, if the customer adds a couple of new US with the effort estimates summing up to 20 days we will fall back to 33%.

This is a good start, but are we able to answer the question about when the project will be finished? First, we will never be able to guarantee a specific date, however we can use historical data to make a good estimate. Let's say it took us 6 iterations to complete the sum of 40 days. That makes ~6.5 per iteration. 60 days are left in the product backlog; 60/6.5 = ~10. (with the rounding, don't be obsessed with precision; I like to err on the cautious side) If there are no significant changes we can be pretty confident to complete the project in 10 iterations. Also, it should be obvious that all the iterations are strictly time boxed and of fixed length -- No exemptions!

In order to measure progress we need tangible units like US and a clear definition of done. All US stories with their effort estimate are the product backlog. Once we have those we can measure the project progress. If we work with those units in a iterative framework, we are actually able to provide an end date with a certain degree of confidence.

[1] Agile Estimating and Planning

10 comments:

良哥 said...

Teenagers in a track adidas shoes can go through shoes rate adidas outlet teenage runner well knows that adidas sneakers to wear the right shoes air jordan 2010 any cross country among world jordan shoes especially important to the sportsman discount jordan shoes a young person growing up Pure GHD Not only do they want to bourke dooney handbags grow out of their shoes dooney bourke bags but shape of their feet changes which means every time we dooney bourke outlet the time comes to get dooney bourke totes a new pair of shoes eveyone NIKE SHOX a good choice to get NIKE SHOX SHOES it with a high material SHOX SHOES that breathes easily on random moncler They should be extended runs moncler jackets give enough support to athlets moncler coats especially around the ankles area moncler vest to avoid injury your ankles discount moncler outlet when you make your trip discount moncler t-shirt something in store possible fit cheap ugg boots his is also the way to discount ugg boots that don't fit properly only ugg boots it focuses on your convenience classic ugg boots but they are not returnable ugg classic tall boots

Michael Jacksson said...

buy viagra
viagra online
generic viagra

aiai said...

For a pair of sleek gloves that would look great with your suit, pick up the Ross Gloves Italian Sheepskin Gloves with Cashmere lining. These gloves are perfect for those who live in metropolitan areas
spyder skiwhere the temperatures drop in the winter because these gloves are lined with extra warm and soft cashmere for that added layer of spyderwarmth and insulation. The premium Italian lambskin will mold to your hands in a close fit and the slim lines of this glove are convenient enough to slip into your pockets when not neededspyder jacket.

For a great pair of gloves that will keep up with you on the slopes even spyder ski wearin the harshest of temperatures, pick up the Burton' Gore-Tex Under Gloves for $64.95. The Thermacore insulation on these ski jacketgloves will keep your fingers warm even when the freezing wind and slate beats down on you. spyderThe DryRide Ultrashell combined with the Gore-Tex Insert ensures that nothing will get your fingers wet. spyderThe hidden heater and vent pocket stashes extra warmth on the cold days and dumps spyder jacketsexcess heat in the spring. spyder ski wearIf you are worried about your goggles getting steamed up, these gloves help solve that problem with the soft chamois goggle wipe which will keep your vision clear.

贝贝 said...

The Tax Return Crack-Up<3>
Granted, there are usuallyMicrosoft Office 2010write-ups when presidential contenders make their tax returns available, but the coverage falls far short of the Office 2010
full court press (pardon the pun) that the Clintons have received. What's Microsoft Office 2007different now?Office 2007One possibility is that most upper middle class Democrats, and therefore most Microsoft OfficeOffice 2007 keyeditors and reporters of our nation's big papers as well as Office 2007 downloadtelevision producers, are Obama supporters who think that Hillary should hurry up Office 2007 Professionaland drop out of the race already.Microsoft outlook
Microsoft outlook 2010Whom elite liberals are pulling for really does shape political coverage in ways

moncler said...

Moncler Sito Ufficiale, Piumini Moncler è stata fondata in Francia nel 1952
Moncler Sito Ufficiale
Moncler sito ufficiale, Piumini Moncler risparmiare
Piumini Moncler
In winter,piumini moncler is our necessities.We can buy them in moncler
Giubbotti Moncler
Moncler,Piumini Moncler, Moncler Piumini, Moncler Sito Ufficiale, Piumini Moncler Donna, Piumini Moncler Uomo
Moncler Outlet
Moncler outlet negozio online, abbiamo piรน economico e migliore Moncler uomo
Moncler

SteveBrad said...

Buy Generic Viagra
Cheap Generic Viagra
Kamagra

Spineless said...

ibrahim saraçoğlu
seal
blogger indeks
saç ekimi
estetik
meme küçültme
liposuction
meme büyütme

Rainman Mark said...

I liked your article, I will share your article to everyone!!




RS gold|Diablo 3 Gold|GW2 gold|WoW Gold

escortbayan said...

ataşehir escort - escort bayanlar ataşehir - ataşehir escortları - kadikoy escort - kadıköy escort - kızıltoprak escort - ataşehir escort - ataşehir bayan escort - escort ataşehir - bayan ataşehir escort - halkalı escort - beylikdüzü escort - izmir escort - izmir urla escort - güzelbahçe izmir escort - bornova escort - izmir tire escort - izmir escort bayanlar - izmir kızları - escort bayan - travesti - kadıköy travesti - kadıkoy travesti - kadikoy travesti - travesti kadıköy - ataşehir travesti - halkalı travesti - beylikdüzü travesti - beylikdüzü travesti

escortbayan said...

Seçkin escortların bir arada olduğu bayan escort - kadıköy escort - fenerbahçe escort - escort ataşehir - escort kartal - maltepe bayan - escort beylikdüzü - bursa escort - halkalı escort - avcılar escort - Escort Haritası ziyaret ederek, ihtiyacınıza ve bulunduğunuz mekana uygun bir escort düşünebilirsiniz. - travesti - travesti - kadıköy travesti - feneryolu escort - istanbul escort - kadıköy escort - travesti - kadıköy travesti - travesti - Eskort sitelerini reklam amaçlı kullanan escortlar vardır. kadıköy escort, kızıltoprak escort, bayan escortlar, escort.com sitesine düzenli olarak yeni escortlar reklam veya ilan vermektedirler. Bu yüzden siz de aradığınız kriterlerde ve yeni fiyatlarla uygun fiyatlarla escort bulabileceksiniz. Eskort (escort bayan) tamamen sizin kontrolünüzde olup saatlik ya da belirli bir süreliğine sizin hizmetinize tabi olan özel bayanlardır. www.escortbayanescort.com sitesinden siz de aradığınız biçimde, fikirlerinize uygun escort - feneryolu escort - kadıköy escort bayanlar - escort - bayan - bayan escort - escort bayan - bayan escort - - ataşehir escort - kadıköy bayan escort - escortbayanescort - escortbayan - bayan partner - escortbayanescort.com escort hizmetleri.