This is the first in a series of Policy Reviews that I will post over the next day or two. There are several more to follow.
This last CAP project took almost three months to complete. That is WAY too long for a CAP project. Here's a quick rundown how long each CAP project has taken:
In CAP 2, Hyra was very cautious with the polling, and did multiple rounds of polls for almost every part. IIRC, eric twisted Hyra's arm a few times and caused a few more polls than even Hyra wanted. Regardless of the reason, Revenankh took a long time because there were lots and lots of polls, each one taking multiple days to complete. I haven't gone back through the threads to verify this, but that is my recollection.
For CAP 5, the delays were due to protracted polling and discussion threads. Tennis regularly left threads open long after the meaningful discussion had died. Sometimes this was due to real life complications. Other times... well, I don't know why he let threads stagnate. But, I sent tennis PM's many times during CAP5, urging him to "get on with it". During one poll, I think I actually opened the next thread myself, after trying to reach Tennisace for two days, and getting no response.
Tennis started CAP 5 with some of the fastest, most efficient threads we've ever had. Then, as the project progressed, it slowed down. I don't know if Tennis got burned out, or if real life commitments started piling up. But whatever the reason, CAP 5 dragged slower and slower with almost every step. There at the end, I honestly had no idea if it would finish at all.
So what do we do about this? I have a few ideas, but I am open to other suggestions if you don't agree with mine.
I don't want to set any overall time expectations on a CAP project. I simply want the pace of the project to keep a high level of community interest and involvement. If each step of the process has a lot of activity and interest and it takes 4 months to finish - that's fine with me. If the process only takes 6 weeks, but has times where threads are left "dead" for days on end, and other times where vibrant threads are abruptly closed -- then that project would be unsuccessful IMO. The project should be paced so that the community involvement curve never experiences deep valleys, but also never limits the peaks.
Each thread in the creation process should be open for as long as it needs to be open, but no more. Coming up with a definition for "needs to be open" -- that's the tricky part. I think it is helpful for polls to have clearly defined time limits, so voters know how long they have to get their votes in. Sometimes voters intentionally delay their votes to see how discussion progresses, before settling on a choice. If the poll times are not clear, people could inadvertantly wait too long, and not get their vote in. On the other hand, sometimes polls completely "die" long before their time limit. It is pointless to leave a thread open, without much interest or activity, simply because the time limit has not expired.
My general yardstick for measuring activity on a CAP project is the hourly rate of posting and/or voting in a given thread. When the community is actively involved in a thread, the posts per hour is high. At the beginning of a hot thread, it might have dozens of posts per hour. After the initial posting flurry, it usually settles down to several (5-10) posts per hour. As the thread dies down, it only gets a couple of posts per hour. If a thread gets less than a post per hour, it is effectively dead. If a thread has periods of several hours with no posts, it is completely dead -- and the decomposing carcass is stinking up the forum. Obviously, this measuring system is very subjective and fluctuates based on the time of day and other factors. But, posts per hour is my rule of thumb for activity.
Here's a few other things to remember when discussing project pace:
As a general rule, we should never have a "dead" thread on a CAP project. I would like to implement the following changes to our process to avoid dead threads and maintain project pace:
In a separate PR thread, I will also make some suggested changes to the Order of Events, that should help prevent certain threads from staying open too long while waiting for other steps to complete.
I look forward to hearing feedback on the issues and proposals mentioned above.
CAP projects need to maintain momentum. We should have a high level of energy and enthusiasm throughout every CAP project. When CAP projects are delayed, the community loses interest and participation. While I do not think we need to hurry through the creation process at breakneck speed, we need an efficient process that sustains community involvement from start to finish. I would like to make some process changes to regulate the pace of all future CAP projects.If you are not an experienced member of the CAP community, it is strongly recommended that you do not post in this thread.
This thread is intended to contain intelligent discussion and commentary by experienced members of the CAP project regarding CAP policy, process, and rules. As such, the content of this thread will be moderated more strictly than other threads on the forum. The posting rules for Policy Review threads are contained here.
This last CAP project took almost three months to complete. That is WAY too long for a CAP project. Here's a quick rundown how long each CAP project has taken:
CAP 1 (Syclant) - 6 weeks
CAP 2 (Revenankh) - 11 weeks
CAP 3 (Pyroak) - 6 weeks
CAP 4 (Fidgit) - 7 weeks
CAP 5 (Stratagem) - 11 weeks
You can see that two CAP projects took significantly longer than the other three. My goal is to implement process changes that ensure that long CAP projects like CAP 2 and 5 do not happen again.CAP 2 (Revenankh) - 11 weeks
CAP 3 (Pyroak) - 6 weeks
CAP 4 (Fidgit) - 7 weeks
CAP 5 (Stratagem) - 11 weeks
In CAP 2, Hyra was very cautious with the polling, and did multiple rounds of polls for almost every part. IIRC, eric twisted Hyra's arm a few times and caused a few more polls than even Hyra wanted. Regardless of the reason, Revenankh took a long time because there were lots and lots of polls, each one taking multiple days to complete. I haven't gone back through the threads to verify this, but that is my recollection.
For CAP 5, the delays were due to protracted polling and discussion threads. Tennis regularly left threads open long after the meaningful discussion had died. Sometimes this was due to real life complications. Other times... well, I don't know why he let threads stagnate. But, I sent tennis PM's many times during CAP5, urging him to "get on with it". During one poll, I think I actually opened the next thread myself, after trying to reach Tennisace for two days, and getting no response.
Tennis started CAP 5 with some of the fastest, most efficient threads we've ever had. Then, as the project progressed, it slowed down. I don't know if Tennis got burned out, or if real life commitments started piling up. But whatever the reason, CAP 5 dragged slower and slower with almost every step. There at the end, I honestly had no idea if it would finish at all.
So what do we do about this? I have a few ideas, but I am open to other suggestions if you don't agree with mine.
I don't want to set any overall time expectations on a CAP project. I simply want the pace of the project to keep a high level of community interest and involvement. If each step of the process has a lot of activity and interest and it takes 4 months to finish - that's fine with me. If the process only takes 6 weeks, but has times where threads are left "dead" for days on end, and other times where vibrant threads are abruptly closed -- then that project would be unsuccessful IMO. The project should be paced so that the community involvement curve never experiences deep valleys, but also never limits the peaks.
Each thread in the creation process should be open for as long as it needs to be open, but no more. Coming up with a definition for "needs to be open" -- that's the tricky part. I think it is helpful for polls to have clearly defined time limits, so voters know how long they have to get their votes in. Sometimes voters intentionally delay their votes to see how discussion progresses, before settling on a choice. If the poll times are not clear, people could inadvertantly wait too long, and not get their vote in. On the other hand, sometimes polls completely "die" long before their time limit. It is pointless to leave a thread open, without much interest or activity, simply because the time limit has not expired.
My general yardstick for measuring activity on a CAP project is the hourly rate of posting and/or voting in a given thread. When the community is actively involved in a thread, the posts per hour is high. At the beginning of a hot thread, it might have dozens of posts per hour. After the initial posting flurry, it usually settles down to several (5-10) posts per hour. As the thread dies down, it only gets a couple of posts per hour. If a thread gets less than a post per hour, it is effectively dead. If a thread has periods of several hours with no posts, it is completely dead -- and the decomposing carcass is stinking up the forum. Obviously, this measuring system is very subjective and fluctuates based on the time of day and other factors. But, posts per hour is my rule of thumb for activity.
Here's a few other things to remember when discussing project pace:
- A day is a long time on a CAP project.
- Two days is a very long time on a CAP project.
- Three days is an eternity on a CAP project.
As a general rule, we should never have a "dead" thread on a CAP project. I would like to implement the following changes to our process to avoid dead threads and maintain project pace:
The first poll and/or discussion thread for a given step on a CAP project should normally be open for two days.
The first thread of a project step is always the most active and interesting. But very rarely is anything substantial added after the second day of discussion. Normally, after day two, the post rate is very low. If not, it's usually because a few posters are going back and forth arguing over something ad nauseum and the rest of the community isn't participating or paying attention anyway. I can see certain threads stretching for three days in some cases, but two days should be the norm. TL discretion will still reign supreme when determining the duration of threads, but this will serve as a general guideline.
All secondary polls should be open for one day only.
Secondary polls are a real drag on the energy level of the community. All the interesting discussion comes out in the fisrt poll. People rarely change their minds in secondary polls. Even if they do, people aren't too interested in talking about it. I don't think secondary polls should be discouraged; they are essential to arriving at a fair democratic decision. But, secondary polls need to be completed swiftly. One day is plenty of time to simply collect and tally votes.
The Topic Leader should monitor the posting/voting rate of all threads and move on to the next step when project activity begins to lull.
This is very subjective, and really isn't a "rule". But, it is a clear statement that the TL is responsible for preventing the project from losing momentum. This rule is also a precursor to my next proposal...
We should select an Assistant TL to help the Topic Leader monitor project pace, tally votes, and to step in during project lulls and open new threads, if the Topic Leader is not available to do so.
Topic Leader is a big job, and requires a lot of time and attention. Sometimes it requires too much time and attention to do the job properly. In those cases, we should have another member of the project ready and empowered to step in and lend a helping hand. The forum moderators can always do it, but I think an Assistant TL will help build the community. Assistant TL could be a training ground for future TL's.
I can think of two suitable ways for Assistant TL's to be selected.
The first thread of a project step is always the most active and interesting. But very rarely is anything substantial added after the second day of discussion. Normally, after day two, the post rate is very low. If not, it's usually because a few posters are going back and forth arguing over something ad nauseum and the rest of the community isn't participating or paying attention anyway. I can see certain threads stretching for three days in some cases, but two days should be the norm. TL discretion will still reign supreme when determining the duration of threads, but this will serve as a general guideline.
All secondary polls should be open for one day only.
Secondary polls are a real drag on the energy level of the community. All the interesting discussion comes out in the fisrt poll. People rarely change their minds in secondary polls. Even if they do, people aren't too interested in talking about it. I don't think secondary polls should be discouraged; they are essential to arriving at a fair democratic decision. But, secondary polls need to be completed swiftly. One day is plenty of time to simply collect and tally votes.
The Topic Leader should monitor the posting/voting rate of all threads and move on to the next step when project activity begins to lull.
This is very subjective, and really isn't a "rule". But, it is a clear statement that the TL is responsible for preventing the project from losing momentum. This rule is also a precursor to my next proposal...
We should select an Assistant TL to help the Topic Leader monitor project pace, tally votes, and to step in during project lulls and open new threads, if the Topic Leader is not available to do so.
Topic Leader is a big job, and requires a lot of time and attention. Sometimes it requires too much time and attention to do the job properly. In those cases, we should have another member of the project ready and empowered to step in and lend a helping hand. The forum moderators can always do it, but I think an Assistant TL will help build the community. Assistant TL could be a training ground for future TL's.
I can think of two suitable ways for Assistant TL's to be selected.
1) Whoever comes in 2nd place in the regular TL selection balloting
2) Allow the Topic Leader to select their Assistant TL
Personally, I like option 2. But, any process is fine as long as we name a person with a clear expectation that they will serve as an assistant and backup to the Topic Leader.2) Allow the Topic Leader to select their Assistant TL
In a separate PR thread, I will also make some suggested changes to the Order of Events, that should help prevent certain threads from staying open too long while waiting for other steps to complete.
I look forward to hearing feedback on the issues and proposals mentioned above.