| [eclipse.org-eclipsecon-program-committee] Yes / No Polling Analysis |
|
All, Last year we went to the yes/no polling for the first time. We actually got a lot of feedback with almost 7,000 ballots cast over the four days and 226 sessions. I realize that this polling data is not very detailed and the Yes/No nature of probably games people towards a better approval rating than you might get if you used a different scale, but I still like the data for its simplicity and the volume of feedback. At a very high level we should be please that better than 90% of the people liked (+) the session that they attended. On the other hand, it is a little troublesome to me that 1 in 10 people walked away from a session and decided that they were somehow unsatisfied (-). This is why you will hear me continuing to harp on quality this year. I hope to see an improvement in the overall ratings next year, but it will only happen if you work with the submitters in your category to improve their talks and make sure that they are prepared to give great presentations. The attached PDF provides a fairly good overview of the results of last years feedback. One of the things that surprised me, and really stood out was how well the Short Talks (96% +) did on average as compared to the Tutorials (89% +) and Long Talks (90% +). This is one of the reasons that we have expanded the number of short talk sessions this year and that we will be actively pushing you to recruit and organize more short talks. One particular fact that stood out was that of the ten lowest rated sessions, 8 of them were tutorials ( 44% - 62% approvals ). I think that the take away is that if you are going to advertise a tutorial the presenter had better be prepared to do more than just talk about the kewl stuff that they can do. The demos have to be clear and well rehearsed. There needs to be concrete take away content. Finally, a tutorial should have some level of hands on involvement. This is one of the reasons that I would like to see more commercial trainers recruited to come and provide tutorials this year. Do you feel that we as a program committee can take on a content review of all of the tutorials? Would you be willing to do that with the tutorials in your categories? Thoughts? Scott Rosenbaum |
Attachment:
overall_analysis.pdf
Description: Adobe PDF document