|
Re: [CR] critical mass for relevant statistics [message #640656 is a reply to message #640538] |
Mon, 22 November 2010 17:47 |
|
That's a real tough question to which I don't have a good answer yet. We didn't conduct experiments on how many examples we needed to create "good" results.
Just one example for illustration:
For (mid-size API) SWT Button we found approx. 160 different ways how developers used (i.e., invoked methods on) instances of SWT Button. These observations have been observed in thousands of different method contexts (e.g. PreferencePage#performOk, DialogPage#createContents etc.)
By now, you need at least one example for each method context - assuming that there is only one common way of how to use this type in this method. If you have different ways (like using a Button as check/radio/push button) more examples are needed to identify these patterns.
To be honest: I can't give you a good number yet. We should define some experiments and evaluation statistics on that. Do you (anyone?) have any concrete ideas how to evaluate this? I may find a student to work on this interesting question if we have a concrete vision of what to measure/achieve
|
|
|
Powered by
FUDForum. Page generated in 0.02889 seconds