Top Menu

Measuring agreement between different raters

Monday, October 28, 2013

Rating averages (mean values) are definitely useful and they are, above all, very easy to interpret and communicate. They provide a very simple measure of the overall ratings provided by different respondents. Their main drawback is that they do not convey the level of agreement (or disagreement) between the different raters.

Primalogik 360 uses graphs and statistics to provide better insight into the level of agreement/disagreement behind an average.

Statistics and Frequency Distribution graphs

Frequency distribution graphs

They are easy to read and interpret. A quick glance at a graph allows you see if there's a disagreement or not (responses are scattered through the rating scale). They also allow you to identify if there are responses on the extremes. We've added frequency distribution graphs to Primalogik 360 back in june. They are easily accessible through the 360-degree survey report and they are included in the PDF report as well.

Standard deviation and coefficient of variation

We've just added these two statistical measures as an additional tool for response analysis. Both the standard deviation and the coefficient of variation provide an indication of how far the different responses are from the average.

The standard deviation shows how much variation from the average exists. A low standard deviation indicates that the data points tend to be very close to the average (mean); a high standard deviation indicates that the data points are spread out over a large range of values. [wikipedia]

The coefficient of variation is a normalized measure of dispersion of the frequency distribution. The coefficient of variation is useful because the standard deviation of data must always be understood in the context of the mean of the data. In contrast, the actual value of the CV is independent of the unit in which the measurement has been taken, so it is a dimensionless number. [wikipedia]

Primalogik turns one!

Tuesday, October 22, 2013

Yes, Primalogik turned one this October!

Only twelve months ago we decided it was time to focus exclusively on our ideas and dedicate full time to our startup. Starting a business from scratch is a huge undertaking and a humbling journey. It's been a huge learning experience and a lot of fun.

We've accomplished a lot in the past 12 months. We launched our 360-degree feedback software only 7 months ago and we we have made improvements to it almost constantly. We have happy customers in 4 different countries... and 3 different continents!

And we are not stopping here. We're proud of what we've achieved so far but we're even more excited about what's coming ahead. We have a bunch of very supportive clients and we'll keep working with them to make sure we're providing them the best user experience. We also have a full roadmap with tons of interesting ideas. So expect to see some very cool features from Primalogik in the coming months. Stay tuned!