What are good ways to score an ordering?

For context, a close friend organizes a club facts evening and also would love to recognize an excellent way to rack up ranking inquiries. As an example, placed these 5 flicks from the 70 remains in order of release: Jaws, Star Wars, Alien, Blazing Saddles, and also Superman. There is a proper ordering, yet just how should partial debt be set aside to wrong purchasings?

Rather extra officially, intend that you produce an inquiry asking individuals to get $N$ points. What are excellent ways to quality their feedbacks with partial debt?

As an example, intend $N=5$ and also individuals are asked to place B, C, E, A, and also D in order. Complete debt (whatever that suggests) is offered for ABCDE. Yet what is an excellent way to offer partial debt for various other permutations?

As an example, I assume EDCBA need to get no debt in all, given that it is entirely in reverse (regardless of having one letter in the appropriate placement). I assume ACBDE needs to get the greatest feasible partial debt (whatever that would certainly be), given that it is just one transposition far from proper. (Personally I would certainly additionally consider that the transposition remains in the center, so at the very least the individual obtained the extremal letters proper. Nonetheless, that transforms this right into a non - symmetrical trouble, and also I'm satisfied to throw away that factor to consider.) I assume BCDEA needs to get a reasonable quantity of partial debt, given that the loved one ordering of 4 out of 5 things is proper, regardless of having no letters in the proper placement.

I'm mindful of a numerous practical - appearing approaches to assign partial debt. Each method gauges just how "far away" the sent solution is to the proper solution, and afterwards makes use of some function to transform that range right into a rating in an adverse fashion (the extra the range the much less ball game.)

Opportunities for gauging range:

$\bullet$ Count the marginal variety of surrounding transpositions that transform the sent solution right into the proper solution.

$\bullet$ Create an $N$ - vector gauging the range from each letter is sent placement to its proper placement, and also placed an idea of dimension on that particular vector. As an example DCABE would certainly have vector $(3,1,2,2,0)$. Dimension could be the typical Euclidean range, the square of Euclidean range, the taxicab statistics

$\bullet$ Other suggestions?

After that there are great deals of practical features that transform range right into a rating.

$\bullet$ $\mbox{score(distance)}=100\%\cdot r^{\mbox{distance}}$, for some $r<1$.

$\bullet$ $\mbox{score(distance)}=100\%-k\%\cdot\mbox{distance}$, where $k\%\cdot\mbox{(maximal distance)}=100\%$.

$\bullet$ $\mbox{score(distance)}=\displaystyle\frac{100\%}{1+\mbox{distance}}$

$\bullet$ Other suggestions?

What I am seeking is greater than simply new and also various propositions for racking up (although I would certainly enjoy to listen to even more of those also). I am extra curious about reviewing a persuading argument for favoring a certain method of racking up.

7
2022-06-07 14:35:32
Source Share
Answers: 3

You need to have a look at the Kendall Tau Distance and also the Kendall Tau Rank Correlation Coefficient.

2
2022-06-07 17:56:40
Source

It relies on your perspective and also the inquiries:

Regard the permutation BCDEA

For instance, if the inquiry has to do with historic occasions, and also a person determines that the pyramids where constructed after the Empire State Building, after that you could not intend to offer much debt, due to the fact that it presents full lack of knowledge. The range of each letter per proper area penalizes this mistake as necessary.

Yet the getting BCDEA for the flicks over can simply suggest that the individual did not recognize the flick A while being flawlessly knowledgeable about the 4 various other flicks which is fairly a great deal of expertise concerning flicks launched prior to their birth. So, you could intend to base your rating on the inquiry: The amount of letters need to be gotten rid of to get to a proper getting?

5
2022-06-07 16:25:39
Source

If I was scoring this by computer system, after that I would certainly consider the $N(N-1)/2$ sets (10 when $N=5$) and also offer a factor (or $\frac{2}{N(N-1)}$ of a complete debt) for each and every proper set. So ABCDE obtains 100% ; ABCED obtains 90% ; BCDEA obtains 60% ; and also EDCBA obtains 0%.

In a club test, this is also made complex. You can simply offer incentive factors if the complete order is proper and also absolutely nothing if there is a solitary mistake.

2
2022-06-07 16:24:04
Source