Classify importance of Data (Characters, Houses,...) by Centrality measure

[sacdallago]

Hi there,

as mentioned around and in other teams, it would be extremely useful to have a measure of importance of a character, house, and everything that can be scraped from the wiki and has a unique link.

This can be done by creating a graph of in- and outgoing links via https://www.npmjs.com/package/ngraph.centrality and then storing in separate values the in-, out-, degree and betweenness centralities. Just be careful: the centralities are graph dependent. Thus you need to think wether you want to have a mega-graph or separate graphs for characters, houses,... Both are correct, it's a matter of choice.
Also: think about the package handles multiple links from A -> B

Last but not least, some other teams have already been working on these things, so @Rostlab/js_cs_sose_2016_students please raise your voice. For now we have been wrongly advising this as page rank but that's just one flavor of centrality measure.

EDIT: Centrality is: https://en.wikipedia.org/wiki/Centrality

[boriside]

Is this a call for help/collaboration with another team or it is an issue for Project_A?

[kajo404]

I did something . I took the data from Guy's wiki scraper and generated some jsons from it. I then matched this with the character list provided by and ordered by score.

The code can be found here . Its not great but it works. Maybe this helps someone...

[sacdallago]

It's a call for collab if someone has done something about it. But I think I described quite extensively how you could implement this, regardless of other's people work. So :D you know... :D

[AlexBeischl]

Well, we have just gathered some images for the characters, we created paths for and which are most important/popular. Those images can be found here:
https://github.com/Rostlab/JS16_ProjectC_Group10/tree/develop/mockup/img/persons

[sacdallago]

@AlexBeischl that's still not really what I had in mind :) but again, a start:
@kordianbruck @adiolis can you assign someone except you two or @togiberlin to take care of this one? Assign as in, this issue is assigned.

I asked already on the facebook group, who wants to do this. Till now, there are no volunteers.
I am really not able to also do this. 😠
Should we really just assign some one, @sacdallago 😄

Is this even a part of Project A?

[kordianbruck]

Yea, I don't think this is in the project scope of A nor can be done till the 25. I vouch to move this issue to 'someday'

[gyachdav]

I actually think it is within the scope of A, but since this requirement showed up late in the game we can defer it to the next version.

In the mean time, please integrate the data from here https://rostlab.org/~gyachdav/awoiaf/Data/pageRank/allchars.tgz

it's not perfect but at least gives a measure of which character is more referenced than others. I believe the range is [1-300](unknown to popular) . All you want to do here is, read the first item in the array from which you pick up the page_name to identify the character and assign that character the "score" value.

We really need this popularity measure in, to be able to sort the characters by the most important ones. otherwise we run into a case where we show bunch of negligible characters on the character portal.

@gyachdav thank you. We will do that.