Wikirage Methodology

Wikirage uses the edit stream on Wikipedia to find out what is hot and trendy in pop culture. 

The first step in the process is to capture the edit stream.  Wikipedia provides this reasonably up to date at this web address.   I'm currently not capturing Robots or Minor Edits, getting 500 edits a page spreads a time frame of 5-10 minutes depending on time of day and day of week.

The second step is to visit the page editing for every entry that was found in the list. Wikipedia lets you see that here. I log all of these actions in a database.

To give some background to the edits I pull a synopsis of each Wikipedia Page and look for flags on the page like cleanup and current event.  As I'm writing this, the Russia-Ukraine gas disputes page shows examples of flags that editors place on Wiki content.

One more piece of contextual data is captured by capturing all links from the home page and Featured Ariticles Archive.

Once you have all of the data you can now do a summarization routine to build the lists of what's hot. I run summarizations 6-10 times an hour for the data points of 1, 6, 24, and 72 hours.  The summarizer for weekly and monthly data are run once a day.

 Undo, Reversion, and Vandalism are notes that are put on the edit trail and I keep track of these statistics individually.  Total Edits and Unique Editors are exactly what they describe.  Quality Edits is the Total Edits minus Undos and Reversions.

Please feel ask for clarification on any of these points, or just post thank you if you find Wikirage helpful and/or fun.

 

Comments (3)

Inappropriate or promotional comments may be removed.

Reply
Ira Abramov (9:11 AM on Mon May 18, 2009)

Howdie!

Looks like an interesting tool to play with! I wanted to adapt it to the Hebrew Wikipedia, but I can't see any links to sources so I suppose you never released any. Can you recommend other similar projects that are released as Free Software?

Thanks!

Reply
Nishanth (3:23 AM on Wed Oct 7, 2009)

hi,
I need the recent edits made in the last 30 days in wikipedia.
"http://en.wikipedia.org/wiki/Special:RecentChanges"
with the above link I'm unable to get the recent changes for last 1 month. Could you help me regarding this?

Reply
Laura Hale (10:24 AM on Fri Jan 8, 2010)

Hi! I'd love to use this for Fan History Wiki. Is there any chance that you might release the script so that others can use it for their own wikis?

Add a comment Cancel & reply to article ›

Inappropriate or promotional comments may be removed. To create a clickable link, simply type the URL (including http://) and we will make a link for you. Line breaks and paragraphs are automatically converted — no need to use <p> or <br> tags, but if you're into that kind of thing, you can use any of the following tags: b, i, strong, em, a (href only), p and br.

Click one of the three commenter types below. Member comments are added immediately once you confirm your email address. Anonymous comments are moderated by our editorial staff.

Email Me
  
Comment Preview
Avatar
Anonymous (8:30 PM on Thu Mar 11, 2010)

Preview your comment here.