General > About us...
Research: Algorithm 'identifies future trolls from just five posts'
greentara:
Antisocial Behavior in Online Discussion Communities
Justin Cheng, Cristian Danescu-Niculescu-Mizil, Jure Leskovec
(Submitted on 2 Apr 2015)
User contributions in the form of posts, comments, and votes are essential to the success of online communities. However, allowing user participation also invites undesirable behavior such as trolling. In this paper, we characterize antisocial behavior in three large online discussion communities by analyzing users who were banned from these communities. We find that such users tend to concentrate their efforts in a small number of threads, are more likely to post irrelevantly, and are more successful at garnering responses from other users. Studying the evolution of these users from the moment they join a community up to when they get banned, we find that not only do they write worse than other users over time, but they also become increasingly less tolerated by the community. Further, we discover that antisocial behavior is exacerbated when community feedback is overly harsh. Our analysis also reveals distinct groups of users with different levels of antisocial behavior that can change over time. We use these insights to identify antisocial users early on, a task of high practical importance to community maintainers.
Comments: ICWSM 2015
Subjects: Social and Information Networks (cs.SI); Computers and Society (cs.CY); Applications (stat.AP); Machine Learning (stat.ML)
Cite as: arXiv:1504.00680 [cs.SI]
(or arXiv:1504.00680v1 [cs.SI] for this version)
Source: http://arxiv.org/abs/1504.00680
PDF (cache): http://arxiv.org/pdf/1504.00680v1
greentara:
Internet Algorithm 'identifies future trolls from just five posts'
It is possible to tell comment trolls apart from other users simply from looking at the way they write, researchers have found.
Studying the comments on three sites – CNN, Breitbart and IGN – over an 18 month period, the researchers at Cornell and Stanford universities found that users who went on to be banned wrote differently to other users in the same comment thread, using fewer words indicative of positive emotion.
Future banned users also tended to write comments that were more difficult to read than typical users, the researchers found.
“We find that such users tend to concentrate their efforts in a small number of threads, are more likely to post irrelevantly, and are more successful at garnering responses from other users,” the researchers add, in a pre-publication paper titled Antisocial Behavior in Online Discussion Communities.
“Studying the evolution of these users from the moment they join a community up to when they get banned, we find that not only do they write worse than other users over time, but they also become increasingly less tolerated by the community.
The researchers also discovered that antisocial behaviour was exacerbated when moderation appears to be overly harsh.
The researchers studied more than 35m posts sent from almost 2 million users on the three websites under investigation, and found nearly 50,000 individual users who had been banned over the 18 month period. They also examined the number of individual comments that had been deleted or reported to the site’s moderators, with all the data provided to the researchers by Disqus, the commenting platform used by all three sites.
They focused their investigation on the 50,000 users banned over the period under examination, and attempted to find tell-tale signs in their prior posts that acted as an indicator for their later behaviour.
They discovered that users who would end up being banned from the site often wrote noticeably different to the main bulk of commenters. “Users can stay on-topic or veer off-topic; prior work has also shown that users tend to adopt linguistic conventions or jargon in a community … and that they also unconsciously mimic the choices of function-word classes they are communicating with.” Sure enough, they found that “text similarity” of banned users was significantly lower than that of non-banned users.
Additionally, the posts of banned users had similar word counts to those of non-banned, but when tested against a standard readability index were revealed to be significantly harder to read.
On top of the information found in the actual posts, the authors also found that users who would go on to be banned interacted differently with the community at large. “For instance, [future banned users] tended to spend more time in individual threads than [users who weren’t banned],” they write.
With all the information together, they created a prediction model which can guess with 80% accuracy whether or not that user will go on to be banned from just their first five posts. Looking at the first 10 raises the accuracy of the model by a further two percentage points, which raises the possibility of automatically highlighting potentially problematic users to moderators so that antisocial behaviour can be dealt with more quickly.
But the authors warn that overzealous moderation can have its own downside: “Taking extreme action against small infractions can exacerbate antisocial behaviour (e.g. unfairness can cause users to write worse) … Whereas trading off overall performance for higher precision and have a human moderator approve any bans is one way to avoid incorrectly blocking innocent users, a better response may instead involve giving antisocial users a chance to redeem themselves.”
Source: http://www.theguardian.com/technology/2015/apr/17/algorithm-identifies-future-trolls-from-just-five-posts
greentara:
Mediacorp has produced and released a timely and heart-warming programme titled "The White and Red Rose Event". Thank-you Mediacorp.
Video (22mins in Toggle.sg, Cache): http://video.toggle.sg/en/series/testube-6/ep2/328496
Photographs: http://www2.toggle.sg/testube/thewhiteandtheredroseevent.html
Synopsis of the "The White and Red Rose Event", Testube 6 - EP2 (Channel 5):
Can reel life cross seamlessly into real life? Find out in The White and Red Rose Event where lives of ordinary people are disrupted by the level of internet trolling that takes place in an anonymous battle field of social media.
greentara:
Script to remove postings from any user from Hardwarezone Forum (Example: Powerpuff_Girls)
1. Install TamperMonkey, an extension available for Firefox or Chrome
2. Add a new userscript
3. Copy and paste this in: http://pastebin.com/B1SEkW3n
Pros
1. Let you concentrate on the task at hand
Cons
1. Only works after the page is fully loaded
2. You don't get to read hilarious insults or counter-insults
3. You will still read them anyway if someone else quotes it
--- Code: ---// ==UserScript==
// @name HWZ Selective Post Remover
// @version 0.1
// @match http://forums.hardwarezone.com.sg/*
// Script http://pastebin.com/B1SEkW3n
// Author aeipathy (from HWZ)
// PostSrc http://forums.hardwarezone.com.sg/93380649-post854.html
// ==/UserScript==
(function(){
var arrPosts = document.getElementsByClassName("post");
for(x=0;x<arrPosts.length;x++)
if(arrPosts[x].getElementsByClassName("bigusername")[0].innerHTML == "Powerpuff_Girls")
arrPosts[x].innerHTML = "";
})();
--- End code ---
greentara:
Navigation
[0] Message Index
[#] Next page
Go to full version