There are over 50 Entities and Service Operations available in the Social Analytics Lab API. Over the next few posts we will provide details on how the Entities can be used to accomplish some basic scenarios in the Social Analytics lab.
The first scenario we’ll look at identifies top keywords for one of the lab datasets. To accomplish this, you only need two Entities in our API (pictured below):
The Keywords entity includes every keyword that has been defined or observed by our curation processes. After two weeks of activity on the Bill Gates Lab, we already have an inventory of over 10,000 keywords. New keywords observed in the Social Stream are marked as New. These new keywords are useful to consider when defining filters (coming in a future version) to curate relevant conversations.
With the following LINQ Statement in LINQPad, we can get a sample of the active keywords in the Bill Gates Lab:
( from k in Keywords where k.ItemStatusId == 10 //Active select new { k.Name, } ).Take(10)
Name
Vaccinations
Stanford
Philanthropic
Germany
BillGates
Global Health
Bill Clinton
UN Foundation
GatesFoundation
March of Dimes
KeywordReferenceEntities
KeywordReferenceEntities are the record of what Keywords are referenced in Content Items and Message Threads. In our taxonomy, a Content Item is a post of any kind, ranging from gestures such as Facebook likes to a Tweet to a Blog Post. A Message Thread is a summary of an original post in a feed and all responses to that post in the same feed.
With the following LINQ Statement in LINQPad, we can get a sample of Keyword References:
( from k in KeywordReferenceEntities select new { KeywordName = k.Keyword.Name, k.MessageThread.LastReplyContentItem.Title, k.MessageThread.LastReplyContentItem.HtmlUrl, } ).Take(10)
KeywordName
Title
HtmlUrl
Bill Gates
"Ô Bill Gates, vamos dar um jeito na internet aqui do Brasil, hein?" http://t.co/flCjtGrx
http://twitter.com/13_levi/statuses/126703589409304576
Em palestra paga por um banco americano Lula se supera: “Sem um dedo, fiz mais que Bill Gates e Steve Jobs”.
http://twitter.com/Thais_Grimald/statuses/126703689510551552
Rapaz......Isso não era pra hoje não viu....Até agora sem almoçar! Se pudesse, mandava Bill Gates para junto de Jobs!
http://twitter.com/mbatistasilva/statuses/126703767683993600
RT @GuidoFawkes: Nobody loves Bill Gates, but if he has funded a Malaria vaccine, it makes up for everything and is kind of more signifi ...
http://twitter.com/TadasLabudis/statuses/128649702337032192
BillGates Bill GatesFor those of us lucky enough to get to work with Steve, it’s been an insanely great honor. I will miss Steve immensely.
http://twitter.com/Carolina_S_O/statuses/126704102003572736
endmalaria
RT @PATHtweets: Blog: Read commentary on 2011 @gatesfoundation Malaria Summit from our Malaria Control Program team. http://t.co/DSdlUoO ...
http://twitter.com/EVERY_ONE_CAN/statuses/126704433638805504
Bill & Melinda Gates Foundation Malaria Forum
Using information systems to track a killer parasite
http://macepadiary.wordpress.com/2011/10/18/using-information-systems-to-track-a-killer-parasite/
Top Keywords for the Last Week
Using these two Entities together, we can calculate the top 5 Keywords referenced in the last week for Bill Gates. Here’s the code:
( from k in Keywords.Expand("KeywordReferences").AsEnumerable() where k.ItemStatusId == 10 && k.KeywordReferences.Max(kr => kr.LastUpdatedOn) > DateTime.Now.AddDays(-7) orderby k.KeywordReferences.Count descending select new { k.Id, k.Name, References = k.KeywordReferences.Count } ).Take(5)
and the results:
Id
References
9acbefab-156f-4039-98b9-0a56c2d359d6
108
0db05e2f-233f-4155-93db-01a07c693017
philanthropic
102
d268a214-0033-4f89-b297-051f2fdf7029
91
f41b31fb-63ce-47bc-ab72-016a4e43803a
68
a65d7774-59d7-42d5-a224-013b226cdcae
35
Check out our blog later this week to find out more about what you can do with the entities in the Social Analytics Lab.
Also, please let us know what questions you have or other interesting discoveries you find in the labs.