Harvest : a collaborative system for distributed retrieval of social data
In recent years, social network providers has become one of the largest industries in the world. These networks created a new arena for sharing information over the Internet, and thus changed the way people interact with each other. Hundreds of millions of social network users are updating statuses and sending messages to each other every day. These interactions produce vast amounts of social data. This data is the core of the social network providers business model, and it is sold to large companies to perform personalized advertisement, brand monitoring and viral marketing. The price of this data can be intimidating, and some might be unable or unwilling to pay for it because of its price. If the data was freely available, research that could benefit from this data would be derived more freely, leading to new knowledge. This thesis presents Harvest, a collaborative system for retrieving social data. Harvest is a peer-to-peer system consisting of contributing social network users, inspired by public resource computing. Harvest shares social network account-bound resources to retrieve large social data sets. Contribution is achieved by running an application on the contributors computer like other public resource computing system such as the @home systems. The system implements retrieval of data from Twitter. Experiments on real Twitter data show that the system scales with increased contribution. The data retrieval bandwidth per contributing user is quite low, and the number of contributors needed to achieve a considerably large data retrieval bandwidth is high, but there are no associated financial costs with the system. Harvest would benefit greatly by retrieving data from more sources as this would increase its data retrieval bandwidth, in addition to offer more abundant data.
PublisherUniversitetet i Tromsø
University of Tromsø
MetadataShow full item record
Copyright 2012 The Author(s)
The following license file are associated with this item:
Showing items related by title, author, creator and subject.
Condition Monitoring System for Internal Blowout Prevention (IBOP) in Top Drive Assembly System using Discrete Event Systems and Deep Learning Approaches Noori, Nadia Saad; Waag, Tor Inge; Bianchi, Filippo Maria (Conference object; Konferansebidrag, 2020-07-19)<p>Offshore oil drilling is a complex process that requires careful coordination of hardware and control systems. Fault monitoring systems play an important role in such systems for safe and profitable operations. Thus, predictive maintenance and monitoring operating conditions of drilling systems are critical to the overall production cycle. In this paper, we are addressing the topic of condition ...
Future Role of Application of New Technologies in Small-and Medium Scale Manufacturing Systems - Regarding Intelligent and Advanced Manufacturing Systems in Northern Peripheral Area Somlò, Kinga; Sziebig, Gabor (Peer reviewed; Conference object; Konferansebidrag, 2017-08-08)Nowadays the concept of Industry 4.0. and the relating intelligent manufacturing system are getting more and more current and well-known. In the past years the outstanding development of different areas such as information technology computer science, machining, robotics and so on, made possible a comprehensive transformation of the manufacturing systems. Present paper aims to give a general overview ...
Reducing the number of individuals to monitor shoaling fish systems – Application of the Shannon entropy to construct a biological warning system model Eguiraun, Harkaitz; Casquero, Oskar; Sørensen, Asgeir Johan; Martinez, Iciar (Journal article; Tidsskriftartikkel; Peer reviewed, 2018-05-08)The present study aims at identifying the lowest number of ﬁsh (European seabass) that could be used for monitoring and/or experimental purposes in small-scale ﬁsh facilities by quantifying the effect that the number of individuals has on the Shannon entropy (SE) of the trajectory followed by the shoal’s centroid. Two different experiments were performed: (i) one starting with 50 ﬁsh and decreasing ...