Harvest : a collaborative system for distributed retrieval of social data
In recent years, social network providers has become one of the largest industries in the world. These networks created a new arena for sharing information over the Internet, and thus changed the way people interact with each other. Hundreds of millions of social network users are updating statuses and sending messages to each other every day. These interactions produce vast amounts of social data. This data is the core of the social network providers business model, and it is sold to large companies to perform personalized advertisement, brand monitoring and viral marketing. The price of this data can be intimidating, and some might be unable or unwilling to pay for it because of its price. If the data was freely available, research that could benefit from this data would be derived more freely, leading to new knowledge. This thesis presents Harvest, a collaborative system for retrieving social data. Harvest is a peer-to-peer system consisting of contributing social network users, inspired by public resource computing. Harvest shares social network account-bound resources to retrieve large social data sets. Contribution is achieved by running an application on the contributors computer like other public resource computing system such as the @home systems. The system implements retrieval of data from Twitter. Experiments on real Twitter data show that the system scales with increased contribution. The data retrieval bandwidth per contributing user is quite low, and the number of contributors needed to achieve a considerably large data retrieval bandwidth is high, but there are no associated financial costs with the system. Harvest would benefit greatly by retrieving data from more sources as this would increase its data retrieval bandwidth, in addition to offer more abundant data.
PublisherUniversitetet i Tromsø
University of Tromsø
The following license file are associated with this item:
Showing items related by title, author, creator and subject.
Condition Monitoring System for Internal Blowout Prevention (IBOP) in Top Drive Assembly System using Discrete Event Systems and Deep Learning Approaches Noori, Nadia Saad; Waag, Tor Inge; Bianchi, Filippo Maria (Conference object; Konferansebidrag, 2020-07-19)<p>Offshore oil drilling is a complex process that requires careful coordination of hardware and control systems. Fault monitoring systems play an important role in such systems for safe and profitable operations. Thus, predictive maintenance and monitoring operating conditions of drilling systems are critical to the overall production cycle. In this paper, we are addressing the topic of condition ...
Holm, Ragnhild Kosmo (Master thesis; Mastergradsoppgave, 2015-06-01)Nexans Rognan is a cable manufacturer located in Nordland County. Each new cable order have a set of requirements provided by the customer. The cable specifications change in terms of characteristics of fibre optical elements, type and quality of cable armouring and dimension and amounts of electrical conductors. Due to the variety in different cables produced, they also need a wide array of ...
Marzullo, Keith; Lauvset, Kåre J.; Johansen, Dag (Research report; Forskningsrapport, 2000-03-02)Distributed systems are becoming harder to manage, in part because the uses we put to distributed systems are rapidly changing. Hence, the software used to manage a distributed system needs to be flexible enough to accommodate these new uses. It also has to be secure enough to not allow unauthorized changes to be made to the system. We present a library and a kernel that supports the management ...