Cognition in Structured Electronic Environments: references

CiteULike: dartar's web_epistemology

• Do people trust their eyes more than ears?: media bias in detecting cues of expertise
  In CHI '05: CHI '05 extended abstracts on Human factors in computing systems (2005), pp. 1745-1748.
  Jens Riegelsberger, Angela Sasse, John Mccarthy
• How opinions are received by online communities: a case study on amazon.com helpfulness votes
  In WWW '09: Proceedings of the 18th international conference on World wide web (2009), pp. 141-150.
  
  There are many on-line settings in which users publicly express opinions. A number of these offer mechanisms for other users to evaluate these opinions; a canonical example is Amazon.com, where reviews come with annotations like "26 of 32 people found the following review helpful." Opinion evaluation appears in many off-line settings as well, including market research and political campaigns. Reasoning about the evaluation of an opinion is fundamentally different from reasoning about the opinion itself: rather than asking, "What did Y think of X?", we are asking, "What did Z think of Y's opinion of X?" Here we develop a framework for analyzing and modeling opinion evaluation, using a large-scale collection of Amazon book reviews as a dataset. We find that the perceived helpfulness of a review depends not just on its content but also but also in subtle ways on how the expressed evaluation relates to other evaluations of the same product. As part of our approach, we develop novel methods that take advantage of the phenomenon of review "plagiarism" to control for the effects of text in opinion evaluation, and we provide a simple and natural mathematical model consistent with our findings. Our analysis also allows us to distinguish among the predictions of competing theories from sociology and social psychology, and to discover unexpected differences in the collective opinion-evaluation behavior of user populations from ifferent countries.
  Cristian Danescu-Niculescu-Mizil, Gueorgi Kossinets, Jon Kleinberg, Lillian Lee
• Indicators of accuracy of consumer health information on the Internet: a study of indicators relating to information for managing fever in children in the home.
  Journal of the American Medical Informatics Association : JAMIA, Vol. 9, No. 1. (b 2002), pp. 73-79.
  
  OBJECTIVES: To identify indicators of accuracy for consumer health information on the Internet. The results will help lay people distinguish accurate from inaccurate health information on the Internet. DESIGN: Several popular search engines (Yahoo, AltaVista, and Google) were used to find Web pages on the treatment of fever in children. The accuracy and completeness of these Web pages was determined by comparing their content with that of an instrument developed from authoritative sources on treating fever in children. The presence on these Web pages of a number of proposed indicators of accuracy, taken from published guidelines for evaluating the quality of health information on the Internet, was noted. MAIN OUTCOME MEASURES: Correlation between the accuracy of Web pages on treating fever in children and the presence of proposed indicators of accuracy on these pages. Likelihood ratios for the presence (and absence) of these proposed indicators. RESULTS: One hundred Web pages were identified and characterized as "more accurate" or "less accurate." Three indicators correlated with accuracy: displaying the HONcode logo, having an organization domain, and displaying a copyright. Many proposed indicators taken from published guidelines did not correlate with accuracy (e.g., the author being identified and the author having medical credentials) or inaccuracy (e.g., lack of currency and advertising). CONCLUSIONS: This method provides a systematic way of identifying indicators that are correlated with the accuracy (or inaccuracy) of health information on the Internet. Three such indicators have been identified in this study. Identifying such indicators and informing the providers and consumers of health information about them would be valuable for public health care.
  D Fallis, M Frické
• Toward an epistemology of Wikipedia
  J. Am. Soc. Inf. Sci. Technol., Vol. 59, No. 10. (2008), pp. 1662-1674.
  
  Wikipedia (the “free online encyclopedia that anyone can edit”) is having a huge impact on how a great many people gather information about the world. So, it is important for epistemologists and information scientists to ask whether people are likely to acquire knowledge as a result of having access to this information source. In other words, is Wikipedia having good epistemic consequences? After surveying the various concerns that have been raised about the reliability of Wikipedia, this article argues that the epistemic consequences of people using Wikipedia as a source of information are likely to be quite good. According to several empirical studies, the reliability of Wikipedia compares favorably to the reliability of traditional encyclopedias. Furthermore, the reliability of Wikipedia compares even more favorably to the reliability of those information sources that people would be likely to use if Wikipedia did not exist (viz., Web sites that are as freely and easily accessible as Wikipedia). In addition, Wikipedia has a number of other epistemic virtues (e.g., power, speed, and fecundity) that arguably outweigh any deficiency in terms of reliability. Even so, epistemologists and information scientists should certainly be trying to identify changes (or alternatives) to Wikipedia that will bring about even better epistemic consequences. This article suggests that to improve Wikipedia, we need to clarify what our epistemic values are and to better understand why Wikipedia works as well as it does.
  Don Fallis
• WIKIPEDIA and the Epistemology of Testimony
  Episteme, Vol. 6, No. 1. (2009), pp. 8-24.
  Deborah Tollefsen
• Web 2.0 vs. the Semantic Web: A Philosophical Assessment
  Episteme, Vol. 6, No. 1. (2009), pp. 25-37.
  Luciano Floridi
• The Fate of Expertise after WIKIPEDIA
  Episteme, Vol. 6, No. 1. (2009), pp. 52-73.
  Lawrence Sanger
• The Epistemic Cultures of Science and WIKIPEDIA: A Comparison
  Episteme, Vol. 6, No. 1. (2009), pp. 38-51.
  Brad Wray
• Prediction Markets: The Practical and Normative Possibilities for the Social Production of Knowledge
  Episteme, Vol. 6, No. 1. (2009), pp. 91-106.
  George Bragues
• On Trusting WIKIPEDIA
  Episteme, Vol. 6, No. 1. (2009), pp. 74-90.
  PD Magnus
• Introduction: The Epistemology of Mass Collaboration
  Episteme, Vol. 6, No. 1. (2009), pp. 1-7.
  Don Fallis
• Toward an Epistemology of Wikipedia
  Social Science Research Network Working Paper Series (06 September 2008)
  
  Wikipedia (the "free online encyclopedia that anyone can edit") is having a huge impact on how a great many people gather information about the world. So, it is important for epistemologists and information scientists to ask whether or not people are likely to acquire knowledge as a result of having access to this information source. In other words, is Wikipedia having good epistemic consequences? After surveying the various concerns that have been raised about the reliability of Wikipedia, this paper argues that the epistemic consequences of people using Wikipedia as a source of information are likely to be quite good. According to several empirical studies, the reliability of Wikipedia compares favorably to the reliability of traditional encyclopedias. Furthermore, the reliability of Wikipedia compares even more favorably to the reliability of those information sources that people would be likely to use if Wikipedia did not exist (viz., websites that are as freely and easily accessible as Wikipedia). In addition, Wikipedia has a number of other epistemic virtues (e.g., power, speed, and fecundity) that arguably outweigh any deficiency in terms of reliability. Even so, epistemologists and information scientists should certainly be trying to identify changes (or alternatives) to Wikipedia that will bring about even better epistemic consequences. This paper suggests that, in order to improve Wikipedia, we need to clarify what our epistemic values are and we need a better understanding of why Wikipedia works as well as it does.
  Don Fallis
• Information quality work organization in Wikipedia
  Journal of the American Society for Information Science and Technology, Vol. 59, No. 6. (2008), pp. 983-1001.
  
  The classic problem within the information quality (IQ) research and practice community has been the problem of defining IQ. It has been found repeatedly that IQ is context sensitive and cannot be described, measured, and assured with a single model. There is a need for empirical case studies of IQ work in different systems to develop a systematic knowledge that can then inform and guide the construction of context-specific IQ models. This article analyzes the organization of IQ assurance work in a large-scale, open, collaborative encyclopedia-Wikipedia. What is special about Wikipedia as a resource is that the quality discussions and processes are strongly connected to the data itself and are accessible to the general public. This openness makes it particularly easy for researchers to study a particular kind of collaborative work that is highly distributed and that has a particularly substantial focus, not just on error detection but also on error correction. We believe that the study of those evolving debates and processes and of the IQ assurance model as a whole has useful implications for the improvement of quality in other more conventional databases.
  B Stvilia, MB Twidale, LC Smith, L Gasser
• Trust on the world wide web: a survey
  Found. Trends Web Sci., Vol. 1, No. 2. (2006), pp. 131-197.
  
  The success of the Web is based largely on its open, decentralized nature; at the same time, that allows for a wide range of perspectives and intentions. Trust is required to foster successful interactions and to filter the abundance of information. In this review, we present a comprehensive survey of trust on the Web in all its contexts. Three main targets of trust are identified: content, services, and people. Trust in the content on the Web, including webpages, websites, and Semantic Web data is addressed first. Then, we move on to look at services including peer-to-peer environments and Web services. This includes a discussion of Web policy frameworks for access control. People are the final group, where we look at the role of trust in web-based social networks and algorithms for inferring trust relationships. Finally, we review applications that rely on trust and address how they utilize trust to improve functionality and interface.
  Jennifer Golbeck
• A framework for web science
  Found. Trends Web Sci., Vol. 1, No. 1. (January 2006), pp. 1-130.
  
  This text sets out a series of approaches to the analysis and synthesis of the World Wide Web, and other web-like information structures. A comprehensive set of research questions is outlined, together with a sub-disciplinary breakdown, emphasising the multi-faceted nature of the Web, and the multi-disciplinary nature of its study and development. These questions and approaches together set out an agenda for Web Science, the science of decentralised information systems. Web Science is required both as a way to understand the Web, and as a way to focus its development on key communicational and representational requirements. The text surveys central engineering issues, such as the development of the Semantic Web, Web services and P2P. Analytic approaches to discover the Web's topology, or its graph-like structures, are examined. Finally, the Web as a technology is essentially socially embedded; therefore various issues and requirements for Web use and governance are also reviewed.
  Tim Berners-Lee, Wendy Hall, James Hendler, Kieron O'Hara, Nigel Shadbolt, Daniel Weitzner
• Crowdsourcing, Attention and Productivity
  
  
  The tragedy of the digital commons does not prevent the copious voluntary production of content that one witnesses in the web. We show through an analysis of a massive data set from YouTube that the productivity exhibited in crowdsourcing exhibits a strong positive dependence on attention, measured by the number of downloads. Conversely, a lack of attention leads to a decrease in the number of videos uploaded and the consequent drop in productivity, which in many cases asymptotes to no uploads whatsoever. Moreover, uploaders compare themselves to others when having low productivity and to themselves when exceeding a threshold.
  Bernardo Huberman, Daniel Romero, Fang Wu
• How the Web is changing the way we trust
  In Current Issues in Computing and Philosophy (2008)
  
  Several studies have addressed the issue of what makes information on the World Wide Web credible. Understanding how we select reliable sources of information and how we estimate their credibility has been drawing an increasing interest in the literature on the Web. In this paper I argue that the study of information search behavior can provide to social and cognitive scientists an extraordinary insight into the processes mediating knowledge acquisition by epistemic deference. I review some of the major methodological proposals to study how users judge the reliability of a source of information in the World Wide Web and I propose an alternative framework inspired by the idea that–as cognitively evolved organisms–we adopt to this aim strategies that are as effortless as possible. I argue in particular that Web users engaging in information search are likely to develop simple heuristics to select in a computationally viable way trustworthy sources of information and I discuss the consequences of this hypothesis and related research directions.
  Dario Taraborelli
• Empirical research in on-line trust: a review and critical assessment
  International Journal of Human-Computer Studies, Vol. 58, No. 6. (June 2003), pp. 783-812.
  
  Lack of trust is one of the most frequently cited reasons for consumers not purchasing from Internet vendors. During the last four years a number of empirical studies have investigated the role of trust in the specific context of e-commerce, focusing on different aspects of this multi-dimensional construct. However, empirical research in this area is beset by conflicting conceptualizations of the trust construct, inadequate understanding of the relationships between trust, its antecedents and consequents, and the frequent use of trust scales that are neither theoretically derived nor rigorously validated. The major objective of this paper is to provide an integrative review of the empirical literature on trust in e-commerce in order to allow cumulative analysis of results. The interpretation and comparison of different empirical studies on on-line trust first requires conceptual clarification. A set of trust constructs is proposed that reflects both institutional phenomena (system trust) and personal and interpersonal forms of trust (dispositional trust, trusting beliefs, trusting intentions and trust-related behaviours), thus facilitating a multi-level and multi-dimensional analysis of research problems related to trust in e-commerce.
  Sonja Grabner-Kräuter, Ewald Kaluscha
• Web search engines and distributed assessment systems
  Pragmatics & Cognition, Vol. 14, No. 2. (2006), pp. 387-409.
  
  I analyse the impact of search engines on our cognitive and epistemic practices. For that purpose, I describe the processes of assessment of documents on the Web as relying on distributed cognition. Search engines together with Web users, are distributed assessment systems whose task is to enable efficient allocation of cognitive resources of those who use search engines. Specifying the cognitive function of search engines within these distributed assessment systems allows interpreting anew the changes that have been caused by search engine technologies. I describe search engines as implementing reputation systems and point out the similarities with other reputation systems. I thus call attention to the continuity in the distributed cognitive processes that determine the allocation of cognitive resources for information gathering from others.
  Christophe Heintz
• Extracting Trust from Domain Analysis: A Case Study on the Wikipedia Project
  Autonomic and Trusted Computing (2006), pp. 362-373.
  
  The problem of identifying trustworthy information on the World Wide Web is becoming increasingly acute as new tools such as wikis and blogs simplify and democratize publications. Wikipedia is the most extraordinary example of this phenomenon and, although a few mechanisms have been put in place to improve contributions quality, trust in Wikipedia content quality has been seriously questioned. We thought that a deeper understanding of what in general defines high-standard and expertise in domains related to Wikipedia – i.e. content quality in a collaborative environment – mapped onto Wikipedia elements would lead to a complete set of mechanisms to sustain trust in Wikipedia context. Our evaluation, conducted on about 8,000 articles representing 65% of the overall Wikipedia editing activity, shows that the new trust evidence that we extracted from Wikipedia allows us to transparently and automatically compute trust values to isolate articles of great or low quality.
  Pierpaolo Dondio, Stephen Barrett, Stefan Weber, Jean Seigneur
• Social Networks and Trust (Theory and Decision Library C)
  (31 March 2002)
  
  Social Networks and Trust discusses two possible explanations for the emergence of trust via social networks. If network members can sanction untrustworthiness of actors, these actors may refrain from acting in an untrustworthy manner. Moreover, if actors are informed regularly about trustworthy behavior of others, trust will grow among these actors.
  A unique combination of formal model building and empirical methodology is used to derive and test hypotheses about the effects of networks on trust. The models combine elements from game theory, which is mainly used in economics, and social network analysis, which is mainly used in sociology.
  The hypotheses are tested (1) by analyzing contracts in information technology transactions from a survey on small and medium-sized enterprises and (2) by studying judgments of subjects in a vignette experiment related to hypothetical transactions with a used-car dealer.
  Vincent Buskens
• Reputation in Artificial Societies: Social Beliefs for Social Order (Multiagent Systems, Artificial Societies, and Simulated Organizations)
  (31 October 2002)
  
  Reputation In Artificial Societies discusses the role of reputation in the achievement of social order. The book proposes that reputation is an agent property that results from transmission of beliefs about how the agents are evaluated with regard to a socially desirable conduct. This desirable conduct represents one or another of the solutions to the problem of social order and may consist of cooperation or altruism, reciprocity, or norm obedience.
  Reputation In Artificial Societies distinguishes between image (direct evaluation of others) and reputation (propagating meta­belief, indirectly acquired) and investigates their effects with regard to both natural and electronic societies. The interplay between image and reputation, the processes leading to them and the set of decisions that agents make on their basis are demonstrated with supporting data from agent­based simulations.
  Rosaria Conte, Mario Paolucci
• Are people biased in their use of search engines?
  Commun. ACM, Vol. 51, No. 2. (February 2008), pp. 49-52.
  
  Search-engines are among the most used resources on the Internet. Google [2], for example, now hosts over eight billion items and returns answers to queries in a fraction of a second; thus realising some of the more far-fetched predictions envisioned by the pioneers of the World Web Web [1]. In the present study, we assess whether people are biased in their use of a search-engine; specifically we assess whether people tend to click on those items that are presented as being the most relevant in the search engine’s result list (i.e., those items listed at the top of the result list). To test this bias hypothesis, we simulated the Google environment systematically reversing Google’s normal relevance-ordering of the items presented to users. Our results show that people do manifest some bias, favouring items at the top of result lists, though they also seek out high-relevance items listed further down a list. Later, we discuss whether this bias arises from people’s implicit trust in search engines such as Google, or some other effect.
  Mark Keane, Maeve O'Brien, Barry Smyth
• Google and the Mind: Predicting Fluency With PageRank
  Psychological Science, Vol. 18, No. 12. (December 2007), pp. 1069-1076.
  Griffiths, L Thomas, Steyvers, Mark, Firl, Alana
• Web search strategies and human individual differences: Cognitive and demographic factors, Internet attitudes, and approaches
  Journal of the American Society for Information Science and Technology, Vol. 56, No. 7. (2005), pp. 741-756.
  
  The research reported here was an exploratory study that sought to discover the effects of human individual differences on Web search strategy. These differences consisted of (a) study approaches, (b) cognitive and demographic features, and (c) perceptions of and preferred approaches to Web-based information seeking. Sixty-eight master's students used AltaVista to search for information on three assigned search topics graded in terms of complexity. Five hundred seven search queries were factor analyzed to identify relationships between the individual difference variables and Boolean and best-match search strategies. A number of consistent patterns of relationship were found. As task complexity increased, a number of strategic shifts were also observed on the part of searchers possessing particular combinations of characteristics. A second article (published in this issue of JASIST; Ford, Miller, & Moss, 2005) presents a combined analyses of the data including a series of regression analyses.
  Nigel Ford, David Miller, Nicola Moss
• Research on Web search behavior
  Library & Information Science Research, Vol. 23, No. 2. ( 2001), pp. 167-185.
  
  This article reviews studies, conducted between 1995 and 2000, on Web search behavior. These studies reported on children as well as on adults. Most of the studies on children described their interaction with the Web. Research on adult searchers focused on describing search patterns, and many studies investigated effects of selected factors on search behavior, including information organization and presentation, type of search task, Web experience, cognitive abilities, and affective states. What distinguishes the research on adult searchers is the use of multiple data-gathering methods. The research on Web search behavior reflects researchers' commitment to examine users in their information environment and exhibits rigor in design and data analysis. However, many studies lack external validity. Implications of this body of research are discussed.
  Ingrid Hsieh-Yee
• The New Metrics of Scholarly Authority
  The Chronicle (15 June 2007)
  Michael Jensen
• Digital Media, Youth, and Credibility (John D. and Catherine T. MacArthur Foundation Series on Digital Media and Learning)
  (01 December 2007)
  
  Today we have access to an almost inconceivably vast amount of information, from sources that are increasingly portable, accessible, and interactive. The Internet and the explosion of digital media content have made more information available from more sources to more people than at any other time in human history. This brings an infinite number of opportunities for learning, social connection, and entertainment. But at the same time, the origin of information, its quality, and its veracity are often difficult to assess. This volume addresses the issue of credibility--the objective and subjective components that make information believable--in the contemporary media environment.
  
  The contributors look particularly at youth audiences and experiences, considering the implications of wide access and the questionable credibility of information for youth and learning. They discuss such topics as the credibility of health information online, how to teach credibility assessment, and public policy solutions. Much research has been done on credibility and new media, but little of it focuses on users younger than college students. Digital Media, Youth, and Credibility fills this gap in the literature.
  
  Contributors:
  Matthew S. Eastin, Gunther Eysenbach, Brian Hilligoss, Frances Jacobson Harris, R. David Lankes, Soo Young Rieh, S. Shyam Sundar, Fred W. Weingarten.
  MJ Metzger
• Oxford Handbook of Internet Psychology (Oxford Handbook Series)
  (04 May 2007)
  
  Over one billion people use the Internet globally. Psychologists are beginning to understand what people do online, and the impact being online has on behaviour. It's making us re-think many of our existing assumptions about what it means to be a social being. For instance, if we can talk, flirt, meet people and fall in love online, this challenges many of psychology's theories that intimacy or understanding requires physical co-presence. "The Oxford Handbook of Internet Psychology" brings together many of the leading researchers in what can be termed 'Internet Psychology'. Though a very new area of research, it is growing at a phenomenal pace. In addition to well-studied areas of investigation, such as social identity theory, computer-mediated communication and virtual communities, the volume also includes chapters on topics as diverse as deception and misrepresentation, attitude change and persuasion online, Internet addiction, online relationships, privacy and trust, health and leisure use of the Internet, and the nature of interactivity. With over 30 chapters written by experts in the field, the range and depth of coverage is unequalled, and serves to define this emerging area of research. Uniquely, this content is supported by an entire section covering the use of the Internet as a research tool, including qualitative and quantitative methods, online survey design, personality testing, ethics, and technological and design issues. While it is likely to be a popular research resource to be 'dipped into', as a whole volume it is coherent and compelling enough to act as a single text book. "The Oxford Handbook of Internet Psychology" is the definitive text on this burgeoning field. It will be an essential resource for anyone interested in the psychological aspects of Internet use, or planning to conduct research using the 'net'.
• Aspects of Augmented Social Cognition: Social Information Foraging and Social Search
  Online Communities and Social Computing (2007), pp. 60-69.
  
  In this paper, we summarized recent work in modeling how users socially forage and search for information. One way to bridge between different communities of users is to diversify their information sources. This can be done using not only old mechanisms such as email, instant messages, newsgroups and bulletin boards, but also new ones such as wikis, blogs, social tags, etc. How do users work with diverse hints from other foragers? How do interference effects change their strategies? How can we build tools that help users cooperatively search? We seek theories that might help us answer these questions, or at least point us toward the right directions.
  Ed Chi, Peter Pirolli, Shyong Lam