spacer blank blank blank blank blank blank blank blank blank blank blank blank
blank
blank logo blank organization name organization name organization name organization name organization name organization name organization name organization name
blank blank
issues link to access link to privacy link to defamation link to divide blank blank
One Internet with Equal Access for All
spacer blank blank blank blank blank blank blank blank blank blank blank blank
blank home link to turing link to disabled link to elderly link to health link to race link to women link to youth link to action link to research
blank blank blank blank blank
blank
blank blank blank
link to news
blank
link to about
blank
link to Internet services
blank
link to volunteer or intern
blank
link to join / donate
blank
blank
    
blank
 
Bobby Approved (v 3.2)
blank Terms of Service, Other Policies, and
Copyright ©2000-2004
Online Policy Group, Inc.

blank
blank blank blank
blank
blank

Research: Online Service Provider Assessment Project: Methodology

The latest version of this document is available online at http://www.onlinepolicy.org/research/ospa/methodology.shtml.

The appendixes are confidential and provided only on an as-needed basis to staff and volunteers actually monitoring online service providers.

Contents

Introduction
Reporting
Accountability
Confidentiality
Acknowledgments
Comments and Updates
Researchers
History
Technology
Policies
Accounts and Access Levels
Web Browsing
Web Test Suite
Email
Search Facility
Chat
Message Boards
Instant Messaging
Member Web Sites
Online Policy Email Accounts
Appendixes

Introduction

The goal of this online service assessment methodology is to produce reports about the conditions of use that online service providers (OSP) offers to various constituent communities.

Reporting

Detailed test results will be compiled into a confidential test results document.

Then, reports summarizing concisely the findings from the application of this methodology to each online service provider will be prepared without disclosing the specific details of the assessment methodology. These reports will assist OPG and other organizations in making recommendations to the online service providers about improvements to the online experience of the constituent communities. These recommendations may be used to engage online service providers in an effort to improve the services they provide.

Once enough online service providers have been analyzed using a similar methodology, summary reports will detail comparisons of the conditions of use for each constituent community on various online service providers. If certain online service providers are intransigent about service that is not fair, accurate, and inclusive to a constituent community, the report may be provided to that community, select media outlets, and the general public as appropriate.

Accountability

Detailed test results and the specific details of the assessment methodology may be audited, providing that project management and those requesting an audit can agree upon and fund an audit by an independent agency willing to guarantee confidentiality of the detailed test results and the specific details of the assessment methodology.

Confidentiality

Details of the assessment methodology will be kept confidential because if OSPs become aware of the details of the assessment methodology, they may be able to make cosmetic adjustments to their service that do not address the underlying issues the service may have with respect to the constituent community. The appendixes containing the actual test items are only provided to staff and volunteers actually engaged in testing.

Acknowledgments

The initial methodology for the online service provider assessment project was developed by former GLAAD Director of Online Community Development Will Doherty and funded by GLAAD.

report cover image
The inspiration for the project came from Access Denied v. 1.0, edited by former GLAAD Digital Media Director Loren Javier. Many thanks to Loren for his leadership and for his review comments on this document.

Thanks to the interns and volunteers who have contributed countless hours of labor to produce these reports, especially to Alberto Curotto, Roman Frillarte, Andy Grigsby, David Gudelunas of the Annenberg School for Communication - University of Pennsylvania, Kate Kennedy of Ohio State University, Wesley Leverenz of University of Wisconsin at Madison, Alex Marthews of the University of California at Berkeley's Goldman School of Public Policy, Margaret Meyers of Yale University, Lee Wasserman, Genevieve York-Erwin of Yale University, and many others who wish to or must remain anonymous. David Gudelunas deserves special mention for assistance with statistical analysis and drafting of this report.

GLAAD Educational Services Manager Jane Ralph assisted by recruiting interns for the project and Dilia Loe, GLAAD Deputy Director for Programs and Operations, offered sage advice and supervisorial encouragement. Thanks to GLAAD Executive Director Joan Garry and other LGBT community representatives who participated in various meetings and discussions with AOL management on these topics.

Thanks to GLAAD Center for the Study of Media & Society Director Jason Heffner, GLAAD Research Advisory Board member John Bowes of the University of Washington at Seattle, and to Christopher Hunter of the Annenberg School of Communication - University of Pennsylvania for improvements in the project methodology. Special thanks to statistician Mark Thompson for his review of the project methodology and training on statistical methods.

Comments and Updates

To provide comments on this document or to obtain copies of this and related online service provider assessment documents, please contact ospa@onlinepolicy.org.

Revision 1.100 of January 31, 2001

Next or Top

top of page

blank
blank