How do I evaluate journals?
How do I evaluate journals?
Last Updated (Wednesday, 14 October 2009 20:13) Wednesday, 16 September 2009 17:52
Various methods have been used to evaluate academic journals and create journal rankings. One gets a picture of how competitive the journal is by looking at the acceptance rate vs the rejection rate. Another way is to examine how often articles are cited in subsequent research to gauge a journal's impact. The resources listed below use some of these methods and may be used as a guide to help evaluate academic journals.
Ulrich's is a bibliographic database providing detailed and authoritative information on over 290,000 periodicals (journals, magazines and newspapers) published throughout the world. You can find a description of a specific journal, and it tells you if the journal contains academic/scholarly articles and if the articles are refereed. Publisher details, ISSN, publication dates, abstracting and indexing sources, reviews, table of contents, subscription information are also included.
The CSI Library subscribes to the database, with 1 simultaneous user access. Please use the LOGOUT button at the end of each search session to free the seat for the next user. If you are off campus, you will be prompted to log in. Enter your CSI e-mail username, and your e-mail password to log in.
Journal Citation Reports provides easy access to data that helps evaluate and compare scholarly journals within the sciences and social sciences, using citation data drawn from over 7,500 journals from over 3,300 publishers in over 60 nations. Information available includes:
- Most frequently cited journals in a field
- Hottest journals in a field
- Highest impact journals in a field
- Leading journals in a field
- Related journals in a field
CSI Library has arranged a trial for the resource.
Trial period: 09/14/09 - 10/14/09
Available content: Science Edition 2003 and Social Sciences Edition 2003
Notes: Trial subscriptions are limited to 2003 content only, NOT current content. Also, only 5 simultaneous users are allowed. Please use the LOGOFF button at the end of each search session to free the seat for the next user.
Cabell's provides acceptance rates, review process, as well as topic(s) of articles, manuscript guidelines, type of reader, pulication and contact information for over 6,000 journals in these areas: Accounting, Economics & Finance, Management, Marketing, Educational Curriculum & Methods, Educational Psychology & Administration, Educational Technology & Library Science, and Psychology & Psychiatry.
CSI Library has the following print volumes:
Cabell, D. W. E. (2007). Cabell's directory of publishing opportunities in psychology and psychiatry. Beaumont, Tex.: Cabell Pub.
(Location and Call No.: Reference - BF30 .C25)
Cabell, D. W. E. Z. (Ed.). (2007). Cabell's directory of publishing opportunities in educational technology and library science (1st ed. (2007-2008). ed.). Beaumont, Tex.: Cabell Pub. Co.
(Location and Call No.: Library Administration Office - Z286 .E3 C324 2007)
Cabell's directory of publishing opportunities in management, 2006-2007(2006).
S.l.: Cabell Pub.
(Location and Call No.: Reference - HD28 .C14 2006/2007)
Cabell, D. W. E., & English, D. L. Z. (Eds.). (2006). Cabell's directory of publishing opportunities in marketing, 2006-2007 (10th ed. (2006-2007) ed.). Beaumont, Texas:
Cabell Publishing.
(Location and Call No.: Reference & Stacks 3rd Floor - HF5410 .C23 2006/2007
Cabell, D. W. E., & English, D. L. (2002). Cabell's directory of publishing opportunities
in educational curriculum and methods. Beaumont, Tex.: Cabell Pub. Co.
(Location and Call No.: Reference - LB1028 .C322)
Cabell, D. W. E., & English, D. L. (2002). Cabell's directory of publishing opportunities
in educational psychology and administration. Beaumont, Tex.: Cabell Pub. Co.
(Location and Call No.: Reference - LB1028 .C323)
Cabell, D. W. E., & English, D. L. (2006). Cabell's directory of publishing opportunities
in accounting. Beaumont, Tex.: Cabell Pub. Co.
(Location and Call No.: Reference - H91 .C23)
Cabell, D. W. E., & English, D. L. (2006). Cabell's directory of publishing opportunities
in economics and finance. Beaumont, Tex.: Cabell Pub. Co.
(Location and Call No.: Reference - H91 .C24)
Cabell, D. W. E. Z. (1993). Cabell's directory of publishing opportunities in nursing.
Beaumont, Tex.: Cabell Pub. Co.
(Location and Call No.: Reference - RT24 .C3)
ScienceWatch.com provides a behind-the-scenes look at the scientists, journals, institutions, nations, and papers selected by Essential Science Indicators from Thomson Reuters and other products of the Research Services Group.
ScienceWatch uses citation analysis to develop rankings of top 10 journals, fast breaking papers, hot papers, emerging research fronts, fast moving fronts, top topics, rising stars, and more in various disciplines, including biology, chemistry, medicine, and physics.
Sci-Bytes from ISI provide ranking and impact factor for selective journals. The list is located at http://www.sciencegateway.org/rank/index.html
Selective Journal Rankings
Top Journals Ranked by Impact: All Fields or Multidisciplinary Fields
Top Ten Most-Cited Journals (All Fields), 1999-2009Top Ten Most-Cited Journals (All Fields), 1996-2006
Top 10 Most Prolific Journals, 1998-2008
Most-Cited Journals in Social Sciences, 1997-2007
Journals Ranked by Impact: Multidisciplinary Sciences
The Ten Most-Cited Journals of 2006
Highest-Impact Journals (All Fields), 1995-2005
Top 10 Journals Ranked by Impact: Specific Fields
Anthropology
Journals Ranked by Impact: Anthropology
Astronomy & Astrophysics
Top 10 Journals Ranked by Impact: Astronomy & Astrophysics
Biology
Journal Rankings in Molecular Biology and Genetics, 1997-2007
Journals Ranked by Impact: Microbiology
Journals Ranked by Impact: Marine and Freshwater Biology
Business, Finance
Journals Ranked by Impact: Business
Journals Ranked by Impact: Business, Finance
Chemistry
Journals Ranked by Impact: Chemistry (multidisciplinary)
Journals Ranked by Impact: Organic Chemistry
Criminology & Penology
Journals Ranked by Impact: Criminology & Penology
Economics
Journals Ranked by Impact: Economics
Education
Top 20 Journals in Education: Ranked by 2007 Impact Factor
Journals Ranked by Impact: Education & Educational Research
Engineering
Journals Ranked by Impact: Electrical & Electronic Engineering
Journals Ranked by Impact: Metallurgy & Metallurgical Engineering
Environmental Studies
Journals Ranked by Impact: Environmental Studies
Journal Ranking in Ecology and Environmental Sciences, 1998-2008
Food Science & Techology
Journals Ranked by Impact: Food Science & Technology
Geography
Journals Ranked by Impact: Geography
Information Science and Library Science
Journals Ranked by Impact: Information Science & Library Science
International Relations
Journals Ranked by Implact: International Relations
Law
Journals Ranked by Impact: Law
Linguistics
Journals Ranked by Impact: Linguistics
Journals Ranked by Impact: Applied Linguistics
Literary Studies
Literary Studies: Most Prolific U.S. Institutions, 2003-07 (CUNY ranked No.2)
Management
Journals Ranked by Impact: Management
Materials Science
Journals Ranked by Impact: Materials Science ( Multidisciplinary)
Mathematics
Journals Ranked by Impact: Mathematics
Journals Ranked by Impact: Applied Mathematics
Medicine
Journals Ranked by Impact: Geriatrics & Gerontology
Journals Ranked by Impact: Surgery
Journals Ranked by Impact: Psychiatry
Physics
Journals Ranked by Impact: Physics
Journals Ranked by Impact: Physics - Fluids & Plasmas
Journals Ranked by Impact: Condensed-Matter Physics
Plant Sciences
Journals Ranked by Impact: Plant Sciences
Political Science
Journals Ranked by Impact: Political Science
Psychology
APA publishes yearly statistics on acceptance rates for psychology journals
Sociology
Journals Ranked by Impact: Sociology
The following definition is from Cabell's Directory of Publishing Opportunities at http://www.cabells.com/using.aspx#x9
With some exceptions, a refereed article is one that is blind reviewed and has two external reviewers. The blind review requirement and the use of external reviewers are consistent with the research criteria of objectivity and of knowledge.
The use of a blind review process means that the author of the manuscript is not made known to the reviewer. With the large number of reviewers and journals, it is also likely that the name of the reviewers for a particular manuscript is not made known to the author. Thus, creating a double blind review process. Since the author and reviewers are frequently unknown, the manuscript is judged on its merits rather than on the reputation of the author and/or the author's influence on the reviewers.
The use of two (2) reviewers permits specialists familiar with research similar to that presented in the paper to judge whether the paper makes a contribution to the advancement of knowledge. When two reviewers are used it provides a broader perspective for evaluating the research. This perspective is further widened by the discussion between the editor and reviewers in seeking to reconcile these perspectives.
In contrast to these criteria, some journals that have attained a reputation for quality do not use either a blind review process or external reviewers. The most notable is Harvard Business Review that uses an editorial review process. Its reputation for quality results from its readership whose continual subscription attests to its quality.
In addition to these criteria, some researchers include the journal's acceptance rate in their definition of a refereed journal. However, the method of calculating acceptance rates varies among journals. Some journals use all manuscripts received as a base for computing this rate. Other journals allow the editor to choose which papers are sent to reviewers and calculate the acceptance rate on those that are reviewed. Also, many editors do not maintain accurate records on this data and provide only a rough estimate.
Furthermore, the number of people associated with a particular area of specialization influences the acceptance rate. If only a few people can write papers in an area, it tends to increase the journal's acceptance rate.
Although the type of review process and use of external reviewers is one possible definition of a refereed article, it is not the only criteria. Judging the usefulness of a journal to the advancement of knowledge requires the reader to be familiar with many journals in their specialization and make their own evaluations.
The following information is from: http://www.sciencegateway.org/impact/index.html
Journal Impact Factor is from Journal Citation Report (JCR), a product of Thomson ISI
(Institute for Scientific Information). JCR provides quantitative tools for evaluating journals. The impact factor is one of these; it is a measure of the frequency with which the "average article" in a journal has been cited in a given period of time.
The impact factor for a journal is calculated based on a three-year period, and can be considered to be the average number of times published papers are cited up to two years after publication. For example, the impact factor 2009 for a journal would be calculated as follows:
A = the number of times articles published in 2008-9 were cited in indexed journals
during 2010
B = the number of articles, reviews, proceedings or notes published in 2008-9
impact factor 2010 = A/B
(note that the impact factor 2009 will be actually published in 2010, because it could not be calculated until all of the 2010 publications had been received. Impact factor 2010 will be published in 2011)
Impact factor of Nature, Science and Cell journals can be found on their journal websites.
Acceptance rate refers to the number of manuscripts accepted for publication relative to the number of manuscripts submitted within the last year. The method of calculating acceptance rates varies among journals (http://www.cabells.com/using.aspx#x1)
Except for refereed journal, the following definitions are adapted from the ALA Glossary of Library and Information Science.
| Serial | A publication in any medium issued in successive parts bearing numerical or chronological designations and intended to be continued indefinitely. |
| Periodical | A serial appearing or intended to appear indefinitely at regular or stated intervals. Magazines, journals and newspapers are all periodicals. |
| Journal | A periodical containing scholarly articles and/or disseminating current information on research and development in a particular subject field. |
| Magazine | A periodical for general reading containing articles, stories, photographs and advertisements on a variety of subjects. |
| Refereed/Peer-reviewed Journal | A refereed journal has a structured reviewing system in which at least two reviewers, excluding in-house editors, evaluate each manuscript and advise the editor as to acceptance or rejection. Refereed is oftern used interchangeably with peer-reviewed. |