Examples of assessment tools

This section of the guidebook provides some concrete examples of the assessment tools discussed in the previous section.

Example 1: Research Paper Rubric
Example 2: Checklist
Example 3: Search Report Process Guide
Example 4: Rubric for Poster Presentations
Example 5: Evaluation of Lab Reports
Example 6: Evaluation of Critiques of Scientific Articles
Example 7: Rubric for Original Research Project
Example 8: Evaluation of Instruction

Example 1: Research Paper Rubric

Characteristics to note in the rubric:

  • Language is descriptive, not evaluative.
  • Labels for degrees of success are descriptive ("Expert" "Proficient", etc.); by avoiding the use of letters representing grades or numbers representing points, there is no implied contract that qualities of the paper will "add up" to a specified score or grade or that all dimensions are of equal grading value.
  • This rubric is developed for a specific writing assignment; it would need to be revised to describe the expectations for each specific assignment.


Figure 1: Research Paper Rubric

 
EXPERT
PROFICIENT
APPRENTICE
NOVICE
INTEGRATION OF KNOWLEDGE
The paper demonstrates that the author fully understands and has applied concepts learned in the course. Concepts are integrated into the writer's own insights. The writer provides concluding remarks that show analysis and synthesis of ideas. The paper demonstrates that the author, for the most part, understands and has applied concepts learned in the course. Some of the conclusions, however, are not supported in the body of the paper. The paper demonstrates that the author, to a certain extent, understands and has applied concepts learned in the course. The paper does not demonstrate that the author has fully understood and applied concepts learned in the course.
TOPIC FOCUS
The topic is focused narrowly enough for the scope of this assignment. A thesis statement provides direction for the paper, either by statement of a position or hypothesis. The topic is focused but lacks direction. The paper is about a specific topic but the writer has not established a position. The topic is too broad for the scope of this assignment. The topic is not clearly defined.
DEPTH OF DISCUSSION
In-depth discussion & elaboration in all sections of the paper. In-depth discussion & elaboration in most sections of the paper. The writer has omitted pertinent content or content runs-on excessively. Quotations from others outweigh the writer's own ideas excessively. Cursory discussion in all the sections of the paper or brief discussion in only a few sections.
COHESIVENESS
Ties together information from all sources. Paper flows from one issue to the next without the need for headings. Author's writing demonstrates an understanding of the relationship among material obtained from all sources. For the most part, ties together information from all sources. Paper flows with only some disjointedness. Author's writing demonstrates an understanding of the relationship among material obtained from all sources. Sometimes ties together information from all sources. Paper does not flow - disjointedness is apparent. Author's writing does not demonstrate an understanding of the relationship among material obtained from all sources. Does not tie together information. Paper does not flow and appears to be created from disparate issues. Headings are necessary to link concepts. Writing does not demonstrate understanding any relationships.
SPELLING & GRAMMAR
No spelling &/or grammar mistakes. Minimal spelling &/or grammar mistakes. Noticeable spelling & grammar mistakes. Unacceptable number of spelling and/or grammar mistakes.
SOURCES
More than 5 current sources, of which at least 3 are peer-review journal articles or scholarly books. Sources include both general background sources and specialized sources. Special-interest sources and popular literature are acknowledged as such if they are cited. All web sites utilized are authoritative. 5 current sources, of which at least 2 are peer-review journal articles or scholarly books. All web sites utilized are authoritative. Fewer than 5 current sources, or fewer than 2 of 5 are peer-reviewed journal articles or scholarly books. All web sites utilized are credible. Fewer than 5 current sources, or fewer than 2 of 5 are peer-reviewed journal articles or scholarly books. Not all web sites utilized are credible, and/or sources are not current.
CITATIONS
Cites all data obtained from other sources. APA citation style is used in both text and bibliography. Cites most data obtained from other sources. APA citation style is used in both text and bibliography. Cites some data obtained from other sources. Citation style is either inconsistent or incorrect. Does not cite sources.

Adapted from: Whalen, S. "Rubric from Contemporary Health Issues Research Paper" http://academics.adelphi.edu/edu/hpe/healthstudies/whalen/HED601_r2.shtml

Back to top

Example 2: Checklist

Characteristics to note in this particular checklist:

  • This checklist is given to students when the assignment is given, and students are advised that this checklist can serve as a guide for them.
  • He also advises them that their papers are likely to be stronger if they pay attention to these criteria.
  • This is less formal than a rubric; it is intended to guide students as they work.
  • The instructor tells them that he will choose five papers (20%) to give to the consulting librarian to read; he will take these assessments as advice when he evaluates the papers; the consulting librarian also writes a summary of how well the five papers meet the criteria; the department saves these summaries and over time looks for patterns to determine what should be taught more intentionally.
  • This assessment, then, serves two purposes: to improve student performance and to modify the instruction.

Figure 2: Checklist

Bibliography Checklist for Psychology of Sport (Physical Education 215)
  Criteria
  Sources are authoritative. Articles come from journals whose standards for publication include conscientious editorial review or peer review. Books cited are authored by individuals with appropriate credentials. Web sites are attributed to organizations or individuals with expertise on the topic at hand.
  Sources are current (Older articles are justified).
  Sources are varied. Citations represent various media (book, journal, website, etc.) Where appropriate, diverse points of view are represented. Sources represent a range of publication dates to show the spectrum of thought on the topic, as appropriate.
  Sources are of an appropriate number. At least [five] different sources are included. No single source provides the primary substance for the final product.
  Sources represent appropriate scope for the assignment. Books and journal articles are not too highly specialized for the scope of the paper. General reference citations are used as background material.
  Special-interest web resources are acknowledged as such in the text of the document. Biases are explained.
  Popular literature is included only when appropriate and is acknowledged as such in the text.
  Citations follow APA citation style both in the text and in the list of references.
  Information from sources is integrated into a cohesive text.

Back to top

Example 3: Search Report Process Guide

Characteristics to note in this process guide:

  • This form can provide substance to the brief structured interview type of assessment described in the previous section. It is formative, providing feedback to both the student and the librarian.
  • This form is given to students by the librarian after they have had a group instruction session geared to their specific assignment.
  • After conducting and recording searches, strategies, and results on this form, each student consults individually with a librarian.
  • Self-reporting helps students become aware of the steps in their search process.
  • Individual consultations based on the students' reported strategies allow the librarian to tailor recommendation for refining searches to each student's needs.

Figure 3: Process Guide

Biology
Search Report Process Guide

Initial Topic:________________________________________________________________________
Revised Topic: (if applicable):__________________________________________________________

Research is a recursive process in which we search, revise our search strategy, search again, refine our strategy, etc. Fill in the grid below for each search you perform to track your process. Bring this completed form when you meet with your librarian.

Date of search Tool used (e.g. EBSCOhost Academic Search Premier, General Science Abstracts, etc.) Search terms (write exactly what you typed) Number of results Search Limits (e.g. title or author fields, timeframe, subject) Evaluation of results (e.g. focused on my topic, length of articles, relevance of publication year, scholarly/popular, suitable number, article type, etc.)
           
           
           
           
           

Final Topic: _____________________________________________________________

Back to top

Example 4: Rubric for Poster Presentations

RUBRIC for POSTER PRESENTATIONS
Criteria
Expert
Proficient
Apprentice
Novice

Presentation of Research
  • Prominently positions title/authors of paper
  • Thoroughly but concisely presents main points of introduction, hypotheses/propositions, research methods, results, and conclusions in a well-organized manner
  • Narration and/or answering of questions is engaging, thorough, and adds greatly to the presentation
  • Contains title/authors of paper
  • Adequately presents main points of introduction, hypotheses/proposition, research methods, results, and conclusions in a fairly well-organized manner
  • Narration and/or answering of questions is adequate and adds to the presentation
  • Contains title/authors of paper
  • Presents main points of introduction, hypotheses/propositions, research methods, results, and conclusions but not as sufficiently and not as well-organized
  • Narration and/or answering of questions is somewhat lacking
  • Title/authors absent
  • Does not sufficiently present main points of introduction, hypotheses/propositions, research methods, results, and conclusions and is not well-organized
  • Narration and/or answering of questions is lacking
Visual Presentation
  • Overall visually appealing; not cluttered; colors and patterns enhance readability
  • Uses appropriate font sizes/variations to facilitate the organization, presentation, and readability of the research
  • Graphics (e.g., tables, figures, etc.) are engaging and enhance the text
  • Content is clearly arranged so that the viewer can understand order without narration
  • Overall visually appealing; not cluttered; colors and patterns support readability
  • Adequate use of font sizes/variations to facilitate the organization, presentation, and readability of the research
  • Graphics (e.g., tables, figures, etc.) enhance the text
  • Content is arranged so that the viewer can understand order without narration
  • Visual appeal is adequate; somewhat cluttered; colors and patterns detract from readability
  • Use of font sizes/variations to facilitate the organization, presentation, and readability of the research is somewhat inconsistent/distracting
  • Graphics (e.g., tables, figures, etc.) adequately enhance the text
  • Content arrangement is somewhat confusing and does not adequately assist the viewer in understanding order without narration
  • Not very visually appealing; cluttered; colors and patterns hinder readability
  • Use of font sizes/variations to facilitate the organization, presentation, and readability of the research is inconsistent/distracting
  • Graphics (e.g., tables, figures, etc.) do not enhance the text
  • Content arrangement is somewhat confusing and does not adequately assist the viewer in understanding order without narration
Documentation of Sources, Quality of Sources
  • Cites all data obtained from other sources. APA citation style is accurate
  • Cites most data obtained from other sources. APA citation style is accurate
  • Cites some data obtained from other sources. Citation style is either inconsistent or incorrect.
  • Does not cite sources
Spelling & Grammar
  • No spelling & grammar mistakes
  • Minimal spelling & grammar mistakes
  • Noticeable spelling and grammar mistakes
  • Unacceptable number of spelling and/or grammar mistakes
Comments:

Swygart-Hobaugh, A. J.

Back to top

Example 5: Evaluation of Lab Reports

Expert
Proficient
Apprentice
Novice
Introduction
Presents a clear summary of the aims of the study and its significance. Briefly describes experimental design. Probably includes one or more references to supporting sources.
Either lacks clarity or is missing one of the primary elements.
Weak or missing primary elements.
No real introduction.
Materials and Methods
Gives the reader a clear picture of the methods and materials used. Does not use prescriptive language. Uses specific, not general, terminology. Detailed, step-by-step procedures are clearly referenced. Avoids long, redundant descriptions.
Some methods are presented so briefly and/or vaguely that it is unclear how or why they were done. May be some written as a protocol rather than a description.
Some methods are omitted; others are presented in a piecemeal, vague form.
Methods barely mentioned.
Results
All figures and tables have titles and legends. All results are clearly presented, with a logical sequence. Controls are clearly indicated.
Some data may be missing, or legends may be brief, vague or uninformative.
Data is presented haphazardly. It is sometimes not possible to tell what material or procedure was used to obtain the data.
No logical connection between methods and data. Irrelevant data may be included, and relevant data left out. No legends.
Discussion
It is clear that the methods and results have been understood. The results (including controls) are related to the questions posed and analyzed for their effectiveness. Possible explanations for inconsistencies and/or unexpected results are given.
There may be some lack of clarity. Did the writer understand why certain methods were used, and how the results could shed light on the questions asked? Incomplete analysis of inconsistencies and unexpected results.
Very little analysis of the results. Statements are vague and general. Inconsistencies are explained by 'human error' or something similar.
Mostly a restatement of results. No analysis given. No recognition of error sources. No understanding of controls.
Cohesiveness
It is clear that the report covers a group of related procedures with a clear set of goals.
Sometimes the goals are not clearly related to the report. Some fragmentation occurs, with methods and results apparently unrelated to each other.
Transitions are abrupt. Each day's work seems unrelated to the next's. Aims are not clearly present throughout.
Disjointed. No flow. Very little use of headings, or explanatory sentences.
Spelling/grammar
No spelling or grammatical errors.
An occasional error.
Apparently not proofread for errors.
Frequent grammatical errors: incomplete sentences, tense changes, misspellings.

J. Cardon

Back to top

Example 6: Evaluation of Critiques of Scientific Articles

Expert
Proficient
Apprentice
Novice
Introduction

Clearly summarizes the aims of and methods used by the authors.

Summary is complete, but lacks clarity.

Picture communicated is not clear; connection to paper is not obvious.

No real introduction.
Data presentation
There is a clear understanding of experimental design, especially controls. It is also clear that you understand what was observed and how it relates to the authors' model or hypothesis.
Some parts of the experiments have not been understood. You may not have a clear grasp of the model being tested, or the relevance of the data
There are significant gaps in understanding, or inaccuracies in reporting the data. You have shown some understanding, but there are clearly large parts of the paper that you haven't mastered.
Hurriedly done, with little understanding.
Criticism
There is a clear understanding of the authors' interpretation, of the implications of the results for the hypothesis. Outside information is brought to bear on evaluating the design and conclusions.
Not quite as clear an understanding. Less complete evaluation of design and conclusions.
Uncritical acceptance of authors' conclusions. Or baseless objections to them.
Little or no mention of authors' intent. Little or no evaluation.
Cohesiveness
You have selected the data most relevant to the authors' aims. Your conclusions actually make results clearer.
Although the most relevant data are selected, your picture of the authors' aims and conclusions is not quite as clear and/or complete.
Some of the data you have selected do not seem as relevant to the overall aims of the paper. You seem to have missed some important parts.
Lack understanding of the paper or its context. Authors' aims are unclear.
Spelling/grammar
No spelling or grammatical errors.
Very few spelling or grammatical errors.
Errors on almost every page.
Apparently no proofreading done.

J. Cardon

Back to top

Example 7: Rubric for Original Research Project

Criteria
Expert
Proficient
Apprentice
Novice
Introduction [Introductory paragraph(s), literature review, hypotheses or propositions]
  • Clearly identifies and discussed research focus/purpose of research
  • Research focus is clearly grounded in previous research/theoretically relevant literature
  • Significance of the research is clearly identified (how it adds to previous research)
  • Hypotheses/propositions are clearly articulated
  • Limited discussion of research focus/purpose of research
  • Research focus is less well-grounded in previous research/theoretically relevant literature
  • Significance of the research is not as clearly identified (how it adds to previous research)
  • Hypotheses/propositions are described but not as well articulated
  • Inadequate discussion of research focus/purpose of research
  • Research focus is not well-grounded in previous research/theoretically relevant literature
  • Significance of the research is not clearly identified (how it adds to previous research)
  • Hypotheses/propositions are not well articulated
  • Poor discussion of research focus/purpose of research
  • Research focus not grounded in previous research/theoretically relevant literature
  • Significance of the research is not identified (how it adds to previous research)
  • Hypotheses/propositions are poorly articulated or are absent altogether
Research Methods
  • Provides accurate, thorough description of how the data was collected, what/how many data sources were analyzed, plan of analysis or measurement instrument, research context\
  • Reflection on social situatedness/reflexivity and how it may influence data collection and interpretation is thorough and insightful
  • Description of how the data was collected, what/how many data sources were analyzed, plan of analysis or measurement instrument, research context is adequate but limited.
  • Reflection on social situatedness/reflexivity and how it may influence data collection and interpretation is adequate but limited
  • Description of how the data was collected, what/how many data sources were analyzed, plan of analysis or measurement instrument, research context is somewhat confusing/not clearly articulated.
  • Reflection on social situatedness/reflexivity and how it may influence data collection and interpretation is limited and lacks insight
  • Description of how the data was collected, what/how many data sources were analyzed, plan of analysis or measurement instrument, research context is very confusing/not articulated sufficiently.
  • Reflection on social situatedness/reflexivity and how it may influence data collection and interpretation is severely limited, lacks insight, or is absent altogether
Results
  • Results are clearly explained in an appropriate level of detail and are well-organized
  • Tables/figures clearly and concisely convey the data.
  • Statistical analyses (if used) are appropriate tests and are accurately interpreted.
  • Results are explained but not as clearly, level of detail is not as sufficient, and there are some organizational issues
  • Tables/figures are not as clear/concise in conveying the data.
  • Statistical analyses (if used) are appropriate tests but are not accurately interpreted.
  • Results are not very clearly explained, level of detail is insufficient, and there are more organizational issues
  • Tables/figures are not clear/concise in conveying the data.
  • Statistical analyses (if used) are inappropriate tests and/or are not accurately interpreted.
  • Results are not clearly explained, level of detail is severely insufficient, and there are serious organizational issues
  • Tables/figures are not clear/concise in conveying the data.
  • Statistical analyses (if used) are inappropriate tests and/or are not accurately interpreted.
Conclusions
  • Interpretations/analysis of results are thoughtful and insightful, are clearly informed by the study's results, and thoroughly address how they supported, refuted, and/or informed the hypotheses/propositions
  • Insightful discussion of how the study relates to and/or enhances the present scholarship in this area
  • Suggestions for further research in this area are insightful and thoughtful
  • Interpretations/analysis of results are sufficient but somewhat lacking in thoughtfulness and insight, are not as clearly informed by the study's results, and do not as thoroughly address how they supported, refuted, and/or informed the hypotheses/proposition
  • Discussion of how the study relates to and/or enhances the present scholarship in this area is adequate.
  • Suggestions for further research in this area are adequate.
  • Interpretations/analysis of results lacking in thoughtfulness and insight, are not clearly informed by the study's results, and do not adequately address how they supported, refuted, and/or informed the hypotheses/propositions
  • Discussion of how the study relates to and/or enhances the present scholarship in this area is limited.
  • Suggestions for further research in this area are very limited.
  • Interpretations/analysis of results severely lacking in thoughtful ness and insight, are not informed by the study's results, and do not address how they supported, refuted, and/or informed the hypotheses/propositions
  • Discussion of how the study relates to and/or enhances the present scholarship in this area is severely limited and/or absent altogether.
  • Suggestions for further research in this area are severely limited and/or absent altogether.
Documentation of Sources, Quality of Sources
  • Cites all data obtained from other sources. APA citation style is accurately used in both text and bibliography.
  • Sources are all scholarly and clearly relate to the research focus.
  • Cites most data obtained from other sources. APA citation style is used in both text and bibliography.
  • Sources are primarily scholarly and relate to the research focus.
  • Cites some data obtained from other sources. Citation style is either inconsistent or incorrect.
  • Sources are not primarily scholarly and relate to the research focus but somewhat tangentially.
  • Does not cite sources.
  • Sources are disproportionately non-scholarly and do not clearly relate to the research focus.
Spelling & Grammar
  • No spelling & grammar mistakes
  • Minimal spelling & grammar mistakes
  • Noticeable spelling and grammar mistakes
  • Unacceptable number of spelling and/or grammar mistakes
Manuscript Format
  • Title page has proper APA formatting
  • Used correct headings & subheadings consistently
  • Title page approximates APA formatting
  • Used correct headings & subheadings almost consistently
  • Title page deviates a bit more from APA formatting
  • Headings & subheadings less consistent
  • Title page completely deviates from APA formatting
  • Headings and subheadings completely deviate from suggested formatting or are absent altogether
Additional Comments:

Swygart-Hobaugh, A. J. (Some elements adapted from vom Saal, F., "Scoring Rubric-Scientific Paper" http://www.biology.missouri.edu/courses/Bio4984_vomSaal/pdf/Sci_Paper_Critique.pdf and Cornell College/Colorado College., "Figure 1: Research Paper Rubric" http://www.coloradocollege.edu/library/acmassign/tools.html)

Back to top

Example 8: Evaluation of Instruction

This evaluation form is used after instruction sessions with the librarian. A similar form is given to faculty for feedback on the session. The form informs the librarian for revising instruction sessions for the future.

Library Instruction Session--Student Evaluation
Course:_______________________________________________________ Block:_____

Please mark the item that best describes your assessment of the instruction session you experienced during this block.

1. Content
1.1 Relevance
  The content of the session was highly relevant to my assignment.
  The content of the session was partially relevant to my assignment.
  The content of the session was not appropriate for this class.

1.2 Degree of complexity

  The content was at the right level of complexity and detail.
  The session covered too much content.
  The content of the session had too much detail.
  The content of the session was too difficult.
  I did not learn anything new.

2. Outcome

  I applied information from the library instruction in my work, either in the sources used, in citations, or in other aspects of my final product.
  The content of the lesson did not help me with my assignment.

3. Resources

  I got the resources I needed to do this assignment through the library, either by using resources in the library or by accessing resources through the library's web site or through inter-library loan.
  The library had some information, but I had to supplement it by going to another library.
  I did not use the library or its web site at all, either remotely or physically.

One resource I want to explore since I attended this instruction session:


One suggestion I would like to offer to the library:


A concept or skill I learned from this session:

Back to top

 



















This site is © Copyright Colorado College and Cornell College 2004-2005, All Rights Reserved.
Free web templates