Technology-based Testing

Members

Faculty Chair: Mary Ryan, GCC
Co-Chair: Maria Harper-Marinick, DIST

Pat English, MCC
Mark Foshee, GCC
Pam Raman, SCC
Sue Thomas, GWCC
Suzanne Van de Putte, PC
Yvonne Zeka, GWCC

Charge

Technology-based Testing identifies models for a technology-based testing system. Discussions will include an investigation of assessment ideals, an inventory of testing models that are currently available, and the issues and implications of developing such technology-based testing systems.

Introduction

Since the majority of the committee members were Nursing faculty, it was decided initially that the committee would focus its efforts in the development of a computerized "math for meds" tutorial and test that could be available for use by each college's nursing department. The Ocotillo General Faculty Chair, Maria Hesse, suggested that the committee look into more global issues related to technology-based testing and provide insight useful beyond a particular discipline. The committee members were reluctant to put aside the "math for meds" project and with further discussion came up with a modification. The committee would attempt to outline the issues concerning technology-based testing that were encountered while researching the initial project. In addition, a survey would be sent to residential faculty throughout the District to identify interest in use of computer testing.

Year in Review

The committee met five times during the academic year. The "math for meds" tutorial was explored. A number of issues were raised in trying to work on the project.

  1. It is difficult to develop a product to be used at more than one college if objectives and competencies for a course differs from college to college.
  2. Software needs to be developed for both DOS-based and MAC systems due to differences in hardware available at the different colleges.
  3. When different Nursing publishers were contacted to see what software already exists, the publishers were interested in have such a product developed. Members were unsure of what course to take in the District to respond to the publishers' interest.
  4. A computer math test for nursing exists at Phoenix College; however, personnel to maintain and upgrade the software is not available.

The committee conducted a survey regarding faculty interest in use of computer-based testing. The original instrument was developed and administered at Glendale Community College (GCC) in February. A revised version was sent to all MCCCD faculty in March. The MCLI did the mailing and Yvonne Zeka (GWCC) collected the results. Mark Foshee (GCC) worked on the summary. Results of the survey, including the GCC data, are discussed next.

District-Wide Survey of Interest in Computer-Based Testing

Computer-based testing has become technically possible. The purpose of this survey was to find out if District faculty were interested in pursuing this testing option. The survey was sent to full-time faculty at all of the colleges in the District, with the exception of GCC, since a similar survey had recently been conducted there. However, results from the GCC survey have been included in this report. A total of 254 faculty responded to the survey.

While 28 questions were asked, clearly the most significant questions were whether computer-based tested was desired and if there was support for the creation of dedicated testing facilities at each of the colleges.

Support for computer-based testing was strong. About 80% (204) of respondents "agreed" or "strongly agreed" to support efforts to obtain or develop a computer-based testing program (See Chart 1). Support for the program was consistent throughout the District with percentage of favorable responses ranging from a low of 63% at Mesa Community College to 100% support at Estrella Mountain Community College Center and Rio Salado Community College.

The concept of a dedicated testing facility at each college received only slightly less enthusiasm. About 76% (189) of respondents supported establishing such facilities (See Chart 2). The level of support, however, varied widely throughout the District. Only 33% of respondents from Chandler/Gilbert Community College and South Mountain Community College favored such facilities compared to about 90% support from Gateway Community College and Paradise Valley Community College.

The survey results highlight clearly defined support for computer-based testing throughout the District. While the precise desires varied from college to college, the evolution of testing appears to include computers on an ever greater scale.

It should be noted that some of the more extreme figures may be the result of unusually low samples from some colleges. For example, only two surveys were received from Estrella Mountain Community College Center. Thus, the averages are the most accurate indicators. The complete survey and survey results are available at the Maricopa Center for Learning and Instruction (MCLI).

Conclusion/Future Goals

Based on our meetings and the survey, the committee identified the following five conclusions or goals concerning technology-based testing.

  1. There is value in interdepartmental/inter-college teams working on educational tools and processes together. Some of us are pragmatists and would like to do more than dream when we are a member of an enthusiastic, congenial group.
  2. A list of what's available on different colleges for computer testing, with names of persons to contact, might assist people in getting started on projects they are interested in working on.
  3. Faculty and staff are developing tools helpful in teaching. When outside organizations are interested in these tools, it is difficult to know what process to follow in response to that interest. Must it always be entrepreneurial (i.e., pursued outside the Maricopa system)? Could cooperative ventures of our system with other organizations, in terms of personnel or money, be mutually beneficial and fit within our mission statement of community service?
  4. Members of the committee are interested in continuing to work on the project. The presence of expertise in math, nursing, and programming supports the possibility of a good product.
  5. Survey results (25% returns) from all colleges support the use of computer-based testing. A focus on what's available on different colleges for computer testing (#2 above) would be a logical step in response to the survey results.

Index

Ocotillo Report '94-- Technology-based Testing
back next
c 1994, Maricopa Center for Learning and Instruction (MCLI) Maricopa County Community College District, Arizona