Sloan-C Logo
  
   
  - Publications - Journal: JALN - Vol4:2   
Top shadow
Journal: JALN
Survey Reports
Sloan-C View
Workshop Pubs
Books
ALN Magazine
Free Downloads

 
 register/help
User Name:

Password:

JALNlogo Volume 4, Issue 2 - September 2000
Issue Table of Contents
ISSN 1092-8235

Integrating ALN into an Independent Study Distance Education Program: NVCC Case Studies

John Sener
Download
PDF version:
Adobe Acrobat Document
Northern Virginia Community College
Mary Liana Stover
University of Maryland University College


Abstract
This paper describes eight ALN courses developed under various Sloan Foundation-funded degree program initiatives at Northern Virginia Community College (NVCC) Extended Learning Institute (ELI). These chemistry, engineering, mathematics, and information technology courses offer useful lessons about what makes ALN courses successful. The courses incorporated ALN into an independent study format to increase interaction among learning participants while maximizing learner convenience and flexibility; some courses also focused on both on-line and in-person collaboration. A wide variety of other course design and delivery strategies contributed to the courses' success. The results of this study indicate that ALN courses can be viable and successful for community college students and that ALN can succeed in a distance education program delivered in an independent study format to motivated learners. NVCC/ELI's experience also suggests that ALN works within a multiple media approach to course design and delivery; that faculty selection, support, and development are critical factors in assuring quality ALN courses; that a wide variety of best practices can result in successful ALN courses; and that the learning effectiveness of ALN courses will continue to improve as better tools, content, and support are developed.

I. INTRODUCTION

A. General Background
This paper describes several ALN courses developed under various Sloan Foundation-funded degree program initiatives as described below. These particular courses were selected because each possesses unique or noteworthy characteristics (see Table 1) that offer useful lessons about what make ALN courses successful. One guiding assumption in selecting these courses was that, at least in our experience, when courses were less successful it was generally for prosaic and well-documented reasons, whereas courses which succeeded did so due to a variety of interesting and instructive factors. The following courses were selected as case studies:

Case Study #1: Chemistry
College Chemistry I & II (CHM 111/112) are four-credit courses designed primarily for science and engineering majors. These courses explore the fundamental laws, theories, and mathematical concepts of chemistry. CHM 111 is required for the Associate in Science (AS) Engineering degree. CHM 112 also was originally required for the AS Engineering degree program, but this requirement was dropped in 1996 when the degree program requirements were revised.

CHM 111 and 112 are of special interest because they attract a high percentage of students with prior degrees. Over 50% of the enrolled students have bachelor degrees and 12% have master's degrees and/or doctorates. Many of these students are self-described career changers who need a transfer chemistry course to pursue their new career goals in a diverse variety of fields such as medicine, engineering, physical therapy, and even enology.

Case Study #2: Engineering
Introduction to Engineering (EGR 120) is a two-credit survey course which introduces the engineering profession so that students can determine whether engineering is a suitable field of study for them. EGR 120 is a required course for the AS engineering degree.

Case Study #3: Mathematics
Vector Calculus (MTH 277); Differential Equations (MTH 291); Mathematics for the Liberal Arts I and II (MTH 151, 152). MTH 277 is a four-credit, second-year course on vector calculus. MTH 291 is a three-credit course on differential equations. MTH 151 and 152 are three-credit courses on basic mathematical concepts. MTH 151 fulfills the math requirements for a number of NVCC degree programs including the Associate in Applied Science (AAS) Information Systems Technology (IST) degree. MTH 152 is a requirement for the Associate in Arts (AA) Liberal Arts degree program and was developed to enable ELI to offer a complete AA Liberal Arts degree.

Case Study #4: Information Systems Technology
Introduction to Internet Services (IST 128) is a three-credit course that provides students with a working knowledge of Internet terminology and services including E-mail, WWW browsing, search engines, ftp, telnet, and other services, as well as introducing students to related software packages and web page construction. IST 128 is an elective course for the AAS IST degree.

Course

Noteworthy/Unique Characteristics

CHM 111/112

  • Focus on collaboration, particularly face-to-face in lab settings
  • Frequent/continuous improvement of course, including field-testing of technological innovations in on-campus classes before incorporating them into ELI ALN courses
  • Highly educated student population (~60% with prior degrees)

EGR 120

  • Combined on-line, face-to-face collaboration in simulation assignment

MTH 277/291

  • Innovative use of methods for two-way transmission of equations and graphical content Innovative grading structure which rewards practice
  • Continuous course improvement

IST 128

  • Use of pre-packaged customizable course material within a Web course delivery program (Serf)
  • High volume of student/instructor interaction
  • Large enrollments

Table 1:  Noteworthy Characteristics of NVCC Case Study Courses

B. The College
NVCC is one of the three largest multi-campus community colleges in the United States and is the largest educational institution in Virginia. Founded in 1964, NVCC has grown rapidly so that in 1998-99, it enrolled 60,714 students (unduplicated headcount; 21,888 annualized FTEs). The college is comprised of five campuses and the ELI.
 
The ELI was established in 1975 as the College's distance learning administrative unit. It now has more than 11,000 enrollments per year (7,020 unduplicated headcount or 11.6% of the College's total) and offers more than 140 college credit courses delivered by a mix of cable and broadcast television, video and audiotapes, telephone, voice mail, print, World Wide Web, CD-ROM, and computer conferencing. From the beginning, ELI supported continuous enrollment in credit courses whereby students could enroll in classes at any point in the semester. Continuous enrollment and asynchronous learning continue to be at the heart of the ELI program.

ELI is organized as a home-study distance education unit. Geographic distance is not the barrier so much as distance through isolation caused by the students' hectic lives and difficulties of traveling even short distances in congested urban traffic. ELI primarily serves students whose busy lives and inability to get to campus preclude their participation in college courses.

Since 1991, ELI has received grant funding for three major development projects. With the first, through support from Annenberg/CPB's New Pathways to a Degree project, ELI developed Associates of Science (AS) degrees in Business Administration and General Studies for delivery at a distance. The second project, with grants from the Alfred P. Sloan Foundation, developed an AS degree in Engineering available using ALN through home-study distance education. The third project, still in process, is incorporating ALNs into the mainstream at NVCC as described below. The Alfred P. Sloan Foundation sponsors this program.

C. The Programs
From 1994-97, ELI developed the first and only AS in Engineering degree program available in the United States through ALN, funded by two grants from the Sloan Foundation. In fall 1997, ELI offered the complete engineering degree program, including 14 ALN courses in science, math, and engineering.

In 1998, Sloan funded a program to enable NVCC to scale-up its ALN course offerings. Through this program, 41 courses have been or will be developed using ALNs for distance as well as campus-based delivery. The program includes development of three degree programs and completion of a fourth degree program for distance delivery through ELI: Information Systems Technology, Microcomputer specialization (spring 2000), Business Management, Public Management specialization (spring 2000), Business Management without specialization (spring 2000), and Liberal Arts (fall 1999). The program also includes mini-grants to faculty for developing 21 ALN courses or course components in on-campus and ELI courses.

D. Intended Audience
The intended audience for the ALN programs is community college students who are employed or have significant outside responsibilities and find that time and location are major obstacles to attaining degrees. The intended students are those requiring flexibility to complete a degree program. Compared to their colleagues in campus-based courses, these students tend to work more hours at outside employment, have more family responsibilities, and in general have less uninterrupted time, especially during regular business hours, to dedicate to their college studies. The students are slightly older than on-campus students with 46% of them being 25-44 years old. About 70% are part-time students and 60% are women. Usually about 50% of ELI students take ELI courses only, and the other half take both ELI and campus courses.

While ELI students value the flexibility and convenience of self-paced, independent study, most learners live within 20 miles of one of NVCC's five campuses. ELI students are thus generally able to visit a campus occasionally for exams, laboratory exercises, or other course-related activities. Because of the proximity of students, ELI has supported computer-mediated communication software such as Searchlight (1990-95), Lotus Notes (1994-95), and FirstClass (1995-99) that allows access with a local phone call. ELI now supports Web-based conferencing, using Allaire Forums, Web-Course-in-a Box, and Blackboard/Course Info now that Internet access is widespread.

II. RATIONALE

A. Motivating Factors for Program Development
ELI and NVCC's engineering faculty initiated the engineering degree ALN program funded by the Sloan Foundation. The program addressed the problem facing potential engineers enrolled in transfer-oriented degree programs of how to complete a degree program when encumbered with many professional and family obligations. The engineering degree program was also developed as a proof of concept project funded by Sloan to determine the feasibility of offering home-study, distance-education ALN courses in these subject areas.

The second ALN project supported by the Sloan Foundation was designed to bring ALNs into the mainstream at NVCC through a large-scale deployment of ALN courses and degree programs in key disciplines. The project is intended to address the need in Northern Virginia to have educational opportunities which are accessible anywhere, anytime for the growing new majority of students who face significant obstacles preventing them from attaining degrees via traditional on-campus classes. The project also addresses the critical shortage of information technology (IT) workers in Northern Virginia and the resulting high demand for IT courses at the College, as well as the need in Northern Virginia for education and training opportunities relevant to public sector employment.

The ELI was one of the few institutions using distance ALNs before the Sloan Foundation initiatives, so the ALN projects fit neatly into ELI's existing structure. In fall 1989, ELI introduced the use of computer conferencing on the mainframe computer for use in instruction. Voice-mail conferencing was introduced in 1993. With the Sloan grants, computer conferencing on personal computers using a bulletin board system began in 1995. The first courses delivered via the World Wide Web were offered in 1998.

B. Evaluation Methods
Originally, planned evaluation activities included formative and summative evaluations. Planned formative evaluation consisted of

  • Focus group meetings of students to get feedback on the effectiveness of pilot courses
  • Faculty and student surveys on the effectiveness of courses, technologies, and procedures
  • Grade distribution studies to determine rates of student success

Planned summative evaluation consisted of

  • Faculty and student surveys on the effectiveness of courses, technologies, and procedures
  • Grade distribution studies to determine rates of student success
  • Telephone interviews with students to determine their satisfaction with the courses
  • Interviews with faculty, staff, and administrators on project outcomes
  • If possible, a tracking study to determine graduation and transfer rates for students who take a majority of the program by distance education

The original evaluation plan was intentionally short on details so that suitable evaluation activities could be developed as the project progressed. Various evaluation methods were employed during the project periods; those related to learning effectiveness are described in the Results section below.

III. BACKGROUND INFORMATION FOR THE NVCC CASE STUDY COURSES

The students served in the engineering project are fairly similar to engineering students enrolled in on-campus courses. However, as in other distance programs, the students are slightly older and more often employed full-time than those in on-campus programs. Since its development, the ELI engineering degree has had over 1,300 total enrollments. Program enrollments declined slightly after peaking in fall 1997 and now number more than 300 per academic year. Comparative analyses show that students who start their courses have achieved success rates comparable to their on-campus counterparts.

The courses discussed in the case studies have been offered a varying number of times  (see Table 2). CHM 111 and EGR 120 were first offered in spring 1995 and have been taught most semesters since then. MTH 152 is the most recently developed of the case study courses and was taught for the first time in summer 1999.

 

CHM 111

CHM 112

EGR 120

MTH 277

MTH 291

MTH 151

MTH 152

IST 128

Total # of Times Offered

 

8

 

3

 

8

 

10

 

8

 

2

 

1

 

5

Enrollments:

Spring 1995

31

 

15

 

 

 

 

 

Spring 1996

26

 

23

 

 

 

 

 

Summer 1996

 

 

 

15

 

 

 

 

Fall 1996

27

 

21

8

14

 

 

 

Spring 1997

34

 

19

11

13

 

 

 

Summer 1997

 

 

 

13

 

 

 

 

Fall 1997

21

12

26

15

13

 

 

 

Spring 1998

14

8

18

9

9

 

 

8

Summer 1998

 

 

 

9

13

 

 

37

Fall 1998

24

 

16

12

7

 

 

63

Spring 1999

21

6

18

9

4

62

 

88

Summer 1999

 

 

 

13

23

46

20

38

Total Enrollments:

196

26

156

114

96

108

20

234


Table 2. Frequency of Offerings & Enrollments by Semester, NVCC Case Study Courses

IV. METHOD

A. Technology and Infrastructure
As described below, computer technology was used primarily to facilitate interaction among learning participants and only secondarily for content delivery in some courses. College Chemistry I and Introduction to Engineering were two of the first courses developed as part of Sloan's initial grant to NVCC/ELI. For the first iteration of these courses, Lotus Notes v4.13 was used as the course development and management system. This was before Lotus's development of Lotus LearningSpace. Although Lotus Notes was a powerful system with many useful features, Lotus Notes was replaced with FirstClass (with Internet access) in the spring 1996 semester as an alternative that would be easier to use and administer, less expensive for the institution and students, and equal to Notes for instructional purposes [1]. FirstClass was subsequently used for the College Chemistry II, Vector Calculus, Differential Equations, and Introduction to Engineering courses. ELI managed technical infrastructure in-house. Consulting services were used in the initial installation and implementation of FirstClass, but operation and maintenance proved to be sufficiently simple that no additional consulting services were used even though funds were set aside for that purpose. As E-mail has become more widely available at the College and for its students, the advantages of using FirstClass have diminished. Accordingly, all case-study courses that are still using FirstClass are being migrated to a Web-based conferencing system (Allaire Forums) as of the fall 1999 semester.

B. Content Delivery
In the early and mid-1990s when most of these courses were developed, ELI utilized a multiple media approach to course development. The earlier courses were designed with a specific model in mind: video and print media for content delivery, computer conferencing and telephone for interaction facilitation. When computer conferencing was used for content delivery, it was only as a supplementary means, for example, homework help, questions and answers, or assignment transmission. By contrast, the courses developed in the past two years utilize the Web as the principal delivery medium along with selected course delivery management tools and other software as described below. In addition, the use of various methods and media evolved in different ways in different courses over time. Table 3 summarizes the use of media in the case-study courses by semester.

Most ELI courses feature self-paced, independent study as well as continuous enrollment, which allow students to register for most ELI courses on virtually any day of the year. However, for most of these courses, continuous enrollment was suspended to enable face-to-face activities and other forms of cohort formation to facilitate collaborative learning activities. For the mathematics courses, however, as it became apparent that learning participants were most comfortable with instructor-student interaction and cohort formation was unnecessary, continuous enrollment was re-instituted.

Several noteworthy content delivery strategies were employed in the case-study courses. For the chemistry courses, technological innovations were field-tested in the classroom before incorporating them into the ELI ALN courses. For instance, the instructor field-tested the use of ChemSkillBuilder electronic homework exercises on campus in spring 1998, then incorporated them into the ELI ALN course in fall 1998. Similarly, the use of CD-ROM material bundled with a revised edition of the course textbook was piloted on-campus in spring 1999 and was incorporated into the ELI ALN course in the fall 1999 semester.

Face-to-face meetings were required for the Introduction to Engineering (EGR 120) and chemistry courses. The EGR 120 course required one face-to-face meeting designed as a culminating activity for an on-line collaborative learning assignment. The assignment required students to conduct a mock technical meeting of a fictitious engineering company dealing with an engineering-related manufacturing problem. The chemistry courses required two-to-five, face-to-face meetings to conduct laboratory experiments. The laboratories were self-contained activities in the College Chemistry II course; however, in the College Chemistry I course, students were required to work collaboratively to prepare pre- and post-lab reports.





Table 3. ALN Activities, Resources and Media in NVCC Case Study Courses by Semester


The more recently developed courses use the World Wide Web in different ways to deliver content. The Mathematics for the Liberal Arts I and II courses (MTH 151/152) use instructor-developed pages rather than a commercial course management system. The Introduction to Internet Services course (IST 128) uses a pre-packaged course, Internet Literacy, which operates within a Web course delivery program (Serf), both of which were developed at the University of Delaware and licensed through the Public Broadcasting Service (PBS). In the spring 1999 semester, this content was customized by the IST 128 instructor to make the course more specific to its student population.

One noteworthy challenge related to content delivery involved how to facilitate affordable, two-way transmission of equations, formulas, and graphical content. Although software such as Mathematica and Maple V were available at the time, they were far too expensive to be considered for use by home-study, community college students. Instead, a solution was developed which used an equation typesetter product called Expressionist which, used with FirstClass, provided an affordable means (<$2/student) for students to compose and transmit documents with equations, formulas, etc. This solution proved to be serviceable in the mathematics courses for several semesters [2] until a better solution was identified, which was incorporated into the Mathematics for the Liberal Arts courses. These courses use Scientific Notebook as the means of mathematical communication with students. The instructor and students use the software to transmit quizzes, homework problems, and general questions and answers to each other. The instructor arranged for the textbook publisher to bundle Scientific Notebook with the course textbook at a greatly reduced rate ($29.95 vs. $75 retail). Besides its equation-editor capability, Scientific Notebook also contains the Maple symbolic engine for computational power; Scientific Notebook also has one of the easiest user interfaces of the available math software packages. The instructor currently uses MSWord with MathType, the full version of the Equation Editor that comes with Word to post Web pages with mathematical content [3]. This procedure is much easier and quicker to download than the previous common practice of embedding mathematical expressions within graphics on Web pages.

Student performance was assessed in a variety of means (see Table 4). Tests and quizzes were conducted in the same manner as with all ELI courses; students were required to take exams at a testing lab at one of NVCC's five campuses. Students outside the NVCC service area could arrange for local exam proctoring as necessary in accordance with ELI's existing procedures. Of special interest is how quizzes were conducted in the mathematics courses. After studying the related material, students requested a quiz, which was sent to them via E-mail. The student used Scientific Notebook to complete the quiz and then returned it to the instructor. The quizzes were graded excellent, satisfactory, or unsatisfactory; however, the student received full credit for submitting the completed quiz, regardless of the grade. Since the ten required quizzes collectively comprised 25% of the course grades, students, in effect, were rewarded for effort rather than punished for practice, while the instructor received valuable feedback on student progress, which was used to monitor and improve student performance.

Course

Graded Assignments

Special Requirements

 

 

CHM 111

3 exams
1 comprehensive final exam
10 homework assignments
10 laboratory exercises
(4-8 off-campus; 2-6 on-campus)

Introductory letter and course completion plan; passing grades (>60%) in both lab and 'lecture' course components

 

 

CHM 112

3 exams
1 comprehensive final exam
6 homework assignments
6 laboratory exercises
(3 off-campus; 3 on-campus)

Introductory letter and course completion plan; passing grades (>60%) in both lab and 'lecture' course components

 

EGR 120

4 exams
1 library research paper
1 computer program 
1 mock engineering meeting

Lowest grade is discarded in calculating final grade

MTH 277, 291, 151, 152

1 midterm
1 final
10 quizzes

Quizzes are graded excellent, satisfactory, or unsatisfactory; credit given for completion, not performance

 

IST 128

3 quizzes
1 home page & resume 
1 term paper
12 assignments

All assignments except quizzes submitted via Internet

Table 4. Student Performance Assessment in NVCC Case Study Courses

C. Organization and Evolution
1. Course Development
ELI uses a faculty-centered course development model in which faculty members and instructional technologists collaborate to develop course materials for delivery. Faculty serve as content experts and are highly involved in developing and teaching their own courses. Instructional technologists provide instructional design expertise. The engineering degree courses were developed by teams, each composed of a faculty member, instructional technologist, a video producer (when applicable), and clerical support staff [4]. Other staff instructional technologists were employed as consultants on an as-needed basis.

2. Technical Support
ELI staff instructional technologists provide technical support for course development and delivery. Instructional technologists train faculty in the instructional use of technology and provide technical support during the course development process. ELI instructional technologists also provide course delivery technical support, including trouble shooting for students and faculty and server administration. Front-line clerical staff answer basic technical questions from students and refer other questions to ELI instructional technologists.

3. Course Development Budget
Course development funds were provided by grants from the Sloan Foundation. The course development costs for the engineering degree courses and the more recently developed courses differ markedly. This differential is due to several factors: 

  • Large decreases in software costs during the project development period
  • Pre-existing software infrastructure for more recently developed courses
  • Video production expenses for the engineering degree courses (except MTH 291)
  • The pioneering nature of the engineering degree program

Although costs per course are difficult to quantify with precision since some costs (e.g., software) are not allocated per course, the figures in Table 5 represent reasonable estimates. Note that the figures in Table 5 do not include recurring course delivery costs. Although in most cases these costs are low, the IST 128 course incurs about $2-4,000/year in costs due to licensing and student fees.
 

Course

Development Period

Development Costs

Comments

Engineering degree courses:

CHM 111

 

Fall '94; Summer/Fall '95

$16,100*

Course redeveloped in second project phase

CHM 112

 

Summer/Fall '97

$16,100*

 

EGR 120

 

Fall '94; Summer/Fall '95

$12,700*

Course redeveloped in second project phase

MTH 277

 

Fall '95/Spring '96

$14,300*

 

MTH 291

Spring/Summer '96

$8,100

 

Other courses:

MTH 151

Summer/Fall '98

$4,000

Web-based course

MTH 152

Spring '99

$4,000

Web-based course

IST 128

Spring '98;

Spring '99

$3,000

Web-based course; course redeveloped for IST degree program

*Includes video production and videotape distribution costs

Table 5. Development Costs for NVCC Case Study Courses

V. RESULTS

Overall, the case study courses have been successful both compared to other ELI courses and to their on-campus counterparts. Although comparisons have not been done for each individual case-study course, extensive evaluation activities performed on the Engineering degree program as a whole indicated that students who started Engineering degree program courses were roughly as successful as their on-campus counterparts [5].

A. Faculty Perceptions of Learning Effectiveness
As indicated in Tables 6 and 7 below, according to the case-study faculty this success is attributable to a variety of course design and student-related factors. The factors cited by faculty as necessary for student success (see Table 7) are not surprising, as they are in line with ELI's past experience with home-study, distance education learners. This is reflected for instance in ELI's "Is ELI for Me?" questionnaire, a ten-question, self-administered student survey designed to allow students to assess whether distance learning is suitable for them. The questionnaire contains similar questions about personal preferences for interaction, need for course, reading ability, etc. This questionnaire has been widely adopted and distributed in various forms throughout higher educational institutions in the U.S.

 

CHM 111/112

EGR 120

MTH 277/291

IST 128

Good analytical ability

x

 

 

 

Takes responsibility, is accountable

x

 

 

 

Self-motivated

 

x

 

x

Doesn't need/want student-student interaction

 

x

 

x

"Good student"

 

 

x

 

Willing to ask questions

 

 

x

 

Doesn't have external problems

 

 

x

 

Self-disciplined

 

 

x

x

Good reading comprehension

 

 

 

x

Has adequate prior knowledge base/preparation

 

 

x

x

Good writing skills

 

 

 

x

Mature, age a factor

x

 

no

no

Table 6. Which Students Are Best-Suited for ELI ALN Courses?



Table 7. Course Design Features Cited by NVCC Case Study Faculty as
Critical Factors for Successful Course Performance for ELI ALN Courses 

The case-study course instructors cited a variety of pedagogical and technological factors that were critical for student success and learning effectiveness in their courses, as summarized in Table 7 above.

1. Chemistry (CHM 111/112)
Both instructors who developed the course were strong believers in incorporating collaborative activities into the learning process whenever feasible. They believed that collaborative learning worked best with appropriate preparation, including didactic instruction, and with appropriate guidance from the instructor. However, one instructor noted a distinct difference in the quality of her on-line communication with students after the first face-to-face laboratory session. Her experience was that having several on-campus lab sessions resulted in a more productive learning environment, produced more collaboration, a sense of camaraderie, and resulted in more productive on-line interactions than would occur if there were fewer on-campus laboratory sessions. Face-to-face sessions were also best for enabling certain kinds of hands-on lab experience.

Technologies that worked well for the chemistry students were student-directed tools, including computer conferencing, interactive CD-ROM, electronic homework software (ChemSkillBuilder), and videotapes. Videotapes and print materials (and to a lesser extent computer conferencing) worked well to deliver most of the course content involving fundamental principles and concepts of chemistry with examples and demonstrations, while the ChemSkillBuilder software effectively enabled skills practice. The instructor also found that telephone communication was not particularly effective, since on-line and face-to-face communication made the telephone unnecessary.

2. Introduction to Engineering (EGR 120)
Unlike the chemistry courses, in the introductory engineering course most of the on-line interaction and collaboration among students preceded rather than followed the face-to-face meeting. The instructor felt that the success of this on-line collaboration was largely dependent on the number of enrolled students and their particular characteristics. The on-line collaborative assignments did not work well when roughly fewer than about a dozen students participated in it. Also, some students responded well to on-line collaboration, and others did not; in fact, some students did not like the face-to-face meeting assignment because even one required in-person visit impeded the flexibility and convenience of taking the course. Accordingly, on-line collaboration was usually, though not always, successful.

3. Mathematics (MTH 277/291)
As described previously, the use of quizzes to enable students to practice performance without punishment has proved to be an effective means for the instructor to provide feedback and monitor progress more frequently. Improvements in the enabling technologies have increased the ease and convenience of this interaction. The instructor noted that the initial enabling technology used (Expressionist + FirstClass) was a definite improvement over paper and pencil. However, Scientific Notebook also represented a definite improvement over Expressionist + FirstClass because it is a more convenient equation editor and a more powerful math tool which enables students to focus on the problem-solving process. Scientific Notebook can also be used for many math courses. Similarly, the instructor has found the Web to be better than the FirstClass client environment because it has more flexible space, fewer constraints, and is more accessible since it is easier to install and use. The instructor also noted that all of math content in his calculus and liberal arts math courses is suitable for delivery via the Web, although he speculated that dealing with discrete math proofs could be a problem.

4. Introduction to Internet Services (IST 128)
The instructor noted several minor technological and pedagogical aspects that impeded learning effectiveness. There was too much written text on the screen; the course materials were so densely hyper-linked that it was virtually impossible for students to print it out; some of the category labels within Serf were non-intuitive and difficult for students to figure out; and access to the Serf Website was often slow and occasionally unavailable. However, the instructor also felt that the advantages of using Serf and the on-line Internet Literacy course outweighed the disadvantages. Having pre-organized publisher resources was much more efficient and timesaving for both students and instructor. Using customizable pre-packaged course material allowed the instructor to adapt the existing course material to students' needs. Another development noted by the instructor was a tendency toward supporting a more mastery learning-oriented approach to assessment by allowing students to resubmit substandard assignments (not including exams). The instructor's experience was that, by having a well-organized structure and supporting rapid feedback, the technology made this much easier to do, unlike on-campus courses where such an approach was impractical.

These features not only facilitated learning effectiveness but also increased the instructor's capacity to teach larger numbers of students effectively. They also encouraged a much greater volume of student/instructor interaction. Although exact figures were not available, the instructor estimated that she had at least ten times as many one-on-one interactions with students in her ELI ALN course than with students in her on-campus courses. Another subjective but perhaps telling indicator of the success of one-on-one interaction is that several students who had never met the instructor face-to-face while taking the course came to visit the instructor at ELI's semester orientation after they had already completed the course.

Several common themes emerged from the case-study courses. One of them was that ELI students often seemed to learn more in-depth than students in on-campus courses. In the chemistry courses, this was attributed in part to the ELI classes having a much higher percentage of excellent students, at times "just extraordinary". The IST 128 instructor felt that students learned more and received better grades because she was able to "hold [her students'] feet to the fire more" than was possible in an on-campus class. Another possible explanation is the fact that home-study courses such as ELI's do not allow instructors to skimp on content covered in the latter stages of a course due to time constraints.

Another commonly mentioned factor to consider was the variation in course performance from semester to semester within the same course. Just as with on-campus courses, this is probably more a function of the particular collection of students enrolled in a course in a given semester than a function of the courses themselves. This is a factor worth considering when assessing learning effectiveness in ALN courses, especially in comparison to on-campus courses.

B. Student Perceptions of Learning Effectiveness
A series of student-focus groups was conducted over several semesters for the engineering degree courses, including the chemistry, calculus, and engineering case-study courses. Both the overall responses (n=51) and the responses in case-study courses (n=13) reflect a generally favorable student perception of learning effectiveness. A large majority (84%) of students overall felt that they had equal (74%) or greater (10%) access to learning resources in ELI ALN courses than in on-campus classes. An even greater majority (92%) was satisfied with their level of access to learning resources in ELI ALN courses. Two-thirds (over 70% in the case study courses) felt that ELI ALN courses were an equally or more effective way to learn than on-campus classes. Over 90% of student respondents said that they would take another ELI course based on their experience in the Engineering degree courses, thus indicating high overall student satisfaction.

C. Course Grades
As Tables 8 and 9 indicate, the case-study courses, as is generally the case with distance-learning courses everywhere, have a higher student withdrawal rate than on-campus courses; however, students who started case-study courses have success rates comparable to their on-campus counterparts [5]. Although the grade results for the non-engineering degree courses are incomplete, results thus far indicate that these courses will have similar success rates. Course grades also reflect the typical ELI pattern (for both ALN and non-ALN courses) of polar success/failure, i.e., lots of As and Fs, some Bs, and very few Cs and Ds.

Legend:
W = students who withdrew from the course
NS = Non-Starters = students who withdrew before submitting any assignments
I = Incompletes = students who have not yet finished their course
R = Refunds = students who withdrew with refund before starting their course
X = Audited course.

Course

A

B

C

D

F

W

NS

I

R

X

Total

CHM 111

30

39

9

2

15

81

38

3

13

4

196

CHM 112

10

3

1

0

0

11

6

0

1

0

26

EGR 120

32

17

10

0

24

63

50

0

10

0

156

MTH 277

15

16

12

9

5

44

22

7

5

1

114

MTH 291

13

11

6

0

9

40

27

10

5

2

96

MTH 151

13

21

4

0

17

28

15

27

0

0

110

MTH 152

5

0

1

0

1

7

3

6

0

0

20

IST 128

72

21

4

0

49

60

51

21

2

5

234

Totals

190

128

47

11

120

334

212

74

36

12

952

Table 8. Course Grades, NVCC Case Study Courses, through Summer 1999 Semester


Table 9 also indicates comparative results for the same instructor when that same instructor taught the same course both on-campus and at ELI in the same semester. Comparison data by instructor is limited, partly because most instructors opted to drop their on-campus sections of the same course after beginning to teach or while teaching the ELI ALN versions. However, within the limited data (in the chemistry courses), it is striking how similar the results are between the ELI ALN and on-campus courses.

Course

ELI
(thru Sum'99)

ELI
(thru Fall'97)

On-Campus
(thru Fall'97)

On-Campus
Same Instructor, Same Semester
(thru Sp'99)

 CHM 111

56.5%*

58.9%

64.5%

55.7% (n=93)

 CHM 112

73.7%

60.0%

53.2%

73.9% (n=64)

 EGR 120

61.5%

54.0%

63.0%

n/a

 MTH 277

54.4%*

57.8%

72.9%

71.2%(n=52)

 MTH 291

57.7%*

77.8%

61.8%

N/A

 MTH 151

55.9%*

N/A

N/A

N/A

 MTH 152

54.5%*

N/A

N/A

N/A

 IST 128

62.6%*

N/A

N/A

N/A

*Pending Spring and Summer '99 completed

Table 9. Course-by-Course ELI vs. On-Campus Starter Success Rates, Cumulative

While course performance has varied by semester, this is probably a function of the particular collection of students enrolled in a course for a given semester rather than a reflection of the courses themselves. Other data indicate that performance varies at least as greatly from semester to semester within on-campus courses as it does between on-campus and ALN ELI courses.

VI. CONCLUSIONS

NVCC case study courses indicate that ALN courses, even those in their pioneering or early stages, can be a viable and successful way for community college students to learn. NVCC's experience with its case study and other ALN courses also support several other conclusions:

  • ALN can succeed in a distance education program delivered in an independent study format and designed to provide maximum flexibility and convenience to motivated learners.
  • ALN works within a multiple media approach to course and delivery; i.e., ALN courses do not have to be on-line cybercourses, but rather ALN courses that integrate various media can be delivered effectively.
  • Faculty selection, support, and development are critical factors in assuring quality ALN courses, in particular because faculty are a key resource in generating best practices in course design and delivery.
  • A wide variety of best practices can result in successful ALN courses, and we are just beginning to learn about what these best practices are.
  • The learning effectiveness of ALN courses will continue to improve as better tools, content, and support are developed.

VII. REFERENCES

  1. Sener, J. Developing a distance education engineering program for home-based learners: Lessons learned. Journal of Instruction Delivery Systems, pp. 41-45, Winter, 1996.
  2. Sener, J. Creating asynchronous learning networks in mathematics, science, and engineering courses for home-based learners. International Journal of Educational Telecommunications, Vol. 3, no. 1, pp. 23-40, 1997, http://www.aace.org/pubs/ijet/v3n1.html.
  3. Goral, D. Carrots, sticks, and distance learning II:  Math on the web. VCCS New Horizons Conference, Richmond, VA, April, 1999, http://elisp.nv.cc.va.us/dgnh99/index.html.
  4. Lemke, R. Encouraging and supporting asynchronous learning networks. First International Conference on Asynchronous Learning Networks, Philadelphia, October, 1995, http://elisp.nv.cc.va.us/aln.html.
  5. Sener, J., and Stover, M. An AS engineering degree program via ALN. Proceedings of the 1997 ASEE/IEEE Frontiers in Education Conference, Pittsburgh, PA, November, 1997.

ABOUT THE AUTHORS

John Sener is Project Director and Instructional Technologist for the Sloan-funded projects at Northern Virginia Community College's Extended Learning Institute. Over the past five years at NVCC/ELI, Mr. Sener has directed development of associate degrees in engineering, information systems technology, public management, and business management, available through home study and on-line distance education. He has been responsible for course and technology development, project evaluation coordination, marketing and publicity, budget supervision, and dissemination of project results. Mr. Sener's career in education and training over the past twenty-one years includes directing a number of foundation and federally funded projects; he has also been a trainer, teacher, administrator, instructional designer, and tutor in the areas of adult literacy, basic skills, information systems, and English as a Second Language. He holds a M.S. degree in Education from Johns Hopkins University and a B.A. in Psychology from Oberlin College.

Contact: Extended Learning Institute, Northern Virginia Community College, 8333 Little River Turnpike, Annandale, Virginia 22003; Telephone: 703-323-3712;Fax: 703-323-3392; E-mail: jsener@nv.cc.va.us; URL: http://elisp.nv.cc.va.us.

Mary Liana Stover is Assistant Dean for Communication, Arts, and Humanities at the University of Maryland University College. She is currently responsible for over 90 sections of ALN courses serving 4000 students in Foreign Language, English, History, and the Arts. From 1997 to 1999 Dr. Stover served as the Director of the Extended Learning Institute of Northern Virginia Community College where she worked with Sloan -funded projects to develop ALN degree programs in Engineering, Information Systems Technology, Public Management, and the Liberal Arts. An anthropologist by training, Dr. Stover has served on the faculty of the Open University in London, University of London Birkbeck College, Monterey Institute of International Studies, and the University of Hawaii.

Contact: Communication, Arts, and Humanities, Undergraduate Programs, University of Maryland University College, 3501 University Boulevard East, Adelphi, Maryland 20783; Telephone: 301-985-7877; Fax: 301-985-7910; Email: mstover@umuc.edu.