Evaluating the effect of cultural competency training on medical student attitudes, JC Crosson, W Deng, C Brazeau, L Boyd

Tags: health care, health beliefs, cultural competency, health care providers, Health Beliefs Attitudes Survey, student attitudes, training program, depression management, self efficacy, patient, perspectives, Liaison Committee on Medical Education, students, clinical medicine, physical examination, Treatment of Depression, quality health care, medical education, Problem-solving, medical students, intervention, Medical Student Attitudes, Linda Boyd, culturally competent care, cultural competency training, medical school, culturally competent, feasibility, Janette L. Seville, Drs Hegel, PST-PC, Family Medicine, family medicine residents, counseling skills, Allen J. Dietrich, depression, Weiling Deng, Primary care, New Jersey Medical School, patient care, Tervalon M. Components, Bureau of Health Professions, Population Projections Branch, Mindy Smith, Population Division, Divisions of Health Professions Diversity, Alison Dobbie, minority students, quality component, Health Resources and Services Administration, objective structured clinical examination, Acad Med, cultural perspective, perspective, family members, elderly patient, formal component, instructional videotape, Clinical faculty members, HBAS, correct diagnosis, Physicians, illnesses, clinical faculty member, interpreter
Content: Special Articles--Assessing Competence
Vol. 36, No. 3 199
Evaluating the Effect of Cultural Competency Training on Medical Student Attitudes Jesse C. Crosson, PhD; Weiling Deng; Chan tal Brazeau, MD; Linda Boyd, DO; Maria Soto-Greene, MD Background and Objectives: Developing skills for taking care of patients from a wide variety of backgrounds is a growing area of importance in medical education. Incorporating cultural competency training into undergraduate medical education is an accreditation requirement. Although there are an increasing number of such curricula reported in the literature, there has been little evaluation of their effectiveness. We describe a new undergraduate cultural competency curriculum, the reliability of an instrument for assessing student attitudes in this area, and the effects of our curriculum on student attitudes. Methods: Two introductory clinical medicine courses focused on the importance of providing culturally competent care to all patients. The courses used Problem-based Learning and a historytaking mnemonic to teach students to assess patients' perspectives. The authors verified the reliability of the Health Beliefs Attitudes Survey (HBAS) and used it to determine changes in students'attitudes on issues relating to cultural competency. Results: The HBAS reliably measured four cultural competency concepts. Student attitudes regarding the importance of assessing patient opinions and determining health beliefs improved significantly following the courses. Conclusions: The method used here to teach students cultural competency skills early in medical school positively affects student attitudes on cultural competency issues. (Fam Med 2004;36(3):199-203.)
The US Census Bureau projects that by 2050 the proportion of the population classified as non-Hispanic white will drop from 71% to 53%, resulting in a diverse cultural environment in which today's medical students will practice.1 In recognition of the increasing diversity of the US population, the most recent accreditation standards from the Liaison Committee on Medical Education (LCME) require that all students develop "an understanding of the manner in which people of diverse cultures and belief systems perceive health and illness."2 To meet this requirement, medical schools must develop curricula that teach students to assess and appreciate the cultural sources of each patient's health beliefs. Failure to develop these skills and attitudes may limit access to health care resources for some patients, pose risks to Patient Safety, and may contribute to the continuation of health disparities. In recent years, curricula and guidelines have been developed for both undergraduate and graduate medi-
cal education to meet the need for cross-cultural training of health professionals.3-9 However, there are relatively few published studies evaluating the effectiveness of these approaches.10-12 We describe and evaluate a method of cultural competency training that focuses on assessing health beliefs. We integrated this focus into existing medical school courses that introduce students to issues in clinical care and teach basic history taking and physical examination skills. The courses used problem-based learning and history-taking mnemonics to encourage students to assess patients' perspectives on their problems and to improve students' use of interpreters in patient care settings. To evaluate the effect of this new curriculum, we used the Health Beliefs Attitudes Survey developed by Dobbie et al.13 We report on the reliability of this instrument and the effect that the curriculum had on student attitudes toward assessing patients' health beliefs and other aspects of cultural competency.
From the Department of family medicine (Drs Crosson, Brazeau, Boyd, and Ms Deng) and Office of Education (Dr Soto-Greene), UMDNJ-New Jersey Medical School.
Met hods We revised two existing required courses on intro- duction to clinical medicine so that they nowinclude a focus on the importance of providing culturally com-
200 March 2004
Family Medicine
petent care. A total of 175 first-year medical students took the revised courses during the 2001­2002 academic year at New Jersey Medical School. Students taking the courses completed a 15-item survey before and after the courses to determine the importance that they placed on assessing patients' health beliefs. We examined the reliability and factor structure of the instrument. We also compared pre- and post-course scores on four factors relating to cultural competence to determine the effect of the courses on students' attitudes. Curriculum The students in this study were all first-year medical students at UMDNJ-New Jersey Medical School. At New Jersey Medical School, two courses in the first year introduce students to clinical medicine: the Art of Medicine (AOM) and the History and Physical Examination (H&P) courses. Prior to the start of the 2001­ 2002 academic year, we revised these two courses with two goals in mind. First, we wanted to focus on the importance of providing culturally competent care to all patients. The second goal was to reinforce key concepts related to culturally competent medical care by developing a more cohesive curriculum. A faculty committee in the family medicine department and a separate committee convened by the Office of Education worked on incorporating cultural competency instruction into these introductory courses and developed new course materials to accomplish these goals. The committees determined that students should gain knowledge about how cultural differences between providers and patients could affect health care. The committees also determined that students should gain history-taking skills to assess cultural differences and develop attitudes that accept the importance of assessing patients' beliefs and psychosocial-cultural context for providing good health care. AOM Course The first of these courses, AOM, uses the problem- based learning method to introduce students to some basic concepts of clinical medicine. Groups of seven or eight students work through a series of written patient cases with a faculty facilitator. The course director and the case authors set learning objectives for each case, which were included in a facilitator handbook and discussed at regular facilitator meetings. Since others have found that using a problem-based learning approach is successful in teaching humanistic attitudes and behaviors,14 we revised this course to provide students with an understanding of the influence of cultural and psychosocial factors on health beliefs and practices as well as to help students develop strategies likely to enhance communication with patients from a variety of backgrounds. The revised course used six cases depicting three generations of a multiracial/multiethnic family. These cases include issues relating to cultural and linguistic
differences between family members and health care providers. For example, one of the cases depicts a patient who does not speak English and has a family member serving as an interpreter. Another case involves an elderly patient who uses a folk remedy to treat a serious medical condition. As part of their investigations and discussions in this course, students learn to construct history-taking questions that elicit patients' perspectives on their problems. In addition, students discuss how to deal with situations where the perspective and values of the patient differ from their own. The facilitator handbook instructed faculty members in ways to challenge students to discuss how their own preconceptions and prejudices about particular patients could affect patient care. H&P Course The revised H&P course has groups of 12 to 14 stu- dents who work with a clinical faculty member to learn how to take a complete history and perform a physical examination on a patient who has no significant abnormal findings. The overall goal of the revised course was for students to gain competencies in performing the history and physical examination in a professional manner while meeting the needs of diverse populations. To teach students how to elicit the patients' perspective on their problems as a formal component of history taking, we used a portion of the ETHNIC mnemonic developed by Levin et al.15 Using this mnemonic, stu- dents elicit patients' perspectives on their problems by determining their Explanation of the problem, the Treatments that they have sought or would like, and the Healers that they have consulted. Since developing a plan based on the history is a more advanced skill, students learn the remainder of the mnemonic involving Negotiation, Intervention, and Collaboration in the second and third years. Additionally, students watched an instructional videotape designed to improve their ability to work with an interpreter in health care settings.16After viewing the videotape, students learned to use a new history-taking mnemonic designed to aid in the use of interpreters.17 Clinical faculty members teaching this course also viewed the videotape and received training in the use of these mnemonics. At the same time that students are taking the H&P course, they also participate in a primar y car e preceptorship. This preceptorship provides students with the opportunity to observe the practice of general internal medicine, general pediatrics, and family medicine in ambulatory clinical settings. In these settings, students also have the opportunity to practice the physical examination and history-taking skills that they are beginning to develop in the H&P course. To reinforce in the clinical setting the skills learned in the course, preceptors receive regular updates about the H&P curriculum along with a copy of the mnemonics used in the course.
Special Articles--Assessing Competence
Vol. 36, No. 3 201
Survey Instrument A literature search for survey instruments we could use to assess students' attitudes toward cultural competency issues found no published instruments suited to our purposes. We obtained permission to use a new instrument developed by Dobbie et al, the Health Beliefs Attitudes Survey (HBAS).13 This survey was constructed by a group of nationally recognized experts in the field of cultural competency and was targeted at the areas that we wanted to assess. The HBAS consists of 15 items, scored on a 6-point Likert-type scale, assessing various aspects of students' attitudes toward how cultural competency relates to health care quality (see Table 1 for survey items). Questions 3, 5, 7, and 15 were worded negatively to help ensure data quality. Since reports on the reliability of the instrument have not been published,13 we undertook additional analyses to verify the reliability of the HBAS. data collection After we obtained approval from our Institutional Review Board, faculty facilitators distributed surveys in February 2002, at the beginning of the AOM course. Out of 175 first-year students, 114 completed the initial HBAS, for a response rate of 65%. In May 2002, as part of the evaluation process at the end of the H&P course, 151 students completed the survey again for a
response rate at follow-up of 86%. Complete data was available for 91 students, representing 80% of baseline respondents and 52% of all first-year students. Data Analysis To assess the reliability of the HBAS, we computed Cronbach's for students' survey responses both before and after the intervention. We identified the constructs measured by the instrument through principal components analysis with varimax rotation of the pre- intervention survey responses. After reverse coding items that were negatively worded on the instrument, we used principal axis factor analysis with oblique rotation to verify the presence of the factors identified through the principal components analysis. Component or factor loadings of 0.4 or greater were used to identify the main components or factors. We then averaged the responses to questions associated with each particular component or factor to construct component scores. In cases where items loaded onto more than one component, they were only included in the component with the highest loading. Using only those cases with complete data, we examined the component scores using paired samples t tests to determine the relationship of the courses to students' attitudes. In addition, we used independent samples t tests to compare the attitudes of different
Table 1
Principal Components Analysis of Baseline Health Beliefs Attitudes Survey Data (February 2002--n=114)
Importance of assessing patients' perspectives and opinions (Opini on): (=.7620)*
I-1
Physicians should ask patients for their opinions about their illnesses
I-3
Patients may lose confidence in physician if physician asks their opinion about their illness or problem
I-6
Understanding patients' opinions about their illnesses helps physicians provide better care
I-10
Physicians can learn from their patients' perspectives on their illnesses
I-13
Physicians should make empathic statements about their patients' illnesses
Importance of determining patients' beliefs for hi story taking and treatment (Belief): (=.6670)*
I-2
It is important to know patients' points of view for the purpose of diagnosis
I-4
Understanding patients' opinions about their illnesses helps physicians reach correct diagnosis
I-8
Physicians should ask their patients what they believe is the cause of their illness
I-11
Physicians should ask their patients why they think their illness has occurred
Importance of assessing patients' psychosocial and cultural contexts (Context): (=.6362)*
I-9
Physicians should learn about their patients' cultural perspective
I-12
Physicians should ask about how an illness is impacting a patient's life
I-14
Physicians should ask patients for their feelings about their illnesses
Importance of knowing the patient's perspective for providing good health care (Quality): (=.6137)*
I-5
Physicians can give excellent care without knowing patients' opinions on their illnesses or problems
I-7
Physicians can give excellent health care without knowing patients' understanding of their illness
I-15 Physicians do not need to ask about patients' personal lives or relationships to provide good health care
Component Loading .740 .669 .771 .655 .651 .436 .577 .804 .738 .699 .770 .513 .668 .765 .672
* Cronbach's alpha for the subscale Factor loadings > .4 retained Items reverse coded when constructing component scores so that strong agreement=1, strong disagreement=6
202 March 2004
Family Medicine
demographic groups. To examine the relationship be- ing patients' beliefs is an important part of history tak-
tween the components of the survey and student age, ing and treatment, (3) Context: understanding psycho-
we used bivariate correlation. To test for possible re- social and cultural contexts is important, and (4) Qual-
sponse bias, we compared the demographic character- ity: knowing the patient perspective is important in pro-
istics of those who completed either the baseline or viding quality health care. The principal axis factor
follow-up surveys with those who completed both sur- analysis with oblique rotation c onfirmed this four-
veys, using Pearson chi-square. In addition, we com- construct structure.
pared the responses to the survey items of these two
At baseline, women had significantly higher scores
groups using independent samples t tests.
on several of the questions (5, 9, 12, and 14, P<.05)
and on two of the four components: context (P=.001)
R esu lt s
and quality (P=.019). At follow-up, women had sig-
For those students with complete data (n=91), 45% nificantly higher scores on some of the survey items
were women, which is identical to the gender break- (5, 6, 7, and 9, P<.04) and on the quality (P<.001) and
down of the class as a whole. Further, 50% identified opinion (P=.022) components. Age was correlated sig-
themselves as white, 32% as Asian American, 9% His- nificantly with responses to item 8 (r=.226, P=.032)
panic, 3% African American, with the remainder (7%) on the baseline survey, indicating that older students
identifying other racial/e thnic backgrounds. The were more in agreement with the importance of asking
registrar's office reported that for the class as a whole, about what patients believe to be the cause of their ill-
47% were white, 31% Asian, 12% Hispanic, and 10% ness at baseline. In addition, older students agreed more
African American. The mean age of respondents was on the follow-up survey with the importance of asking
24 years and ranged from 21 to 35 compared to a mean about the relationships and personal lives of their pa-
age for the class of 23 with a range of 19 to 35. The tients for delivering good quality care following the
sample includes fewer African American and Hispanic courses (question 15, r=.247, P=.018). There were no
students than in the class as a whole.
other significant age-related differences. There were no
Cronbach's for the pre-intervention survey was significant differences at either baseline or follow-up
.785 and .859 for the post-intervention survey. Previ- relating to ethnicity. Compared to those responding to
ous uses of the survey had found similar reliability co- only one of the surveys, the respondents to both sur-
efficients.13
veys were more likely to identify themselves as white
The principal components analysis of students' re- (50% versus 34.4%, P=.007) or Asian (32.2% versus
sponses to the HBAS before the intervention revealed 22.2%, P=.007). However, those responding to only one
a four-component structure (see Table 1). The four con- of the surveys did not differ significantly on any of the
structs were (1) Opinion: assessing patients' perspec- components at baseline or follow-up from those who
tives and opinions is important, (2) Belief: determin- responded to both surveys.
Comparison of pre- and post-inter-
vention scores on the above four com-
ponents showed statistically significant
Table 2
improvement in two of the four constructs: opinion (P=.016) and belief
Health Beliefs Attitudes Survey Component Scores*
(P<.001). Student scores also improved on the remaining components but did
Pre Intervention
Post Inte rv e ntion
not reach statistical significance (Table
Factors
(February2002) Mean SD
(May 2002)
Mean
SD
2). t Statistic P Value
Opinion (1) Belief (2)
4.88 .81 4.49 1.10
5.10
.65
5.08
.81
2.552
.012
4.850
.000
Discussion
Context (3) Quality (4)
5.44 .63 4.38 .93
5.45
.62
4.62
.83
.097
.923
2.291
.288
The curricular methods used here contributed to an improvement in stu-
Note: n=91
dents' attitudes toward the importance
SD--standard deviation
of assessing patients' health beliefs. Women were more likely to see the
(1) Importance of assessing patients' perspectives and opinions
value of knowing the patient's perspec-
(2) Importance of determining patients' beliefs for history taking and treatment (3) Importance of assessing patients' psychosocial and cultural contexts (4) Importance of knowing the patient's perspective for providing good health care
tive for providing good quality health care both before and after the intervention. Further, while older students were
* Component scores are the mean of responses to items scored on a 6-point scale (1=strongly disagree to 6=strongly agree)
somewhat more likely to agree with some of the survey items both before and after the intervention, this differ-
Special Articles--Assessing Competence
Vol. 36, No. 3 203
ence was not evident in the component scores, indicating that age is not a significant determinant of cultural competency attitudes measured by the survey. The lack of significant differences in attitudes when comparing minority students to other students may be the result of the relatively small number of students from minority groups participating in the study. Although we did find a significant change in students' self-reported attitudes after these two courses, we do not know the extent to which this learning will improve the history-taking practices of students in clinical encounters. Further, we do not know how long the change in attitudes observed here will persist, and others have found that such attitudes are likely to fade over time.18 Future research will focus on determining whether these improvements in student attitudes toward assessing patients' health beliefs persist throughout their education and the extent to which they translate into different clinical behaviors. As part of these efforts, we plan to reassess student attitudes later in their experience and to add the assessment of health beliefs and other cultural competency skills to the graduation objective structured clinical examination currently required at our institution. Limitations Although we did get high response rates on both the baseline and follow-up surveys, because different students were nonrespondents to the two surveys, we had complete data for only 52% of the class. While this may have introduced some response bias, our examination of those students who responded to only one of the surveys showed that their attitudes were not significantly different, at either baseline or follow-up, from those who responded to both surveys. The relatively high baseline scores on the context component may have contributed to the lack of significant improvement in this area and may suggest a need for further refinement of questions in this area. Finally, although we did not see statistically significant improvement on the quality component, this could be the result of student inexperience with regard to what determines quality health care. As students gain clinical experience using the techniques learned in these beginning courses, they may come to value more highly the understanding of cultural context and the relationship of cultural competency to the quality of health care. Conclusions The effective teaching of cultural competency atti- tudes and skills such as those targeted in our intervention is increasingly important in undergraduate medical education. Teaching the importance of assessing patients' understanding of their problems early in the medical school curriculum can have a positive influence on the importance that students assign to this as-
sessment and may help future physicians to be more culturally competent, patient-focused, health care providers. Acknowledgments: This project was supported by a Hispanic Center of Excellence grant from the Divisions of health professions Diversity and Development, Bureau of Health Professions, Health Resources and Services Administration (2 D34 HP 02045-10). We thank Alison Dobbie, MD, for her permission to use the HBAS. We also thank Mindy Smith, MD, MPH, and the two anonymous reviewers for their comments on earlier versions of this paper. Corresponding Author: Address correspondence to Dr Crosson, UMDNJNew Jersey Medical School, Department of Family Medicine, 185 South Orange Avenue, MSB B-648, Newark, NJ 07107. 973-972-5195. Fax: 973972-7997. [email protected] REFERENCES 1. Census Bureau, Population Division, Population Projections Branch. Projections of the resident population by race, Hispanic origin, and nativity: middle series, 1999­2100. Washington, DC, January 2000 (revised August2, 2002). http://landview.census.gov/population/www/projections/natsum-T5.html. Accessed April 30, 2003. 2. Functions and structure of a medical school: standards for accreditation of medical education programs leading to the MD degree. Washington, DC: Liaison Committee on Medical Education, March 2003. 3. Carillo JE, Green AR, Betancourt JR. Cross-cultural primary care: a patient-based approach. Ann Intern Med 1999;130(10):829-34. 4. Loudon RF, Anderson PM, Gill PS, Greenfield SM. Educating medical students fo r work in culturally diverse societies. JAM A 1999 ; 282(9):875-80. 5. Azad N, Power B, Dollin J , Cherry S. Cultural sensitivity training in Canadian medical schools. Acad Med 2002;77:222-8. 6. Like RC, Steiner RP, RubelAJ. Recommended core curriculum guidelines on culturally sensitive and competent health care. Fam Med 1996;28(4):291-7. 7. Culhane-Pera KA, Like RC, Leben soh n-Chialvo P, L oewe R. Multicultural curricula in family p ractice residencies. Fam Med 2000;32(3):167-73. 8. Tervalon M. Components of culture in health for medicalstudents'education. Acad Med 2003;78:570-6. 9. Dolhun EP, Munoz C, Grumbach K. Cross-cultural education in US medical s chools : development of an ass essment to ol. Acad Med 2003;78:615-22. 10. BetancourtJR. Cross-culturalmedical education: conceptual approaches and frameworks for evaluation. Acad Med 2003;78:560-9. 11. Godkin MA, Savagneau JA. The effect of a global multiculturalism track on cultural competence of preclinical medical students. FamMed 2001;33(3):178-86. 12. Crandall SJ, George G, Marion GS, Davis S. Applying theory to the design of culturalcompetency training for medical students: a case study. Acad Med 2003;78:588-94. 13. Dobbie AE, Medrano M, Olney C, Welsh K, Tysinger J. A curriculum in health beliefs for first-year medical students. Presented at the 2002 Society of Teachers of Family Medicine Predoctoral Education Conference in Tampa, Fla. 14. Vernon DTA, Blake RL. Does problem-based learning work? A metaanalysis of evaluative research. Acad Med 1993;68:550-63. 15. Levin SJ, Like RC, Gottlieb JE. ETHNIC: a framework for culturally competent clinical practice. In appendix: Useful clinical interviewing mnemonics. Patient Care 2000;34:188-9. 16. The Cross Cultural health care program at PacMed Clinics. Communicating effectively through an interpreter: an instructional video for health care providers. www.xculture.org. Accessed May 14, 2003. 17. Cominolli R, Soto-Greene M, Salas-Lopez D. INTERPRET: a framework for providers and interpreters. Newark, NJ: Office of Education, UMDNJ-New Jersey Medical School, 2002. (available from the first author). 18. Began BL. Teaching social and culturalawareness to medical students: "it's all very nice to talk about it in theory, but ultimately it makes no difference."Acad Med 2003;78:605-14.
204 March 2004 Residen cy Education
Family Medicine
Training Residents in Problem-solving Treatment of Depression: A Pilot Feasibility and Impact Study Mark T. Hegel, PhD; Allen J. Dietrich, MD; Janette L. Seville, PhD; C aren B. Jordan, PhD
Background and Objectives: primary care patients with depression may prefer or require a non-pharmacological treatment such as counseling. We investigated the feasibility of teaching family medicine residents an evidence-based brief counseling intervention for depression (Problem-solving Treatment of Depression for Primary Care [PST-PC]). Methods: Eleven residents over 3 consecutive years were provided a brief training program in PST-PC. Residents were evaluated for skill acquisition, changes in self efficacy, intentions to improve their care for depression, and post-residency integration of PST-PC into their daily practice. Results: Trainees met established criteria for competency to administer PST-PC. They improved to moderate-to-high levels of self efficacy for treating depression, including for their counseling skills, and in their intentions to improve their depression management. At up to 3 years post residency, 90% indicated they were using PST-PC, often in a modified form, and also for illnesses other than depression. They indicated they would recommend the training to new residents. Conclusions: The PST-PC training program evaluated in this study is feasible in residency training and appears to influence practice post residency. These findings warrant continued investigation of this training program with a larger sample of residents and evaluation of outcomes with depressed patients treated with PST-PC in realworld practice settings. (Fam Med 2004;36(3):204-8.)
Depression is one of the most prevalent illnesses seen in primary care practice,1 but patients may refuse or not respond to antidepressant medication and may be unwilling to accept referral to Mental health professionals.2,3 Evidence-based counseling interventions exist, but due to their length and complexity, family physicians are not often trained to use them.4-8 Family physicians regularly provide pragmatic supportive counseling, such as planning pleasant activities,9 and are receptive to learning evidence-based counseling methods,10 but feasible treatment methods and training models are needed. Problem-solving Treatment of Depression for Primary Care (PST-PC) is a brief intervention specifically designed for primary care that is effective for reducing depressive symptoms and increasing function among patients with major depression and possibly minor depression and dysthymia.11-14 PST-PC has been shown to be equally effective when provided by nurses and From the the Department of Psychiatry (Drs Hegel, Seville, and Jordan) and the Department of Community and Family Medicine (Drs Hegel and Dietrich), Dartmouth Medical School.
primary care physicians as by mental health professionals.13-15 PST-PC is comprised of seven treatment steps that are outlined in Appendix 1 and have been thoroughly described elsewhere.16,17 The full seven-step PST-PC treatment program is typically conducted in four to six 30-minute office visits. However, the capacity to deliver more brief modules makes it feasible for visits as short as 10­15 minutes. The PST-PC training program used for research is time consuming.16,17 If PST-PC is to have an influence in family medicine, then a more feasible training model must be developed. We redesigned the PST-PC training model (Table 1) to be more suitable for a residency program and examined its feasibility and effect in terms of acquired skills, self efficacy in depression management, and reported routine use after training. Met hods Study Design Three consecutive classes of residents (n=11) were provided training by the first author during their second year of residency. Evaluation of residents' performance included videotape reviews of the two PST-PC role-play sessions, self-report questionnaires completed

JC Crosson, W Deng, C Brazeau, L Boyd

File: evaluating-the-effect-of-cultural-competency-training-on-medical.pdf
Title: Part II-March 2004.pdf
Author: JC Crosson, W Deng, C Brazeau, L Boyd
Author: Julie
Published: Wed Mar 3 10:25:36 2004
Pages: 6
File size: 0.04 Mb


Noncoherent coded modulation, 12 pages, 1.15 Mb

, pages, 0 Mb

Class Schedule, 1 pages, 0.66 Mb

, pages, 0 Mb

Explorations in Australia, 292 pages, 1.09 Mb
Copyright © 2018 doc.uments.com