Rajiv Jhangiani, Ph.D.

Open Education, SoTL, Psychology

Page 2 of 3

Are open textbooks the end game?

“I don’t want to be part of a movement that is focused on replacing static, over-priced textbooks with static, free textbooks.” I hope Robin DeRosa’s thoughtful post about open textbooks provokes some reflection on the tone and goals of the open textbook movement and its advocates. It begs the question of whether we are waging the wrong war here, at least in part. Continue reading

Pilot testing open pedagogy

This summer, as has become usual practice for me, I adopted open textbooks for my Introductory Psychology and Social Psychology sections (produced by NOBA and the BC Open Textbook Project, respectively); however, my desire to enjoy a semester entirely free from traditional textbooks was challenged by the absence of a high quality open textbook for Cognitive Psychology. Continue reading

Tunnelling up: Announcing a new book project

A measure of salvation by cujoquan. Retrieved from https://flic.kr/p/Lnp6f CC-BY-NC-SA 2.0

The open education community is multidisciplinary and consists of passionate and intrinsically motivated leaders. In inspiring one another, we serve as caretakers of our mutual flame. We are the core. Continue reading

Textbooks? Where we’re going we don’t need textbooks!

Back to the future time machine

As many of you will remember, 2015 is the “future” year in the beloved 1985 film “Back to the Future.” Although this may make you chuckle, I believe that Doc Brown had it right and that at least part of the future is here.

Consider this: In a now-famous blog post, David Wiley argued that “using OER the same way we used commercial textbooks misses the point. It’s like driving an airplane down the road. Yes, the airplane has wheels and is capable of driving down on the road (provided the road is wide enough). But the point of an airplane is to fly at hundreds of miles per hour – not to drive. Driving an airplane around, simply because driving is how we always traveled in the past, squanders the huge potential of the airplane.”

As always, David makes an important point in a persuasive fashion. But let me add what I believe is the perfect meme to his argument with a slightly amended version of the famous final scene of the iconic film:Doc Brown meme

From believer to dOER

It was in May of 2013 that I first heard David Wiley speak about open textbooks. That experience catalyzed my involvement with reviewing, adopting, and adapting open educational resources (OER). In May of 2014 I heard David speak once again (as the keynote speaker at last year’s Open Textbook Summit). Since then I have been immersed in research projects on the impact and efficacy of OER, advocacy as a Faculty Fellow with BCcampus (including a number of workshops at universities in BC), and a second open textbook revision. Of course all of this means that it has been rather too long since my last post and that I have a number of open education-related updates to share:

1. I recently concluded the data collection phase of a major survey of BC faculty who have adopted open educational resources (OER) in the classroom. The online survey was a collaboration with BCcampus, with whom I work as a Faculty Fellow (along with Christina Hendricks and Jessie Key), and Beck Pitt of the UK-based OER Research Hub. We are currently in the process of analyzing these data but the preliminary results look very promising. Among other things, the responses to the survey will shed more light on the types of OER that faculty have been using, their motivations for using OER, barriers, enablers, and a host of other contextual information that will help us to develop roadmaps for OER adoption and adaptation within the BC post-secondary context.

2. I just launched a major survey of BC students aimed at assessing the impact of open textbook adoption on their personal and educational outcomes, including cost savings, employment status, course performance, and program completion rates.

3. I am collaborating with my colleagues Farhad Dastur and Richard Le Grand in carrying out a quasi-experimental investigation of the impact of open textbook adoption on students taking introductory psychology at KPU.

4. Also with Farhad Dastur, I developed a course on Research Methods in Psychology for Thompson Rivers University’s Open Learning Division and the OERu. The course is unique in that it has been constructed entirely with OER and resides in Wikieducator.

5. I am putting the finishing touches to a chapter I wrote titled “Unleashing openness in the teaching of introductory psychology.” The chapter will be published later this year in a book about Thematic Approaches to Teaching Introductory Psychology. As soon as it is ready I will post a copy on this site. [Update (May 24, 2015): A pre-publication copy is now available online].

6. I co-facilitated a webinar during Open Education week titled “Distinguishing the dOERs” during which Beck Pitt and I shared some data from our research on faculty adopters and adapters of OER.

7. Over the next few months I will give a number of presentations about open textbooks, open educational resources, and open pedagogy at a variety of meetings and conferences, including the following:

  • “Using open pedagogy to promote critical skill development” at the Teaching Introductory Psychology – North West Conference
  • “Giving psychology away: The impact of open textbook adoption on psychology students” at the 2015 Psychology Articulation Meeting.
  • “An openness to openness: The terrifying and liberating process of disrupting higher education” – the keynote address at the 2015 Open Textbook Summit. Vancouver, Canada
  • “Academic librarians and OER: Access, advocacy, and activism” at the 2015 BC Library Conference, Vancouver, Canada.

I am looking forward to each of these but was especially honoured to be invited to deliver the keynote address at the Open Textbook Summit. I am not yet certain that I am deserving of following in David’s footsteps but will do my darndest to deliver a memorable experience.

8. Finally, I should say that it has been wonderful to see the Open Education movement get so much local press lately. Given that awareness of OER is still a major barrier, I have been delighted to see press releases from the Ministry of Advanced Education, an interview with CBC Radio, and articles in the Surrey Now, Indo-Canadian Voice, Chilliwack Times, and The Link feature our work. This coverage really helps raise awareness and build momentum which, together with a supportive institutional culture, will create more many more believers and, I daresay, a few more dOERs.

OER for Psychology

Later this week Farhad Dastur and I will present at a symposium at the Annual Conference on the Teaching of Psychology in Atlanta, organized by the Society for the Teaching of Psychology. Our symposium is titled “Opening up psychology: Adopting open textbooks, open pedagogy, and an open philosophy in the classroom.” The following is a list of some Psychology-specific OER for those who attend our symposium. It is not an exhaustive list by any means but is a start: [Click here to download the list: Psychology OER]

NOBA Project: http://nobaproject.com/

BC Open Textbook Project: http://open.bccampus.ca/

Resources for Teaching Research and Statistics in Psychology: http://www.teachpsychscience.org/

Go Cognitive: http://www.gocognitive.net

Cognitive Psychology Wiki: http://cognitivepsychology.wikidot.com/

STP Office of Teaching Resources in Psychology: http://teachpsych.org/otrp/resources/index.php

APA Online Psychology Laboratory: http://opl.apa.org/

Personality Pedagogy: http://personalitypedagogy.arcadia.edu/

Animations for Teaching: http://garyfisk.com/anim/index.html

Social Psychology Teaching Resources: http://www.socialpsychology.org/teaching.htm

Timothy Bender’s Memory & Cognition Demonstrations: http://courses.missouristate.edu/timothybender/mem/mydemos.html

Rossman/Chance Applet Collection: http://www.rossmanchance.com/applets/index.html

Consortium for the Advancement of Undergraduate Statistics & Education: https://www.causeweb.org/webinar/activity/

Interpreting Correlations: http://rpsychologist.com/d3/correlation/

The Brain from Top to Bottom: http://thebrain.mcgill.ca/

Research Methods Knowledge Base: http://www.socialresearchmethods.net/kb/

Fostering Sustainable Behavior (textbook): http://www.cbsm.com/pages/guide/preface/

TED Ed: Psychology: http://ed.ted.com/lessons?category=psychology

Psychology Tutorials & Animations: http://psych.hanover.edu/Krantz/tutor.html

 

Other General Repositories & Providers of OER

MIT Open Courseware: http://ocw.mit.edu/courses/brain-and-cognitive-sciences/

Saylor Academy Library: https://saylor.longsight.com/

OpenStax College: http://openstaxcollege.org/books

OpenStax CNX: http://cnx.org/

Merlot: http://www.merlot.org/

OER commons: https://www.oercommons.org/browse/keyword/psychology

The Fellowship of the Open

Over the past year I have had the pleasure of working with the fine folk at BCcampus a fair bit – first as a reviewer of two open textbooks, then as an adopter of three, adapter of two, organizer of an open test bank sprint, and a co-presenter at professional development workshops at Capilano University and Kwantlen Polytechnic University. So when I saw another potential excuse to spend time with Mary, Amanda, and Clint, I couldn’t help but apply for one of three Faculty Fellow positions with their open education program.

Today was the first meeting of us fellows – Christina Hendricks (UBC Philosophy) and Jessie Key (VIU Chemistry) are the other two – at BCcampus headquarters in Victoria. We received a briefing about the status of the Open Textbook Project and discussed our roles over the next year (mainly research, advocacy, & feedback to the OT team). In some ways this will be a continuation of our efforts thus far but there are many new opportunities as well (e.g., outreach within our disciplines and to student groups, presenting at the next Open Textbook summit in Vancouver, research funding, etc.). I am especially pleased to lead the research initiative, including an online survey of BC faculty that Clint and I have been working on recently with Beck Pitt (OER Research Hub) that is almost ready for launch, and that fits very well within my own research agenda at KPU.

Christina and Jessie are already doing remarkable work in the open arena and I look forward to working closely with them. Our mandate is thrilling, we have great support at BCcampus, and I believe we will collectively be able to help tangibly advance the open education agenda here in BC.

The Future is Open (https://creativecommons.org/weblog/entry/43164) by Luke Surl under CC BY (http://creativecommons.org/licenses/by/4.0/)

The Great Psychology Testbank Sprint

Well, we did it. Seventeen psychology faculty from six post-secondary institutions in British Columbia came together on July 18 & 19 and worked intensively for two days to create a testbank designed to accompany open textbooks for introductory psychology. As I have previously written about, the absence of ancillary materials (a testbank most of all) presents a significant challenge to instructors who wish to adopt an open textbook. Although some observers will turn their noses up at the thought of faculty not writing every single one of the questions on their exams, the reality is that many (overworked) instructors of large, multi-section survey courses do start working from the publisher-supplied testbank, writing, revising, and editing as necessary over time. The need for this crutch becomes even more pronounced for new faculty that do not have years of classroom and assessment experience to draw on, sessional faculty assigned to a course only weeks ahead of the first class meeting, and large sections with limited teaching assistant support. For those of us that advocate for the adoption of open educational resources in the classroom, ignoring or criticizing this reality is self-defeating.

Fast forward to this May when, following a series of productive conversations with Mary Burgess (Director of Open Education at BC Campus) and Peter Lindberg (NOBA Project), I was able to secure the financial support of both organizations to coordinate a “testbank sprint.” Modelled on the efforts of textbook sprints that, for example, bring together a number of faculty members for a few days to write a textbook from scratch, the idea was to invite faculty from a number of psychology departments in BC to come together for two days for a retreat-style sprint.

At the best of times, writing questions is not enjoyable work, so I knew that in order to recruit enough participants and to create a productive environment the sprint would have to be interspersed with opportunities for socializing and rejuvenation. Another goal was to gather sprinters from a variety of institutions (the wider the representation, the more natural the sense of ownership and buy-in). Finally, the challenge of producing a resource like this for Introductory Psychology is the sheer number of topic areas (15) that need coverage. Thus we would have to find a way of collecting data about potential participants’ areas of expertise and mapping these onto the topic areas in order to ensure adequate coverage.

Enter the Organizing Team

Following a couple of discussions with members of my department at Kwantlen Polytechnic University, three wonderful souls in Dianne Crisp, Cory Pedersen, and Levente Orban stepped forward to offer their assistance with organizing the sprint. Together we dealt with the questions of when to hold the sprint (mid-July, in time for Fall adoptions), where to hold it (the Cheam Golf Course in Chilliwack with accommodations at the nearby Coast Chilliwack hotel – central enough for those travelling from Victoria or Kamloops but far enough away to feel like a retreat), how to recruit faculty (the Articulation listserve + direct emails to those with past involvement in open education projects), how to map availability & areas of relative expertise onto the 15 topic areas of Introductory Psychology (enter the technical wizardry of Levente with custom online forms and formulae-laden Excel worksheets), and how to structure the event (see below).

Nineteen faculty signed up and, although two dropped out just 48 hours before the sprint was to begin, seventeen faculty representing the psychology departments at Kwantlen Polytechnic University, Thompson Rivers University, Camosun College, Northern Lights College, Capilano University, and the University of the Fraser Valley met in Chilliwack on July 18. The amazing Clint Lalonde from BC Campus was also on hand to provide logistical and technical support for both days of the sprint.

The Cheam Mountain Golf Centre welcomes us

The Cheam Mountain Golf Centre welcomes us

The logo for our sprint (yes, I got carried away with my role)

The logo for our sprint (yes, I got carried away with my role)

Sprint Structure

The sprint was structured around 3 90-minute working sessions each day for two days, interspersed with breakfast, coffee breaks, and lunch. Following an early breakfast we began on both days with an orientation at 8:30am. The working sessions ran from 9-10:30am, 11am-12:30pm, and 1:30-3pm, with a final progress update & wrap up from 3-3:30pm. Dragon boating and a hosted dinner were scheduled for the afternoon/evening of July 18 while the sprinters were free to play 18 holes of golf on the afternoon of the 19th.

The seventeen faculty were assigned to one of 7 working groups of 2-3 faculty for each session, with each group responsible for writing questions for a specific topic area. The composition of the groups and the topics changed every session such that by the end of the second session on Day 2 of the sprint each faculty member had participated in 5 working groups and each topic area had been visited by two working groups. From an organizational point of view this was a bit like playing with a Rubik’s cube with 17 squares and 15 sides. Only the squares had feelings and the saturation of the colours was not always the same.

The target for each working group during their 90 minute session was to write an average of 10 high-quality multiple-choice questions per group member (~20-30 questions per topic per session and ~50 questions per topic or ~750 questions in total by the end of the sprint). To help with this we circulated the topic assignments and a document outlining some best practices for good multiple-choice questions ahead of the sprint (the sprinters were encouraged to think about or even write questions ahead of time and to bring their own laptops).

The final session on Day 2 was devoted to the vetting and categorization (Applied, Conceptual, or Factual) of questions. I assigned one faculty member to go through and vet all of the questions written for one topic area in which they had intermediate-to-high expertise. Minor problems could be fixed immediately but larger problems had to be flagged. Flagging a question meant that another faculty member with overlapping expertise would have to be consulted to see if the question could be resuscitated or whether it had to be deleted (deletion was always a two-person decision). I should note here that we did not have an easy template to follow for any of this so the structure and rules of the sprint really resulted from my sense of what would work well. Mercifully it all went to plan and when I solicited feedback and suggestions at the end of the first day the group appeared very happy with how things were going.

Battle stations

Battle stations

Vetting questions

Vetting questions

The Finish Line

So how did we do? By the end of the fifth session we had collectively written 870 questions across the 15 topic areas (comfortably surpassing my initial target of 750 questions). Following the vetting process in the final session on Day 2, we finished with 851 questions (296 Applied, 219 Conceptual, & 336 Factual). Very soon this entire testbank will be made available by BC Campus to any recognized psychology faculty, in a format that can imported into any LMS. In other words, mission accomplished, under budget and on schedule.

Perhaps most importantly though, we truly enjoyed ourselves. Both process and outcome, journey and destination, were gold.

Happy Sprinters

Happy Sprinters

Some Observations

  • Although some working groups began writing questions collaboratively, most found that they worked more productively when they divided the learning objectives/sub-topics and worked in parallel. Having said this, some truly enjoyed writing questions collaboratively.
  • The target of 10 questions per faculty member per 90 minute session was found to be reasonable and well-calibrated.
  • Although we had installed testbank creation software on a KPU-issued laptop at each of the seven stations Clint and I decided ahead of the sprint that it would be easier and a time-saver to have everyone enter questions (using the correct format) into a more familiar tool (MS Word) instead. The software permitted the easy import of questions from Word.
  • Our hosts at the golf course remarked several times at how quiet we were while working. This was generally true as the soundtrack of each session was a steady chorus of fingers on keyboards punctuated with laughter (one of the sources of laughter was the amusement we spontaneously derived from embedding one another’s first names into many of the applied questions!).
  • Given the nature of the work we were there to perform I remain amazed by the level of enjoyment we derived. The dominant and universal theme in the feedback I have received since the end of the sprint has been how much fun it was.
  • As noted by someone during our dinner at the end of Day 1, dragon boating on Harrison Lake on the first evening proved to be the ideal metaphor for the sprint. We were in it together, we had to coordinate our efforts well, we had one person (me) providing continual feedback to the group while staying mindful of our pace and progress, we rested in between sessions of hard work, we laughed a lot, truly cherished one another’s company, and experienced a rather unforgettable adventure.

The Heroes of the Sprint

My thanks to my organizing team (Dianne Crisp, Cory Pedersen, & Levente Orban from Kwantlen Polytechnic University), other fellow sprinters (Betty Rideout, Carla Maclean, David Froc, Farhad Dastur, John Marasigan, Kurt Penner, Kyle Matsuba, and Richard LeGrand from Kwantlen Polytechnic University, Jacqueline Kampman from Thompson Rivers University, Randal Tonks from Camosun College, Istvan Geczy from Northern Lights College, Hammond Tarry from Capilano University, Wayne Podrouzek from the University of the Fraser Valley, and  Clint Lalonde from BC Campus), ed-tech whiz Meg Goodine from Kwantlen Polytechnic University, and project sponsors (Mary Burgess from BC Campus and Peter Lindberg from the NOBA Project). Thanks also to the Mavericks Dragon Boat Team for hosting us on the evening of July 18.

See Also

Clint’s blog post from Day 1 of the sprint

Press coverage of our work by the Chilliwack Times

A Faculty Perspective on Open Textbooks

Recently I have found myself at many meetings and events (e.g., the Open Textbook summit) centered on Open Education. Despite my non-representativeness due to self-selection, I am often called upon at these meetings to represent the “faculty perspective.”

As much as I would love to do this, in my experience, there is no single faculty perspective on open education in general and open textbooks in particular. Some, like myself, are early adopters. Others are willing to go along if their concerns are addressed. Still others remain skeptical and resistant. And there are many views in between, many of which contain a mixture of curiousity, interest, and concern. And this is not a bad thing. Academic freedom is sacred. And, at least in my experience, a faculty members’ teaching philosophy is often intimately connected with their openness to openness.

Most faculty I know consider the cost to students when assigning a textbook for their courses. For them, shifting to an open textbook (assuming one is available) provides a clear advantage. Students can download and use a digital copy of the textbook for free or even print a physical copy at a fraction of the cost of a traditional textbook. At a time when a growing number of students are attempting to hold down full-time jobs while pursuing their post-secondary educational ambitions, this is a tangible benefit with a human face. Every semester I notice students in my classes who elect not to purchase the course textbook (despite cautionary notes from me) due to financial constraints. My colleagues report the same. In the battle between groceries and a textbook, the textbook loses every time.

This is especially true given the increase in the price of a traditional textbook over the past decade. We cannot fault our students for questioning the value of their (forced) purchase. As an example, the textbook I previously assigned for Research Methods in Psychology (which just happens to be the most popular textbook for this course in BC) is a softcover book printed in black ink that runs 416 pages long and retails for $114.95 + taxes & shipping. I should say that it is a great book and well written. But, in contrast, the Canadian edition of the open textbook for Research Methods in Psychology that I revised includes colour graphics throughout, runs 378 pages long and costs my students nothing. If they wish to order a print copy of the book it will cost them $13.06 + taxes & shipping. At least on price, there is no contest.

So why are faculty not yet adopting open textbooks more widely?

1. Quite simply, for many disciplines and courses, there is no open textbook available. So other than putting together a set of existing open educational resources, the nontraditional options are limited. I should say here that cost-saving alternatives like e-textbooks put forward by the big publishers are often a terrible option for students because they come with a time-limited license and have no resale value, which means that they often end up costing the students the same (or even more) in the long run, as compared with biting the bullet and buying the assigned traditional textbook.

2. In my experience, reason #2 has to do with concerns about quality (e.g., comprehensiveness, clarity, currency, etc.). Some faculty are instantly skeptical of open textbooks and hold them to a higher standard than traditional textbooks. This is fair, because traditional textbooks typically have several sets of eyes on them through their development and are later sent to many other faculty for their review. Although some open textbook initiatives (such as the BC Campus Open Textbook Project) collect and post comprehensive faculty reviews for the books in their repository, others do not. Where available, open textbooks or chapters written by leading scholars (e.g., the NOBA project) are especially helpful in countering doubts about quality.

3. But let’s imagine that a high quality open textbook is available for a particular course. Sometimes these are entirely text-based – no illustrations, charts, or graphics to aid comprehension. No questions or critical thinking exercises embedded. No online learning management system available that students can rely on for formative feedback. And, crucially for many faculty, no testbank, which means that the instructor is then obligated to write every question for every assessment for their course. Considering the amount of time it takes to write good test questions that are reliably able to distinguish between different levels of understanding, this is a tall order.

4. The choice of textbook is sometimes not an individual one. Especially for large, multi-section introductory courses (sometimes offered in two halves), in order to facilitate student mobility, academic departments often mandate that faculty adopt the same textbook across all sections. This reality often makes switching to an open textbook a less nimble decision.

One of the myths I often try to dispel is that faculty are the enemy and have some great stake in upholding the traditional textbook model. To be clear – assuming they are not the author, faculty do not receive any benefit when they assign a particular publisher’s textbook. Faculty are, however, deeply concerned about student learning. For this reason I believe that if faculty are presented with an open textbook alternative that has been favourably reviewed by other faculty, embeds good pedagogical features, and has an available testbank, it would be more difficult for the majority to continue upholding the status quo.

Beyond merely speaking to the legitimate concerns of faculty, however, I find it more refreshing to speak to the additional advantages that open textbooks bring to faculty:

1. Faculty have the ability to adapt and remix the textbook to suit their needs. They may choose to delete specific chapters or sections or even write and insert sections for their open textbook, making it possible to incorporate recent developments in research and theory much faster than the traditional textbook’s five-year review cycle permits. In other words, an increase in academic freedom!

2. There is some evidence to suggest that when an open textbook is carefully adapted to suit a particular program, student performance and retention is actually enhanced.

3. The ideal textbook does not exist. My colleague Takashi Sato at Kwantlen Polytechnic University recently made this excellent point. There are always tradeoffs that faculty make when adopting a textbook. Often it is a question of whether the content is “good enough,” assuming that several other resources are in place. For the reasons listed above, open textbooks are very often better than “good enough.”

4. As soppy as this sounds, the looks on your students’ faces when you tell them that you have adopted an open textbook. You have them at hello.

5. Although this post is about open textbooks, I would be remiss if I did not point out that the open research movement is a natural and strong ally, particularly when addressing faculty. Open access journals like PLOS ONE have become mainstream as researchers have come to appreciate the need for the fruit of their labour (and public tax coffers) to be shared with the public. In many ways, open textbooks are merely an extension of this same philosophy and permit faculty to live more closely in concert with their values.

Of course there are many remaining issues to work on before open textbooks can go mainstream. The sustainability of who will continue to revise and update the open textbooks is one such question. Government support and resource sharing agreements help a great deal. But ultimately I believe that it is institutional culture that will need to shift. A university’s strategic priorities need to include moving towards open education. From the president’s office down, open education initiatives need to be supported for these to develop and mature. This includes time releases for faculty adapting/adopting open textbooks, institutional recognition of this work, practical and regularly offered professional development workshops, and the consideration of the development of open educational resources in the files of those on the tenure-track.

I recently met a student from the University of Regina who spoke eloquently about why we should avoid pitting different stakeholders (e.g., faculty and students) against one another. I believe she is correct. There is not just one reason to consider adopting open textbooks. The benefits to students are obvious, the benefits to faculty can be highlighted, and the benefits to the institution (e.g., with recruitment) may need to be spelled out. Open textbooks represent a rare win-win-win scenario, the kind we do not see very often in post-secondary education.

To finish, I ask you to engage in a useful thought exercise: Imagine a world in which open textbooks, open research, open pedagogy, and open educational resources are the norm. In this future world, imagine that a representative from a for-profit publishing house approaches a faculty member in order to persuade them to adopt one of their textbooks. What would their pitch look like? And what could they possibly say that would convince faculty to adopt their product?

Asking for a Letter of Reference

I often get approached by students asking for a letter of reference. To be honest, merely being asked is often a wonderful validation of how the student in question perceives you. And writing a letter of reference (an art in itself) is a joyful exercise when you know the individual well and believe in their abilities. But too often the student is simply one name amid a class of 200. They might have done well enough in terms of their grades in the course, but often they have never visited my office hours, hung around after class for a chat, or even participated actively enough in class to stick out in my memory. What to do then?

In these cases I typically advise the student that, given our limited personal contact, any letter I write could only really discuss their performance in the course (interpreted via formal, summative assessments). Of course, I could include information also listed in their cv, but none of this amounts to the kind of reference they really need (or are hoping for). I believe the ethical approach here is to be open and honest with the student and then let them decide. A letter from someone who knows them well enough to comment on their character and performance over a longer period of time is far more valuable (having been on the receiving end of many letters of reference I can also attest that a lukewarm letter of reference is often rather damning). In short, the question they should ask me is not “would you please write me a letter of reference?” but instead “do you feel you could write me a strong letter of reference?”

« Older posts Newer posts »