Posts Tagged ‘questionnaires’

 

What’s the Best Assessment Tool? Part II – Interviews

Posted on: November 16th, 2009 by Hayim Herring No Comments

The last Tools for Shuls post on assessment examined using questionnaires to gather information about the perceived success of a project, process or event.  This post focuses on another common tool that synagogues and other organizations can use with relative ease: interviewing.  Questionnaires are great for quickly gathering information from many people.  The trade-off is you only receive top-line, superficial information.  For greater depth, use interviews as a method of gathering information.  To get the most useful results, you’ll often find that a mix of both is the best choice.

For example, let’s say that you’ve surveyed a group of adults who have just attended a spirituality retreat.  The retreat was designed to offer participants an introduction to a range of spiritual practices including yoga, meditation, study and cooking.  You can use a questionnaire to get a general sense of how people responded to the various activities.  But, given the complex nature of the experience you were trying to create, you’ll probably want to interview participants so you can really understand why certain experiences resonated for some and not for others.

While interviewing is a formal process, we interview people informally on a regular basis.  After all, interviewing is simply asking someone for a restatement, clarification or explanation of an experience or idea.  There are several characteristics that turn those questions into an interview.

Interviews are a series of questions that are purposeful, systematic and structured.  “Structured” means that all of those interviewed will answer a core set of questions, with the interviewer probing more deeply for items of special note.  By using a core set of questions, you can be assured that you are comparing similar information.  Interviewing also requires trained listening (knowing when and when not to probe further,) and objectivity (recording the views of the interviewee without coloring them with your interpretation).

In addition to carefully determining the questions, there are several important choices you’ll have to make if you interview congregants. Who will do the interviewing?  Will you train fellow congregants or use an outside person or organization?  How many people do you need to interview to get reliable information?  Will you record the interview or take hand written notes?  At a minimum, you should consult with a congregant who is an expert at conducting interviews to help guide you with these choices.

Now, it’s my turn to “interview” you: do you have experience in your organization in interviewing members?  What triggered the use of interviewing?  Did you use members or non-members as interviewers?  What made the process work—or not?  Please share your own experiences.

Thanks,
Rabbi Hayim Herring

image from flickr.com smiling_da_vinci

What’s the Best Assessment Tool? It Depends…

Posted on: October 9th, 2009 by Hayim Herring No Comments

I confess that I don’t know very much about tools. However, I do know enough to recognize that the question, “What tool should I use?” must be asked in some context. Just as you wouldn’t use an Allen wrench to pound in a nail, you wouldn’t want to use a survey instrument that was mismatched for the information that you desire.

There are three assessment tools which lend themselves nicely to congregations and non-profit organizations: questionnaires, interviews and focus groups. These three methods work well because they are simple, easy to learn and enable you to use volunteers who have expertise in these areas. This post is going to review some basics about questionnaires.

If you are looking for more in-depth information about an issue, a questionnaire is not the tool to use. However, questionnaires are a good tool for efficiently gathering basic information from a large number of people at low cost. Today, through the use of inexpensive or free electronic questionnaire services, this method of gathering information has been made incredibly easy. But, there is a science to constructing questionnaires so that the data you get back actually answer the questions about which you want to learn.

Take a moment now to reflect on this question: when you speak with someone either in person or by telephone, how often are you misunderstood? Misunderstandings are frequent but can be corrected when you are in direct conversation with someone. However, when you have distributed a questionnaire to congregants, they will not have the benefit of asking for clarification. That is why it is critical to have someone with experience and expertise help you develop your questions.

Additionally, before you add a question to your questionnaire, ask yourself, “Do I really need to include it—is it germane to the issue?” There is an understandable temptation to ask questions which are not directly related to the assessment topic because you have people’s attention. But, if that temptation gets the better of you, you’ll limit the number of people who respond either because they will start to question your motives or because your have included too many questions.

Another good practice is to test questionnaires before you distribute them. By doing so, you’ll detect any unclear questions and get feedback on the length of the questionnaire. Typically, most volunteers will be willing to spend no more than about 15 minutes on a questionnaire. If they see a questionnaire which has over 20 to 25 questions, you will likely lose them. (This observation is based on my experience.) Aim for a greater response rate by limiting the number of questions. Those who are more invested in your organization, like board members, may be willing to spend more time as they better understand the importance of the effort. Still, you need to explain to people why you are asking for their help in supplying this information, how you hope it will be used and how you will inform them once it is used. In this way, they will be more likely to help you now and in the future. If you guarantee that responses will be confidential, which will increase the number of people who respond, then you must honor that confidentiality!

If you are using an electronic service, make sure that all of the potential respondents have access to a computer and know how to complete an online questionnaire. (Commonly used services are www.zoomerang.com and www.surveymonkey.com. You’ll also find that some newsletters, like Constant Contact, have a questionnaire feature.) Have you accounted for people with special needs? How about the elderly who may not like to use a computer but would respond to a telephone call?

With the right team of professionals and volunteers, you will be gratified by incorporating questionnaires as a part of program planning and congregational engagement into your activities. So—now it’s your turn to ask questions. Please fire away or share your experience with using electronic questionnaires.

Thanks,

Rabbi Hayim Herring