I don't really prescribe to Popper and his specific rejection of empiricism... I am leaning toward a hermeneutic approach of both holistic and integrative in nature. Rationalism has it's place, but we can certainly rationalize anything, with convincing deductive and inductive arguments. This is it's downfall...
I think that my brother's ice-cream example (great example by the way)
" epistemologies have different flavours and thus - in the same way as strawberry and chocolate are both nice flavours of coloured milk but both are still valid nice flavours of milk - equal right to be called truthful nice flavours of milk if they are based on some internally self consistent socially grounded method, including personal choice." (Mondy, P., 2007)
fits in with what I was reading about objectivity in a critical community, which means that you can have two or more paradigms standing side by side, and both being equally objective and reasonable. This is where one should look for a touchstone...a commonality between a number of paradigms and triangulate certain premises that work in a number of different perspectives. This is where Fereyabend is genuinely great, in that he sees beyond just trying to maintain a single view... But don't you find that if you are too loose in your views, there would be a flip flop from belief in a theory, to rejection then back again...? This can be quite detrimental within the area of high-stakes research...with doctors they may prescribe...but later recant on their previous philosophies...This is socially irresponsible, too.
Hermeneutics has a pyramid structure of Theory (being as objective as one can be)----Philosophy (recognizing reader's perceptions, prejudices and foreknowledge)----and social dynamics (understanding of how context can distort ideas). For educational purposes, this seems pretty sound...
Friday, December 7, 2007
Feyerabend: The case for Methodological Pluralism
I have to say that Feyerabend has a point, when it comes to saying that science has inherent biases, and
that the only way to have an epistemological viewpoint that is free from prejudice, is by having a perspective that is flexible and changeable. But, Berstein (1983) quotes Gadamer by saying there is no knowledge without prejudice, anyway...
I think that Feyerabend's Dadaistic (anything goes approach), and anarchist view of scientific method is a little extreme, especially when it comes to replacing let's say astronomy (a hard science, backed by empirical experience) with astrology (a more touchy feely, yet rational paradigm). The article I was reading, proposed a kind of openness to accepting new ideas, that science should take advantage of other theories and paradigms; such as medicine accepting the help of herbalists and other alternative medicine.
Feyerabend just has far too liberal an interpretation of truth, that he accepts just about any idea (Magic and mysticism). Scientific method may be inconclusive, but it has given us various understandings that are open to verification and falsifiability, but even more importantly they can be practically applied, with reasonable success. Shouldn't we be looking for all those successful applications of theories, and reject those ideas that don't help better our understanding of society. We don't have to hold onto one paradigm, at the expense of beneficial aspects of another (Tibbetts, 1977)
I think that Feyerabend has made it possible to have a more critical view of the nature of scientific method, and probably enabled us to be more open to all potential sources of information...so that we can have a better quality of life, Holistically...
Steven Mondy
Tibbetts, P. (1977) Feyerabend's Against Method: The case for Methodological Pluralism, Sage publications, retrieved Nov, 27, 2007 at http://pos.sagepub.com
that the only way to have an epistemological viewpoint that is free from prejudice, is by having a perspective that is flexible and changeable. But, Berstein (1983) quotes Gadamer by saying there is no knowledge without prejudice, anyway...
I think that Feyerabend's Dadaistic (anything goes approach), and anarchist view of scientific method is a little extreme, especially when it comes to replacing let's say astronomy (a hard science, backed by empirical experience) with astrology (a more touchy feely, yet rational paradigm). The article I was reading, proposed a kind of openness to accepting new ideas, that science should take advantage of other theories and paradigms; such as medicine accepting the help of herbalists and other alternative medicine.
Feyerabend just has far too liberal an interpretation of truth, that he accepts just about any idea (Magic and mysticism). Scientific method may be inconclusive, but it has given us various understandings that are open to verification and falsifiability, but even more importantly they can be practically applied, with reasonable success. Shouldn't we be looking for all those successful applications of theories, and reject those ideas that don't help better our understanding of society. We don't have to hold onto one paradigm, at the expense of beneficial aspects of another (Tibbetts, 1977)
I think that Feyerabend has made it possible to have a more critical view of the nature of scientific method, and probably enabled us to be more open to all potential sources of information...so that we can have a better quality of life, Holistically...
Steven Mondy
Tibbetts, P. (1977) Feyerabend's Against Method: The case for Methodological Pluralism, Sage publications, retrieved Nov, 27, 2007 at http://pos.sagepub.com
Sunday, December 2, 2007
Week 2 of Research Methods in Education
Well, having come to the end of yet another week, I have found that things are starting to make sense... The first week was hard in that there was a lot of terminology... but this week has been hard for me, trying to come to terms with many of the concepts and issues in research...I came to a point in which I needed a time line of these 'thinkers' in the history and philosophy of science.... It is amazing how much of a visual person I am...so I looked up any sites that would give me a good look at all of them in relation to one another…
One site (very simple, I know): http://timelineindex.com/content/view/2031
1. Some of the people I have befriended this week...
Plato...Aristotle...Kant...Hume...Popper…. hahahaha
Actually, it was really good to get some perspective on these guys…
2. Also, I have started to get an idea about what goes into making up good research, but I am still at the very beginning... The readings in module 2 helped, but there were just so many questions (especially in the last reading: Gay, 1992)...and I will need some time to digest the information and sort out what I think...
3. One idea that came out while I was reading the module 2 readings was the idea of allowing time to synthesize and formulate other perspectives and reflect on data (Goetz & Lecompte, 1984). I've often thought to myself, that given enough time between tasks, I am bound to come up with major improvements to whatever I am working on. (That reading kinda consolidated it in my own mind ~ each subsequent revision can slowly give more and more clarity). I try to encourage my writing class students to do exactly that – leave time to reflect. They are often (like many of us) in too much of a hurry to finish things, that they rush through something and not give themselves much time to just sit back and mull things over...
4. I also like the idea that a researcher should say to themselves, “So what”? I think that whenever I start working on something in my teaching job (say some internet based activity), I often get so excited in the task at hand (more so than the students sometimes), that I end up forgetting to answer this fundamental question. What purpose is there in what I am doing, and when much of myself is invested in the project, how much do I wish to be critical (or skeptical) of what I am doing? Am I willing to ask myself, if there are any other ways or even more scope to the approach I am taking? As a researcher, can I afford to be so personally involved in the project? How hard is it to take a step back, and distance myself from the undertaking, so that I can be more responsive to data (or text)? Am I able to modify and possibly change my initial work, if the applications of my initial generalizations yield strange results? I hope that I can be flexible enough to do so…
I hope that we all can…
Steven Mondy
Goetz & Lecompte, (1984) Ethnography and qualitative design in education research, Academic press, Orlando.
One site (very simple, I know): http://timelineindex.com/content/view/2031
1. Some of the people I have befriended this week...
Plato...Aristotle...Kant...Hume...Popper…. hahahaha
Actually, it was really good to get some perspective on these guys…
2. Also, I have started to get an idea about what goes into making up good research, but I am still at the very beginning... The readings in module 2 helped, but there were just so many questions (especially in the last reading: Gay, 1992)...and I will need some time to digest the information and sort out what I think...
3. One idea that came out while I was reading the module 2 readings was the idea of allowing time to synthesize and formulate other perspectives and reflect on data (Goetz & Lecompte, 1984). I've often thought to myself, that given enough time between tasks, I am bound to come up with major improvements to whatever I am working on. (That reading kinda consolidated it in my own mind ~ each subsequent revision can slowly give more and more clarity). I try to encourage my writing class students to do exactly that – leave time to reflect. They are often (like many of us) in too much of a hurry to finish things, that they rush through something and not give themselves much time to just sit back and mull things over...
4. I also like the idea that a researcher should say to themselves, “So what”? I think that whenever I start working on something in my teaching job (say some internet based activity), I often get so excited in the task at hand (more so than the students sometimes), that I end up forgetting to answer this fundamental question. What purpose is there in what I am doing, and when much of myself is invested in the project, how much do I wish to be critical (or skeptical) of what I am doing? Am I willing to ask myself, if there are any other ways or even more scope to the approach I am taking? As a researcher, can I afford to be so personally involved in the project? How hard is it to take a step back, and distance myself from the undertaking, so that I can be more responsive to data (or text)? Am I able to modify and possibly change my initial work, if the applications of my initial generalizations yield strange results? I hope that I can be flexible enough to do so…
I hope that we all can…
Steven Mondy
Goetz & Lecompte, (1984) Ethnography and qualitative design in education research, Academic press, Orlando.
Saturday, November 24, 2007
Falsifiability - Can we use this concept in qualitative research?
As for falsifiability, I think that the underlying assumption of this concept may be at odds with the underlying concepts within qualitative studies. I did a lot of reading on the distinction between quantitative and qualitative theory today and some postulating about the assumptions that both take. In the end, I see a clear distinction being drawn between both, in that quantitative studies relate to explaining or controlling variables; these variances can be double checked in future similar studies, by re-creating similar if not exact conditions within future experiments. Qualitative studies on the other hand try to look at things more holistically. I think that in qualitative studies, it is harder to say something is either right or wrong, as the phenomena under investigation is viewed more loosely and with greater flexibility. In addition, the kinds of things that qualitative studies focus on are reliant on context. That is they are specific to the particular classroom, or based on a specific problem of a smaller group. The theories that may come out (within say, a Funnel approach) are related to smaller and more specific groups, within a certain time frame. That said, it is difficult to come up with conditions that reject the findings of this kind of qualitative study, as it would be more difficult to correlate the findings (not having numerical data) with other similar groups in the future, without validity issues.
From what I gather, falsifiability is about understanding that there may be a case that your theory may be disproved, and in such a case you need to modify your thinking or may even have to reject it. Unless we take a time machine (or utilize historical organization in a qualitative study), we are unable to create the exact conditions necessary to disprove the findings. So, what can we do?
We can look into the validity of the qualitative research by checking the organization of the arguments presented and the usefulness of the descriptive analysis. If the study is logical and presents exceptional descriptions, then how can it be falsified?
One may say that the theory produced for that particular group may not suit present groups, ‘cause the conditions or context is different. Is it now falsified?????
What is the purpose to a qualitative study? How much can we depend on the universals that come out of such studies to make inferences about other groups? Do we use them as only a guide????
Maybe I am way off track, but I thought that the falsifiability idea better suits hard numerical data, which can more easily be disproved…Plus I think more important issues with qualitative studies are with how well the generalizations fit with the context of the study, and what happens soon after with that particular group…I don’t know, I think I m starting to confuse myself….
Steven M.
Wiersma & Jurs (2005) Research Methods in Education, Pearson, USA
From what I gather, falsifiability is about understanding that there may be a case that your theory may be disproved, and in such a case you need to modify your thinking or may even have to reject it. Unless we take a time machine (or utilize historical organization in a qualitative study), we are unable to create the exact conditions necessary to disprove the findings. So, what can we do?
We can look into the validity of the qualitative research by checking the organization of the arguments presented and the usefulness of the descriptive analysis. If the study is logical and presents exceptional descriptions, then how can it be falsified?
One may say that the theory produced for that particular group may not suit present groups, ‘cause the conditions or context is different. Is it now falsified?????
What is the purpose to a qualitative study? How much can we depend on the universals that come out of such studies to make inferences about other groups? Do we use them as only a guide????
Maybe I am way off track, but I thought that the falsifiability idea better suits hard numerical data, which can more easily be disproved…Plus I think more important issues with qualitative studies are with how well the generalizations fit with the context of the study, and what happens soon after with that particular group…I don’t know, I think I m starting to confuse myself….
Steven M.
Wiersma & Jurs (2005) Research Methods in Education, Pearson, USA
Friday, November 23, 2007
Research Philosophical Essay: Where am I?
Hello everyone,
Week 1 coming to an end... where am I? Well, you could use a metaphor and say I was a sponge trying to soak up a pretty big spill, but unfortunately the spill is quite large (content area reading) and my sponge is a little ineffective (or my brain is OS9, trying to deal with i-life applications... bit of a MAC reference there...)...
What am I trying to come to terms with at the moment...and struggling...
The awards go to...
1. In the category of Jargon
~ and the biggest winners so far are Epistemology, Ontology, and Axiology and whateverelse-ology... Actually it is good to be able to put words to the things that I am thinking…but maybe don’t have a word for… I was reading an article dealing with subjectivity (Luhrmann T.M. 2006) that discussed emotions and how different cultures have different ways of expressing various feelings. Some cultures didn’t have a word for ‘sad’, but they expressed the feeling in another way.. It got me thinking about knowing the concepts behind words, but not having the jargon to talk about them in sufficient detail. Now, we have all this new jargon that expresses our ideas even more succinctly;-)
2. In the category of Concepts: The winner is ‘Falsifiability’.
I was particularly struggling with the concept of falsifiability… It is a concept that has come up a number of times in my study, but it is quite a difficult thing for me to grasp. The idea of having to have the logical possibility that something can be shown to be false is quite difficult for me to grasp. And it almost seems defeatist…in that we can only ever accept something until it is proven otherwise, and we can never feel absolute confidence in any decision or outcome… But then again, it allows for improvement, modification, or even change on a large scale…which can make one feel quite satisfied in that we don’t have to stick to traditions that start seeming to be inappropriate within changing societies. Tradition handed down from one generation to the next, is often accepted at face value, due to its long history…even though it could be wrong…case in point: “the world is flat…”
3. In the category of methods and approaches: Qualitative, quantitative and mixed methods win hands down... I see a lot of theory trying to say that these concepts have been thought of as mutually exclusive for a long time, but are now being thought of as complementary. I’m kind of moving toward this later idea. I believe that quantitative data and descriptive analysis can sit side by side…I just need some more information to prove it…When I did ‘Testing’ I noticed you could use both numerical data and qualitative descriptions in analytical scoring. It was quite satisfying, being able to give a number and description of the test takers ability on an item. Yet, when it comes to the student, what will they look at? The number or the description?
4. In the category of self awareness: What kind of researcher am I? Well,
A) Having grown up in Australia with an immigrant mother an Australia born father
B) Culture and language
C) Living in Japan as an Australian
D) Having taught in a variety of contexts.
These among other things are shaping the researcher I am. I am starting to think that the research we do is inextricably linked to our self identity, and what we bring to the research can determine how we conduct the body of our research. Although the paradigm of the research may be determined by the need established by the end users, and/or the needs set out by the inquiry, the approach and methods we use are accented by the person we are. What do I mean by this? Well, even though the goal in scientific method is to be as objective as possible, and try to limit all influences from the researcher, I think that it is extremely difficult to eliminate all subjectivity, even in the data analysis of quantitative studies. The questions we choose and the procedure we follow will have slight variations due to individual researcher bias. Just as no two cooks can make exactly the same meal, no two researchers will have exactly the same influence (or lack there of) on a research study.
This is where I am at the moment… It is not much, and definitely not very logical, but it is an attempt to think aloud and share some thoughts…
Steven Mondy
Luhrmann T.M. (2006) Subjectivity, SAGE publications, University of Chicago, USA
Week 1 coming to an end... where am I? Well, you could use a metaphor and say I was a sponge trying to soak up a pretty big spill, but unfortunately the spill is quite large (content area reading) and my sponge is a little ineffective (or my brain is OS9, trying to deal with i-life applications... bit of a MAC reference there...)...
What am I trying to come to terms with at the moment...and struggling...
The awards go to...
1. In the category of Jargon
~ and the biggest winners so far are Epistemology, Ontology, and Axiology and whateverelse-ology... Actually it is good to be able to put words to the things that I am thinking…but maybe don’t have a word for… I was reading an article dealing with subjectivity (Luhrmann T.M. 2006) that discussed emotions and how different cultures have different ways of expressing various feelings. Some cultures didn’t have a word for ‘sad’, but they expressed the feeling in another way.. It got me thinking about knowing the concepts behind words, but not having the jargon to talk about them in sufficient detail. Now, we have all this new jargon that expresses our ideas even more succinctly;-)
2. In the category of Concepts: The winner is ‘Falsifiability’.
I was particularly struggling with the concept of falsifiability… It is a concept that has come up a number of times in my study, but it is quite a difficult thing for me to grasp. The idea of having to have the logical possibility that something can be shown to be false is quite difficult for me to grasp. And it almost seems defeatist…in that we can only ever accept something until it is proven otherwise, and we can never feel absolute confidence in any decision or outcome… But then again, it allows for improvement, modification, or even change on a large scale…which can make one feel quite satisfied in that we don’t have to stick to traditions that start seeming to be inappropriate within changing societies. Tradition handed down from one generation to the next, is often accepted at face value, due to its long history…even though it could be wrong…case in point: “the world is flat…”
3. In the category of methods and approaches: Qualitative, quantitative and mixed methods win hands down... I see a lot of theory trying to say that these concepts have been thought of as mutually exclusive for a long time, but are now being thought of as complementary. I’m kind of moving toward this later idea. I believe that quantitative data and descriptive analysis can sit side by side…I just need some more information to prove it…When I did ‘Testing’ I noticed you could use both numerical data and qualitative descriptions in analytical scoring. It was quite satisfying, being able to give a number and description of the test takers ability on an item. Yet, when it comes to the student, what will they look at? The number or the description?
4. In the category of self awareness: What kind of researcher am I? Well,
A) Having grown up in Australia with an immigrant mother an Australia born father
B) Culture and language
C) Living in Japan as an Australian
D) Having taught in a variety of contexts.
These among other things are shaping the researcher I am. I am starting to think that the research we do is inextricably linked to our self identity, and what we bring to the research can determine how we conduct the body of our research. Although the paradigm of the research may be determined by the need established by the end users, and/or the needs set out by the inquiry, the approach and methods we use are accented by the person we are. What do I mean by this? Well, even though the goal in scientific method is to be as objective as possible, and try to limit all influences from the researcher, I think that it is extremely difficult to eliminate all subjectivity, even in the data analysis of quantitative studies. The questions we choose and the procedure we follow will have slight variations due to individual researcher bias. Just as no two cooks can make exactly the same meal, no two researchers will have exactly the same influence (or lack there of) on a research study.
This is where I am at the moment… It is not much, and definitely not very logical, but it is an attempt to think aloud and share some thoughts…
Steven Mondy
Luhrmann T.M. (2006) Subjectivity, SAGE publications, University of Chicago, USA
Saturday, November 17, 2007
Contextualizing of Research
Westerners come here in droves, staying a short time, but trying to impart western philosophical norms on a society that either resists or is blatantly opposed (yet not openly) to the ideologies that they try to impart. Many times I hear teacher's complaining about the 'sounds of silence' within the classroom, when not realizing the difference in learning styles that our Japanese learners have.
Communicative teaching and learning is something that we learned about in Methodology...but when it comes to my classroom, in Asia, students find it quite a struggle to change to a learning style that is not introduced to them in elementary and junior/senior high school.
Japanese learners are very good at adapting to new ways of learning, but still have trouble with so called western ways of doing things. True, they are learning English, and with that comes not only language but cultural aspects, too. Yet, one must consider the influence of many years of socialization and learning of cultural norms, within the way one views these learners when it comes to educational research.
Yes, contextualizing of research seems to be quite relevant, especially for more localized studies...
Communicative teaching and learning is something that we learned about in Methodology...but when it comes to my classroom, in Asia, students find it quite a struggle to change to a learning style that is not introduced to them in elementary and junior/senior high school.
Japanese learners are very good at adapting to new ways of learning, but still have trouble with so called western ways of doing things. True, they are learning English, and with that comes not only language but cultural aspects, too. Yet, one must consider the influence of many years of socialization and learning of cultural norms, within the way one views these learners when it comes to educational research.
Yes, contextualizing of research seems to be quite relevant, especially for more localized studies...
Quantitative, Qualitative and mixed methods...
Numbers tend to give a feeling of exactness and rightness (if I can say that), but as I think Hawkins states, you can just choose one model and work out all the predictions according to that particular model (as opposed to other equally valid models)... However, I feel that there will always be a point in which we reach that stops us, 'cause we do not have the capacity to continue...case in point computer technology. In an empirical only framework, our theories and ideas are only based on the next evolution of ideas and the technology that enables us to work out those ideas... How do we make advances in new ways of thinking? One way is being creative and being able to think outside of the box... I think subjectivity can give us a way to do that, but it has to go along with empirical positivism...in tandem...
Also, what is objectivity? How do you reduce emotional states and affective factors for instance to specific data? And once you do reduce it to facts and figures, how do you stop from turning that data into something that disadvantages the individual? I know that within positivism, there is the debate between individual vs. society, but looking at the outcome and usability of data, aren't there many cases where descriptive analysis and holistic expressions may be more useful than just data alone? I guess it depends on what the end user is needing the research to do. Action research on a very specific level may cry out for specific descriptions of the situation at hand, whereas, bigger studies on a national or even world level may need general trends, as the problem as stated in the research affects more people in greater variety. This is possibly where number crunching can be very effective.
At the moment, I see quantitative data sitting along side qualitative observation...And the benefit that comes from both is reflected in the end user...
Also, what is objectivity? How do you reduce emotional states and affective factors for instance to specific data? And once you do reduce it to facts and figures, how do you stop from turning that data into something that disadvantages the individual? I know that within positivism, there is the debate between individual vs. society, but looking at the outcome and usability of data, aren't there many cases where descriptive analysis and holistic expressions may be more useful than just data alone? I guess it depends on what the end user is needing the research to do. Action research on a very specific level may cry out for specific descriptions of the situation at hand, whereas, bigger studies on a national or even world level may need general trends, as the problem as stated in the research affects more people in greater variety. This is possibly where number crunching can be very effective.
At the moment, I see quantitative data sitting along side qualitative observation...And the benefit that comes from both is reflected in the end user...
Hitch hikers guide to the galaxy 2
Arthur Dent's voyage into the unknown somewhat harnesses the tie-in between subjective experience and empirical truths, according to Comte's (see Wikipedia ~ Positivism for very general description) view of Positivism and it's cyclic nature. One man traveling the universe in his pajamas and dressing gown, trying to make sense of things based on the limited experience he has had on an earth that is now non-existent. Arthur struggles to break things down into their simplest, understandable pieces, somewhat in the frame of reductionists trying to reduce everything into an ultimately measurable form.
The series also touches on the idea that we may have trouble understanding the world around us, 'cause we are part of the actual workings of the universe. Arthur, was the last remaining part of the super computer known as earth. If you are part of the search for the solution, you may never fully understand the actual problem. Possibly... Thus, as researchers, how do we view ourselves, within the whole structure of the inquiry? Do our actions actually change the results? Or even our non-participatory role, may influence unforeseen elements???
Accounting for variables is inherent in scientific method, but can those variables truly be eliminated? Viewing methods have their limitations, and often when we try to account for those variables, we rely on hypothesis and theory to create models of behavior that would occur according to rational thought. Back to Comte again and his cyclic view of things.
However, if theorists such as Emile Hennequin (Wikipedia - Positivism) who included subjectivity into the equation, were to look beyond just the empirical data, they mind find answers that are more creative, but still understand that they are still based on certain assumptions...
Do I make any sense?
The series also touches on the idea that we may have trouble understanding the world around us, 'cause we are part of the actual workings of the universe. Arthur, was the last remaining part of the super computer known as earth. If you are part of the search for the solution, you may never fully understand the actual problem. Possibly... Thus, as researchers, how do we view ourselves, within the whole structure of the inquiry? Do our actions actually change the results? Or even our non-participatory role, may influence unforeseen elements???
Accounting for variables is inherent in scientific method, but can those variables truly be eliminated? Viewing methods have their limitations, and often when we try to account for those variables, we rely on hypothesis and theory to create models of behavior that would occur according to rational thought. Back to Comte again and his cyclic view of things.
However, if theorists such as Emile Hennequin (Wikipedia - Positivism) who included subjectivity into the equation, were to look beyond just the empirical data, they mind find answers that are more creative, but still understand that they are still based on certain assumptions...
Do I make any sense?
Hitch hikers guide to the galaxy?
Does anyone remember a little British show called the Hitch hikers guide to the galaxy? In that program, a group of people created a machine to calculate the answer to the ultimate question, of life, the universe and everything. The final answer was 42. Everyone was happy to know the answer, but didn't really know what it meant. So they invented an even bigger computer to work out what the actual question was...
I guess this is my slightly warped, but interesting view of the whole idea of what research is. We may find answers to wonderful questions, but do we actually understand the questions themselves. Or even the methods of obtaining answers to questions? How can we be certain that the processes that we are using are either accurate or valid. When I studied the testing unit here at USQ, I came across the ideas of validity and reliability, and developing consistent and proven methods of evaluating students. Time seemed to factor into the equation, as well as healthy skepticism of ones own creations.
I guess that one thing that the hitch-hikers guide taught me, was that we may develop understandings, but those understandings must remain open, as there may be other interpretations to our theories. And the ideas we have or the questions we ask, may not provide us with satisfactory answers that we can be happy with.
This is not to say that we stop asking, but keep searching for better understanding...
What do you say?
Ciao
Steve M.
I guess this is my slightly warped, but interesting view of the whole idea of what research is. We may find answers to wonderful questions, but do we actually understand the questions themselves. Or even the methods of obtaining answers to questions? How can we be certain that the processes that we are using are either accurate or valid. When I studied the testing unit here at USQ, I came across the ideas of validity and reliability, and developing consistent and proven methods of evaluating students. Time seemed to factor into the equation, as well as healthy skepticism of ones own creations.
I guess that one thing that the hitch-hikers guide taught me, was that we may develop understandings, but those understandings must remain open, as there may be other interpretations to our theories. And the ideas we have or the questions we ask, may not provide us with satisfactory answers that we can be happy with.
This is not to say that we stop asking, but keep searching for better understanding...
What do you say?
Ciao
Steve M.
Friday, November 16, 2007
Technology in Education...
How I would love to take a trip into the future and see what is happening with technology in the classroom, and beyond.
I too, am very interested in technology, but more out of an interest, rather than a particular research focus. I haven't actually done any of the CAL, or technology in Ed. subjects, but I have taken it upon myself to introduce my students (in Japan), to the empowering aspects of utilizing technology in their studies. However, one thing that I have noticed, and in Japan mind you, is the lack of internet access among the student body. In Japan (especially among my students), mobile phone use far surpasses internet use (very subjective, I know...). So, one of the issues that I face is with computer/internet access. Students send e-mail from phones, and portable devices, that although convenient, can limit what they can do. I guess when i-phones come to Japan, at a reasonable price, we will start seeing a change in behavior patterns and greater freedom to do a wider variety of things.
Having said that, I am also a little cautious about going full steam into a situation of complete reliance on technology. A friend of mine has a son who has taken the computer based TOEFL test, and has commented on how different the testing style was. She talked about her son not being able to concentrate as effectively on that test, compared to the paper test, therefore affecting his score. I guess there is still a lot of ironing out of little problems to do, but computer based activities can offer a new scope for teachers and open up new avenues for students in their own learning.
I look on it as giving the best possible access to a great variety of material, to the greatest number of students. In the end, students have to choose to embrace new technologies, and we have to give them the chance to do so.
Ciao
Steven Mondy
I too, am very interested in technology, but more out of an interest, rather than a particular research focus. I haven't actually done any of the CAL, or technology in Ed. subjects, but I have taken it upon myself to introduce my students (in Japan), to the empowering aspects of utilizing technology in their studies. However, one thing that I have noticed, and in Japan mind you, is the lack of internet access among the student body. In Japan (especially among my students), mobile phone use far surpasses internet use (very subjective, I know...). So, one of the issues that I face is with computer/internet access. Students send e-mail from phones, and portable devices, that although convenient, can limit what they can do. I guess when i-phones come to Japan, at a reasonable price, we will start seeing a change in behavior patterns and greater freedom to do a wider variety of things.
Having said that, I am also a little cautious about going full steam into a situation of complete reliance on technology. A friend of mine has a son who has taken the computer based TOEFL test, and has commented on how different the testing style was. She talked about her son not being able to concentrate as effectively on that test, compared to the paper test, therefore affecting his score. I guess there is still a lot of ironing out of little problems to do, but computer based activities can offer a new scope for teachers and open up new avenues for students in their own learning.
I look on it as giving the best possible access to a great variety of material, to the greatest number of students. In the end, students have to choose to embrace new technologies, and we have to give them the chance to do so.
Ciao
Steven Mondy
Friday, November 9, 2007
CLT
CLT is an interesting idea, but there are certainly drawbacks, as well as positives. The ideals of developing communicative competence in a socially integrated way are quite appealing, but very difficult for the average teacher to implement.
I also find it difficult to balance the potential benefits of CLT activities (such as role-play, find someone, and info-gap) with the needs of individuals in a non-English speaking, essentially homogeneous environment.
I also find it difficult to balance the potential benefits of CLT activities (such as role-play, find someone, and info-gap) with the needs of individuals in a non-English speaking, essentially homogeneous environment.
Qualified teacher vs. Inexperienced teacher
1 August 2007 7:56 PM
Having thought about things, I now believe that CLT offers a lot with respect to taking many classroom activities and even textbooks and adapting them to help Ss develop their Communicative language competence... I think it has the flexibility and enough variety to allow for what I was hinting at with different style.
I am not sure whether style can equate with approach, but is closely related. Style might be an accent to approach, and be what each and every teacher brings to the whole process.
I don't know whether having an inexperienced teacher teaching me would be all that bad (as long as they have had enough life experience to offer anecdotal references), as they may bring with that inexperience a fresh, dare I say approach (or should I say style in this case). I understand that the inexperience can be quite inefficient, but the new and inexperienced teacher will be trying their hardest to make it and prove something....at least if there was variety, then it would be interesting...
Having thought about things, I now believe that CLT offers a lot with respect to taking many classroom activities and even textbooks and adapting them to help Ss develop their Communicative language competence... I think it has the flexibility and enough variety to allow for what I was hinting at with different style.
I am not sure whether style can equate with approach, but is closely related. Style might be an accent to approach, and be what each and every teacher brings to the whole process.
I don't know whether having an inexperienced teacher teaching me would be all that bad (as long as they have had enough life experience to offer anecdotal references), as they may bring with that inexperience a fresh, dare I say approach (or should I say style in this case). I understand that the inexperience can be quite inefficient, but the new and inexperienced teacher will be trying their hardest to make it and prove something....at least if there was variety, then it would be interesting...
Having different programs side by side
1 August 2007 4:31 PM
Surely it is possible to have content-based classes side by side (but not necessarily following on from) with other kinds of classes, lets say grammar translation, a small free talking tutorial, or an extensive reading type program. All require different approaches, but could fit within a school program. The students themselves may be able to transfer aspects of one system over to another. Just because English is the commonality btw both, it doesn't mean that the kind of class/approach to the class is/should be the same. It's the transfer of the ball in the football game (as Savignon puts it in "Teaching English as a second or foreign language"), not the actual ball itself, in this case English. We are talking about competence in using English overall. Students just adapt to a new system, transferring knowledge and skills from one activity to another. Variety! Doesn't that more closely resemble real life? Though students may like one style better than another. They may be a little confused in the beginning, but for the sake of individual differences, shouldn't we expose Ss to a variety of learning and teaching styles. If handled right, the program may in fact stimulate students...
Imagine studying 10 subjects with exactly the same teacher in exactly the same style. Wouldn't you get bored?
Do I make any sense? Probably not...
Surely it is possible to have content-based classes side by side (but not necessarily following on from) with other kinds of classes, lets say grammar translation, a small free talking tutorial, or an extensive reading type program. All require different approaches, but could fit within a school program. The students themselves may be able to transfer aspects of one system over to another. Just because English is the commonality btw both, it doesn't mean that the kind of class/approach to the class is/should be the same. It's the transfer of the ball in the football game (as Savignon puts it in "Teaching English as a second or foreign language"), not the actual ball itself, in this case English. We are talking about competence in using English overall. Students just adapt to a new system, transferring knowledge and skills from one activity to another. Variety! Doesn't that more closely resemble real life? Though students may like one style better than another. They may be a little confused in the beginning, but for the sake of individual differences, shouldn't we expose Ss to a variety of learning and teaching styles. If handled right, the program may in fact stimulate students...
Imagine studying 10 subjects with exactly the same teacher in exactly the same style. Wouldn't you get bored?
Do I make any sense? Probably not...
Comprehensible Output ~ Swain
Comprehensible Output ~ Swain 20 July 2007 11:20 PM
I’m am just in the middle of the first reading, and I want to say a big “Hooray” to Swain 1985, as cited in Hadley 2001), for proposing the comprehensible output hypothesis. All through the last subject (principles in language learning), I was reading and wondering about Krashen and his focus on comprehensible input, to the exclusion of a focus on production. Now I have to be careful, as I didn’t choose Krashen to investigate last subject, but to a novice like myself, I feel the need to encourage more outward production of language. Especially being here in Japan, where output is at a premium, and no matter what I do, it is difficult to encourage students to practice with others, and make use of the range of functions needed in whatever we are studying (Hypothesis 2).
One of my colleagues likened Krashen’s input hypothesis to a glass being filled (I’m sure he read it somewhere?!). Only when the glass is filled, will it start overflowing. I understand the logic behind this, but many of our students in the college where I work, tend to stay quiet for pretty much the whole time they are with us (maybe a little bit of an overgeneralization ;-). Why can’t they be encouraged to produce language, at least at levels relative to the student’s abilities? This is rather a big question that would incorporate not only affective variables, but social ones, too. I believe, that essentially students want to start producing in the TL as soon as possible as they wish to communicate, it’s just that they are unable to because they don’t have the communicative competence.
Having said that, I have had times when I gave students the opportunity to contribute, but they have not been ready to respond (think of the glass half full). And it ends up that they give up, or other students decide to respond, cause it takes and aggravatingly long time for the student to answer (I do try to discourage this king of situation, though). This has the potential of raising anxiety, and lifting that affective filter we learned about last semester. But, it’s up to the classroom teacher to read the class and give out opportunities to students to respond at various times in their particular development. Students need opportunities to test the structures they have learned, and the hypotheses they are making about language and the target culture.
So, Output, I say yes…we need to encourage a certain amount of risk taking and foster within students the courage to take chances in the TL.
Steven Mondy
Hadley, A.O. (2001), Teaching language in context 3rd Ed., Heinle and Heinle.
I’m am just in the middle of the first reading, and I want to say a big “Hooray” to Swain 1985, as cited in Hadley 2001), for proposing the comprehensible output hypothesis. All through the last subject (principles in language learning), I was reading and wondering about Krashen and his focus on comprehensible input, to the exclusion of a focus on production. Now I have to be careful, as I didn’t choose Krashen to investigate last subject, but to a novice like myself, I feel the need to encourage more outward production of language. Especially being here in Japan, where output is at a premium, and no matter what I do, it is difficult to encourage students to practice with others, and make use of the range of functions needed in whatever we are studying (Hypothesis 2).
One of my colleagues likened Krashen’s input hypothesis to a glass being filled (I’m sure he read it somewhere?!). Only when the glass is filled, will it start overflowing. I understand the logic behind this, but many of our students in the college where I work, tend to stay quiet for pretty much the whole time they are with us (maybe a little bit of an overgeneralization ;-). Why can’t they be encouraged to produce language, at least at levels relative to the student’s abilities? This is rather a big question that would incorporate not only affective variables, but social ones, too. I believe, that essentially students want to start producing in the TL as soon as possible as they wish to communicate, it’s just that they are unable to because they don’t have the communicative competence.
Having said that, I have had times when I gave students the opportunity to contribute, but they have not been ready to respond (think of the glass half full). And it ends up that they give up, or other students decide to respond, cause it takes and aggravatingly long time for the student to answer (I do try to discourage this king of situation, though). This has the potential of raising anxiety, and lifting that affective filter we learned about last semester. But, it’s up to the classroom teacher to read the class and give out opportunities to students to respond at various times in their particular development. Students need opportunities to test the structures they have learned, and the hypotheses they are making about language and the target culture.
So, Output, I say yes…we need to encourage a certain amount of risk taking and foster within students the courage to take chances in the TL.
Steven Mondy
Hadley, A.O. (2001), Teaching language in context 3rd Ed., Heinle and Heinle.
Approach - How do you incorporate that into a curriculum or Syllabus?
31 July 2007 9:46 AM
How do you incorporate that into a curriculum or Syllabus?
Which approach will give enough freedom of movement?
Do we just allow all teachers the complete freedom to chop and change like the weather, or do we do like ECC (English teaching school in Japan) and prescribe the step-by-step procedures, give all the materials, and expect teachers to adhere to the program?????
Well, the answer to both is yes and no. Complete freedom in teaching technique will be excellent, in that it allows teacher autonomy and creativity, but it doesn't really support the teacher in terms of a suggested course. A dictated curriculum is great for the new or lazy teacher, in that everything is prepared (almost like factory work - does that remind us of any job we've had?), but limits the possible potential of a completely unplanned learning experience.
What I was trying to get at was that teachers need a framework to work by, but be open to the odd side track that will open up those golden opportunities...
For a curriculum planner or coordinator, it would be a headache trying to balance the two. As I was saying in my previous entry, too much freedom makes it difficult to maintain consistency...
Thank you Edith, I too try to never miss an opportunity...
Steven Mondy
How do you incorporate that into a curriculum or Syllabus?
Which approach will give enough freedom of movement?
Do we just allow all teachers the complete freedom to chop and change like the weather, or do we do like ECC (English teaching school in Japan) and prescribe the step-by-step procedures, give all the materials, and expect teachers to adhere to the program?????
Well, the answer to both is yes and no. Complete freedom in teaching technique will be excellent, in that it allows teacher autonomy and creativity, but it doesn't really support the teacher in terms of a suggested course. A dictated curriculum is great for the new or lazy teacher, in that everything is prepared (almost like factory work - does that remind us of any job we've had?), but limits the possible potential of a completely unplanned learning experience.
What I was trying to get at was that teachers need a framework to work by, but be open to the odd side track that will open up those golden opportunities...
For a curriculum planner or coordinator, it would be a headache trying to balance the two. As I was saying in my previous entry, too much freedom makes it difficult to maintain consistency...
Thank you Edith, I too try to never miss an opportunity...
Steven Mondy
Approach 1
21 July 2007 12:01 AM
I see the approach, design and procedure model in the realm of the syllabus designer, who needs to contemplate how the principles of learning and teaching relate to actual practical application and implementation, however that may be stating the obvious??? Each approach requires specific thought to how it is to be presented.
Richards and Rodgers (2006) use the approach, design and procedure model and apply it to the oral, audio-lingual, TPR, silent way, community language learning, Suggestopedia, whole language, MI theory, NLP, lexical, CLBT approach and so on...
It seems that in any situation, thought must be given to the theoretical principles that underlie it, what objectives of each method, the types of learning tasks and the roles of learner and teacher. Once thought has been given to these aspects, then we need to understand which tasks will foster the learning principles and then achieve the particular objectives that are set.
Most of the time, busy or inexperienced teachers will rely heavily on the textbook to decide on these things. Yet, as we become more familiar with teaching approaches, we can sculpt our lessons (design), using activities (procedure) that encourage greater student participation and interaction.
I see the approach, design and procedure model in the realm of the syllabus designer, who needs to contemplate how the principles of learning and teaching relate to actual practical application and implementation, however that may be stating the obvious??? Each approach requires specific thought to how it is to be presented.
Richards and Rodgers (2006) use the approach, design and procedure model and apply it to the oral, audio-lingual, TPR, silent way, community language learning, Suggestopedia, whole language, MI theory, NLP, lexical, CLBT approach and so on...
It seems that in any situation, thought must be given to the theoretical principles that underlie it, what objectives of each method, the types of learning tasks and the roles of learner and teacher. Once thought has been given to these aspects, then we need to understand which tasks will foster the learning principles and then achieve the particular objectives that are set.
Most of the time, busy or inexperienced teachers will rely heavily on the textbook to decide on these things. Yet, as we become more familiar with teaching approaches, we can sculpt our lessons (design), using activities (procedure) that encourage greater student participation and interaction.
Approach 2
30 July 2007 7:40 PM
I think that the approach we take will have a profound impact on the way we go about choosing objectives and in determining activities that will help in achieving them. If one were to have an approach based on behaviorist principles, then the objectives will probably be ones that encourage responses to a stimulus, thus requiring a selection of various drills, for instance. A large language school in Japan (NOVA), works on similar principles, with their use of American Streamline, a text (and some may say an approach) so outdated, it seems laughable that it is still being marketed today. If one were to follow in the steps of the audio-lingual approach, then the objectives will allow for the soaking up time that is required, and be less intrusive, and more teacher centered teaching may take place, until the students are at the point of producing language. Then there is the opposite end of the continuum, with the silent way approach, which has at its heart the idea that a student needs to start producing from the very beginning. So, as you can see, changing the approach will undoubtedly change the way the lesson is taught. In fact, it will shape the way that learners deal with their own learning, while at our institutions. The activities that they will be undertaking have vastly different outcomes, and require different things from students.
My question is:
“If an approach is decided upon within a school, do all teachers, in all classes need to take on that approach?”
I know of a situation in which a coordinator is forcing all teachers to take on communicative language teaching principles within a program, regardless of teacher gripes, or student difficulties with that particular approach. An approach may not necessarily work for all people, all of the time. After all, we need to also take in cultural aspects, or individual differences, for instance that may make one approach ineffective, in some cases, some of the time.
Then there’s what is happening in our college, a kind of free for all with, as many approaches as there are teachers. This too, is not an ideal situation, as there is no consistency (something in fact, that I need in my own learning).
In the end, we have to balance the needs and abilities of the students we teach. We also have to keep in mind that only one approach to teaching may severely disadvantage our students, if it so happens that other approaches are found to be more beneficial. I guess it’s an argument over consistency vs. flexibility. There are merits and demerits in both. I tend to be on the flexibility side, as long as it is based in firm and logical principles. There has to be a reason to change. I remember a lecturer introducing us to the, ‘if a bird were to fly into the room theory…what would you do?’ Carry on with your lesson plan or start talking about the bird (I think he was talking about Herbert Kohl, but I could be wrong…). That idea, although a little outdated (alternative education movement), has had a deep impact on me personally.
We need to establish curriculum's and syllabi that are based on consistent principles, yet they must also have within them some flexibility to allow for the ‘bird flying in the room’ factor.
What do you say?????
Steven Mondy
I think that the approach we take will have a profound impact on the way we go about choosing objectives and in determining activities that will help in achieving them. If one were to have an approach based on behaviorist principles, then the objectives will probably be ones that encourage responses to a stimulus, thus requiring a selection of various drills, for instance. A large language school in Japan (NOVA), works on similar principles, with their use of American Streamline, a text (and some may say an approach) so outdated, it seems laughable that it is still being marketed today. If one were to follow in the steps of the audio-lingual approach, then the objectives will allow for the soaking up time that is required, and be less intrusive, and more teacher centered teaching may take place, until the students are at the point of producing language. Then there is the opposite end of the continuum, with the silent way approach, which has at its heart the idea that a student needs to start producing from the very beginning. So, as you can see, changing the approach will undoubtedly change the way the lesson is taught. In fact, it will shape the way that learners deal with their own learning, while at our institutions. The activities that they will be undertaking have vastly different outcomes, and require different things from students.
My question is:
“If an approach is decided upon within a school, do all teachers, in all classes need to take on that approach?”
I know of a situation in which a coordinator is forcing all teachers to take on communicative language teaching principles within a program, regardless of teacher gripes, or student difficulties with that particular approach. An approach may not necessarily work for all people, all of the time. After all, we need to also take in cultural aspects, or individual differences, for instance that may make one approach ineffective, in some cases, some of the time.
Then there’s what is happening in our college, a kind of free for all with, as many approaches as there are teachers. This too, is not an ideal situation, as there is no consistency (something in fact, that I need in my own learning).
In the end, we have to balance the needs and abilities of the students we teach. We also have to keep in mind that only one approach to teaching may severely disadvantage our students, if it so happens that other approaches are found to be more beneficial. I guess it’s an argument over consistency vs. flexibility. There are merits and demerits in both. I tend to be on the flexibility side, as long as it is based in firm and logical principles. There has to be a reason to change. I remember a lecturer introducing us to the, ‘if a bird were to fly into the room theory…what would you do?’ Carry on with your lesson plan or start talking about the bird (I think he was talking about Herbert Kohl, but I could be wrong…). That idea, although a little outdated (alternative education movement), has had a deep impact on me personally.
We need to establish curriculum's and syllabi that are based on consistent principles, yet they must also have within them some flexibility to allow for the ‘bird flying in the room’ factor.
What do you say?????
Steven Mondy
Sunday, October 21, 2007
What is the linguistic wealth that we bring to this course?
Topic: What is the linguistic wealth that we bring to this course? Date: 14 November 2006 3:06 PM
Subject: Theory into practise... Author: Mondy, Steven
Where do we kick this discussion off? Well, at the moment, our college is in the middle of our mid-term examinations. And I am in the process of thinking about how to test, not only a variety of skill areas, but varying levels and students with different purposes. I have many concerns regarding the appropriateness or validity of all that I do in testing situations. Reading Hughes, I see that testing where possible is to be seen as a group task, and that we should be assessing our own tests and their purposes. I think that essentially this is needed and in theory a given, but I sometimes find that the situations that we find ourselves in make it hard to do. Making our mid-term examinations, while juggling class teaching requirements and college commitments can be quite a handful. I guess what I’m trying to say is that it is not always possible to take time with the test making process, and we may not be able to always give very much attention to evaluation until much later. How do we as teachers start to implement some of the necessary theory into our real life working situations? This is where balance and fortitude is needed in making small changes to the things that we are already doing. We are already using various strategies and techniques, such as suggested in the readings under the different approaches (integrative, communicative etc…). There is definitely a need to understand the effect that our choices of items and complete examinations have on the overall motivation of students within our classes, and to their whole attitude toward language. What do you think?
Steven Mondy
Subject: Theory into practise... Author: Mondy, Steven
Where do we kick this discussion off? Well, at the moment, our college is in the middle of our mid-term examinations. And I am in the process of thinking about how to test, not only a variety of skill areas, but varying levels and students with different purposes. I have many concerns regarding the appropriateness or validity of all that I do in testing situations. Reading Hughes, I see that testing where possible is to be seen as a group task, and that we should be assessing our own tests and their purposes. I think that essentially this is needed and in theory a given, but I sometimes find that the situations that we find ourselves in make it hard to do. Making our mid-term examinations, while juggling class teaching requirements and college commitments can be quite a handful. I guess what I’m trying to say is that it is not always possible to take time with the test making process, and we may not be able to always give very much attention to evaluation until much later. How do we as teachers start to implement some of the necessary theory into our real life working situations? This is where balance and fortitude is needed in making small changes to the things that we are already doing. We are already using various strategies and techniques, such as suggested in the readings under the different approaches (integrative, communicative etc…). There is definitely a need to understand the effect that our choices of items and complete examinations have on the overall motivation of students within our classes, and to their whole attitude toward language. What do you think?
Steven Mondy
Validity and reliability - issues and discussion
Topic: Validity and reliability - issues and discussion Date: 22 November 2006 1:35 PM
Subject: Usefulness??? Author: Mondy, Steven View PeopleLink Options for this User
It should be understood that validity and reliability are but two categories within the general notion of understanding a test’s usefulness. According to Bachman & Palmer, we need to understand a test’s usefulness ~ encompassing reliability, construct validity, authenticity, interactiveness, impact, and practicality (Bachman & Palmer, 1996, Language Testing in Practice, Oxford University Press, p. 18).
They go on to talk about how reliability is a necessary aspect of validity, but it does not necessarily meet the needs of validity, in all cases. What does this mean? Well, it may have something to do with a test being able to fulfill the requirements of getting consistent results over time, however, using the same test in varying situations (such as a proven grammar test, being used to test someone’s speaking ability) may be inappropriate as it does not address all the other aspects to a students speaking ability. It is, as a solitary test for speaking ability, invalid. What is to be learned from this? One thing is that we have to understand the aspects of the skill area that we are testing, to design not only a reliable test, but also a test that retrieves the results that we should be looking for.
We need to also understand that we should to be careful about using tests or test items that we know have worked in the past, with our existing students. There could be many things that invalidate the test. If we aren’t careful of what it is we need to test (our objectives), what we have actually taught in our classes, and our student’s needs, we may end up with results that are actually more harmful, because of bad backwash. Do I make any sense?
Steven Mondy
Subject: Usefulness??? Author: Mondy, Steven View PeopleLink Options for this User
It should be understood that validity and reliability are but two categories within the general notion of understanding a test’s usefulness. According to Bachman & Palmer, we need to understand a test’s usefulness ~ encompassing reliability, construct validity, authenticity, interactiveness, impact, and practicality (Bachman & Palmer, 1996, Language Testing in Practice, Oxford University Press, p. 18).
They go on to talk about how reliability is a necessary aspect of validity, but it does not necessarily meet the needs of validity, in all cases. What does this mean? Well, it may have something to do with a test being able to fulfill the requirements of getting consistent results over time, however, using the same test in varying situations (such as a proven grammar test, being used to test someone’s speaking ability) may be inappropriate as it does not address all the other aspects to a students speaking ability. It is, as a solitary test for speaking ability, invalid. What is to be learned from this? One thing is that we have to understand the aspects of the skill area that we are testing, to design not only a reliable test, but also a test that retrieves the results that we should be looking for.
We need to also understand that we should to be careful about using tests or test items that we know have worked in the past, with our existing students. There could be many things that invalidate the test. If we aren’t careful of what it is we need to test (our objectives), what we have actually taught in our classes, and our student’s needs, we may end up with results that are actually more harmful, because of bad backwash. Do I make any sense?
Steven Mondy
Validity and reliability - issues and discussion 2
Topic: Validity and reliability - issues and discussion Date: 4 December 2006 11:41 PM
Subject: Re:Very testy indeed Author: Mondy, Steven
I kind of resist using anything more than once as I feel, now this is only on a personal level, that it isn't fair to the student who pays X amount of $ to get up to date, well thought out, original, and unique material. Of course, re-inventing the wheel is a laborious and somewhat futile endeavor, yet shouldn't we try to personalize our teaching as much as possible. If students know that a test is being used in basically the same format for years on end, then doesn't that automatically invalidate the test.
I understand that the issue of creating and maintaining reliability is paramount, yet I think that is also essential that we remain vibrant and abreast to the changes in our teaching environment. That may mean whole changes to not only the test, but to the content of the course and the objectives.
Each student is an individual, learning within a certain context. Our programs need to have flexibility in order to respond to that. It’s too easy to expect students to fit our models. Yet, maintaining our formats, will also maintain our teaching objectives, and keep up standards, not to mention strengthen the basis on which we can make judgments about overall ability.
What are we to do?
Steven Mondy
Subject: Re:Very testy indeed Author: Mondy, Steven
I kind of resist using anything more than once as I feel, now this is only on a personal level, that it isn't fair to the student who pays X amount of $ to get up to date, well thought out, original, and unique material. Of course, re-inventing the wheel is a laborious and somewhat futile endeavor, yet shouldn't we try to personalize our teaching as much as possible. If students know that a test is being used in basically the same format for years on end, then doesn't that automatically invalidate the test.
I understand that the issue of creating and maintaining reliability is paramount, yet I think that is also essential that we remain vibrant and abreast to the changes in our teaching environment. That may mean whole changes to not only the test, but to the content of the course and the objectives.
Each student is an individual, learning within a certain context. Our programs need to have flexibility in order to respond to that. It’s too easy to expect students to fit our models. Yet, maintaining our formats, will also maintain our teaching objectives, and keep up standards, not to mention strengthen the basis on which we can make judgments about overall ability.
What are we to do?
Steven Mondy
Reliability in once-off tests
Topic: Validity and reliability - issues and discussion Date: 26 November 2006 5:45 PM
Subject: Reliability in once-off tests Author: Mondy, Steven
How do we ensure reliability in a test we make and use only once? Often I find myself in a situation in which I’m unable to use a test again in the same kind of context, or with students with similar abilities. I often find that I may need to wait 2-3 years before actually being able to teach the same content. By that time, the tests lose validity? Reliability is closely related to having items that are consistent over time. Hughes and Bachman talk about creating item banks, which store items that we know are reliable, in order to reduce the effort that’s needed to make tests. I guess this is one way to be more certain that whether a test is a one-time thing, or to be used again, the content of the test will be reliable. Also, we shouldn’t understand a test only in terms of a complete, unchangeable entity, but a series of well-formulated items that put together correctly, can be reliable and valid for each and every time we use them. So, what I’m trying to say here is, whenever we make a test, we should try to create a test that may have items that are often used again and again, but not necessarily tests as a whole that are used again and again. Is it really possible to use an intact, unchangeable test in exactly the same way with new students anyway?
I’ve also been thinking of how one can develop tests that are specifically used more as a teaching tool, rather than a measurement or evaluation instrument. If students are prevented from seeing a test and analyzing the mistakes that are made in order to solely ensure reliability, then the student is missing a valuable learning experience. I think that tests can be used as a way to have students experience giving an answer, and then checking their answers with a model, or having an instructed lesson following the tests administration (looking over the actual test) in order to clarify the main points of the test within a student’s mind. Of course, we may need to forgo the ability to use the test in the future, but what can be gained may outweigh the possible disadvantages. This may be where the idea of item banks may help?! What do you think?
Steven Mondy
Subject: Reliability in once-off tests Author: Mondy, Steven
How do we ensure reliability in a test we make and use only once? Often I find myself in a situation in which I’m unable to use a test again in the same kind of context, or with students with similar abilities. I often find that I may need to wait 2-3 years before actually being able to teach the same content. By that time, the tests lose validity? Reliability is closely related to having items that are consistent over time. Hughes and Bachman talk about creating item banks, which store items that we know are reliable, in order to reduce the effort that’s needed to make tests. I guess this is one way to be more certain that whether a test is a one-time thing, or to be used again, the content of the test will be reliable. Also, we shouldn’t understand a test only in terms of a complete, unchangeable entity, but a series of well-formulated items that put together correctly, can be reliable and valid for each and every time we use them. So, what I’m trying to say here is, whenever we make a test, we should try to create a test that may have items that are often used again and again, but not necessarily tests as a whole that are used again and again. Is it really possible to use an intact, unchangeable test in exactly the same way with new students anyway?
I’ve also been thinking of how one can develop tests that are specifically used more as a teaching tool, rather than a measurement or evaluation instrument. If students are prevented from seeing a test and analyzing the mistakes that are made in order to solely ensure reliability, then the student is missing a valuable learning experience. I think that tests can be used as a way to have students experience giving an answer, and then checking their answers with a model, or having an instructed lesson following the tests administration (looking over the actual test) in order to clarify the main points of the test within a student’s mind. Of course, we may need to forgo the ability to use the test in the future, but what can be gained may outweigh the possible disadvantages. This may be where the idea of item banks may help?! What do you think?
Steven Mondy
Reliability in once-off tests 2
Topic: Validity and reliability - issues and discussion Date: 30 November 2006 10:07 PM
Subject: Reliability in once-off tests Author: Mondy, Steven
I like to think of a test as something that not only gauge someone's ability, but as a tool that helps a student see where they need to improve. I was doing some speed reading work in a class today that had simple multiple choice recognition items that helped students see a general overall comprehension score in relation to the time it took them to read a passage. By the time we got through 4 passages, students were able to see a pattern being established, which helped them make their own judgements on their reading ability.
In other classes, I tend to buck our school policy a little and let students mark their own tests, or their partners. One disadvantage would be that it could discourage students who are doing badly. On the other hand, it promotes a common mateship within a class, and a little bit of a competative spirit. Handled well, it can be quite a motivating tool, and reduce the negative image toward taking tests. I understand the need to withold tests on large scale apptitude type tests, but for classroom evaluation and learning, there are times when students need to see the test.
Does anyone else agree with this?
Steven
Subject: Reliability in once-off tests Author: Mondy, Steven
I like to think of a test as something that not only gauge someone's ability, but as a tool that helps a student see where they need to improve. I was doing some speed reading work in a class today that had simple multiple choice recognition items that helped students see a general overall comprehension score in relation to the time it took them to read a passage. By the time we got through 4 passages, students were able to see a pattern being established, which helped them make their own judgements on their reading ability.
In other classes, I tend to buck our school policy a little and let students mark their own tests, or their partners. One disadvantage would be that it could discourage students who are doing badly. On the other hand, it promotes a common mateship within a class, and a little bit of a competative spirit. Handled well, it can be quite a motivating tool, and reduce the negative image toward taking tests. I understand the need to withold tests on large scale apptitude type tests, but for classroom evaluation and learning, there are times when students need to see the test.
Does anyone else agree with this?
Steven
Reliability in once-off tests 3
Topic: Validity and reliability - issues and discussion Date: 4 December 2006 9:08 PM
Subject:Reliability in once-off tests Author: Mondy, Steven
Unfortunately, the speed reading is only a unit within a more general course on reading skills, the purpose of which is to increase students ability in gaining information more efficiently. The book I've enlisted is "More Reading Power", which has a series of reading passages in it (all roughly the same length and complexity). Each of the readings can/should be done within a five minute time span. It has lists of reading time to words/minute and a graph for students to plot their own reading time. The onus is on the student themselves to do the comprehension without cheating, mark their own papers, and record all information.
The activity has worked, but I recommend strongly that it be used with high intermediate~advanced students anyway (who are more likely to be motivated to doing the activity).
As for assessment, I'm still struggling on that one. As it is a skill that I want them to improve, I consider their achievements in increasing their comprehension to reading speed a key factor. This is where some kind of criterion referenced list (as a rubric) may come into play to see if each student has 1. been able to improve and 2. If students have achieved a certain level of proficiency.
I'm still juggling what to do, but luckily I still have time (with the approach of our winter vacation).
Hope that I have shed some light on how I approach or plan to approach speed reading.
As for more standardized tests that you are referring to, I can just say that lots of practice may be the key. In those practice tests, you can show students visually on their graphs, and this may give them the motivation to soldier on. You may need to think very carefully about the material you're teaching in close relationship to the students actual abilities, and think about how to test to increase positive results in the students minds. We can't just rely on intrinsic motivation (within the students), but look at giving them an outside reason to be motivated. This may have to be a step by step process, somewhat like a reward system, however, the rewards may need to be made explicit, in terms of concrete visual pictures (graphs and so forth). Do I make any sense? I think I may have just babbled and not really synthesized what I actually mean...!
Steven Mondy
Subject:Reliability in once-off tests Author: Mondy, Steven
Unfortunately, the speed reading is only a unit within a more general course on reading skills, the purpose of which is to increase students ability in gaining information more efficiently. The book I've enlisted is "More Reading Power", which has a series of reading passages in it (all roughly the same length and complexity). Each of the readings can/should be done within a five minute time span. It has lists of reading time to words/minute and a graph for students to plot their own reading time. The onus is on the student themselves to do the comprehension without cheating, mark their own papers, and record all information.
The activity has worked, but I recommend strongly that it be used with high intermediate~advanced students anyway (who are more likely to be motivated to doing the activity).
As for assessment, I'm still struggling on that one. As it is a skill that I want them to improve, I consider their achievements in increasing their comprehension to reading speed a key factor. This is where some kind of criterion referenced list (as a rubric) may come into play to see if each student has 1. been able to improve and 2. If students have achieved a certain level of proficiency.
I'm still juggling what to do, but luckily I still have time (with the approach of our winter vacation).
Hope that I have shed some light on how I approach or plan to approach speed reading.
As for more standardized tests that you are referring to, I can just say that lots of practice may be the key. In those practice tests, you can show students visually on their graphs, and this may give them the motivation to soldier on. You may need to think very carefully about the material you're teaching in close relationship to the students actual abilities, and think about how to test to increase positive results in the students minds. We can't just rely on intrinsic motivation (within the students), but look at giving them an outside reason to be motivated. This may have to be a step by step process, somewhat like a reward system, however, the rewards may need to be made explicit, in terms of concrete visual pictures (graphs and so forth). Do I make any sense? I think I may have just babbled and not really synthesized what I actually mean...!
Steven Mondy
correlation coefficients and true score?
Topic: Validity and reliability - issues and discussion Date: 27 November 2006 11:36 AM
Subject: correlation coefficients and true score? Author: Mondy, Steven
Last night, I was reading about how knowing the correlation coefficient (positive, negative, and no relationship) is quite a useful way to determine the reliability of a test. The study book was talking about how highly correlated scores can mean high reliability. It got me thinking about specific ways of gauging the reliability of our tests and test items. It was suggested that we could do things like give the same test twice (as long as not too much time has elapsed between the administration of the tests), or have such things as split tests, where we compare the two parts of one test. Up until this point, I didn’t really see the value of giving a test more than once in relatively the same, if not exactly the same format. I thought that it might be a waste of time, as I have been always encouraged to believe a test must be held back in extreme secrecy to not influence cheating and studying for specific items. According to the study materials, we see that there may be a change in the scores in that they may be slightly higher, but we can account for this in working out the students overall performance, and correlate the scores to see how that student performed in relation to other students doing the same test (norm referencing?). Then we can see if it has been error from the test format or from other things such as communicative ability, personal attributes, or other random factors (study materials: module 4).
Another interesting thing that I came across was the comparison of the two students with different scores, and being able to say that a student with a slightly higher score in a test may not be better than the student with the lower score, if we take into account their true score (true score=observed score +-measurement error). This was quite striking as I had assumed that ranking students in order of best to worst according to their raw scores was sufficient to get an idea of general performance. This idea of true score has made me rethink how I look at data, especially in terms of what judgments I make when I see the scores of two or more students are very close. What makes the difference between an A and an A- for example, if the range overlaps so significantly?
What do you think about correlation coefficients and true score?
Steven Mondy
Subject: correlation coefficients and true score? Author: Mondy, Steven
Last night, I was reading about how knowing the correlation coefficient (positive, negative, and no relationship) is quite a useful way to determine the reliability of a test. The study book was talking about how highly correlated scores can mean high reliability. It got me thinking about specific ways of gauging the reliability of our tests and test items. It was suggested that we could do things like give the same test twice (as long as not too much time has elapsed between the administration of the tests), or have such things as split tests, where we compare the two parts of one test. Up until this point, I didn’t really see the value of giving a test more than once in relatively the same, if not exactly the same format. I thought that it might be a waste of time, as I have been always encouraged to believe a test must be held back in extreme secrecy to not influence cheating and studying for specific items. According to the study materials, we see that there may be a change in the scores in that they may be slightly higher, but we can account for this in working out the students overall performance, and correlate the scores to see how that student performed in relation to other students doing the same test (norm referencing?). Then we can see if it has been error from the test format or from other things such as communicative ability, personal attributes, or other random factors (study materials: module 4).
Another interesting thing that I came across was the comparison of the two students with different scores, and being able to say that a student with a slightly higher score in a test may not be better than the student with the lower score, if we take into account their true score (true score=observed score +-measurement error). This was quite striking as I had assumed that ranking students in order of best to worst according to their raw scores was sufficient to get an idea of general performance. This idea of true score has made me rethink how I look at data, especially in terms of what judgments I make when I see the scores of two or more students are very close. What makes the difference between an A and an A- for example, if the range overlaps so significantly?
What do you think about correlation coefficients and true score?
Steven Mondy
Validity and Reliability Brainstorm
Topic: Validity and reliability - issues and discussion Date: 30 November 2006 12:51 PM
Subject: Validity and Reliability Brainstorm Author: Mondy, Steven
I've read the Hughes book as well as a lot of both Bachman books and what seems to be the case is that they present a very good definition of both construct validity and reliability and some of the problems associated with them, and give some comparison in the summaries at the end of the respective chapters. Though, I think it may be up to us to come up with a good idea of how they inter-relate, based on what we have learned about the essence of each.
Personally, I've found the Bachman books (Fundamental considerations in testing and Language testing in practice) more helpful for understanding the concepts, as they go into greater detail (a great part of those books is in the material that we were supplied with).
Maybe if we can start a brainstorm on this discussion board of the major issues involved in looking at how they inter-relate, or affect each other. Let me start listing a few ideas that I have come across in the readings…(please correct me if I’m way off base)
1. Reliability and construct validity are concerned with (a) minimizing measurement error (b) maximizing the effects of the language abilities that we are trying to measure. (Bachman, Fundamental considerations in testing, p.161)
2. Reliability is a necessary condition of construct validity, and hence for usefulness. (Bachman, Palmer, Language testing in practice, p.23). Bachman states in the summary on page 289 (Bachman, Fundamental considerations in testing, p.171) that validity is one of the most important qualities to consider in how we use tests, but reliability is necessary to determine potential sources of measurement error and for being able to predict the effects on test scores.
3. Reliability can be defined in terms of CTS theory (classical true score measurement theory) in terms of the correlation of true scores on tests (Bachman, Fundamental considerations in testing, p.171). As long as there is consistency between the scores of various candidates, we can be more certain of item reliability, and therefore of reduced error in testing technique.
4. Please correct me if I’m wrong, but validity seems to be concerned with having a test that closely matches the circumstances of the candidates taking the test, and creating a testing environment that allows for the best possible results to be obtained.
5………
6………
Can anyone add to the list…
Steven Mondy
Subject: Validity and Reliability Brainstorm Author: Mondy, Steven
I've read the Hughes book as well as a lot of both Bachman books and what seems to be the case is that they present a very good definition of both construct validity and reliability and some of the problems associated with them, and give some comparison in the summaries at the end of the respective chapters. Though, I think it may be up to us to come up with a good idea of how they inter-relate, based on what we have learned about the essence of each.
Personally, I've found the Bachman books (Fundamental considerations in testing and Language testing in practice) more helpful for understanding the concepts, as they go into greater detail (a great part of those books is in the material that we were supplied with).
Maybe if we can start a brainstorm on this discussion board of the major issues involved in looking at how they inter-relate, or affect each other. Let me start listing a few ideas that I have come across in the readings…(please correct me if I’m way off base)
1. Reliability and construct validity are concerned with (a) minimizing measurement error (b) maximizing the effects of the language abilities that we are trying to measure. (Bachman, Fundamental considerations in testing, p.161)
2. Reliability is a necessary condition of construct validity, and hence for usefulness. (Bachman, Palmer, Language testing in practice, p.23). Bachman states in the summary on page 289 (Bachman, Fundamental considerations in testing, p.171) that validity is one of the most important qualities to consider in how we use tests, but reliability is necessary to determine potential sources of measurement error and for being able to predict the effects on test scores.
3. Reliability can be defined in terms of CTS theory (classical true score measurement theory) in terms of the correlation of true scores on tests (Bachman, Fundamental considerations in testing, p.171). As long as there is consistency between the scores of various candidates, we can be more certain of item reliability, and therefore of reduced error in testing technique.
4. Please correct me if I’m wrong, but validity seems to be concerned with having a test that closely matches the circumstances of the candidates taking the test, and creating a testing environment that allows for the best possible results to be obtained.
5………
6………
Can anyone add to the list…
Steven Mondy
Two kinds of tests
Topic: Validity and reliability - issues and discussion Date: 4 December 2006 1:45 PM
Subject: Two kinds of tests Author: Mondy, Steven View
Trying to clarify some ideas, I wish to talk about the following case study, that I witnessed.
Case Study:
A teacher for some reason gives students a surprise test (with no previous warning) and then chooses to give them the same test again, but this time with warning.
The student’s are let in on the process of choosing an alternative testing date.
Alternative number 1: One week later (teacher’ choice)
Alternative number 2: Two weeks later (student’s choice)
Surprise tests are not really fair, in that they take students off guard, putting them into a situation in which they are highly resistant to the process at hand and encourage negative attitudes to the test, subject and teacher, which promotes terrible backwash. However, in such a case as above, where the teacher is trying to gauge student’s ability in a spontaneous situation and correlate it with the students prepared-for responses, then I imagine that alternative number 1 would be the better choice to maintain reliability, but would it be invalid, as the students may feel that they need more time to prepare for the test? However, is it really possible to correlate the two tests anyway? Can the formula for working out the correlation between tests be adapted to this scenario (Taking a student’s impromptu ability and comparing it to their prepared answer, I mean)? I think that it would be quite a stretch, without some sort of criterion referencing, and matching to the course objectives.
If alternative 2 is chosen, then there is too much time between the administration of one test and that of the other ~ and the test would become unreliable due to things such as ‘Test Wiseness, ‘ among other factors. (Study book ~ module 4: 4.8)…
The teacher in the above example seems to be in a no-win situation all round. The whole situation seems to be flawed anyway. The teacher will need to consider the reason for giving this test and what information is actually retrieved, and how beneficial it is to the whole learning environment. At the very least, if the tests were to be undertaken, the teacher will need to warn students of the likelihood that this kind of testing will be given.
I wonder, in what situations these kinds of surprise tests could be used in the classroom? There could be a situation, in some speaking classes, where there is a need to know how the student reacts to a new situation, based on their working knowledge of the language. Unfortunately, when in the real world, we cannot prepare for all situations. So, why not have tests that mimic this communicative task?
Steven Mondy
Subject: Two kinds of tests Author: Mondy, Steven View
Trying to clarify some ideas, I wish to talk about the following case study, that I witnessed.
Case Study:
A teacher for some reason gives students a surprise test (with no previous warning) and then chooses to give them the same test again, but this time with warning.
The student’s are let in on the process of choosing an alternative testing date.
Alternative number 1: One week later (teacher’ choice)
Alternative number 2: Two weeks later (student’s choice)
Surprise tests are not really fair, in that they take students off guard, putting them into a situation in which they are highly resistant to the process at hand and encourage negative attitudes to the test, subject and teacher, which promotes terrible backwash. However, in such a case as above, where the teacher is trying to gauge student’s ability in a spontaneous situation and correlate it with the students prepared-for responses, then I imagine that alternative number 1 would be the better choice to maintain reliability, but would it be invalid, as the students may feel that they need more time to prepare for the test? However, is it really possible to correlate the two tests anyway? Can the formula for working out the correlation between tests be adapted to this scenario (Taking a student’s impromptu ability and comparing it to their prepared answer, I mean)? I think that it would be quite a stretch, without some sort of criterion referencing, and matching to the course objectives.
If alternative 2 is chosen, then there is too much time between the administration of one test and that of the other ~ and the test would become unreliable due to things such as ‘Test Wiseness, ‘ among other factors. (Study book ~ module 4: 4.8)…
The teacher in the above example seems to be in a no-win situation all round. The whole situation seems to be flawed anyway. The teacher will need to consider the reason for giving this test and what information is actually retrieved, and how beneficial it is to the whole learning environment. At the very least, if the tests were to be undertaken, the teacher will need to warn students of the likelihood that this kind of testing will be given.
I wonder, in what situations these kinds of surprise tests could be used in the classroom? There could be a situation, in some speaking classes, where there is a need to know how the student reacts to a new situation, based on their working knowledge of the language. Unfortunately, when in the real world, we cannot prepare for all situations. So, why not have tests that mimic this communicative task?
Steven Mondy
Doing Letter Grades on Excel
Topic: Open for Discussion Date: 5 December 2006 1:27 AM
Subject: Doing Letter Grades on Excel Author: Mondy, Steven
If anyone is interested...
There's an easy way of doing your grades on excel.
You can assign letter grades to the results you get for students...
Check out the following website. I managed to finally do it on my computer. It works...
http://www.uwec.edu/help/Excel03/gr-5finalgrad.htm
careful with the formula...
Make the list of grades you want to give then use the formula,
=VLOOKUP(C21,grades,2,TRUE) for example,
~ the c21: is the actual student grade
~ grades: is the list
~ 2: is the column that has A, B, C in the list,
~True: rounds off the grade to the closest figure...
Try it out, it may help you (or may confuse you...)!
Steven Mondy
Subject: Doing Letter Grades on Excel Author: Mondy, Steven
If anyone is interested...
There's an easy way of doing your grades on excel.
You can assign letter grades to the results you get for students...
Check out the following website. I managed to finally do it on my computer. It works...
http://www.uwec.edu/help/Excel03/gr-5finalgrad.htm
careful with the formula...
Make the list of grades you want to give then use the formula,
=VLOOKUP(C21,grades,2,TRUE) for example,
~ the c21: is the actual student grade
~ grades: is the list
~ 2: is the column that has A, B, C in the list,
~True: rounds off the grade to the closest figure...
Try it out, it may help you (or may confuse you...)!
Steven Mondy
Pre-packaged test
Topic: Purposes and Types of Language Test Date: 7 December 2006 7:53 PM
Subject: Pre-packaged test Author: Mondy, Steven
Recently, I was interested to know the effect of a pre-made packaged test on students within our college. I have a class of Chinese students studying within a basic reading course. I’m using the Oxford Dominoes starter series, and they have downloadable book tests (Multiple-choice items) for each of the books. I initially imagined that the tests put out by the publisher had been analyzed and tested (although, here in Japan it’s somewhat a dangerous assumption to make with publishers, as there seems to be frequent mistakes within textbooks). Anyway, after correcting the tests, there seemed to be a definite pattern emerging with relation to the student’s overall results. I saw that what appeared to be a well-formed test that was directly related to the material that we were studying, produced shockingly low results from students. I tried to think about why this was so?
Looking at the test, I couldn’t see any particularly strange or misleading items. The test was divided into sections, “Setting, Characters, Dialog within the book, Vocabulary, and Plot”. All multiple-choice items had four alternatives as suggested in many of our textbooks, which had fairly straightforward distracters. I was fairly confident that it was a reliable test.
However, after getting the results back, I did start to wonder about its validity within the context of this class, and the test’s suitability for our student’s purposes for studying English. The reliability of this test might have been quite high, yet for some reason my students did not do well…
It may have something to do with why the students are actually studying this course in the first place. Chinese students come to Japan, hoping to skip from our course to some university place in Japan. While they are here, they are required to study in (1) Programs that encourage general English learning and (2) Activities that prepare them for university examinations, and other standardized tests.
The reading course above comes under the first heading, and is a required course for them.
Whether right or wrong, I made the following observations:
~ The test may have lacked Validity: in that the objectives of the school, the teacher (me) and the test may not exactly match the goals of the students. These students may not be able to see the purpose of this kind of course, and may be highly resistant to the class and the test itself, therefore invalidating any test, even before it is given.
~ Reliable and well thought-out tests may not produce the same results for different groups of students.
~ Motivation: I observed that many of the students just gave up, and finished the test early because they were either not ready for it, or didn’t have the ability to do it. Either way, they did not feel compelled to continue with the test.
~ Test format: The test that was prepared for these lower level students was solely comprised of written multiple-choice items. There were no pictures or varying techniques such as cloze or matching that would make it possible for students of differing capabilities to have more chances. Also, it was quite clear that although the length of the test did not disadvantage the students (50 items in 50 minutes, which complies with the 1 minute/1question rule), having 50 questions of the same kind did.
Having undertaken this test, and collating the results, I can see that there are some fundamental problems with validity. In the future, I will be wearier of doing tests that aren’t more closely related to the specific needs of my students. That also means I need to be careful of pre-packaged tests that on the surface look fine, but can end up costing in terms of the harmful effects. I will also be careful to provide more of a variety of techniques within a test for differing learning styles.
Steven Mondy
Subject: Pre-packaged test Author: Mondy, Steven
Recently, I was interested to know the effect of a pre-made packaged test on students within our college. I have a class of Chinese students studying within a basic reading course. I’m using the Oxford Dominoes starter series, and they have downloadable book tests (Multiple-choice items) for each of the books. I initially imagined that the tests put out by the publisher had been analyzed and tested (although, here in Japan it’s somewhat a dangerous assumption to make with publishers, as there seems to be frequent mistakes within textbooks). Anyway, after correcting the tests, there seemed to be a definite pattern emerging with relation to the student’s overall results. I saw that what appeared to be a well-formed test that was directly related to the material that we were studying, produced shockingly low results from students. I tried to think about why this was so?
Looking at the test, I couldn’t see any particularly strange or misleading items. The test was divided into sections, “Setting, Characters, Dialog within the book, Vocabulary, and Plot”. All multiple-choice items had four alternatives as suggested in many of our textbooks, which had fairly straightforward distracters. I was fairly confident that it was a reliable test.
However, after getting the results back, I did start to wonder about its validity within the context of this class, and the test’s suitability for our student’s purposes for studying English. The reliability of this test might have been quite high, yet for some reason my students did not do well…
It may have something to do with why the students are actually studying this course in the first place. Chinese students come to Japan, hoping to skip from our course to some university place in Japan. While they are here, they are required to study in (1) Programs that encourage general English learning and (2) Activities that prepare them for university examinations, and other standardized tests.
The reading course above comes under the first heading, and is a required course for them.
Whether right or wrong, I made the following observations:
~ The test may have lacked Validity: in that the objectives of the school, the teacher (me) and the test may not exactly match the goals of the students. These students may not be able to see the purpose of this kind of course, and may be highly resistant to the class and the test itself, therefore invalidating any test, even before it is given.
~ Reliable and well thought-out tests may not produce the same results for different groups of students.
~ Motivation: I observed that many of the students just gave up, and finished the test early because they were either not ready for it, or didn’t have the ability to do it. Either way, they did not feel compelled to continue with the test.
~ Test format: The test that was prepared for these lower level students was solely comprised of written multiple-choice items. There were no pictures or varying techniques such as cloze or matching that would make it possible for students of differing capabilities to have more chances. Also, it was quite clear that although the length of the test did not disadvantage the students (50 items in 50 minutes, which complies with the 1 minute/1question rule), having 50 questions of the same kind did.
Having undertaken this test, and collating the results, I can see that there are some fundamental problems with validity. In the future, I will be wearier of doing tests that aren’t more closely related to the specific needs of my students. That also means I need to be careful of pre-packaged tests that on the surface look fine, but can end up costing in terms of the harmful effects. I will also be careful to provide more of a variety of techniques within a test for differing learning styles.
Steven Mondy
Instructions
Topic: Validity and reliability - issues and discussion Date: 30 December 2006 11:43 PM
Subject: Instructions Author: Mondy, Steven
When we give a test, don't we do so after a long process of introducing the test procedures throughout our teaching? Before attempting the test, the students in many of my classes are often given a pre-test, or warm up test, so that they can become familiar with the kinds of questions and to the types of instructions that they will face.
Also, in the test, each new kind of test item is introduced with an example with answer, or at least the first question is done for them, so that they can work out what to do, if they actually know the content.
I've played with the idea of using the native language of the test takers, but have opted not to, as I feel that a properly presented test (pre-test, test, and post-test activities) can make it possible for any level student to undertake a test solely in the target language.
However, the kinds of instructions are significantly different depending on the level of the student. I find it quite difficult to write clear instructions for lower level students in particular. To resist the urge to use complicated or confusing jargon.
Another thing that I've been pondering is the use of 'please' in instructions. When writing instructions, do we say...Please circle the correct answer, or do we say circle the correct answer? Many would say that we should make our instructions as clear as possible, with little room for misinterpretation. Does that mean we should take the second option?
Steven
Subject: Instructions Author: Mondy, Steven
When we give a test, don't we do so after a long process of introducing the test procedures throughout our teaching? Before attempting the test, the students in many of my classes are often given a pre-test, or warm up test, so that they can become familiar with the kinds of questions and to the types of instructions that they will face.
Also, in the test, each new kind of test item is introduced with an example with answer, or at least the first question is done for them, so that they can work out what to do, if they actually know the content.
I've played with the idea of using the native language of the test takers, but have opted not to, as I feel that a properly presented test (pre-test, test, and post-test activities) can make it possible for any level student to undertake a test solely in the target language.
However, the kinds of instructions are significantly different depending on the level of the student. I find it quite difficult to write clear instructions for lower level students in particular. To resist the urge to use complicated or confusing jargon.
Another thing that I've been pondering is the use of 'please' in instructions. When writing instructions, do we say...Please circle the correct answer, or do we say circle the correct answer? Many would say that we should make our instructions as clear as possible, with little room for misinterpretation. Does that mean we should take the second option?
Steven
oral testing in pairs
Topic: Assignment 2 discussion and queries Date: 3 January 2007 12:16 PM
Subject: oral testing in pairs Author: Mondy, Steven
The point about the stronger student being able to perform in any situation is quite solid. I think that we as teachers can see their ability to handle a situation where the other speaker cannot answer fully (though are we now testing something different). This reflects an aspect of authenticity, in that it more closely resembles real life situations. However, as the proctor of the test, how do we alter our own perceptions to the changes and grading? This is obviously very subjective, as it is quite spontaneous, and we are unable to prepare fully for such a case. We can however, make provisions in our planning for this kind of test, by stating the course of action to take in such a case. This of course is an ideal situation, in which teachers have the time to do so. Still, there will be problems with reliability, especially proctor to proctor consistency, that will certainly need attention.
As for weaker students being paired, well from my experience, it has been rather detrimental as you have pointed out. Students tend to wind down into a state of nervousness about not being able to answer anything. Then there starts to be a problem with reliability (Bachman 1990), in that random factors, such as emotional state and changes to the test environment interfere with the successful completion of the test. Has anyone else had similiar problems?
Steven Mondy
Subject: oral testing in pairs Author: Mondy, Steven
The point about the stronger student being able to perform in any situation is quite solid. I think that we as teachers can see their ability to handle a situation where the other speaker cannot answer fully (though are we now testing something different). This reflects an aspect of authenticity, in that it more closely resembles real life situations. However, as the proctor of the test, how do we alter our own perceptions to the changes and grading? This is obviously very subjective, as it is quite spontaneous, and we are unable to prepare fully for such a case. We can however, make provisions in our planning for this kind of test, by stating the course of action to take in such a case. This of course is an ideal situation, in which teachers have the time to do so. Still, there will be problems with reliability, especially proctor to proctor consistency, that will certainly need attention.
As for weaker students being paired, well from my experience, it has been rather detrimental as you have pointed out. Students tend to wind down into a state of nervousness about not being able to answer anything. Then there starts to be a problem with reliability (Bachman 1990), in that random factors, such as emotional state and changes to the test environment interfere with the successful completion of the test. Has anyone else had similiar problems?
Steven Mondy
oral testing in pairs1
Topic: Assignment 2 discussion and queries Date: 4 January 2007 4:20 PM
Subject:oral testing in pairs Author: Mondy, Steven
I guess I'm talking about practicality here. Pairing up students and using criterion referenced type tests (both discreet and integrated) in the form of mini role-plays and distinct short conversations (both authentic and non). As for the level, I think that anything but true beginner can handle this kind of testing. As for the true beginner, then I would consider straight out student to teacher interviews (even though there may be a problem with performance anxiety in front of a native speaker in the TLU). Oral interviews for speaking type classes are essential to maintain face validity as Hughes points out on page 33. However, the true beginner may not have enough yet to work with to be able to handle true mini-conversation scenarios. Therefore, one may need to balance in favor of less authentic material to make sure validity is maintained…
Does this at all answer your question?
Steven Mondy
Subject:oral testing in pairs Author: Mondy, Steven
I guess I'm talking about practicality here. Pairing up students and using criterion referenced type tests (both discreet and integrated) in the form of mini role-plays and distinct short conversations (both authentic and non). As for the level, I think that anything but true beginner can handle this kind of testing. As for the true beginner, then I would consider straight out student to teacher interviews (even though there may be a problem with performance anxiety in front of a native speaker in the TLU). Oral interviews for speaking type classes are essential to maintain face validity as Hughes points out on page 33. However, the true beginner may not have enough yet to work with to be able to handle true mini-conversation scenarios. Therefore, one may need to balance in favor of less authentic material to make sure validity is maintained…
Does this at all answer your question?
Steven Mondy
oral testing in pairs2
Topic: Assignment 2 discussion and queries Date: 7 January 2007 11:41 AM
Subject: oral testing in pairs Author: Mondy, Steven
It is not always possible to test a wide range of skills within the objectives of your course, but only a selection. Discreet point testing will make it more likely that the skills you are looking for will more clearly be evaluated, whereas integrated tests might make it very difficult to make judgments about students fairly, as students may answer in a variety of ways.
Steven Mondy
Subject: oral testing in pairs Author: Mondy, Steven
It is not always possible to test a wide range of skills within the objectives of your course, but only a selection. Discreet point testing will make it more likely that the skills you are looking for will more clearly be evaluated, whereas integrated tests might make it very difficult to make judgments about students fairly, as students may answer in a variety of ways.
Steven Mondy
iBT TOEFL ~ reflecting authenticity...
Topic: Purposes and Types of Language Test Date: 13 January 2007 5:19 PM
Subject: iBT TOEFL ~ reflecting authenticity... Author: Mondy, Steven
I was reading about an interesting development in the iBT (internet based TOEFL test) in the Daily Yomuiri, a Japan-based English language newspaper
(Lawrence J. Zwier, TOEFL Booster / Readings get longer, and tougher, Yomiurihttp://www.yomiuri.co.jp/dy/features/language/20070112TDY15001.htm).
The article talks about a change in the test that is an attempt to make the reading section more authentic, has made it more difficult for some test-takers. The most significant change is the move from what the article calls enumeration type readings (where a point is given, then supporting evidence) to a more complex form where several ideas are interlaced ~ a task requiring more understanding of various reading skills and the purpose for obtaining information. The article implies that the change in the test is to encompass, 1. Reading to find information (such things as speed reading, using thinking skills while reading), 2. Reading for comprehension (the more traditional focus), and 3. Reading to learn (being able to summarize, and then use the information).
This was very interesting to me as one of the main focuses in my college has been point number two, comprehension, then followed by point number one, the development of reading skills. Unfortunately, point number 3 has been missed in our curriculum design phase, which will make it quite difficult for our students in this new version of the iBT.
This semester, I have also discovered that this focus has been detrimental to our students, especially within short answer type questions. They are too used to multiple choice type questions, and are not sure what information to include in a written response. I have tried to change this by not only testing, but also teaching various techniques to get away from just reading for comprehension, such things as, discussion, inference making, and summarization. I believe that we need to essentially test how we teach, which means that we at the college need to adopt new curriculum ideas, to reflect changes to ideas out in the real world ~ which I suspect the new version of the iBT is attempting to do?!
Steven Mondy
Subject: iBT TOEFL ~ reflecting authenticity... Author: Mondy, Steven
I was reading about an interesting development in the iBT (internet based TOEFL test) in the Daily Yomuiri, a Japan-based English language newspaper
(Lawrence J. Zwier, TOEFL Booster / Readings get longer, and tougher, Yomiurihttp://www.yomiuri.co.jp/dy/features/language/20070112TDY15001.htm).
The article talks about a change in the test that is an attempt to make the reading section more authentic, has made it more difficult for some test-takers. The most significant change is the move from what the article calls enumeration type readings (where a point is given, then supporting evidence) to a more complex form where several ideas are interlaced ~ a task requiring more understanding of various reading skills and the purpose for obtaining information. The article implies that the change in the test is to encompass, 1. Reading to find information (such things as speed reading, using thinking skills while reading), 2. Reading for comprehension (the more traditional focus), and 3. Reading to learn (being able to summarize, and then use the information).
This was very interesting to me as one of the main focuses in my college has been point number two, comprehension, then followed by point number one, the development of reading skills. Unfortunately, point number 3 has been missed in our curriculum design phase, which will make it quite difficult for our students in this new version of the iBT.
This semester, I have also discovered that this focus has been detrimental to our students, especially within short answer type questions. They are too used to multiple choice type questions, and are not sure what information to include in a written response. I have tried to change this by not only testing, but also teaching various techniques to get away from just reading for comprehension, such things as, discussion, inference making, and summarization. I believe that we need to essentially test how we teach, which means that we at the college need to adopt new curriculum ideas, to reflect changes to ideas out in the real world ~ which I suspect the new version of the iBT is attempting to do?!
Steven Mondy
iBT TOEFL ~ reflecting authenticity...2
Topic: Purposes and Types of Language Test Date: 15 January 2007 11:10 AM
Subject: Re:iBT TOEFL ~ reflecting authenticity... Author: Mondy, Steven
It's good to here that others are having similar issues with the TOEFL/TOEIC...My biggest question is whether these new changes are reflective of what is needed by these students. Are we being led down the road in a chicken and egg race, that will end up in our students getting more confused? I think that all the skills that I mentioned before are purposeful and relevant to teaching practice and learning, yet I don't want a situation where it's the test that dictates what we need to focus on in our classes, unless it is truly what our particular students need to know. Isn't a test an evaluation instrument, and not a prescriptive force?
Steven Mondy
Subject: Re:iBT TOEFL ~ reflecting authenticity... Author: Mondy, Steven
It's good to here that others are having similar issues with the TOEFL/TOEIC...My biggest question is whether these new changes are reflective of what is needed by these students. Are we being led down the road in a chicken and egg race, that will end up in our students getting more confused? I think that all the skills that I mentioned before are purposeful and relevant to teaching practice and learning, yet I don't want a situation where it's the test that dictates what we need to focus on in our classes, unless it is truly what our particular students need to know. Isn't a test an evaluation instrument, and not a prescriptive force?
Steven Mondy
iBT TOEFL ~ reflecting authenticity...3
Topic: Purposes and Types of Language Test Date: 20 January 2007 11:54 AM
Subject: iBT TOEFL ~ reflecting authenticity... Author: Mondy, Steven
I can see the value of providing a goal to work towards and providing tasks that will not only develop their abilities to take the test, but through some kind of ‘osmosis’ process in learning, pick up some of the TL (target language). However, this defeats one of the main purposes of an evaluation tool, and it then becomes something else ~ as I said before, a tool to prescribe what some group in society thinks is needed. Isn't it dangerous, and at cross- purposes with ‘authenticity’ to do so? "They need to be able to fulfill certain requirements to succeed in a course," you may ask. Yes they do, and is that the purpose of this kind of test? What is the TOEFL and TOEIC trying to be?
1. A proficiency test (ability in language regardless of ability),
2. or achievement test (how much individuals have been achieving goals of program)
3. or diagnostic test (identify learners' strengths and weaknesses)
4. or placement test (getting info to help position an individuals in a certain place)?
(Hughes, 2005)
Which is the TOEFL or TOEIC, really? In Japan, the TOEIC seems to operate as a placement test for climbing the rungs of the corporate ladder. High score and you get the promotion! TOEFL is closer to the ideals of the proficiency test. And with the new changes is heading towards a closer connection to the real world, and authenticity.
You ask who really cares whether or not they are good speakers? Well, maybe no one does, except the individual who is trying out for the test. Many of my students are still under the illusion that a good score on either of these tests correlates with a good ability in the TL. Probably with the revised TOEFL, they may be right!??? So, do we head down the path of teaching to the test or do we maintain our determination to help these individuals with learning the target language? I think I’ll let you decided on that one for yourself. As for me, I’m still sitting on the fence…
Steven
Subject: iBT TOEFL ~ reflecting authenticity... Author: Mondy, Steven
I can see the value of providing a goal to work towards and providing tasks that will not only develop their abilities to take the test, but through some kind of ‘osmosis’ process in learning, pick up some of the TL (target language). However, this defeats one of the main purposes of an evaluation tool, and it then becomes something else ~ as I said before, a tool to prescribe what some group in society thinks is needed. Isn't it dangerous, and at cross- purposes with ‘authenticity’ to do so? "They need to be able to fulfill certain requirements to succeed in a course," you may ask. Yes they do, and is that the purpose of this kind of test? What is the TOEFL and TOEIC trying to be?
1. A proficiency test (ability in language regardless of ability),
2. or achievement test (how much individuals have been achieving goals of program)
3. or diagnostic test (identify learners' strengths and weaknesses)
4. or placement test (getting info to help position an individuals in a certain place)?
(Hughes, 2005)
Which is the TOEFL or TOEIC, really? In Japan, the TOEIC seems to operate as a placement test for climbing the rungs of the corporate ladder. High score and you get the promotion! TOEFL is closer to the ideals of the proficiency test. And with the new changes is heading towards a closer connection to the real world, and authenticity.
You ask who really cares whether or not they are good speakers? Well, maybe no one does, except the individual who is trying out for the test. Many of my students are still under the illusion that a good score on either of these tests correlates with a good ability in the TL. Probably with the revised TOEFL, they may be right!??? So, do we head down the path of teaching to the test or do we maintain our determination to help these individuals with learning the target language? I think I’ll let you decided on that one for yourself. As for me, I’m still sitting on the fence…
Steven
Niggily bits
Topic: Assignment 2 discussion and queries Date: 19 January 2007 6:18 PM
Subject: Niggily bits Author: Mondy, Steven
I am really getting into the test creation process and reshaping and reformatting of the test. I'm never satisfied...
I wonder if anyone else is really frustrated with Microsoft word, especially with making multiple choice items ~ it insists on capital letters after the a. b. c. and d.
I was also dealing with a minor issue of using 'not' in a multiple choice item, but decided to redo it on advice from the Hughes book. I was ale to rephrase it so that it wouldn't have the potential of disadvantaging my students.
Actually, it has been quite interesting formulating questions. It's so easy to introduce little things that quickly invalidate an item. In one task, I was going to label an item "Vocabulary:Synonyms" and then ask the students to look for the word that is not a Synonym. I quickly realized that by labeling it "Synonyms" I introduce into the students conscious (or unconscious minds) the expectation to look for synonyms. This in turn may cause a student to make a mistake with what is expected of them, and make the item invalid. I decided to cut the heading, and now it states Section A: Vocabulary.
It's all so easy to introduce unforeseen elements into the test.
Steven Mondy
Subject: Niggily bits Author: Mondy, Steven
I am really getting into the test creation process and reshaping and reformatting of the test. I'm never satisfied...
I wonder if anyone else is really frustrated with Microsoft word, especially with making multiple choice items ~ it insists on capital letters after the a. b. c. and d.
I was also dealing with a minor issue of using 'not' in a multiple choice item, but decided to redo it on advice from the Hughes book. I was ale to rephrase it so that it wouldn't have the potential of disadvantaging my students.
Actually, it has been quite interesting formulating questions. It's so easy to introduce little things that quickly invalidate an item. In one task, I was going to label an item "Vocabulary:Synonyms" and then ask the students to look for the word that is not a Synonym. I quickly realized that by labeling it "Synonyms" I introduce into the students conscious (or unconscious minds) the expectation to look for synonyms. This in turn may cause a student to make a mistake with what is expected of them, and make the item invalid. I decided to cut the heading, and now it states Section A: Vocabulary.
It's all so easy to introduce unforeseen elements into the test.
Steven Mondy
Maybe a stupid question...?
Topic: Assignment 2 discussion and queries Date: 19 January 2007 6:32 PM
Subject: Scoring - Maybe a stupid question...? Author: Mondy, Steven
What is the advantage of scoring a test out of 100, as opposed to dividing by the total and working out a percentage?
I was wondering about this, and can see one advantage of scoring out of 100. That is, it is clearer for the test taker to see the division of scores between the sections, and between various parts. For instance, you may divide up your test into various sections based on a certain taxonomy - such as knowledge vs. application. Also for the untrained eye, it's easier to see the weighting given to various parts, and decide how much effort will be required for each section.
Then there's the marker, who may not be the person who designed the test. They can see the breakdown very clearly after the administration of the test, how much emphasis is placed on various sections...
In spite of this, I'd like to ask everyone if it is necessary to have the total = 100?
Steve
Subject: Scoring - Maybe a stupid question...? Author: Mondy, Steven
What is the advantage of scoring a test out of 100, as opposed to dividing by the total and working out a percentage?
I was wondering about this, and can see one advantage of scoring out of 100. That is, it is clearer for the test taker to see the division of scores between the sections, and between various parts. For instance, you may divide up your test into various sections based on a certain taxonomy - such as knowledge vs. application. Also for the untrained eye, it's easier to see the weighting given to various parts, and decide how much effort will be required for each section.
Then there's the marker, who may not be the person who designed the test. They can see the breakdown very clearly after the administration of the test, how much emphasis is placed on various sections...
In spite of this, I'd like to ask everyone if it is necessary to have the total = 100?
Steve
Testing grammar
Sunday, October 21, 2007
Testing grammar
Topic: Assignment 2 discussion and queries Date: 30 January 2007 1:22 AM
Subject:Testing grammar Author: Mondy, Steven
I think that all speaking tests are quite difficult to administer. There are just so many factors to take into consideration. Our classmate has pointed out a very good point with the testing, or at the very least the acknowledgment of the test-taker’s ability to self-correct. We are often too much caught up in the timing and correctness of procedure to allow students enough time to self-correct (a skill that may become more apparent ‘quite a ways down the track’ in their lang. learning).
From my experience (in Japan), learners tend to do better on written tasks, and have great difficulty producing oral language. There have been those students who the reverse is true, but generally written tests seem to be less invasive, especially if enough time is given. As for the question about giving a written test on paper, well, I think that I read somewhere, maybe in Hughes, maybe Bachman, that we need to maintain face validity ~ testing speaking with a written test somewhat invalidates the procedure.
I would go more for some kind of rubric, that incorporates grammar into one of the sections, along with categories including the one Nico suggested, in that the ability to self-correct is a factor in the level of proficiency that the learner has achieved. Your test seems to be more discreet point testing, and for such a case, then yes, you would have to mark them down on knowing that particular grammar, as long as you have given them enough time to answer the question, and as long as that is your focus within your objectives. A more integrative test, based on a role-play would probably pose more difficulties with rater inconsistencies, but may make grammar less of a focus, and make communication the focal point.
Also remember that, the student’s score is dependent on many factors, and the interpretation of them is relative to the other people taking the same test. Cut off scores don’t remain fixed to a magical 50%.
Steven Mondy
Testing grammar
Topic: Assignment 2 discussion and queries Date: 30 January 2007 1:22 AM
Subject:Testing grammar Author: Mondy, Steven
I think that all speaking tests are quite difficult to administer. There are just so many factors to take into consideration. Our classmate has pointed out a very good point with the testing, or at the very least the acknowledgment of the test-taker’s ability to self-correct. We are often too much caught up in the timing and correctness of procedure to allow students enough time to self-correct (a skill that may become more apparent ‘quite a ways down the track’ in their lang. learning).
From my experience (in Japan), learners tend to do better on written tasks, and have great difficulty producing oral language. There have been those students who the reverse is true, but generally written tests seem to be less invasive, especially if enough time is given. As for the question about giving a written test on paper, well, I think that I read somewhere, maybe in Hughes, maybe Bachman, that we need to maintain face validity ~ testing speaking with a written test somewhat invalidates the procedure.
I would go more for some kind of rubric, that incorporates grammar into one of the sections, along with categories including the one Nico suggested, in that the ability to self-correct is a factor in the level of proficiency that the learner has achieved. Your test seems to be more discreet point testing, and for such a case, then yes, you would have to mark them down on knowing that particular grammar, as long as you have given them enough time to answer the question, and as long as that is your focus within your objectives. A more integrative test, based on a role-play would probably pose more difficulties with rater inconsistencies, but may make grammar less of a focus, and make communication the focal point.
Also remember that, the student’s score is dependent on many factors, and the interpretation of them is relative to the other people taking the same test. Cut off scores don’t remain fixed to a magical 50%.
Steven Mondy
Friday, October 19, 2007
Why does English have a need for pronouns?
13th August, 2006
Recently, I was talking with my wife about the differences between her language (Japanese) and mine (English), and she asked me, “Why does English have the need to keep on restating pronouns?” In Japanese, once the referent is established, there is not much need to keep on using the pronouns, ‘watashi’= I, ‘anata’=you, ‘kare’ =he, ‘kanajo’=she and so on... As an English speaker in my L1 and Japanese in L2, I often find that I lose track of who or what the conversation is about when having a conversation in Japanese, because of the lack of pronouns. My wife often says that the English use of pronouns is redundant, as we have already established what is being discussed (or with a little imagination you’d be able to work it out). I was reading that Japanese is a ‘pro-drop’ language (Wikipedia http://en.wikipedia.org/wiki/Japanese_language), in that it tends to omit words to make an utterance shorter, if the context is known. I think, that English also drops pronouns sometimes, however, not as much as Japanese. So, why in English do we tend to overuse pronouns?
Japanese is said to be a high context culture and English a Low context culture. That is...
High context culture: many things don’t need to be made explicit because of a close connection and understanding.
Low context: societies that need to explicitly spell out things because connections are not as close. (Culture at work: Communicating across cultures, http://www.culture-at-work.com/highlow.html)
Could this explain the need for us to continually check that the listener understands who the referent is? ...And why is necessary for English to paraphrase so often? My wife made a joke and asked, “Don’t people listen the first time?”
Another question that came up was why do some languages (like Romance languages, and even English in some cases) tend to use gender more than others? Why in English, we sometimes refer to a ship as a ‘She’? Why in Italian, Bianca (female) and Bianco (male)? How does culture influence language, and how does language influence culture?
Steven Mondy
Recently, I was talking with my wife about the differences between her language (Japanese) and mine (English), and she asked me, “Why does English have the need to keep on restating pronouns?” In Japanese, once the referent is established, there is not much need to keep on using the pronouns, ‘watashi’= I, ‘anata’=you, ‘kare’ =he, ‘kanajo’=she and so on... As an English speaker in my L1 and Japanese in L2, I often find that I lose track of who or what the conversation is about when having a conversation in Japanese, because of the lack of pronouns. My wife often says that the English use of pronouns is redundant, as we have already established what is being discussed (or with a little imagination you’d be able to work it out). I was reading that Japanese is a ‘pro-drop’ language (Wikipedia http://en.wikipedia.org/wiki/Japanese_language), in that it tends to omit words to make an utterance shorter, if the context is known. I think, that English also drops pronouns sometimes, however, not as much as Japanese. So, why in English do we tend to overuse pronouns?
Japanese is said to be a high context culture and English a Low context culture. That is...
High context culture: many things don’t need to be made explicit because of a close connection and understanding.
Low context: societies that need to explicitly spell out things because connections are not as close. (Culture at work: Communicating across cultures, http://www.culture-at-work.com/highlow.html)
Could this explain the need for us to continually check that the listener understands who the referent is? ...And why is necessary for English to paraphrase so often? My wife made a joke and asked, “Don’t people listen the first time?”
Another question that came up was why do some languages (like Romance languages, and even English in some cases) tend to use gender more than others? Why in English, we sometimes refer to a ship as a ‘She’? Why in Italian, Bianca (female) and Bianco (male)? How does culture influence language, and how does language influence culture?
Steven Mondy
Sapir-whorf
10th August, 2006
What are we to understand from the Sapir-Whorf debate on how a language affects culture, and in turn the individual? I find it quite an interesting discussion, as both sides to the debate give intriguing alternatives...
According to end of the lecture on ‘primitive languages’ (from linguistic voices on campus podcast) the linguist makes a point at the end that a weak version of the Sapir-Whorf hypothesis makes some sense in terms of sexist language (the so called generic ‘he’) as somewhat a warning to be careful of the language we use, as it may influence the way we think. Using ‘he’ or not using ‘he’ can determine how we think about something. When we choose to teach (or not) something in a particular way are we influencing the way our students think, by the language we use? Is Political Correctness a form of ‘linguistic determinism’? How about the movement against euphemisms, that some consider ‘bad language’? How about the elimination of racist terminology in songs (Eminem)? Can we shape society by shaping the language it uses? This taken to the extreme is the use of the so-called ‘Newspeak’ in George Orwell's classic novel Nineteen Eighty-Four, to shape society (Wikipedia -http://en.wikipedia.org/wiki/Sapir-Whorf_hypothesis).
Also the Sapir-Whorf hypothesis assumes that people are limited by the language they speak and they cannot think outside ‘the proverbial box’. In that case, how can anyone be creative?
Does language have an impact on the way we think?
What are we to understand from the Sapir-Whorf debate on how a language affects culture, and in turn the individual? I find it quite an interesting discussion, as both sides to the debate give intriguing alternatives...
According to end of the lecture on ‘primitive languages’ (from linguistic voices on campus podcast) the linguist makes a point at the end that a weak version of the Sapir-Whorf hypothesis makes some sense in terms of sexist language (the so called generic ‘he’) as somewhat a warning to be careful of the language we use, as it may influence the way we think. Using ‘he’ or not using ‘he’ can determine how we think about something. When we choose to teach (or not) something in a particular way are we influencing the way our students think, by the language we use? Is Political Correctness a form of ‘linguistic determinism’? How about the movement against euphemisms, that some consider ‘bad language’? How about the elimination of racist terminology in songs (Eminem)? Can we shape society by shaping the language it uses? This taken to the extreme is the use of the so-called ‘Newspeak’ in George Orwell's classic novel Nineteen Eighty-Four, to shape society (Wikipedia -http://en.wikipedia.org/wiki/Sapir-Whorf_hypothesis).
Also the Sapir-Whorf hypothesis assumes that people are limited by the language they speak and they cannot think outside ‘the proverbial box’. In that case, how can anyone be creative?
Does language have an impact on the way we think?
In what language do deaf people think?
10th August, 2006
In what language do deaf people think? 26 Dec-2003
(http://www.straightdope.com/columns/031226.html)
I have been thinking about this topic recently, as an extension to the ‘wild child’ idea. If a child is brought up in a situation devoid of language what do they think? The article puts forward the argument that deaf people think in signs, if they were lucky enough to learn sign language at an early age. However, what if they didn’t? Do these children develop their own way to interpret and react to the world? For this would support the innatist view? Or do these children not develop any form of device to react to the world? Possibly, their brains just don’t develop the necessary neurons, and they are forced to live in some kind of vegetative state. Having these two options, I would like to think that the human brain is predisposed to make sense of the world, in whatever way.... Steven Mondy
In what language do deaf people think? 26 Dec-2003
(http://www.straightdope.com/columns/031226.html)
I have been thinking about this topic recently, as an extension to the ‘wild child’ idea. If a child is brought up in a situation devoid of language what do they think? The article puts forward the argument that deaf people think in signs, if they were lucky enough to learn sign language at an early age. However, what if they didn’t? Do these children develop their own way to interpret and react to the world? For this would support the innatist view? Or do these children not develop any form of device to react to the world? Possibly, their brains just don’t develop the necessary neurons, and they are forced to live in some kind of vegetative state. Having these two options, I would like to think that the human brain is predisposed to make sense of the world, in whatever way.... Steven Mondy
Secret of the wild child
Secret of the wild child 10th August, 2006
I did some background reading on Genie, at "Secret of the Wild Child"
(http://www.pbs.org/wgbh/nova/transcripts/2112gchild.html)
And I have to say (as a parent of a five year old now) that I am quite appalled at what happened to the poor little girl, not only at her parents, but also by the people who were supposedly helping her. It is quite tragic. I wonder where the line can be drawn between science and humanity...
An interesting thing that occurred to me as I was reading the interview was, why they decided to teach her sign language? Was it that they thought that sign language would give her more opportunities to communicate, a different way to produce language? I am not really sure.
I also started thinking about the difference between input and output. Possibly, many of these scientists were judging her knowledge of language by how much she was ‘producing’...If so, I think that they are only getting half the picture. I often notice the difference between how much I can understand, as opposed to how much I can say in my L2. Poor little Genie may have only got to the stage of being able to produce one, two or three word sentences, but how much was she able to understand? ...And how can we measure the amount of progress in her listening capabilities? I guess, by sticking brain wave probes onto the poor little girl’s head. Science or Humanity? Seriously, I wonder in what ways can we as teachers judge our student’s receptive capabilities, without just making qualitative judgments?
Steven Mondy
I did some background reading on Genie, at "Secret of the Wild Child"
(http://www.pbs.org/wgbh/nova/transcripts/2112gchild.html)
And I have to say (as a parent of a five year old now) that I am quite appalled at what happened to the poor little girl, not only at her parents, but also by the people who were supposedly helping her. It is quite tragic. I wonder where the line can be drawn between science and humanity...
An interesting thing that occurred to me as I was reading the interview was, why they decided to teach her sign language? Was it that they thought that sign language would give her more opportunities to communicate, a different way to produce language? I am not really sure.
I also started thinking about the difference between input and output. Possibly, many of these scientists were judging her knowledge of language by how much she was ‘producing’...If so, I think that they are only getting half the picture. I often notice the difference between how much I can understand, as opposed to how much I can say in my L2. Poor little Genie may have only got to the stage of being able to produce one, two or three word sentences, but how much was she able to understand? ...And how can we measure the amount of progress in her listening capabilities? I guess, by sticking brain wave probes onto the poor little girl’s head. Science or Humanity? Seriously, I wonder in what ways can we as teachers judge our student’s receptive capabilities, without just making qualitative judgments?
Steven Mondy
The Critical Period
The critical period 2 6th August, 2006
I understand that the 'critical Period' hypothesis can be a little easy to hold as an all-encompassing reason for the difficulties that we face in the classroom. Yet, I still feel that we need to have it as a consideration. Especially after discovering an updated version of the ‘critical period hypothesis’
“DeKeyser argues that although it is true that there is a critical period, this does not mean that adults cannot learn a second language perfectly, at least on the syntactic level." (wikipedia,takenAug,6,3:30p.m,
http://en.wikipedia.org/wiki/Language_Acquisition_Device).
Also John. B. Carroll talks of ‘Language learning aptitude’, or the “prediction of how well, relative to other individuals, an individual can learn a foreign language in a given amount of time and under given conditions.” (Wikipedia, Language aptitude, http://en.wikipedia.org/wiki/Language_aptitude)
I think that with enough practice, the right motivation, and the right personality, it is quite possible to achieve a high level of competency. Yet, how many of our students can be said to fulfill all these qualifications? As you have said, most of us out there have various responsibilities that take away our time to study, or restrict us in some way.
I just wanted to point to the Critical Hypothesis as a thing to consider in making judgments about our future plans and actions. If it is possible, as Carrol, B., and Pimsleur, P., suggest, we need to gauge in some way, our student’s capacity to learn. Leading us back to the thing I was talking about earlier – Tests. Arghhh! However, there does need to be some thought given to how much are my students ready for what I’m about to present. Depending on the learner’s capacity to learn, we can therefore make judgments on how to proceed.
I understand that the 'critical Period' hypothesis can be a little easy to hold as an all-encompassing reason for the difficulties that we face in the classroom. Yet, I still feel that we need to have it as a consideration. Especially after discovering an updated version of the ‘critical period hypothesis’
“DeKeyser argues that although it is true that there is a critical period, this does not mean that adults cannot learn a second language perfectly, at least on the syntactic level." (wikipedia,takenAug,6,3:30p.m,
http://en.wikipedia.org/wiki/Language_Acquisition_Device).
Also John. B. Carroll talks of ‘Language learning aptitude’, or the “prediction of how well, relative to other individuals, an individual can learn a foreign language in a given amount of time and under given conditions.” (Wikipedia, Language aptitude, http://en.wikipedia.org/wiki/Language_aptitude)
I think that with enough practice, the right motivation, and the right personality, it is quite possible to achieve a high level of competency. Yet, how many of our students can be said to fulfill all these qualifications? As you have said, most of us out there have various responsibilities that take away our time to study, or restrict us in some way.
I just wanted to point to the Critical Hypothesis as a thing to consider in making judgments about our future plans and actions. If it is possible, as Carrol, B., and Pimsleur, P., suggest, we need to gauge in some way, our student’s capacity to learn. Leading us back to the thing I was talking about earlier – Tests. Arghhh! However, there does need to be some thought given to how much are my students ready for what I’m about to present. Depending on the learner’s capacity to learn, we can therefore make judgments on how to proceed.
individual words/signs are quite arbitrary
I found something quite interesting talking about ASL (American Sign Lang.) that would contribute quite well to an argument about how the individual words/signs are quite arbitrary. It talked of how individual ASL signs have meaning within a system of signs, not to individual pictures. So, I guess the sign for Tokyo doesn't relate directly to a picture of Tokyo.
This may be quite obvious, but how many of us realize that the lexical items we are using, be they spoken or signed, are only understood within the context of the system we are using them, understanding of language, through language. If we have more knowledge of the system, we are better able to understand the parts within a system. I guess it's a 'chicken and the egg' kind of realization I'm making here. However, suddenly it has dawned on me that the way I look at words sometimes, is like I expect that the words immediately create certain connections to pictures within student's minds. Yet as in the Fromkin book, students need to start making connection to other words they have already acquired. Beginners often need more input and understanding of the system that they are learning (time to make those connections). After immersion into the language, and getting comfortable (by making those lexical connections between words) they may be ready to understand. I’m probably going off on another tangent here. But, the arbitrariness of the sign language example set me off thinking about how words, along with grammar (signs and facial expressions) are a tools within a system, called language.
This may be quite obvious, but how many of us realize that the lexical items we are using, be they spoken or signed, are only understood within the context of the system we are using them, understanding of language, through language. If we have more knowledge of the system, we are better able to understand the parts within a system. I guess it's a 'chicken and the egg' kind of realization I'm making here. However, suddenly it has dawned on me that the way I look at words sometimes, is like I expect that the words immediately create certain connections to pictures within student's minds. Yet as in the Fromkin book, students need to start making connection to other words they have already acquired. Beginners often need more input and understanding of the system that they are learning (time to make those connections). After immersion into the language, and getting comfortable (by making those lexical connections between words) they may be ready to understand. I’m probably going off on another tangent here. But, the arbitrariness of the sign language example set me off thinking about how words, along with grammar (signs and facial expressions) are a tools within a system, called language.
“Beam me up Scotty.” The role of context
“Beam me up Scotty.”
According to the textbook(Fromkin et al), an inherent part of an expression's meaning, together with the context can determine its referent.
Without knowing the context of the Star Trek world, we cannot know for certain the true meaning of this phrase. Which of the following three points from the textbook does it fit into~
1. Some expressions have sense, but no reference
2. Others have reference, but no sense
3. Deitic terms have sense, but need context to determine reference.
It has reference. Does it make Sense? Well according to the above definition, no, as it doesn’t have the context. We don’t know what it means to ‘Beam someone up (unless you’re a trekkie!).
Given the 3 points above, we can probably say that a phrase can make complete sense, even though the referent is not known, or may be fiction. The truth of a sentence is determined only if the circumstances are known, not just if a sentence has sense.
What does this mean in real terms? Well, it may mean that I can come up with a logical, well formed argument that makes perfect sense, but could be totally false in the real world. Thus, we need to support our arguments with accurate real life (context dependant) information.
Also, a fanatical religious person can make sense in his/her preaching to us in terms of the paradigm they are working within, but when they go beyond that line of thinking, into someone else’s context, they may run into some difficulty.
Therefore, what makes sense to one person may be totally confusing, or completely wrong, to another.
What do you think?
Steve
According to the textbook(Fromkin et al), an inherent part of an expression's meaning, together with the context can determine its referent.
Without knowing the context of the Star Trek world, we cannot know for certain the true meaning of this phrase. Which of the following three points from the textbook does it fit into~
1. Some expressions have sense, but no reference
2. Others have reference, but no sense
3. Deitic terms have sense, but need context to determine reference.
It has reference. Does it make Sense? Well according to the above definition, no, as it doesn’t have the context. We don’t know what it means to ‘Beam someone up (unless you’re a trekkie!).
Given the 3 points above, we can probably say that a phrase can make complete sense, even though the referent is not known, or may be fiction. The truth of a sentence is determined only if the circumstances are known, not just if a sentence has sense.
What does this mean in real terms? Well, it may mean that I can come up with a logical, well formed argument that makes perfect sense, but could be totally false in the real world. Thus, we need to support our arguments with accurate real life (context dependant) information.
Also, a fanatical religious person can make sense in his/her preaching to us in terms of the paradigm they are working within, but when they go beyond that line of thinking, into someone else’s context, they may run into some difficulty.
Therefore, what makes sense to one person may be totally confusing, or completely wrong, to another.
What do you think?
Steve
Paul Grice and his Maxims
Thank you very much for your help. It does give me a direction to head towards.
Doing a search on the net, I have found many interesting pages that not only define both Pragmatics and Semantics, but also talk about the distinctions between them.
Many of the papers tend to point at 'Paul Grice' contributing very much toward Pragmatics, in particular. I haven't explored the material too well yet, but it seems that according to Grice, there is a social element within pragmatics. Along with this are his so called 'maxims'. (Check out Wikipedia for a definition)
With my Semantics research, there seems to be a lot on various relationships between words, such as synonyms, antonyms, and all the rest that are mentioned within our text.
On the net, and in many of the articles I've accumulated, the writers tend to deal with either Pragmatics/Semantics separately or as I said previously, how they differ.
I’m trying to see the relationship between them both and how they influence each other, but I’ve yet to come to any striking conclusions that add to what I have already said. I guess I need some time to let it all soak in a little.
Yet having said this, I do realize that there is quite a striking difference in perspective, when it comes to dealing with this topic. Firstly, that of how individual phrases and words are interpreted individually, and that of how our social situation affects those words or phrases. Also, I never realized how much context and meaning are so interrelated, yet so defined as particular fields (albeit fairly new according to some writers). I’m sorry if I sound a little confused today. I’m in the process of sorting out what I know from what I read.
Doing a search on the net, I have found many interesting pages that not only define both Pragmatics and Semantics, but also talk about the distinctions between them.
Many of the papers tend to point at 'Paul Grice' contributing very much toward Pragmatics, in particular. I haven't explored the material too well yet, but it seems that according to Grice, there is a social element within pragmatics. Along with this are his so called 'maxims'. (Check out Wikipedia for a definition)
With my Semantics research, there seems to be a lot on various relationships between words, such as synonyms, antonyms, and all the rest that are mentioned within our text.
On the net, and in many of the articles I've accumulated, the writers tend to deal with either Pragmatics/Semantics separately or as I said previously, how they differ.
I’m trying to see the relationship between them both and how they influence each other, but I’ve yet to come to any striking conclusions that add to what I have already said. I guess I need some time to let it all soak in a little.
Yet having said this, I do realize that there is quite a striking difference in perspective, when it comes to dealing with this topic. Firstly, that of how individual phrases and words are interpreted individually, and that of how our social situation affects those words or phrases. Also, I never realized how much context and meaning are so interrelated, yet so defined as particular fields (albeit fairly new according to some writers). I’m sorry if I sound a little confused today. I’m in the process of sorting out what I know from what I read.
Critical Period
I understand that the 'critical Period' hypothesis can be a little easy to hold as an all encompassing reason for the difficulties that we face in the classroom. Yet, I still feel that we need to have it as a consideration. Especially after discovering an updated version of the ‘critical period hypothesis’
“DeKeyser argues that although it is true that there is a critical period, this does not mean that adults cannot learn a second language perfectly, at least on the syntactic level." (wikipedia,takenAug,6,3:30p.m,http://en.wikipedia.org/wiki/Language_Acquisition_Device).
Also John. B. Carroll talks of ‘Language learning aptitude’, or the “prediction of how well, relative to other individuals, an individual can learn a foreign language in a given amount of time and under given conditions.” (Wikipedia, Language aptitude, [http://en.wikipedia.org/wiki/Language_aptitude
I think that with enough practice, the right motivation, and the right personality, it is quite possible to achieve a high level of competency. Yet, how many of our students can be said to fulfill all these qualifications? As you have said, most of us out there have various responsibilities that take away our time to study, or restrict us in some way.
I just wanted to point to the Critical Hypothesis as a thing to consider in making judgments about our future plans and actions. If it is possible, as Carrol, B., and Pimsleur, P., suggest, we need to gauge in some way, our student’s capacity to learn. Leading us back to the thing I was talking about earlier – Tests. Arghhh! However, there does need to be some thought given to how much are my students ready for what I’m about to present. Depending on the learner’s capacity to learn, we can therefore make judgments on how to proceed. Steven Mondy
“DeKeyser argues that although it is true that there is a critical period, this does not mean that adults cannot learn a second language perfectly, at least on the syntactic level." (wikipedia,takenAug,6,3:30p.m,http://en.wikipedia.org/wiki/Language_Acquisition_Device).
Also John. B. Carroll talks of ‘Language learning aptitude’, or the “prediction of how well, relative to other individuals, an individual can learn a foreign language in a given amount of time and under given conditions.” (Wikipedia, Language aptitude, [http://en.wikipedia.org/wiki/Language_aptitude
I think that with enough practice, the right motivation, and the right personality, it is quite possible to achieve a high level of competency. Yet, how many of our students can be said to fulfill all these qualifications? As you have said, most of us out there have various responsibilities that take away our time to study, or restrict us in some way.
I just wanted to point to the Critical Hypothesis as a thing to consider in making judgments about our future plans and actions. If it is possible, as Carrol, B., and Pimsleur, P., suggest, we need to gauge in some way, our student’s capacity to learn. Leading us back to the thing I was talking about earlier – Tests. Arghhh! However, there does need to be some thought given to how much are my students ready for what I’m about to present. Depending on the learner’s capacity to learn, we can therefore make judgments on how to proceed. Steven Mondy
Pragmatics and Semantics
I guess it would be useful at this stage to start thinking about the difference and interdependence between ‘Pragmatics and Semantics’. It appears to be quite an involved undertaking, as there are many facets to either. According to the text, we see that Semantics is concerned with the linguistic meaning of: 1.Lexical items – morphemes (and in turn words) and 2. Phrasal Elements – the meaning of phrases.
Pragmatics on the other hand is concerned with how the context affects meaning.
I understand from the readings that even though a sentence can be grammatically correct, well formed syntactically and have a perfectly understandable structure; it may not be true in certain contexts.
I could say, for instance that, “Yesterday was my wife’s birthday.” Semantically you would understand that yesterday there was a birthday, and it was my wife who was celebrating it. This is perfectly fine, but her actual birthday is in June, and not yesterday. In this context, the statement’s ‘Truth Conditions’ are false. However, if I were in a classroom demonstrating the simple past tense and using this declarative statement as an example of a set phrase, even though the truth conditions are still not true, it is still quite a valid statement to make, as the context has now changed. In this instance, we can see the relationship between ‘Pragmatics and Semantics’, if only in a basic way. Semantics needs context to establish the acceptability of a sentence within a certain environment. Grasping this relationship, it is quite possible to apply our understandings to a language learning environment. We can help students, by setting up meaningful contexts for the phrases they learning.
Context plays an extremely important role in avoiding ambiguity. Take for example the newspaper headline, “Teacher strikes idle kids” (Sanderson, P., (1999), Using Newspapers in the Classroom, Cambridge University Press). Anyone reading this headline (without being given the story that goes along with it) may be a little confused, as it can be perceived in two ways. Ambiguity is a great source of confusion, at least with many of my students. This can in turn lead to negative feelings toward the task at hand.
I believe that context also helps a student make use of existing deep lexical networks. Knowing the context of a unit that we are studying can help us anticipate what lexical items will unveil themselves. Just as in the textbook, knowing the word cat, we start thinking of mouse. Well if we know that today’s lesson is about food, we can use our existing knowledge and experiences to visualize food items and create a receptive framework for new words and phrases related to food. A textbook that does this well is the Tactics for Listening series, by Jack C. Richards. It sets up the context in the beginning of a unit, then slowly and progressively introduces phrases and vocabulary.
Pragmatics helps develop a framework for understanding and along with Semantics allows us to make sense of new and unfamiliar words and phrases. What do you think?
Steven Mondy
Pragmatics on the other hand is concerned with how the context affects meaning.
I understand from the readings that even though a sentence can be grammatically correct, well formed syntactically and have a perfectly understandable structure; it may not be true in certain contexts.
I could say, for instance that, “Yesterday was my wife’s birthday.” Semantically you would understand that yesterday there was a birthday, and it was my wife who was celebrating it. This is perfectly fine, but her actual birthday is in June, and not yesterday. In this context, the statement’s ‘Truth Conditions’ are false. However, if I were in a classroom demonstrating the simple past tense and using this declarative statement as an example of a set phrase, even though the truth conditions are still not true, it is still quite a valid statement to make, as the context has now changed. In this instance, we can see the relationship between ‘Pragmatics and Semantics’, if only in a basic way. Semantics needs context to establish the acceptability of a sentence within a certain environment. Grasping this relationship, it is quite possible to apply our understandings to a language learning environment. We can help students, by setting up meaningful contexts for the phrases they learning.
Context plays an extremely important role in avoiding ambiguity. Take for example the newspaper headline, “Teacher strikes idle kids” (Sanderson, P., (1999), Using Newspapers in the Classroom, Cambridge University Press). Anyone reading this headline (without being given the story that goes along with it) may be a little confused, as it can be perceived in two ways. Ambiguity is a great source of confusion, at least with many of my students. This can in turn lead to negative feelings toward the task at hand.
I believe that context also helps a student make use of existing deep lexical networks. Knowing the context of a unit that we are studying can help us anticipate what lexical items will unveil themselves. Just as in the textbook, knowing the word cat, we start thinking of mouse. Well if we know that today’s lesson is about food, we can use our existing knowledge and experiences to visualize food items and create a receptive framework for new words and phrases related to food. A textbook that does this well is the Tactics for Listening series, by Jack C. Richards. It sets up the context in the beginning of a unit, then slowly and progressively introduces phrases and vocabulary.
Pragmatics helps develop a framework for understanding and along with Semantics allows us to make sense of new and unfamiliar words and phrases. What do you think?
Steven Mondy
The capacity and perserverance to learn
I really do believe that we have the capacity to learn any form of communication, as long as it’s within the limits of our physical and mental capabilities. This may include such things as age, motivation and genetic programming. We still don’t have the ability to use mental telepathy (well some of us, anyway?!), but maybe with the evolution of the species, we may develop that capacity. One of my fellow students at USQ makes quite a persuasive point, in that we may not have even developed our existing abilities (to react to pheromones) yet. Who knows…we have yet to discover many things.
The interesting thing for us teachers is that if we have this capacity (at least at some time), how long will it remain with us? As we have come to understand, there is somewhat a time limit to effectively and comprehensively pick up a language (at least for L1). “The critical period.” This is quite a concern for teachers, as it will undoubtedly make it really difficult for adult learners to acquire a second language. I think that these learners are faced with a hidden barrier to language acquisition, which may discourage them from persisting with the process of learning a second language. As another fellow student stated, many learners don't feel it necessary to attend classes more than only a few times a week. Could part of the problem be that the capacity for learning a second language has diminished in our adult learners (depending upon how much they have gone past the ‘critical period’). A language may seem quite exciting in the beginning, but then the novelty starts fading as reality starts kicking in. Maybe that is one of the reasons that pattern recognition systems are so successful with adult learners. They give people a way to balance the scales back in their favor. What do you think? Steven Mondy
The interesting thing for us teachers is that if we have this capacity (at least at some time), how long will it remain with us? As we have come to understand, there is somewhat a time limit to effectively and comprehensively pick up a language (at least for L1). “The critical period.” This is quite a concern for teachers, as it will undoubtedly make it really difficult for adult learners to acquire a second language. I think that these learners are faced with a hidden barrier to language acquisition, which may discourage them from persisting with the process of learning a second language. As another fellow student stated, many learners don't feel it necessary to attend classes more than only a few times a week. Could part of the problem be that the capacity for learning a second language has diminished in our adult learners (depending upon how much they have gone past the ‘critical period’). A language may seem quite exciting in the beginning, but then the novelty starts fading as reality starts kicking in. Maybe that is one of the reasons that pattern recognition systems are so successful with adult learners. They give people a way to balance the scales back in their favor. What do you think? Steven Mondy
Thursday, March 29, 2007
a late news flash on Fossilization...'Stabilization'
I have to agree with Brown (2007, p.261) that 'Fossilization' is a normal natural stage, and should not be viewed as a terminal illness. He suggests another term of 'stabilization', which is a much more positive term, as it allows room for balance and adjustment.
I believe, that L2 learners enter and exit many different kinds of situations throughout their interlanguage phase, and each new situation makes it possible for the learner to re-adjust. Of course the learner can choose not to change, or feel they can't change, but I essentially believe that it is possible. So the term I will glom onto is 'stabilization'. Steven Mondy
I believe, that L2 learners enter and exit many different kinds of situations throughout their interlanguage phase, and each new situation makes it possible for the learner to re-adjust. Of course the learner can choose not to change, or feel they can't change, but I essentially believe that it is possible. So the term I will glom onto is 'stabilization'. Steven Mondy
Sunday, March 25, 2007
Learning from others...
One of my classmates said: "This eloquent man, has learnt to speak Thai from the innapropriate gender and class for the world he circulates in and is quite aware that he speaks like a bar- girl.The Thais being terribly polite excuse him and even think it is quite cute/funny and because of the warmth he gets he has never learned to correct his speech, or seen the need to, his fossilization is actually now a part of his character and if he came out with polite Thai he may find people didn't find him as funny or cute."
The same can be said for all those learning Osaka-ben in Japan. Or a husband (in Jpn) learning his wife's language patterns, and then using them in another social setting, only to find out that he is speaking in a female tone. A foreigner speaking in Osaka-ben will almost always get laughs, which encourage more use of Osaka-ben. And Japanese would be too polite to say to anyone, that your speech sounds 'girlish'.
Even knowing the problem, it is quite difficult to change. Once you have developed a feeling for something, un-learning becomes difficult, if not impossible in some cases. There really has to be some extremely persuasive external motivating forces to make someone even contemplate change. Steven Mondy
The same can be said for all those learning Osaka-ben in Japan. Or a husband (in Jpn) learning his wife's language patterns, and then using them in another social setting, only to find out that he is speaking in a female tone. A foreigner speaking in Osaka-ben will almost always get laughs, which encourage more use of Osaka-ben. And Japanese would be too polite to say to anyone, that your speech sounds 'girlish'.
Even knowing the problem, it is quite difficult to change. Once you have developed a feeling for something, un-learning becomes difficult, if not impossible in some cases. There really has to be some extremely persuasive external motivating forces to make someone even contemplate change. Steven Mondy
Thursday, March 22, 2007
...when you are isolated from a community...
My mum has lived in Australia for just under 60 years (left Malta when she was 14) and she speaks the Maltese of when she was in Malta. She has always spoken to all her brothers in Maltese in Australia, and until recently has had no real contact with the country she was born in. So when she now watches the Maltese news on SBS, she scratches her head wondering what some of the words mean... I guess it is evidence for how language evolves... and when you are isolated from the community, you go on speaking in the same way, while the community that you came from starts changing the way it uses language. Is this a behaviorist-type observation?????
Moving off on a tangent, however, the most amazing thing with her English is that she speaks with native-like fluency (little if no accent), and it's difficult to distinguish the mistakes she makes, from those expected of native-E speaker mistakes. Yet, when she has to write something, that's when you can see all the non-native errors. I quite enjoy seeing my mother's letters (though quite rare, as she readily avoids writing). They remind me of her cultural background. Steven Mondy (By the way, my mothers maiden name - "Muscat", a very Maltese name)
Moving off on a tangent, however, the most amazing thing with her English is that she speaks with native-like fluency (little if no accent), and it's difficult to distinguish the mistakes she makes, from those expected of native-E speaker mistakes. Yet, when she has to write something, that's when you can see all the non-native errors. I quite enjoy seeing my mother's letters (though quite rare, as she readily avoids writing). They remind me of her cultural background. Steven Mondy (By the way, my mothers maiden name - "Muscat", a very Maltese name)
Thursday, March 15, 2007
Accent
Accent is something that seems to worry many of our Japanese students, and frankly I have to ask why? Accents are beautiful, and reflective of deep cultural roots. Why on earth would you want everyone in the world speaking with the same accent? Where's the diversity, and the creativity that comes with that amount of variety in the world. Accents are beautiful, and it's a shame when they are lost...
Actually, does anyone know where I left mine?
Having been in Japan for a fairly long time, I have unwittingly adopted some strange kind of accent... I want my Australian accent back! Does anyone know where I left my accent?Steven Mondy
(sorry for the tongue in cheek tone...)
Ciao
Steven
Actually, does anyone know where I left mine?
Having been in Japan for a fairly long time, I have unwittingly adopted some strange kind of accent... I want my Australian accent back! Does anyone know where I left my accent?Steven Mondy
(sorry for the tongue in cheek tone...)
Ciao
Steven
Tuesday, March 6, 2007
fossilization 1
I always felt that fossilization was only a literacy thing, however, as a long term resident in a foreign country I can see it in my own second language performance in speaking (and even listening, if that’s at all possible?!). I tend to rely a lot on standard set phrases or words that can be used in a multitude of situations. The more I rely on them, the harder it is to be creative in my language use.
We have a student here at the college whose fossilization is so strong, that he has begun making excuses for his inability. “English is so difficult.” “I didn’t learn it when I was young.” “I’m too old, too busy” etc… I guess that denial is part of what ingrains particular routines.
A person may even be totally aware that they are making the mistakes, but when it comes down to the crunch, they make the mistakes anyway, ‘cause it feels more comfortable…or they make the mistake and regret it afterwards, but when the time comes to use that language again, will make the same mistake over and over. I see myself doing this…
Yes, it is useful, to have set phrases to take out when the situation arises. That’s what a lot of audio lingual approaches focus upon. However, we do become over-reliant on these phrases, almost to the point where we ignore the situational context. Or we expect others to interpret or make sense of our babble, which often happens in a sympathetic environment, such as a SL situation. However, how many of you long term residents of a foreign country have discovered that the sympathy turns to impatience, when you continue to rely on the set number of formulaic expressions. And when the personal realization takes place, it becomes difficult to change, ‘cause the expressions have become fossilized.
Cheers,
Steven Mondy
We have a student here at the college whose fossilization is so strong, that he has begun making excuses for his inability. “English is so difficult.” “I didn’t learn it when I was young.” “I’m too old, too busy” etc… I guess that denial is part of what ingrains particular routines.
A person may even be totally aware that they are making the mistakes, but when it comes down to the crunch, they make the mistakes anyway, ‘cause it feels more comfortable…or they make the mistake and regret it afterwards, but when the time comes to use that language again, will make the same mistake over and over. I see myself doing this…
Yes, it is useful, to have set phrases to take out when the situation arises. That’s what a lot of audio lingual approaches focus upon. However, we do become over-reliant on these phrases, almost to the point where we ignore the situational context. Or we expect others to interpret or make sense of our babble, which often happens in a sympathetic environment, such as a SL situation. However, how many of you long term residents of a foreign country have discovered that the sympathy turns to impatience, when you continue to rely on the set number of formulaic expressions. And when the personal realization takes place, it becomes difficult to change, ‘cause the expressions have become fossilized.
Cheers,
Steven Mondy
Subscribe to:
Posts (Atom)