Look at these quizzes and talk about the different aspects studied in the class. Pay attention to every detail and post in this forum (even your own quiz). Test design, validity, test purpose, criterion, method, constraints, social aspects, reliability, measurement, etc.
Start like this "Quiz 1: the design is appropriate for a level of... because... In terms of validity..."
I know it is a lot of work, so I am waving the essay.
Subscribe to:
Post Comments (Atom)
Quiz 1: The design of the quiz is good starts from the easiest tasks and ends with the most complex ones, and the instructions are very well established. One element that it is missing is the percentages of each part of the quiz. I think that the purpose of the quiz is assessing vocabulary and the students’ writing ability in simple sentences. Also, I think that the quiz is appropriated for the students’ capacities and level. As a result, I think that the quiz is fair for the students and I think that they will accept the quiz because it is based on the contents that were taught in the classes.
ReplyDeleteQuiz 2: I think that the quiz is too short; it is not a ten item quiz. How can we score the quiz? What tools or criteria can we use for measuring the students’ ability or performance in the writing task? I think that for scoring the quiz the teacher will need a check list or a rubric, which complicates more the checking process. Also, I think that the quiz is to complex for the students’ level. I think that the quiz is not going to be accepted for students because they might feel the quiz too hard for them. It will be very difficult for the students of an elementary level write a paragraph including all of quiz’s words. I think that writing sentences will be more suitable for them.
Fátima Crespín.
Quiz 3: I think that the quiz is well designed, the task are according to students’ level. Also, the quiz’s method is very clear. For me students will not have any problem in following the quiz’s instructions. Another good point of the quiz is that includes the percentages of each of the quiz’s parts which it is important for the teacher when, measuring the quiz, and important for the students, when working on the quiz because in that way the students can know which of the part is more valuable. The purpose of the quiz is based on vocabulary and writing, and the quiz’s tasks are oriented to measure the students’ abilities in those areas. For me the quiz is faired because it comes from the contents that the students had studied in classes. Finally, I think that the students will feel comfortable with the quiz.
ReplyDeleteQuiz 4: For me the quiz it’s more likes a work guide because of the following reasons. First, the students have to look for some information on the web. Second, they have to study the some vocabulary. Third, one grammar point and some exercises are presented. Forth, the students have to complete one exercise about possessives adjective. Fifth, the students are asked to write definitions about the different kinds of adjectives, and the final purple square is not even clear for me. I don’t know that the teacher expects his students to do in that task. I think that the quiz method is not good. Also, I think that solving the quiz will take a long time. For me some parts of the quiz are too complex for the students’ level as result the quiz will not be acceptable for them.
Fátima Crespín.
Quiz 5: I think that the design of the quiz good because it goes from the easiest tasks to the most complex ones. Also, the instructions are very well established. I think that the purpose of the quiz is assessing vocabulary and the students’ writing ability in simple sentences. Another good point of the quiz is that includes the percentages of each of the quiz’s parts, which it is important for the teacher when, measuring the quiz, and important for the students, when working on the quiz because in that way the students can know which of the part is more valuable. For me the quiz is faired because it comes from the contents that the students had studied in classes. Finally, I think that the students will feel comfortable and confidents with the quiz and its results.
ReplyDeleteQuiz 6: I think that the quiz’s design is poor some elements such as images are missing. I think that images are very important for elementary level students because at that age most of them use their visual intelligence. Also, there are not percentages in the quiz parts. For me the second part of the quiz is too complex for the students because of their level. I think the purpose of the quiz is just to evaluate grammar which is good, but it is necessary to think if the students will be able to handle those types of task and if they might feel uncomfortable when working on the quiz.
Quiz 7: For the quiz’s design is good. The quiz’s tasks are cording the students’ capacities and level. The instructions are very well established. I think that the purpose of the quiz is assessing grammar and the writing ability in a control exercises. I think that just some things are missing like the percentages in each of the parts.
Fátima Crespín.
Thank you Fátima... you are the first!
ReplyDeleteI think that the tests dising are not all in the same level. That is why we analyse them in order to identify for which level the test are been desingned.
ReplyDeleteQuiz 1: The design is very simple and easy, it is focused only in vocabulary and basic writing. The quiz does not have percentages but I understand that each item means one point.
Quiz 2: This is a writing test, the students ere provided of words that they have to use to write a paragraph. The box contains nouns and adjectives that students have to use to build sentences. The test is focused not on what is written but on which items in the box are used.
Quiz 3: The quiz is well designed, the percentages given to each part is fair. One aspect to consider is that the test does not have an example which models what student have to do in each part.
Quiz 4: The quiz is very long, the percentages in each part are not specified and some instructions are missing. The quiz is assessing vocabulary , grammar, reading and writing. In the last part, what students have to do is to complete the definitions of the different kinds of adjectives which are in the purple box.
Quiz 5: The quiz has it purpose well especified on vocabulary and writing, it is easy to understand for the students, the instructions are clear and easy to measure for the teacher.
Quiz 6: The purpose of the test is not specified. The first, second and third part of the quiz does not have an example modeling to follow and it would be better to include pictures as reference to the questions in the first part.
Quiz 7: This test is focused in grammar, the instructions are easy to understand, the test does not have the percentages specified, but it is understood that each part has the 50%. This test is easy to measure.
Raquel.
Quiz 1: the design is appropriate for a level of first grade because it is testing colors and description of things using colors. In terms of test design it is simple but understandable. In terms of test purpose it matches with lesson plan provided to design the test. In terms of test method students can get confused with items 1-5 because of the kind of images shown. Crayons appear black and white in a copy the same like the book and the blouse. The tomatoes and oranges are not clear images so that they can easily get confused with other veggies and fruits. In terms of test constraints, it is simple but includes what is needed to reach a goal. In terms of social aspect; students easily can confuse color according to what they see in their environment. The accountability can sometimes affect the score because as I can see there are thirteen possible answers.
ReplyDeleteQuiz 2: the design is appropriate for a level of third or fourth grade. In terms of validity it is not clear because it is supposed to measure the use of colors but at the end of the day students can end up writing whatever they want just using some of the words and forgetting to use colors and the words el, la, los, las, es, son, etc. In terms of criterion the test does not follow the ten items design. In terms of test method it is poor. In general terms it needs to be revised because it does not look like a test.
Quiz 3: the test design is appropriate for a level of second grade. In terms of validity it measures what it has to measure however the indications for part II and III should list “the articles” and “possessive adjectives” instead of just mentioning them. In terms of test purpose it pretends to reach the goals specified in the lesson plan. In terms of test criterion it has more than ten questions. In terms of test method students can easily solve it. In terms of the constraints it doesn’t deviate from the topics given. In terms of social aspect it can have an impact on the student because the items deal with everyday things. In terms of reliability and measurement for sure it will show consistent results.
Julio Beltran.
Quiz 4: the test design is appropriate for a level of 4th or 5th grade. In terms of validity it includes things beyond the asked ones. The items in general seem a little confusing especially the ones referred to demonstrative adjectives. In my opinion it shows ambiguity. In terms of test purpose as I said; it measures things that were not asked like definitions of concepts and other kind of adjectives. It does not follow test criterion, too many questions. In terms of test method it seems to work, however, part A and B should not be included. It is just extra information. The constraints were not followed because some items just don’t fit in the test, etc. the social aspect of the test, many students can fail it. Access to internet is a disadvantage to some students. In my opinion the reliability of the test won’t be clear. So it needs to leave out some things and stay with the one that deal with guidelines provided.
ReplyDeleteQuiz 5: the test design is appropriate for a level of 2nd grade. In terms of validity I think the items are valid even though they are in English because the information was in Spanish. It was a little tricky, even for my test. The test purpose it’s o.k. it includes the same topics given to design the exam. In terms of test method student would not have problems solving it. In terms of criterion, it has exactly ten questions or difficulties and it includes the topics required. In terms of test constrains, it fails because it was supposed to be made in Spanish. In terms of social aspect the test is open to any answer if the students don’t try to describe the items and the indication says. In terms of reliability the test meets that aspect. In terms of measurement the item facility seems to be high for the level a chose.
Quiz 6 A: the test design is appropriate for a high school level. I think so. In terms of validity it is in English and it is not evaluation what is supposed to evaluate. In terms of test purpose the test is very confusing and being honest, it shows little relationship with the lesson plan given. In terms of test method, it is really hard to understand especially part II and III. The students would have a hard time trying to answer it. In terms of the criterion it just has 9 difficulties. The yes/no questions have no relation with the questions proposed in the lesson plan. In terms of constraints we have too much questions which have to do with grammar and structure something that is very difficult even for an intermediate students. In terms of reliability the results would not reach the necessary goals to be valid. In terms of measurement; the accountability the item facility is really hard.
Quiz 6 B: the test design is appropriate for a level of 7th or 8th grade. In terms of validity it measures just some of the topics provided in the lesson plan. The colors are missing and the test is written in English, so it deletes the objective to reach a necessary validity. In terms of test purpose it includes the similar structures provided to make the test. In terms of test method, it works. In terms of the criterion, it should include items where the students write a little bit more. In terms of the criterion the ten difficulties are o.k. and they have relationship with the communicative skill. In terms of constrains the colors and the writing aspect should be improved. In term of reliability, we can have good expectations by applying the test. In terms of measurement the item facility seems to be kind of easy.
Quiz, 4,5,6a and 6b are mine.
ReplyDeleteJulio Beltran
about the first quiz I consider this for first and second grades. because is just write short words and write sentences with the same words in the quiz. the images are apropiate for the level. smth i got confused was in crayons because there are 4 and how the teacher will evaluate or give the percentages. if there 5 items and in the second are 5 as well. also about image 3(oranges) 5 (tomatoes) will be difficult to understand in a photo copy because the paper and pen quizzes aren't in color special more than 35 copies aren't clear for students.
ReplyDeletesilvia
Quiz 1. I think that the test designed is appropriate for a basic level. It was designed for the writing skill. It is lack of face validity because it missed the percentage in each part, and in the first instruction it missed an article. This quiz has to be printed in a page with colors because students are studying that. It is a paper and pencil language test and it has ten items. Another thing that is important in a quiz is to have examples in each part and this quiz has examples. The quiz 1 has content validity because it is evaluated what students have studied before. And it is clear that the purpose of the quiz is to evaluate colors and articles so it means that the test construct is appropriate.
ReplyDeleteQuiz 2. This quiz is weird because it is supposed that is for an elementary level but it does not seem like that. When you ask to a student to write a paragraph, the student is not in a basic level. The purpose of the quiz is not clear because according to the instruction says that the students have to write a paragraph about what??? Just using the words from the box?? For basic is not appropriate, it would be better if the students write sentences not paragraph in that level. It is not clear how it is going to be assessed so it does not have face validity either content validity. It is not a ten item quiz.
Ana Maria.
Quiz 3. I think that this quiz is for an elementary level. The first part of the quiz is confusing because students have to color the pictures so they do not have to identify any color how teacher will evaluate if the students know the colors. The quiz is lack of face validity because there is not any example for each part. However the instructions and percentage are clear and the quiz is divided in three different parts. Test content is ok because it is evaluating what the students have studied. The purpose is to assess writing skill in a basic level. Something that we have to consider as teacher is that if students have studied all the vocabulary in the quiz, it makes the quiz understandable.
ReplyDeleteQuiz 4. The quiz is not a paper pencil test there is a link it has to be worked in a computer. It is lack of face validity there is not any percentage the instructions are not clear, there are not any examples and in a quiz does not have to have a grammar box for explanation because it is not a worksheet. The quiz is for a basic level but the vocabulary that is using it is not appropriate at all, so the quiz is lack of content validity too. It is not a writing quiz because there are some items that are not for a writing skill, it is a fixed response format. And the last part I did not get it what the teacher wanted the students to do.
Ana Maria
Quiz 5. The quiz is not a ten item quiz, there is only eight. It is ok if the quiz has examples but they do not have to be part of the activity. It is a paper pencil test. The instructions are not really clear because it says that students have to describe the pictures but according to the example it is only to write the color for each picture. So the instructions should be changed. It makes the quiz to be lack of validity and reliability. The quiz has a test designed according to the level that is elementary.
ReplyDeleteQuiz 6. The quiz is difficult to understand what it is going to be assessed. It is lack of test construct, test designed, face and content validity and reliability. The instructions are not clear, the quiz is not a writing sample quiz, and there is not any percentage. However it is a paper pencil test.
Quiz 7. The quiz is for an elementary level, so it has test designed. I am not sure if he quiz is evaluating the writing skill because the students only have to choose the correct word and write it. In my opinion it is evaluating grammar. The quiz does not have any percentage, the items are the same just write the correct word. It means that the quiz is lack of face validity, and content. It is a paper pencil test.
Ana Maria
Quiz 1: In my opinion, this quiz has content validity and purpose because it is testing the knowledge that students may have in this level according to the contents they have studied. It is testing vocabulary. Also it is well designed, it has 10 items, and it goes from the easiest part which is only writing the color and then it goes to the most difficult part, which is making a sentence using the previous vocabulary. The use of the colors is really god, but on terms of constraints this quiz would be difficult to print because of the colors. Maybe the institution would not accept to print it. And, it does not have the percentages on it, but it is ok.
ReplyDeleteQuiz 2: The design of the quiz is not appropriate for the level, because it is too complex. In this level students are not able to create a paragraph. In terms of test content, it has a specific content but it does not have 10 items. It does not have examples for the students to follow. This quiz lacks of content validity because it would be difficult for the students in this level to show the relevant knowledge they may have. It is not a good quiz to give to students; it is not only difficult for the students, but also for the teacher to score.
Quiz 3: For me this quiz is somehow appropriate for the level, it uses pictures in some of the parts, but some instructions are not clear or are not complete. For example on part I, there’s no a clear instruction when it says “con su color correspondiente” Where are the students going to see which colors belong to the different items? How are they going to describe the items if they do not have an example? In the second part it would be good if the articles were in a box, and so the students just choose them to place them when correcting the mistakes. So, I think that it lacks of face validity. In terms of test design it is good, it has the percentages, however it has 15 items, and think that for the elementary level it is too long. In terms of test content it is ok because it is evaluating vocabulary that has been studied in the class.
Quiz 4: I think that this quiz is really confusing. Some things can be good but many others can’t. This is not a paper and pencil quiz, it is a computer test. So, that is a disadvantage because some students do not have the facility to have a computer and Internet. Also it lacks of face validity and content validity, it has too much information which is not appropriate for the level that it is supposed it was made. It has too many items, and maybe most of the students will get confused and would fail.
Magdalena
Quiz 5: In my opinion, this test is well designed, it has only 8 items, and it is appropriate for the level, but the examples do not have to be included in the exercise. In both exercises the instructions are almost the same, and I think that it lacks of content validity.
ReplyDeleteQuiz 6: This quiz is not appropriate for the level. It is kind of difficult; students in the elementary level are not able to answer those types of questions. They just identify some vocabulary. It lacks of test designed, content validity, and face validity. For me it is not a test for elementary level. The instructions are not clear and there are no examples for students to follow and there’s no a percentage in the different parts.
Quiz 7: I think that in this test is well designed, it has the ten items required and the instructions are clear, it is appropriate for the level. It has content validity, and I think that the purpose is to evaluate grammar structure. It was suppose that the quiz would be in Spanish. The percentage is not established.
Magdalena
about the second. as the teacher is asking for writing a short paragraph, in my opnion this is not appropiate for minor levels like 3th, 4th or 5 grades. they will not have like a pattern to follow and they will easily got confused or write non-sense ideas. even some 7,8,9 grades will not write smth, the same as minor they will write sentences. write a paragraph even short and with simple vocabulary will not be easy. it will not have coherence or cohesion. students will write sentences rather a paragraph, the teacher will not achieve his/her goal, because students will not how to write a short paragraph for so simple it be.
ReplyDeletequiz3. this quiz make me think that students can color the objects any color they want, because the teacher didn't establish a specific color so how the teacher will evaluate that? because students probably will have different answers rather a common answer.
quiz4. why a link? if the rest of the quiz is designed as a pen and paper. even there is not clear instructions about what the teacher want and will evaluate. so what students will do with the link in a paper and pen, what about part b it is realated with part a or part c?.
there are not clear instructions and how sts will be evaluated. this quiz is lack of instructions, goal, objective. this quiz seems as a class work sheet even there are a lot of information for being a simple quiz.
silvia