<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving DTD v1.0 20120330//EN" "JATS-journalarchiving.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:ali="http://www.niso.org/schemas/ali/1.0">
  <front>
    <article-meta>
      <title-group>
        <article-title>The power of constructive criticism and its effect on students' learning motivation</article-title>
      </title-group>
      <contrib-group content-type="author">
        <contrib id="person-bc8b401e329f3564c0039560a4e724d9" contrib-type="person" equal-contrib="no" corresp="no" deceased="no">
          <name>
            <surname>Wulandari</surname>
            <given-names>Anggi Putri Suri</given-names>
          </name>
          <email>anggiputrisw@gmail.com</email>
          <xref ref-type="aff" rid="aff-1" />
        </contrib>
        <contrib id="person-12d74c4f81722f6eeb3b2b5542d54450" contrib-type="person" equal-contrib="no" corresp="no" deceased="no">
          <name>
            <surname>Anugerahwati</surname>
            <given-names>Mirjam</given-names>
          </name>
          <email>mirjam.anugerahwati.fs@um.ac.id</email>
          <xref ref-type="aff" rid="aff-2" />
        </contrib>
      </contrib-group>
      <aff id="aff-1">
        <country>Indonesia</country>
      </aff>
      <aff id="aff-2">
        <country>Indonesia</country>
      </aff>
      <history>
        <date date-type="received" iso-8601-date="2021-05-25">
          <day>25</day>
          <month>05</month>
          <year>2021</year>
        </date>
      </history>
      <abstract>
        <p id="paragraph-43101e4c42c89c3ad9d76d2a623fb28f">A plethora of studies have reported positive results on the use of constructive criticism across different academic contexts and levels. However it has remained little understood whether EFL students in Indonesian context respond the use of constructive criticism in the classroom positively. The present study sought to understand EFL students’ perception on the use of oral constructive criticism given by faculty members in the classroom and whether it has any effect on the students’ motivation in learning English. The participants of the study were 86 EFL students from 5 outstanding universities in Malang, East Java, Indonesia. The data were collected through a questionnaire and an interview. The results of the study revealed that the 86 EFL students had positive perceptions on the use of oral constructive criticism. The students were helped in some ways in learning English by means of receiving oral constructive criticism from their faculty members. The students considered oral constructive criticism a confirmation whether they did the right things in the learning process. More prominently, the result showed that the use of oral constructive criticism played a big role in boosting the students’ motivation in learning English. The students did not feel constructive criticism as a thread that inhibited them from being the best version of themselves in learning English. Instead, the students were strongly motivated to study hard and get good scores because of oral constructive criticism that they received during the teaching and learning process.</p>
        <p id="paragraph-d40ac4cd72ea7ddac741002f7e6005ef">
          <bold id="bold-c0bb7652bb997e30b0101bf958d2086c">Keywords: </bold>
          <bold id="bold-50f647fc814983e6df10f100883a9952">constructive criticism, language learning motivation, perception</bold>
        </p>
      </abstract>
    </article-meta>
  </front>
  <body id="body">
    <sec id="sec-3">
      <title>
        <bold id="bold-f0b530383adbd8ab3aad88304cc08d6a">INTRODUCTION</bold>
      </title>
      <p id="_paragraph-18">In the learning process of English as a foreign language, students often have their own difficulties. <ext-link id="_external-link-1" ext-link-type="uri" xlink:href="">Suryanto</ext-link><ext-link id="_external-link-2" ext-link-type="uri" xlink:href=""> &amp; Sari (2020)</ext-link> revealed that the difficulties students encountered were grouped into five categories, namely: vocabulary, grammar, pronunciation, listening, and speaking. As the difficulties that the students faced were complex and varied, it is undeniable that EFL students in Indonesian context make mistakes in their learning progress. The most common mistakes that the students make are among other things: mastering very limited vocabularies, unsuccessfully comprehending grammatical rules, having poor pronunciation, lack of understanding in catching the speed of words in listening English utterances, and having problems in conveying meaning spontaneously. When the mistakes continuously happen during the teaching and learning process, it leads faculty members to criticized students’ performance. Generally, by giving criticisms for the students’ poor performance, some faculty members expect their students to understand their mistake and fix it immediately.</p>
      <p id="_paragraph-19">However, there are times when some students find that they are only treated as the blame when they receive criticism from their faculty members. This situation does happen only if faculty members criticize students’ performance without providing suggestion for the betterment of the students learning progress. Consequently, the students interpret the criticism as an indication of their failure in learning English (<ext-link id="_external-link-3" ext-link-type="uri" xlink:href="">Fong et al., 2018</ext-link>).</p>
      <p id="_paragraph-20">Previous studies have contributed to our understanding on the use of criticism in educational settings. Studies conducted by <ext-link id="_external-link-4" ext-link-type="uri" xlink:href="">Leece</ext-link><ext-link id="_external-link-5" ext-link-type="uri" xlink:href=""> et al., (2011)</ext-link> and <ext-link id="_external-link-6" ext-link-type="uri" xlink:href="">Mizokawa</ext-link><ext-link id="_external-link-7" ext-link-type="uri" xlink:href=""> &amp; </ext-link><ext-link id="_external-link-8" ext-link-type="uri" xlink:href="">Leece</ext-link><ext-link id="_external-link-9" ext-link-type="uri" xlink:href=""> (2017)</ext-link> demonstrated that the deeper understanding of teacher criticism the children had, the better academic achievement they would obtain in their later years. However, both of the studies seem to focus on general criticism employed by teachers in the teaching and learning process. In addition, the subjects of the studies were Italian and Japanese preschoolers and school-aged children. Another study conducted by <ext-link id="_external-link-10" ext-link-type="uri" xlink:href="">Hyland &amp; Hyland (2001)</ext-link>, revealed that the use of hedges in criticism could only lead to confusion and indirectness. But, the criticism that they analyzed was a general criticism and it was in the form of written feedback. Moreover, a study proposed by <ext-link id="_external-link-11" ext-link-type="uri" xlink:href="">Fong et al., (2016)</ext-link> mainly focused on finding out students’ perception and emotional reaction on constructive criticism. Additionally, the subjects of the study were educational psychology students. <ext-link id="_external-link-12" ext-link-type="uri" xlink:href="">Nguyen (2013)</ext-link> also proved that exploiting full instruction on the use of constructive criticism could improve EFL students’ ability in using varied modal auxiliary, hedges, downtowners, and understates to give constructive criticism for their peers.</p>
      <p id="_paragraph-21">It is obvious that all of the reviewed studies above have reported positive responses on the use of constructive criticism across different academic contexts and levels, however it has remained little understood whether EFL students in Indonesian context respond the use of oral constructive criticism in the classroom positively. Different from the reviewed studies above, which focused on finding out the correlation between students’ sensitivity to teacher criticism and Theory of Motivation (Leece et al., 2011), improving students’ ability to give constructive criticism (<ext-link id="_external-link-13" ext-link-type="uri" xlink:href="">Nguyen, 2013</ext-link>), and knowing students’ perception and emotional reaction on the use of constructive criticism in several different field of studies and age (<ext-link id="_external-link-14" ext-link-type="uri" xlink:href="">Fong et al., 2016</ext-link>), the current study focused on knowing undergraduate EFL students’ perception on the use of oral constructive criticism employed by faculty members and whether it gives any effect on the students’ motivation in learning English.</p>
      <p id="_paragraph-22"><ext-link id="_external-link-15" ext-link-type="uri" xlink:href="">Fong et al., (2018)</ext-link> introduced constructive criticism as a tool used by faculty members to evaluate students’ work and direct them to greater learning and conceptual development. When students receive constructive criticism from their faculty members, they will compare between the criticism and their failure they have been through. For example, when a student makes mistakes in writing his essay, a faculty member may say “The topic for your essay is quite unique, however you provided very limited reputable references for your essay. Next time, please be resource-able and use some reputable references for your essay, because this is supposed to be an academic essay” to the student. In this case, by receiving the constructive criticism, the student can be able to generate solution and transform it into cognitive, affective, and also motivational benefits (<ext-link id="_external-link-16" ext-link-type="uri" xlink:href="">Fong et al., 2018</ext-link>). Hence, constructive criticism can be one of the sources of students’ learning motivation by improving their thinking and task performance in the learning process. Besides being a source of motivation, constructive criticism also proved to be a non-threatening way of criticism, since it was specific and delivered promptly (<ext-link id="_external-link-17" ext-link-type="uri" xlink:href="">Leung et al., 2001</ext-link>). <ext-link id="_external-link-18" ext-link-type="uri" xlink:href="">Nguyen and </ext-link><ext-link id="_external-link-19" ext-link-type="uri" xlink:href="">Basturkmen</ext-link><ext-link id="_external-link-20" ext-link-type="uri" xlink:href=""> (2010)</ext-link> also emphasize that constructive criticism aims to improve receiver’s current or future performance and it involved “the identification of a problematic action, choice, or product, as well as advice on how to change or correct the problem”.</p>
      <p id="_paragraph-24"><ext-link id="_external-link-21" ext-link-type="uri" xlink:href="">Petress</ext-link><ext-link id="_external-link-22" ext-link-type="uri" xlink:href=""> (2000)</ext-link> mentions several purposes of constructive criticism. First, constructive criticism enables the receivers to get external views of their performance, so that they can compare their own point of view with another point of view. Second, constructive criticism helps the receivers to recognize their past performance and provide ways to improve their future performance. Giving criticism constructively not only makes the receivers recognize what their problems are, but also provides them some ways to improve their performance or work for their future. Third, constructive criticism makes the receivers feel appreciated instead of being ignored and left behind. The receivers will consider the constructive criticism as a reward for their performance or work, so that they will be glad of receiving such kind of criticism. The last purpose of constructive criticism is to develop the receivers’ confidence since the notion of constructive criticism itself is rather on encouraging instead of blaming the receivers.</p>
      <p id="_paragraph-25">It is important to take language learning motivation into account since the essence of constructive criticism is closely related to build up a person’s motivation to be a better version of oneself. From time to time, motivation has become one of the prominent factors on determining the success of second or foreign language learning. Some scholars have introduced how motivation in second or foreign language learning works. Dornyei proposed three components of L2 Motivational Self System, namely: (1) Ideal L2 Self, (2) Ought-to L2 Self, and (3) L2 Learning Experience (Dornyei &amp; Ushioda, 2009). In the concept of Ideal L2 Self, if a student wants to master a second or foreign language, then he must be his own powerful motivator for himself. For example, a student wants to have an ability to speak English fluently, then he works hard on his pronunciation or even learn to speak English with native speakers. In this case, the motivational system works within himself rather than for other external factors such as teachers’ obligation and parents’ expectations. On the other hand, in the concept of ought-to L2 Self, if a student wants to master a second or foreign language, and then he may have something to possess and to avoid negative outcomes. For example, a student wants to learn English because he believes that English will help him a lot for his future job or he needs to be able to meet his parents’ expectations. The last concept, which is L2 Learning Experience, is situation-specific motives closely related to the classroom environments and experiences such as the curriculum, the impact of teaching styles, and the impact of students’ learning styles. <ext-link id="_external-link-23" ext-link-type="uri" xlink:href="">Dornyei</ext-link><ext-link id="_external-link-24" ext-link-type="uri" xlink:href=""> (2019)</ext-link> noted that L2 Learning Experience and the notion of student engagement are an inseparable system. Student engagement is understood as the meaningful learning activities which involve students’ active participation in the learning process.</p>
      <p id="_paragraph-27">Besides giving an effect on motivational aspect, constructive criticism can also give another effect on students’ emotions (<ext-link id="_external-link-25" ext-link-type="uri" xlink:href="">Fong et al., (2016</ext-link>), <ext-link id="_external-link-26" ext-link-type="uri" xlink:href="">Fong et al., (2018)</ext-link>. In foreign and second language learning, emotion is seen as the fundamental process of students’ language learning, performance, and wellbeing (<ext-link id="_external-link-27" ext-link-type="uri" xlink:href="">Shao et al., 2019</ext-link>). Control Value Theory (CVT) proposes two kinds of emotion in academic circumstance, namely: positive activating emotions and negative deactivating emotions (Stockinger et al., 2021). <ext-link id="_external-link-28" ext-link-type="uri" xlink:href="">Mokhtar</ext-link><ext-link id="_external-link-29" ext-link-type="uri" xlink:href=""> et al., (2021)</ext-link> found that positive emotions such as joy and hope can enhance students’ engagement with their learning materials and also help promote effective learning strategies. Negative emotions, in contrast, such as hopelessness and dissatisfaction can discourage students to do some efforts in their learning process, thus it will affect their motivation and performance. Since the emotions that students feel can have huge impact on their relationship with the target language, therefore the role of students’ emotion must not be neglected. <ext-link id="_external-link-30" ext-link-type="uri" xlink:href="">Rahimi</ext-link><ext-link id="_external-link-31" ext-link-type="uri" xlink:href=""> and </ext-link><ext-link id="_external-link-32" ext-link-type="uri" xlink:href="">Bigdeli</ext-link><ext-link id="_external-link-33" ext-link-type="uri" xlink:href=""> (2014)</ext-link> encourage teachers of English as a foreign or second language to design some types of learning environment and activity which ignite and spread more activating positive than deactivating negative emotions.</p>
      <p id="_paragraph-28">Based on the reviewed studies and the research gap, the current study sought to find out the following research questions:</p>
      <p id="_paragraph-29">1. What is undergraduate students’ perception on the use of oral constructive criticism employed by faculty members in the classroom?</p>
      <p id="_paragraph-30">2. Does the use of oral constructive criticism has any effect on the students’ motivation in learning English?</p>
    </sec>
    <sec id="sec-4">
      <title>
        <bold id="bold-28ebbd5f8b0c40bb16a7aca41bc13f90">METHODS</bold>
      </title>
      <sec id="heading-faef57a37847efb18ff45aa21cbbc64f">
        <title>
          <bold id="bold-696602e71357548061548050bdfdf936">Research Design</bold>
        </title>
        <p id="_paragraph-32">In order to obtain appropriate answers for the two research questions, this study employed a survey research design. As supported by <ext-link id="_external-link-34" ext-link-type="uri" xlink:href="">Latief</ext-link><ext-link id="_external-link-35" ext-link-type="uri" xlink:href=""> (2019)</ext-link>, survey research design helps researchers to describe people’s perception, opinions, preferences, and attitudes on certain trends or beliefs. The representativeness of the sample to obtain data is one of the keys to determine the quality of survey research (Latief, 2019), hence this study involved some representativestudents from several universities as the research participants.</p>
      </sec>
      <sec id="heading-7946a8f2dd29825f471367054c3ebb6d">
        <title>
          <bold id="bold-057c6d96f238625294da5f8b41136970">Participants</bold>
        </title>
        <p id="_paragraph-34">The population involved in a survey research design is usually large (Latief, 2019), therefore 86 undergraduate students enrolling in the fourth semester of English Language Teaching Department at several universities in Malang, East Java were chosen purposively as the research participants. After all of the students finished filling out the questionnaire form, they were assigned into some random numbers. The random numbers were added to a web-based random numbers picker in order to have 3 selected participants for interview sessions. The fourth semester students were chosen because they were on their early 19s or 20s, meaning that they were adult language learners. According to <ext-link id="_external-link-36" ext-link-type="uri" xlink:href="">Harmer (2001)</ext-link>, adult learners have enough life and academic experiences, consequently they tend to be more critical and disciplined than young learners.  In terms of their language learning motivation, they also have better understanding of why they learn English and what kind of outcomes they expect from learning English. Also, the fourth semester students joining this research stated that they had already taken English Grammar course. English Grammar course was the class where they received and asked for several types of criticisms during the learning process. The demographic information of the research participants is drawn in <ext-link id="_external-link-37" ext-link-type="uri" xlink:href="">Table 1</ext-link>.</p>
        <table-wrap id="_table-figure-1">
          <label>Table 1</label>
          <caption>
            <title><bold id="bold-39cedd9d768f36ed2abf7276cea3e3e1"/>The Demographic Information of the Research Participants</title>
            <p id="_paragraph-36" />
          </caption>
          <table id="_table-1">
            <tbody>
              <tr id="table-row-191ead517165c18d544a3949916ce871">
                <td id="table-cell-7e7efdea0ff606fd85a7c50342ef8bd4">Variables</td>
                <td id="table-cell-f09abd25acff1988f92997e101d35b6b">Sub Variables</td>
                <td id="table-cell-b09d93dd954fd6c4a42a07c26e8b6838">Percentage (%)</td>
              </tr>
              <tr id="table-row-dc0ef6de7fa0dd738902166869113fb2">
                <td id="table-cell-58e95a6550820037ffd4879e12e19a1d" rowspan="2">Gender</td>
                <td id="table-cell-3dca92e58fef21df2a0de6e48a32e939">Male</td>
                <td id="table-cell-4bedf55304728fc6ab32c77bf3482213">40.6</td>
              </tr>
              <tr id="table-row-ea2b8568c20cf1211199b32cb44165a4">
                <td id="table-cell-eaa048f0d0e2256bfd057a3877cc00cb">Female</td>
                <td id="table-cell-0d19d4186399c23f1bbe0ebd21ed67a2">59.4</td>
              </tr>
              <tr id="table-row-d33f973efd45038a45f35b0f73708f63">
                <td id="table-cell-c667f21e96da3d0e18ec89a1d8251187">Semester</td>
                <td id="table-cell-5db7166f20841027ad0dc52aa4f365da">4</td>
                <td id="table-cell-388412c22907f37bfb6efbbd7e8ce898">100</td>
              </tr>
              <tr id="table-row-9847bc2d05d7678c847186c167b7364d">
                <td id="table-cell-13bda517c188acb3a573a860e60f9090" rowspan="5">Affiliation</td>
                <td id="table-cell-98c63ac235c3f6c61a16b4786e7312e7">Universitas Negeri Malang</td>
                <td id="table-cell-ce77be9e22373b5b92368fc63911d5d6">30.2</td>
              </tr>
              <tr id="table-row-535e72aaf4009b4a9057b336cb6169f2">
                <td id="table-cell-87d734664128a5924bae1f0805aba55a">Universitas Islam Negeri Malang</td>
                <td id="table-cell-b5bd180e25f4c6f3aaafe51b9d91376c">28</td>
              </tr>
              <tr id="table-row-e7c7bd8de8911c37893f642ee5f82267">
                <td id="table-cell-350e20ce882416d904ffde3659d2a249">Universitas Muhammadiyah Malang</td>
                <td id="table-cell-506adf578a97074f985c4b2478e38451">23.2</td>
              </tr>
              <tr id="table-row-5d6be13b1c1aa60fee6694e4e8cdbd5d">
                <td id="table-cell-39e51aef8038313bacd8601db8849800">UIN Maulana Malik Ibrahim Malang</td>
                <td id="table-cell-b4e16a19a1d9471eba35d6a621e74a44">12.8</td>
              </tr>
              <tr id="table-row-c725942edf4fe55a0c85a35ab03e18c6">
                <td id="table-cell-cf8ba89c715f926a1fcc968291119c83">Politeknik Negeri Malang</td>
                <td id="table-cell-dea829cd62e9b68612235150555904c9">5.8</td>
              </tr>
            </tbody>
          </table>
        </table-wrap>
      </sec>
      <sec id="heading-84f99a384b12bab2bbd153943e3e1dc5">
        <title>
          <bold id="bold-6b019270c808a5f94265a3ab0a293dc7">Data Collection</bold>
        </title>
        <p id="_paragraph-38">In the process of collecting the data, the researchers used two research instruments, namely questionnaire and interview. The first instrument was questionnaire. The questionnaire was adapted from the previous study conducted by <ext-link id="_external-link-38" ext-link-type="uri" xlink:href="">Fong et al., (2016)</ext-link> (see <ext-link id="_external-link-39" ext-link-type="uri" xlink:href="">Appendix 1</ext-link> ). It consisted of 20 items describing some activities, feelings and emotions that students might do and feel after receiving oral constructive criticism from their faculty members. It had 4 point Likert Scale, namely (1) strongly disagree, (2) disagree, (3) agree, and (4) strongly agree. Since 4 point likert scale is a forced likert scale, therefore it helped the researcher to form specific responses on the use of oral constructive criticism in the classroom. </p>
        <p id="_paragraph-39">The items of the questionnaire were all written in English. The items of the questionnaire covered several aspects, namely: the essence of constructive criticism, the advantages of constructive criticism, the emotional reactions that students had after receiving constructive criticism (tiresomeness, worried, pleased satisfaction, and hopeful), and the effect of constructive criticism on students’ motivation in learning English. The questionnaire was distributed through Google Form link. In the questionnaire form, the researchers already explained the meaning of oral constructive criticism in Bahasa Indonesia to avoid misunderstanding.</p>
        <p id="_paragraph-41">The second instrument was interview. The interview guide was also adapted from the previous study conducted by <ext-link id="_external-link-40" ext-link-type="uri" xlink:href="">Fong et al., (2016)</ext-link> (see <ext-link id="_external-link-41" ext-link-type="uri" xlink:href="">Appendix 2</ext-link> ). The interview guide consisted of seven questions written in English. The items of the interview guide focused on investig ating several aspects, namely: T he reason underlying the essence of constructive criticism, the reason why the students had such emotional reactions after receiving constructive criticism, and the reason why the students’ motivation in learning English was affected by the use of constructive criticism in the classroom. The interview session was conducted through having a phone interview. During the phone interview, the researchers used English as the medium of communication while the interviewees were allowed to answer the questions in Bahasa and English. The researchers allowed the interviewees to speak Bahasa and English because they wanted the interviewees to be flexible and comfortable in answering the questions.</p>
      </sec>
      <sec id="heading-e04c447ac54a9e2103da6ab819b45ddc">
        <title>
          <bold id="bold-5db80195f4fb442647c28646623c2afd">Data Analysis</bold>
        </title>
        <p id="_paragraph-43">After the data were completely collected, the data gathered from the questionnaire were analyzed by using simple statistical techniques to find out the percentage of each statement and then the data were interpreted descriptively. The data collected from the interview sessions with the selected students were all transcribed and analyzed thematically for finding out the key features which were related to the use of oral constructive criticism in the classroom. The stages of thematic analysis related to the data taken from the interview session were as follows: familiarization, coding, generating themes, reviewing themes, and writing up. Firstly, the researcher familiarized herself with the transcript by transcribing the audio, reading the transcript, and taking initial notes. Then, the researcher coded the data by highlighting the key features and content related to the use of constructive criticism in the classroom. Next, the researcher identified the patterns of codes and start writing the themes of the codes. After the themes had been selected, the researcher reviewed all the selected themes carefully. Finally, the researcher wrote the results of the thematic analysis.</p>
      </sec>
    </sec>
    <sec id="sec-7">
      <title>
        <bold id="bold-c4f34814be1f22ce472f3be154a25b5f">RESULTS AND DISCUSSION</bold>
      </title>
      <p id="_paragraph-44">
        <bold id="_bold-55">Undergraduate students’ perception on the use of oral constructive criticism in the classroom</bold>
      </p>
      <p id="_paragraph-45">To answer the first research question, the result of the online survey involving 86 undergraduate EFL students at several</p>
      <p id="_paragraph-46">universities around Malang are summarized in <ext-link id="_external-link-42" ext-link-type="uri" xlink:href="">Figure 1</ext-link>. The result of the interview sessions with the selected students are also presented in this section, hence the researchers use some codes as follows: (S1) for Student 1 and (S2) for Student 2.</p>
      <fig id="figure-panel-2e6367fe4662b626b178b94925ce174f">
        <label>Figure 1</label>
        <caption>
          <title>Undergraduate Students’ Perception on the Use of Oral Constructive Criticism</title>
          <p id="paragraph-e679f1675a437bc8c8acd80dea074060" />
        </caption>
        <graphic id="graphic-241ec7700ee7d98f89ec97780ca5b1c8" mimetype="image" mime-subtype="png" xlink:href="f1 anggi.png" />
      </fig>
      <p id="_paragraph-48">
        <italic id="_italic-61">Note:</italic>
      </p>
      <p id="_paragraph-49">Item 1: The use of oral constructive criticism makes me aware of my mistakes in learning English.</p>
      <p id="_paragraph-50">Item 2: Oral constructive criticism provides me with path and solution for my problems in learning English.</p>
      <p id="_paragraph-51">Item 3: Oral constructive criticism helps me learn from my previous mistakes.</p>
      <p id="_paragraph-52">Item 4: Receiving oral constructive criticism sensitizes myself to stop repeating the same mistakes in the future.</p>
      <p id="_paragraph-53">Item 5: Oral constructive criticism is valuable for my future performance in learning English.</p>
      <p id="_paragraph-54">Item 6: I’d rather be criticized constructively than being ignored and left out.</p>
      <p id="_paragraph-55">Out of the total number of the respondents (N=86), it was found that 42 students chose strongly agree, 40 students chose agree, and only 4 students chose disagree with item 1. Since 82 students (95%) gave positive response towards item 1, then it could be interpreted that the use of oral constructive criticism given by faculty members affected the undergraduate students in a way that they became more aware of their mistakes in learning English. Related to item number 2, it was found that 36 students chose strongly agree, 45 students chose agree, and 5 students chose disagree. In this case, the students believed that the path and solutions resulted from the oral constructive criticism were helpful to solve their difficulties and problems in learning English. The fact that oral constructive criticism provided the students with path and solution for their problems in learning English (Item 2) seemed to support and strengthen the students’ positive response towards item 1. Furthermore, for item number 3, there were 46 students chose strongly agree, 37 students chose agree, and 3 students chose disagree. This response was the proof that oral constructive criticism that they received in the teaching and learning process really helped them learn from their previous mistakes.</p>
      <p id="_paragraph-56">In the interview session, the students admitted that the use of constructive criticism helped them aware of their mistakes, hence they could avoid making the same mistakes in the future. They also tried to relate the function of oral constructive criticism and the essence of learning a language. The following are some excerpts taken from the interview sessions with the selected students.</p>
      <p id="_paragraph-57">Because learning a foreign language is not easy. When we learn a language, we learn the culture of the language as well, so there must be trials and errors in the process of learning the language. In this case, constructive criticism is needed, because with the help of constructive criticism we are able to know which one is right and which one is wrong. Constructive criticism can be the tool to measure our capability in learning English and it also becomes the booster to make us be better. (S1)</p>
      <p id="_paragraph-58">Because with constructive criticism, I will know which mistake I made and then I can improve my English. (S2)</p>
      <p id="_paragraph-59">From the excerpts above, we can see the students’ positive response towards the use of oral constructive criticism that they received in the classroom. Their words indicated that the use of oral constructive criticism was necessary for boosting their performance in learning English.</p>
      <p id="_paragraph-60">For item number 4, there were 46 students chose strongly agree, 33 students chose agree, and 7 students chose disagree. The result of the online survey related to item number 4 indicates that the students took oral constructive criticism as a warning to make them stop repeating the same mistakes in their future performance. When they were asked whether constructive criticism was valuable for their future performance (item 5), surprisingly the result revealed that there was only 1 students who were disagree with item number 5. This particular response generally means that the students considered the use of oral constructive criticism important for their future performance in learning English. Since the students really took the use of oral constructive criticism seriously, they showed their real preference on item number 6. For item number 6, it was found that 47 students chose strongly agree, 32 students chose agree, and only 7 students chose disagree. In this case, it could be concluded that the students considered oral constructive criticism a confirmation whether they did the right things in their learning process. Hence, it makes a lot of sense if they would rather be criticized than being ignored.</p>
      <p id="_paragraph-61">The findings indicated that the undergraduate students had positive perception on the use of oral constructive criticism in the classroom. The students felt the use of oral constructive criticism in the classroom was very vital for their progress in learning English. Moreover, the students considered oral constructive criticism beneficial hints to tackle their challenges and difficulties in learning English. From oral constructive criticism that they received during their learning process, they could take beneficial effects such as being aware of their mistakes, utilizing the paths and solutions to overcome their difficulties in learning English,</p>
      <p id="_paragraph-62">and also taking lessons from mistakes that they have made. This finding seems to replicate the studies conducted by <ext-link id="_external-link-43" ext-link-type="uri" xlink:href="">Lecce et al., (2011)</ext-link>, <ext-link id="_external-link-44" ext-link-type="uri" xlink:href="">Mizokawa</ext-link><ext-link id="_external-link-45" ext-link-type="uri" xlink:href=""> &amp; Lecce (2016)</ext-link>, <ext-link id="_external-link-46" ext-link-type="uri" xlink:href="">Fong et al., (2016)</ext-link>, and <ext-link id="_external-link-47" ext-link-type="uri" xlink:href="">Nguyen (2013)</ext-link> which showed that constructive criticism had powerful and positive effect on students’ learning progress.</p>
      <p id="_paragraph-63">When the students were asked about their feelings after receiving constructive criticism from their faculty members, they gave varied and complex emotional responses. The result of the online survey related to the students’ emotional reaction towards the use of oral constructive criticism in the classroom is drawn in <ext-link id="_external-link-48" ext-link-type="uri" xlink:href="">Figure 2</ext-link>.</p>
      <fig id="figure-panel-8ff50de1e533cccba34dd4de8ef13c29">
        <label>Figure 2</label>
        <caption>
          <title>Undergraduate Students’ Emotional Reaction towards Oral Constructive Criticism</title>
          <p id="paragraph-e109e2037410b7d76eb12de4de839562" />
        </caption>
        <graphic id="graphic-815000a76733ca2c66d3543ceca39e14" mimetype="image" mime-subtype="png" xlink:href="f2 anggi.png" />
      </fig>
      <p id="_paragraph-65">
        <italic id="_italic-62">Note:</italic>
      </p>
      <p id="_paragraph-66">Item 7: After receiving oral constructive criticism I feel tired and bored.</p>
      <p id="_paragraph-67">Item 8: After receiving oral constructive criticism I lose my interest in learning English.</p>
      <p id="_paragraph-68">Item 9: I feel embarrassed after receiving oral constructive criticism.</p>
      <p id="_paragraph-69">Item 10: After receiving oral constructive criticism, I feel satisfied with myself.</p>
      <p id="_paragraph-70">Item 11: I feel hopeful about my progress in learning English after receiving oral constructive criticism.</p>
      <p id="_paragraph-71">Item 12: After receiving oral constructive criticism, I feel optimistic.</p>
      <p id="_paragraph-72">As displayed in <ext-link id="_external-link-49" ext-link-type="uri" xlink:href="">Figure 2</ext-link> , it was found that 23 students (26%) were tired and bored after receiving oral constructive criticism (item 7), 14 students (16%) admitted that they lose their interest in learning English after receiving oral constructive criticism (item 8), 31 students (36%) were embarrassed after receiving oral constructive criticism, 69 students (80%) were satisfied after receiving oral constructive criticism, 83 students (97%) were hopeful about their progress in learning English after receiving oral constructive criticism, and 78 students (91%) were optimistic after receiving oral constructive criticism. </p>
      <p id="_paragraph-73">The students’ emotional reactions that were found in this study belonged to four categories, namely: tiresomeness (26%), discomfited worried (36%), pleased satisfaction (80%), and hope (97%). Clearly we can see the role of hope is the most outstanding emotional category compared to tiresomeness, discomfited worried and pleased satisfaction. After receiving oral constructive criticism, surprisingly the students were hopeful about their progress in learning English. Asides from feeling hopeful about their progress in learning English, 91% of the students were optimistic after receiving oral constructive criticism in the classroom. This meant that the students were beyond emotionally ready to receive constructive criticism in the teaching and learning process. This finding is in line with the study conducted by <ext-link id="_external-link-50" ext-link-type="uri" xlink:href="">Fong et al., (2016)</ext-link> which revealed that hope was found to be very dominant in affecting the students’ emotional reaction when they dealt with constructive criticism. It is obvious that in this study the positive emotional reactions have already overpowered the negative emotional reactions. The positive emotional reactions such as hope, pride, and satisfaction can enhance students’ attentiveness and excitement, and also trigger the students’ utilization of learning strategies (Mokhtar et al., 2021).</p>
      <p id="_paragraph-75">The use of oral constructive criticism and its effect on the students’ motivation in learning English</p>
      <p id="_paragraph-76">To find out the answer to the second research question, the result of the online survey involving 86 undergraduate EFL students at several universities around Malang are summarized in <ext-link id="_external-link-51" ext-link-type="uri" xlink:href="">Figure 3</ext-link> . The result of the interview sessions with the selected students are also presented in this section, hence the researchers use some codes as follows: (S1) for Student 1 and (S2) for Student 2.</p>
      <fig id="figure-panel-1ecbe492432dd4eab398f10f096357fb">
        <label>Figure 3</label>
        <caption>
          <title>Undergraduate Students’ Perception on their Motivation in Learning English</title>
          <p id="paragraph-eb18943d7009ee1d7370d27d89bbd740" />
        </caption>
        <graphic id="graphic-19ff31e84afe3ba1b8e1df7846dad76e" mimetype="image" mime-subtype="png" xlink:href="f3 anggi.png" />
      </fig>
      <p id="_paragraph-78">
        <bold id="_bold-74" />
        <italic id="_italic-63">Note:</italic>
      </p>
      <p id="_paragraph-79">Item 13: Constructive criticisms have such a great contribution for my motivation to learn English</p>
      <p id="_paragraph-80">Item 14: My main reason to study hard is constructive criticism that I receive.</p>
      <p id="_paragraph-81">Item 15: Constructive criticism motivates me to get a good score.</p>
      <p id="_paragraph-82">Item 16: Constructive criticism makes me feel motivated to be a good learner.</p>
      <p id="_paragraph-83">Item 17: I want to improve my performance, because I don’t want to receive constructive criticism from my faculty members.</p>
      <p id="_paragraph-84">Item 18: I want to improve my performance, because I want to receive constructive criticism from my faculty members.</p>
      <p id="_paragraph-85">For item number 13, there were 35 students chose strongly agree, 44 students chose agree, and 7 students chose disagree. This response means that most of the undergraduate students (79) believed that constructive criticism gave a great deal of contribution for their motivation in learning English. In other words, they really believed that the use of oral constructive criticism they received in the classroom was one of the sources of their motivation in learning English. It was seen from the result of the online survey of item number 14 and 15. For item number 14, there were 68 students gave positive response about their main reason to study hard. Meanwhile, for item number 15, almost all of the students (76) agreed that the use of oral constructive criticism motivated them to get a good score. From the result of these two charts, it is obvious that the students’ motivation in learning English were positively affected by the use of oral constructive criticism given by their faculty members in the classroom.</p>
      <p id="_paragraph-86">When the students were asked whether the use of oral constructive criticism affect their motivation in learning English, all of them gave their straightforward answers. The following are the excerpts showing the students’ answers about the use of oral constructive criticism affects their motivation in learning English.</p>
      <p id="_paragraph-87">Because with constructive criticism, I feel like I find someone who can criticize me. It feels like finding a new learning partner who are smarter and much better than me. It means that there is a new friend, a new knowledge to understand English. Since some of the materials are in English, so sometimes I find them have multiple and complex interpretations. Hence, I need the correct partner to share my difficulties. The partner that I expect is the one who can give me constructive criticism. (S1)</p>
      <p id="_paragraph-88">After receiving constructive criticism, I am able to know which one is correct or wrong, then I take a note. Sometimes, I can go back to my note when I find similar problems. Finally I can solve the problems and get a good score. (S1)</p>
      <p id="_paragraph-89">S1 confirmed that she really needed oral constructive criticism to boost her learning motivation. From her explanation, clearly we can see her way of utilizing oral constructive criticism that she received as a source of solution to overcome her problems in learning English. Further, she admitted that the use of constructive criticism helped her to gain a good score.</p>
      <p id="_paragraph-90">There is another surprising answers came from S2. The following is some excerpts detailing the answers from S2.</p>
      <p id="_paragraph-91">Because I keep improving and it will make my progress move, not stuck. (S2)</p>
      <p id="_paragraph-92">Of course, because constructive criticism makes me understand which part I’m weak at in learning English. For example, I am really bad at grammar and I always ask to the lecturer for tips and their criticism to help improve my grammar. From that, I know which part I should’ve focus on more. (S2)</p>
      <p id="_paragraph-93">From the excerpts above, S2 was very sure that oral constructive criticism helped her progress during the learning progress. She also gave detailed explanation that she always asked for tips and criticisms from her faculty members in order to improve her grammar. In this particular case, she realized that she was far from the definition of a good EFL student, so she initiatively asked helps from her faculty members. Once again, the result of the interview proofs that the students considered faculty members as the experts who can evaluate their performance in their learning process.</p>
      <p id="_paragraph-94">Related to item number 16, it was found that there were 39 students chose strongly agree, 41 students chose agree, and 6 students chose disagree. This positive response supports the fact that the use of constructive criticism played a big role in boosting the students’ learning motivation (item 13). For item number 17, there were 51 students chose agree with the statement and 35 students chose disagree with the statement. While item number 18, there were 63 students chose agree with the statement and 23 students chose disagree with the statement. These particular responses indicate that most of the students’ learning motivations were affected by the use of oral constructive criticism. From the result of their preference on item 17 and 18, we can also see the students had a great level of perseverance in learning English. They were strongly motivated to study hard, be good students, and get good scores because they wanted to receive oral constructive criticism from their faculty members.</p>
      <p id="_paragraph-95">Pertaining to the second research question, the finding indicated that the use of oral constructive criticism affected the students’ motivation in learning English positively. The word positive means that the students did not feel constructive criticism as a thread that prevented them from being their best version of themselves in learning English. Instead, the students were strongly motivated to get good scores and be good students because of the oral constructive criticism that they received in the teaching and learning process. This finding corresponds closely with the concept of constructive criticism and the source of motivation stated by <ext-link id="_external-link-52" ext-link-type="uri" xlink:href="">Fong et al., (2018)</ext-link> . By receiving oral constructive criticism , the students obtained motivational benefits, so that they could improve their way of thinking and learning ( <ext-link id="_external-link-53" ext-link-type="uri" xlink:href="">Fong et al., 2018</ext-link> ).</p>
      <p id="_paragraph-97">The students also considered their faculty members as the experts who had the rights to evaluate their performance in learning English. They really put their trusts on their faculty members to give them appropriate judgments about their performance in learning English. They also asked for helps and criticisms in order to know whether they did the right things in their learning. They would be worried if they did not get any criticism for their performance. If they did not get any criticism from their faculty members, they felt confused and lost. This is a sign that oral constructive criticism was appropriately used by the faculty members to evaluate students’ work and direct their students to greater learning and conceptual development ( <ext-link id="_external-link-54" ext-link-type="uri" xlink:href="">Fong et al., 2018</ext-link> ).</p>
      <p id="_paragraph-98">This study also revealed that the type of L2 motivational system affected by the use of oral constructive criticism was the L2 Learning Experience as introduced by <ext-link id="_external-link-55" ext-link-type="uri" xlink:href="">Dornyei</ext-link> <ext-link id="_external-link-56" ext-link-type="uri" xlink:href="">(2009)</ext-link> . The students wanted to improve their performance and get good scores because they simply wanted to receive oral constructive criticism from their faculty members. It meant that the use of oral constructive criticism given by the faculty members was necessary for the students’ motivation in learning English. In this case, oral constructive criticism that motivated the students was a medium to facilitate learning engagement in the classroom.</p>
    </sec>
    <sec id="heading-9192a2a7eed2482f23467f05f63ecfd2">
      <title>
        <bold id="bold-c6d2cd065b371a0621a8f9707e923a06">CONCLUSION</bold>
      </title>
      <p id="_paragraph-100">This study confirmed that the undergraduate students have positive reaction towards the use of oral constructive criticism in the classroom. In the opinion of the respondents in this online survey, the use of oral constructive criticism is effective in helping them overcome their difficulties in English language learning such as helping the students recognize their mistakes, learn from their mistakes, and stop repeating the same mistakes in the future. However, it is important not to focus only on the positive reaction towards the use of oral constructive criticism in the classroom. Oral constructive criticism is also valuable for the undergraduate students’ motivation in learning English. It played a prominent role in boosting the students’ motivation in learning English. By receiving oral constructive criticism, the students were strongly motivated to study hard, get good scores, and be good EFL students.</p>
      <p id="_paragraph-101">This study provides some suggestions for future researchers and further research works. Since the present study only targeted college students, especially the fourth semester students of English Language Teaching Department at several universities around Malang, East Java as the research participants, therefore future researchers are suggested for investigating the use of oral constructive criticism combined with another psychological impact such as language anxiety and emotional reaction across different age levels and also different academic settings. By considering these suggestions, it is expected that future researchers can give significant impact and contribution to the existing theories.</p>
    </sec>
    <sec id="heading-74384a707827e0d63e149241fecf4d09">
      <title>
        <bold id="bold-a0fc80a646d290b2be5795cc89d7b88a">ACKNOWLEDGEMENTS</bold>
      </title>
      <p id="_paragraph-104">The authors would like to appreciate the research participants who gave generously of their time and hospitality for this survey. The authors would also like to thank the anonymous reviewers and editor for their valuable comments.</p>
    </sec>
    <sec id="heading-d0b9f887f58c3c8d0524a8d22ea0ac4c">
      <title>
        <bold id="bold-6e43dc47b1ab6e87949098b4003aaad4">REFERENCES</bold>
      </title>
      <p id="_paragraph-106">Creswell, J. W. ( 2012 ) . <italic id="_italic-64">Educational r</italic> <italic id="_italic-65">esearch: Planning, </italic><italic id="_italic-66">conducting, and evaluating qualitative and quantitative research, 4th edition</italic> . Boston: Pearson Education Inc.</p>
      <p id="_paragraph-107">Dornyei , Z. &amp; Ushioda , E. ( 2009 ) . <italic id="_italic-67">Motivation, </italic><italic id="_italic-68">language identit</italic> <italic id="_italic-69">y and the L2 s</italic> <italic id="_italic-70">elf</italic> . Bristol: Channel View Publication.</p>
      <p id="_paragraph-108">Dornyei , Z. ( 2019 ) . Towards a better understanding of the l2 learning experience, the Cinderella of the L2 motivational system . <italic id="_italic-71">Studies in Second Language Learning and Teaching, </italic>9 <italic id="_italic-72">(1)</italic> , 19-30. DOI: 10.14746/ssllt.2019.9.1.2.</p>
      <p id="_paragraph-109">Fong, C.J., Schallert , D.L., Williams, K.M., Williamson, Z.H., Warner, J.R., Lin, S., &amp; Kim, Y.W. ( 2018 ) . When feedback signals failure but offers hope for improvemen t: A process model of constructive criticism . <italic id="_italic-73">Thinking Skills and Creativity</italic> . DOI: 10.1016/j.tsc.2018.02.014.</p>
      <p id="_paragraph-110">Fong, C.J., Warner, J.R., Williams, K.M., Schallert , D.L., Chen, L., Williamson, Z.H., &amp; Lin, S. ( 2016 ) . Deconstructing constructive criticism : The nature of academic emotions associated with constructive, positive, and negative feedback . <italic id="_italic-74">Learning and Individual Differences, </italic>49 , 393-399. DOI: 10.1016/j.lindif.2016.05.019.</p>
      <p id="_paragraph-111">Harmer, J. ( 2001 ) . <italic id="_italic-75">Practice English </italic><italic id="_italic-76">language teaching, 3rd edition</italic> . United Kingdom: Pearson Education Limited.</p>
      <p id="_paragraph-112">Hyland, F. &amp; Hyland, K. (2001). Sugaring the p ill: Praise and criticism in written feedback . <italic id="_italic-77">Journal of Second Language Writing</italic> , 10 , 185–212.</p>
      <p id="_paragraph-113">Kamins , M.L. &amp; Dweck , C.S. ( 1999 ) . Person versus process praise and criticism : Implications for contingent self-worth and coping . <italic id="_italic-78">Developmental Psychology, </italic>35 <italic id="_italic-79">(3),</italic> 835-847.</p>
      <p id="_paragraph-114">Latief , M.A. ( 2019 ) . <italic id="_italic-80">Research </italic><italic id="_italic-81">methods on language learning an introduction, 7th edition</italic> . Malang: Universitas Negeri Malang.</p>
      <p id="_paragraph-115">Lecce, S., Caputi , M., &amp; Hughes, C. ( 2011 ) . Does sensitivity to criticism mediate the relationship between theory of mind and academic achievement ? . <italic id="_italic-82">Journal of Experimental Psychology</italic> , 110 <italic id="_italic-83">,</italic> 318-326. DOI: 10.1016/j.jecp.2011.04.011.</p>
      <p id="_paragraph-117">Leung, K., Su, S., &amp; Morris, M.W. ( 2001 ) . When is criticism not constructive ? The role of fairness perceptions and dispositional attributions in employee acceptance of critical supervisory feedback . <italic id="_italic-84">Human Relations, </italic>54 <italic id="_italic-85">(9)</italic> , 1155-1187.</p>
      <p id="_paragraph-118">Mizokawa , A., &amp; Lecce, S. (2017). Sensitivity to criticism and theory of mind: A cross cultural study on Japanese and Italian children. <italic id="_italic-86">European Journal of Developmental Psychology, </italic>14 <italic id="_italic-87">(2)</italic> , 159-171. DOI: 10.1080/17405629.2016.1180970.</p>
      <p id="_paragraph-120">Mokhtar , Z. M., Amran , M. S., &amp; Roslee , M. J. (2021). With emotions, we learn: understanding emotions in learning English as a second language (ESL). <italic id="_italic-88">International Journal of Academic Research in Progressive Education and Development, </italic>10 <italic id="_italic-89">(3),</italic> 361–372. DOI: 10.6007/IJARPED/v10-i3/9932.</p>
      <p id="_paragraph-121">Nguyen, T.T.M. &amp; Basturkmen , H. ( 2010 ) . Teaching constructive critical feedback . <italic id="_italic-90">TESOL Journal</italic> .</p>
      <p id="_paragraph-122">Nguyen, T.T.M. ( 2013 ) . Instructional effects on the acquisition of modifiers in constructive criticism by EFL l earners. <italic id="_italic-91">Language Awareness, </italic>22 <italic id="_italic-92">(1)</italic> , 76-94, DOI: 10.1080/09658416.2012.658810.</p>
      <p id="_paragraph-123">Petress , K. ( 2000 ) . Constructive Criticism: A Tool for Improvement. From https://www.questia.com/library/journal/1G1-66760571/constructive-criticism-a-tool-for-improvement.</p>
      <p id="_paragraph-124">Rahimi , A., &amp; Bigdeli , R. A. ( 2014 ) . The broaden-and-build theory of positive emotions in second language learning . <italic id="_italic-93">Procedia</italic> <italic id="_italic-94">– Social and Behavioral Sciences, </italic>159 , 795-801, doi : 10.1016/j.sbspro.2014.12.451.</p>
      <p id="_paragraph-125">Shao, K., Pekrun , R., &amp; Nicholson, L.J. ( 2019 ) . Emotions in classroom language learning : What can we learn from achievement emotion research ?. <italic id="_italic-95">System, </italic>86 , 1-11, DOI: 10.1016/j.system.2019.102121.</p>
      <p id="_paragraph-126">Stockinger , K., Rinas , R., &amp; Daumiller , M. (2021). Student adaptability, emotions, and achievement: navigating new academic terrains in a global crisis . <italic id="_italic-96">Learning and Individual Differences, </italic>90 <italic id="_italic-97">,</italic> 1-10, DOI: 10.1016/j.lindif.2021.102046.</p>
      <p id="_paragraph-127">Suryanto . &amp; Sari, Z.E. 2020. Difficulties and strategies in learning English: An analysis of students from English and non English d epartment in Indonesia. <italic id="_italic-98">Advances in Social Science, Education, and Human Research, </italic>518 , 313-331.</p>
      <p id="_paragraph-128"><bold id="bold-6ee3f30499629e063564eb8d52bfd3ca">Conflict of Interest Statement:</bold><bold id="_bold-370"> </bold>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
      <p id="_paragraph-129">
        <italic id="_italic-99">Copyright © 2021 </italic>
        <italic id="_italic-100">Anggi</italic>
        <italic id="_italic-101">Putri</italic>
        <italic id="_italic-102">Suri</italic>
        <italic id="_italic-103">Wulandari</italic>
        <italic id="_italic-104">and </italic>
        <italic id="_italic-105">Mirjam</italic>
        <italic id="_italic-106">Anugerahwati</italic>
        <italic id="_italic-107">.</italic>
        <italic id="_italic-108">This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic </italic>
        <italic id="_italic-109">prac</italic>
        <italic id="_italic-110">- tice. No use, distribution or reproduction is permitted which does not comply with these terms.</italic>
      </p>
    </sec>
    <sec id="heading-e8d5b767748e14db3085838833dcfba9">
      <title>
        <bold id="bold-4a25df197021b2d84df37f268735f00e">APPENDICES</bold>
      </title>
      <p id="_paragraph-131">Appendix 1: Items of the Questionnaire</p>
      <p id="_paragraph-132">(Adapted from <ext-link id="_external-link-57" ext-link-type="uri" xlink:href="">Fong et al., 2016</ext-link> )</p>
      <list list-type="bullet" id="list-576ac9cd2bb6abe44393e5ebe34d3c64">
        <list-item>
          <p>The use of oral constructive criticism makes me aware of my mistakes in learning English.</p>
        </list-item>
        <list-item>
          <p>Oral constructive criticism provides me with path and solution for my problems in learning English.</p>
        </list-item>
        <list-item>
          <p>Oral constructive criticism helps me learn from my previous mistakes.</p>
        </list-item>
        <list-item>
          <p>Receiving oral constructive criticism sensitizes myself to stop repeating the same mistakes in the future.</p>
        </list-item>
        <list-item>
          <p>Oral constructive criticism is valuable for my future performance in learning English.</p>
        </list-item>
        <list-item>
          <p>I’d rather be criticized constructively than being ignored and left out.</p>
        </list-item>
        <list-item>
          <p>After receiving oral constructive criticism I feel tired and bored.</p>
        </list-item>
        <list-item>
          <p>After receiving oral constructive criticism I lose my interest in learning English.</p>
        </list-item>
        <list-item>
          <p>I feel worried after receiving oral constructive criticism.</p>
        </list-item>
        <list-item>
          <p>I feel embarrassed after receiving oral constructive criticism.</p>
        </list-item>
        <list-item>
          <p>I am proud of doing the work after receiving oral constructive criticism.</p>
        </list-item>
        <list-item>
          <p>After receiving oral constructive criticism, I feel satisfied with myself.</p>
        </list-item>
        <list-item>
          <p>I feel hopeful about my progress in learning English after receiving oral constructive criticism.</p>
        </list-item>
        <list-item>
          <p>After receiving oral constructive criticism, I feel optimistic.</p>
        </list-item>
        <list-item>
          <p>Oral constructive criticism have such a great contribution for my motivation to learn English</p>
        </list-item>
        <list-item>
          <p>My main reason to study hard is oral constructive criticism that I receive.</p>
        </list-item>
        <list-item>
          <p>Oral constructive criticism motivates me to get a good score.</p>
        </list-item>
        <list-item>
          <p>Oral constructive criticism makes me feel motivated to be a good learner.</p>
        </list-item>
        <list-item>
          <p>I want to improve my performance, because I don’t want to receive oral constructive criticism from my faculty members.</p>
        </list-item>
        <list-item>
          <p>I want to improve my performance, because I want to receive oral constructive criticism from my faculty members.</p>
        </list-item>
      </list>
      <p id="_paragraph-133">Appendix 2: Items of the Interview</p>
      <p id="_paragraph-134">(Adapted from <ext-link id="_external-link-58" ext-link-type="uri" xlink:href="">Fong et al., 2016</ext-link> )</p>
      <list list-type="bullet" id="list-0497e0ecc742af309d2fa60e079140b6">
        <list-item>
          <p>Why do/don’t you believe that oral constructive criticism is important for your performance in learning English?</p>
        </list-item>
        <list-item>
          <p>Why do you feel tired after receiving oral constructive criticism? (This question also applies for discomfited worried, pleased, and hope. Depending on students’ emotional reaction on oral constructive criticism)</p>
        </list-item>
        <list-item>
          <p>Do you always feel that way after being criticized constructively?</p>
        </list-item>
        <list-item>
          <p>Why do/don’t you think that oral constructive criticism contributes that much for your motivation in learning English?</p>
        </list-item>
        <list-item>
          <p>Can you tell me the way of getting a good score by means of receiving oral constructive criticism?</p>
        </list-item>
        <list-item>
          <p>Why do you avoid receiving oral constructive criticism in the teaching and learning process?</p>
        </list-item>
        <list-item>
          <p>Why do you want to receive oral constructive criticism in the teaching and learning process?</p>
        </list-item>
      </list>
    </sec>
  </body>
  <back />
</article>