Lost in translation: The role of language in assesment design - AIF Skip to content

AIF
  • About Us
    • Mission Vision Values
    • History
    • Impact in Motion
    • Programs at a Glance
    • People
    • Knowledge Center
    • News and Updates
    • Blog
    • Financials
  • Our Work
    • Education
      • Digital Equalizer
      • Learning And Migration Program
    • Livelihoods
      • Ability Based Livelihood Empowerment
      • Market Aligned Skills Training
    • Leadership Development
      • Banyan Impact Fellowship
    • Integrated Programs
      • Support Adolescent Health Education & Livelihood Initiative
      • Skilling Nutrition Education and Health
    • Humanitarian Relief
      • AIF COVID-19 Relief Response
      • COVID Rehabilitation Fund
      • The First Million
    • Public Health
      • Maternal And Newborn Survival Initiative
  • Get Involved
    • Explore Our Chapters
    • Join Circle of Hope
    • Become a Young Professional
    • Create a College Chapter
    • Become a Youth Ambassador
    • Become a Corporate Partner
    • Start Your Fundraiser
    • Join a Mission Trip
    • Join an Event
    • AIF Arcade
  • Contact Us
    • Donor Portal
    • Inquiries
    • Careers
  • Ways To Give
    • Light A Lamp
    • Donate Crypto
    • Give Stock
    • Give from DAF
    • Become a Monthly Donor
    • Start a Birthday Fundraiser
    • Leave a Legacy
    • Donate in India
  • Donate Now
    • Give Once
    • Give Monthly
    • Humanitarian Relief
      • Donate to Nepal Flood Relief
      • Donate to Assam Flood Relief
    • Give to the Galas
      • Bay Area Gala
      • New England Gala
      • New York Gala

July 28, 2025

Lost in translation: The role of language in assesment design

Cora Woloson Uncategorized

Our Crisis

“Hindi nahi aati hai.” She doesn’t know Hindi. I stiffen.  One of our first written pilot tests for the entrepreneurial assessment, and I heard this phrase. “Hahaha, Kuch nahi samajsukti hai!!” She doesn’t understand anything! I whip around to face Mandina and Aarti, and to my surprise, they’re not talking to me, an American working in India; they’re actually talking to each other, trying to address a question they can comprehend. f. Having spent months developing this tool as a Banyan Impact Fellow with ACCESS Development Services, this was our first written attempt at testing its questions and relevance. Yet here was our reality: Mandina struggling to comprehend the jargon, as Aarti read the questions over her shoulder, translating lofty phrases into something more relatable. 

Women entrepreneurs Soni and Vijay Luxmi working together to understand the wording of the questionnaire in the first digital piloting session.
Photo Credit: Author

It reminded me of my own language journey, coming to India on a Critical Language Scholarship, where my first weeks of intensive Hindi study at the American Institute of Indian Studies were filled with formal grammar, traditional verbs, and textbook nouns. I quickly learned that many of these “correct” phrases rarely appear in everyday conversation. Returning to India this fall as a Fellow and again as a student with AIIS, thanks to the Banyan Impact Fellowship Professional Development Grant, I’ve seen how language opens doors and how formal study can fall short in the face of colloquial realities. That same gap was staring us down now. Our first digital pilot revealed that even native Hindi speakers struggled with our questionnaire, not because of translation, but because of how alien the formal vocabulary sounded. The wording we had chosen made our tool inaccessible, a lesson I knew too well from my own experience of learning, unlearning, and learning again.

Language is one of the key components to consider when designing inclusive tools. While we faced specific challenges with translation, these issues presented the far most difficult question. Comprehension. How do you ask questions in a way that they are understood? And at what stage of the research process does the specific wording of a question need to be taken into account? For my team at ACCESS Development Services, aiming to create tools for women operating micro-businesses in Delhi, the divergence of the colloquial language from the formal language created a critical issue in access and comprehension, revealing the larger issues of needing to consider participant comprehension at the center of tool design. 

The Process

While building the enterprise assessment, we aimed to make a tool for women by women. Field visit discussions with groups of women entrepreneurs were followed by near-endless idea-generating and brainstorming sessions. Question by question, the team at ACCESS Development Services built our assessment tool. By the time we were ready to pilot, we had an entire Excel spreadsheet that automatically generated scored responses. Writing the tool in English, we didn’t consider language, because at this point, we thought we didn’t need to.

Banyan Fellow Cora sitting with Coworker Gitima Kakati facing Nisha Devi as they pilot the assesment tool in it's first open format.
Banyan Fellow Cora sitting and ACCESS coworker Gitima Kakati interviewing Nisha Devi at her general store in Gurugaon, piloting the assesment tool in it’s first open format.
Photo courtesy of ACCESS Development services Shika Kumar

The initial test of the questionnaire was considered a “content-focused pilot” (Avnish). Manually rolling out the questionnaire with our field staff, our first sessions were open-ended, relying on the facilitator to translate questions and clarify issues in real time. Aiming to gain valuable feedback on the questionnaire and its comprehension, one-on-one shop visits with Women Entrepreneurs allowed us to ask our questions, identify shortcomings and knowledge gaps, and use our better understanding of the questionnaire scope to rewrite answer options to better reflect the user experience.

 

Phases of Translation

To anyone who’s taken a business assessment, you’re familiar with jargon. The technicalities of business terminology often create barriers for assessments written in someone’s native tongue. While our first content-focused pilot testing was translated on the fly, we didn’t realize that there was actually double translation taking place: One in language and the other in terminology, often changing how we pose technical questions, such as “Which transactions does your business collect?” into the Hindi version of “How do you take money?”.  In these questions alone, we’re beginning levels of teaching and breaking down bits to fix and understand the experience of the business and its functions. While we collected data on the diverse answers and experiences of women, we didn’t consider the larger scope of language and comprehension, and how questions matter.

Standard Translation for assessment generally follows three key steps…

Step1. Forward translation

 This refers to the translation from the language of the research team to the local language(s). This process can take a few days to a few weeks, depending on the complexity of the questions in the survey instrument (Avnish, pg1).

 After more than 20 one-on-one piloting sessions, we began review sessions, expanding answer options and adjusting scoring. What are women telling us? Yes, we took that into account, but how were they saying it? It wasn’t our key objective. It was only after we agreed on the contents of the questionnaire that we then moved on to initiate the process of taking our English written questionnaire and sending it to app developers to be translated

Rishabh looking of the shoulder o team mebers as they sitin the office filling out the assesment on their phones.
Access Development services team members testing the Digital questionnaire before piloting in the field. (Left – right Rishab Goswami, Mohamade Arif, Karuna Kumari , Shikha Kumari) Photo credit: Author

Before deploying our questionnaire in its digital Hindi format in the field, we first tested our tool internally with our team. Working with our program managers and field staff, people who work day in and day out with our target base, we collected a great amount of valuable feedback. Questions and terms were only those that were too complete, an obsolete couple of words, and so questions were altered and adjusted. It wasn’t until our first round of piloting with groups of 20+ women entrepreneurs that we realized that how questions were worded mattered as much as what was asked.   

English business jargon that had been translated into proper, traditional, rarely used Hindi made the questionnaire confusing in three ways. Needless to say, Aarti and — we’re not the only victims that day. Our first set of piloting, group style with a facilitator assisting every 5 participants, revealed extensive issues in questionnaire comprehension, with participants often relying on one another to understand the questionnaire as our staff flurried to answer questions and collect all of the feedback. The problem? We had only done one function of the three-fold translation process. 

 

Step 2. Back translation

“Once researchers receive the first translation, they send only the local language version to a different translator, who translates it back to the language of the research team”  (Avnish, pg1).

5 women entrprenuers sitting in a circle as ACCESS intern, Nitya Agarwal explains one of the question components .
ACCESS intern, Nitya Agarwal explaining one of the question components to her pilot testing group in Vijender Singh Murti Tukalkabaad.
Photo credit: Author

With digital piloting taking place in 5 separate sections, covering over 65 participants, we quickly realized the questionnaire language needed to be altered. After each session, the data information of facilitators would report on which terms were obsolete or incomprehensible. For instance, business could be written just as business because women understand that better.  But we also took note of the ways that the actual questions caused confusion. While our field facilitators recognized some of the confusing terms, we were far from capturing the vocabulary needed for comprehension in diverse regions across Delhi.

Regrouping after the digital pilot, it was clear to the team that serious alterations had to be made. But by taking the finalized version of our Hindi questionnaire, we then had one of our project managers, our field facilitators with translation expertise and years of experience with nano enterprise in rural, urban, and peri-urban spaces, to translate the assessment. Taking the feedback from our piloting sessions and revising our most finalized version of the Hindi questionnaire into a more comprehensive vocabulary, aiming to use words that are part of everyday language, rather than focusing on accurate Hindi translation. The changes were significant. 

  1. Reconciliation: 

“This refers to the process of comparing the original questionnaire to the back-translated questionnaire. In this stage, researchers should highlight any discrepancies and categorize them as either minor (like wording issues), or significant (like changes in the meaning of a question)” (Avnish).

Banyan Impact Fellow Cora Woloson leaning in as a women entreprenuer in her group asks her a question about the assesment tools meaning.
Banyan Impact Fellow Cora listens as participant Ruby explains her inquiry about the assessment tool. Photo courtesy of ACCESS Development Services team member Karuna Khosla

Before deploying for a second round of digital piloting, we did back translation. Seeing the ways in which the terminology needed to be explained and ensuring that the questions were still collecting the intense insights and recommendations. Working with the team to discuss discrepancies in the two versions, making sure to reconcile them. To be frank, the differences were stark. Working with the pilot team, we had to revisit the way we explain questions, asking ourselves, “What does comprehension really mean?”

Lucky for us, the nature of the Enterprise assessment tool is Unique. An instrument that aims to fill the gap between tools that assess the individual capabilities of an individual with those that measure the overall success of an enterprise. After our first digital pilot, we revisited the purpose of an entrepreneurial assessment for women operating businesses at the last mile. Its main aim? Being a tool that can teach. A tool that can enhance one’s understanding of themselves and that of their business. A tool that can grow and expand with the user, first asking them baseline simple questions about savings and then expanding if they demonstrate understanding to ask more technical questions about banking and financial practices. 

Key Learnings 

Our work with the enterprise assessment reaffirmed a critical lesson: comprehension is central to effective tool design. Translation isn’t just about words—it’s about how meaning is understood and lived by the people we hope to reach. Through piloting, back-translation, and reconciliation, we learned that meaningful questions must speak the language of the user’s experience, not just their dialect. By embracing multiple rounds of piloting, feedback, and back-translation, we learned to see our tool not as a finished product, but as a growing, adaptive resource. This journey would not have been possible without the strength, patience, and dedication of our ACCESS Development Services team. Their willingness to test, revise, and refine ensured we addressed every gap, no matter how small. We are proud of their relentless commitment to creating a tool that not only measures but empowers—and we remain dedicated to this process as we continue improving the tool for the women it was built to serve.

 

 

Works Cited

Aizawa, Ikuya. The role of language on assessment outcomes: an analysis of calculation and explanation questions in science classrooms. Routledge Taylor and Francis Group, 2024. Taylor and Francis online, https://www.tandfonline.com/doi/full/10.1080/02602938.2024.2353865#abstract.

Avnish. “Questionnaire Translation | Dime Wiki.” Dime Wiki, 13 April 2021, https://dimewiki.worldbank.org/Questionnaire_Translation. Accessed 21 July 2025.

Depka, Eileen. “What a Difference Our Words Make! Asking Questions that Require Understanding.” All Things Assessment, 14 November 2017, https://allthingsassessment.info/2017/11/14/asking-questions-for-deeper-understanding/. Accessed 21 July 2025.

Author

  • Cora Woloson
    Cora Woloson

    Cora is serving as an American India Foundation (AIF) Banyan Impact Fellow with ACCESS Development Services of New Delhi. For her Fellowship project, Cora will focus on facilitating the expansion and sustainable growth of micro women-owned enterprises, primarily in food manufacturing and handicrafts, in New Delhi. Cora's fascination with emerging economies began during her 2019–20 Rotary International Youth Exchange in Mumbai, India. Witnessing the dynamic ecosystem of India’s financial capital, she developed a keen interest in the institutional gaps that hinder small business owners and entrepreneurs in India's urban settings. As an undergraduate, Woloson developed an appreciation for the vital role women play in International development as she explored the complexities of emerging markets in the different political landscapes of the developing world. In her final year at SUNY Geneseo, Cora won a Critical Language Scholarship (CLS), allowing her to return to India for an immersive language program at the American Institute of Indian Studies in Jaipur, where she deepened her understanding of local culture through her growing proficiency in Hindi. After college, Woloson worked as the Development Coordinator for the Desai Foundation, where she refined her grant writing skills while supporting programs that empower women in rural India through health, livelihood, and menstrual equity initiatives. Cora is excited to return to India’s urban landscape and support ACCESS Development Services' mission of cultivating sustainable livelihoods for India’s underserved communities.

    View all posts
cora-woloson

Cora is serving as an American India Foundation (AIF) Banyan Impact Fellow with ACCESS Development Services of New Delhi. For her Fellowship project, Cora will focus on facilitating the expansion and sustainable growth of micro women-owned enterprises, primarily in food manufacturing and handicrafts, in New Delhi. Cora's fascination with emerging economies began during her 2019–20 Rotary International Youth Exchange in Mumbai, India. Witnessing the dynamic ecosystem of India’s financial capital, she developed a keen interest in the institutional gaps that hinder small business owners and entrepreneurs in India's urban settings. As an undergraduate, Woloson developed an appreciation for the vital role women play in International development as she explored the complexities of emerging markets in the different political landscapes of the developing world. In her final year at SUNY Geneseo, Cora won a Critical Language Scholarship (CLS), allowing her to return to India for an immersive language program at the American Institute of Indian Studies in Jaipur, where she deepened her understanding of local culture through her growing proficiency in Hindi. After college, Woloson worked as the Development Coordinator for the Desai Foundation, where she refined her grant writing skills while supporting programs that empower women in rural India through health, livelihood, and menstrual equity initiatives. Cora is excited to return to India’s urban landscape and support ACCESS Development Services' mission of cultivating sustainable livelihoods for India’s underserved communities.

Post navigation

Previous Post Previous
Next PostNext

You Might Also Like

October 26, 2026
Bring your Binoculars, We’re Playing Bingo
Street that Author lived on
Idliman, Blinkit, and Everyday Adventures
April 15, 2026
Youth Engagement in Panchayati Raj: Insights from Sawai Madhopur

Blog Categories

  • AIF
  • AIF's Barrier Breakers
  • CEO's Corner
  • Chapters
  • Circle of Hope
  • Education
  • Livelihoods
  • Public Health

Latest Posts

  • A group picture of the BIF 2026-2027 cohort with the banner which says "Orientation Week in Delhi".
    Beginning With Questions, Not Answers!
    November 6, 2026
  • Meet Sidhu – Education, DE
    October 26, 2026
  • Meet Nisha – MANSI
    October 26, 2026

Support Our Work

Help transform the lives of millions of people in India.

Donate Now  See Your Impact in Motion

Connect With Us

Stay updated on the latest news and help spread the word.

AIF-logo-white-300x99

The American India Foundation is a 501[c][3] organization committed to improving the lives of India’s underserved, with a special focus on women, children, and youth.

DONATE NOW
NEW YORK | CALIFORNIA
  • About Us
    • Mission Vision Values
    • History
    • Impact in Motion
    • Programs at a Glance
    • People
    • Knowledge Center
    • News and Updates
    • Blog
    • Financials
  • Our Work
    • Education
      • Digital Equalizer
      • Learning And Migration Program
    • Livelihoods
      • Ability Based Livelihood Empowerment
      • Market Aligned Skills Training
    • Leadership Development
      • Banyan Impact Fellowship
    • Integrated Programs
      • Support Adolescent Health Education & Livelihood Initiative
      • Skilling Nutrition Education and Health
    • Humanitarian Relief
      • AIF COVID-19 Relief Response
      • COVID Rehabilitation Fund
      • The First Million
    • Public Health
      • Maternal And Newborn Survival Initiative
  • Get Involved
    • Explore Our Chapters
    • Join Circle of Hope
    • Become a Young Professional
    • Create a College Chapter
    • Become a Youth Ambassador
    • Become a Corporate Partner
    • Start Your Fundraiser
    • Join a Mission Trip
    • Join an Event
    • AIF Arcade
  • Ways To Give
    • Light A Lamp
    • Donate Crypto
    • Give Stock
    • Give from DAF
    • Become a Monthly Donor
    • Start a Birthday Fundraiser
    • Leave a Legacy
    • Donate in India
    • Contact Us
      • Donor Portal
      • Inquiries
      • Careers
  • Donate Now
    • Give Once
    • Give Monthly
    • Humanitarian Relief
      • Donate to Nepal Flood Relief
      • Donate to Assam Flood Relief
    • Give to the Galas
      • Bay Area Gala
      • New England Gala
      • New York Gala
charity-navigator
gep-logo
guidestar
non-profit-logo
© Copyright 2000-2026 American India FoundationTM is a 501(c)(3) organization (EIN: 13-4159765)
Privacy Policy
  • PRIVACY
  • COOKIES
  • TERMS
  • PRICING
  • API
  • DATA

Follow us:

Subscribe to newsletter

Become a Fundraiser or Donate to Light a LAMP

Privacy & Cookies Notice
We use cookies and similar technologies to collect information and to personalize the site. By continuing to use this site, you consent to the placement of these cookies and similar technologies and to our privacy practices.

Read our updated Privacy Notice to learn more.
Accept all cookies  Cookie Settings
Manage consent

Privacy Overview

This website uses cookies to improve your experience while you navigate. Out of these, the cookies categorized as necessary are stored on your browser as they are essential for the working of the basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. These cookies ensure basic functionalities and security features of the website, anonymously.
Functional
Functional cookies help to perform certain functionalities like sharing the content of the website on social media platforms, collect feedbacks, and other third-party features.
Performance
Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.
Analytics
Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics the number of visitors, bounce rate, traffic source, etc.
Advertisement
Advertisement cookies are used to provide visitors with relevant ads and marketing campaigns. These cookies track visitors across websites and collect information to provide customized ads.
Others
Other uncategorized cookies are those that are being analyzed and have not been classified into a category as yet.
SAVE & ACCEPT
55616053293_f0e9c8650d_c
55616127089_e0f11e71d8_c
55614907547_85a67feb8d_c
55615915416_88a4f1bcfa_c
55616052283_0ae34ffa70_c
55616125884_92421a970f_c
55614907782_93773f3a09_c
55616054643_60413bfa1f_c
55614908742_b834e475ff_c
55616128124_3b1605d6c1_c
55616128644_5f7708e2b0_c
55615918406_92f3408182_c
55616331635_3925cb6a26_c
55616055278_52bb8ab3a0_c
55616057133_79fb911de2_c
55615917651_df80b217d8_c
55616056903_cd387ab4c8_c
55616057353_72727dca9d_c
55616333395_785cf5b028_c
55616333590_922d63cbab_c
55326088507_cfb3c39d82_z
55327217314_d3170dfbeb_z
55327418330_706ee45295_z
55326999221_dd05aa938f_z
55327215664_316a7e95a3_z
55327159633_e6611a9578_z
55326086597_bf1f2dafc8_z
55327161938_31321a5d4f_z
55327416140_066c9bbe4b_z
55327216419_f1fd1dc9cb_z
55326994101_e3409674c2_z
55327154373_c75309513b_z
55327156008_5e9316ba57_z
55327002316_48cd65ca3b_z
55327217634_4f1bb2d997_z
55327217854_904e0ea6ee_z
55327217139_28151b7ca8_z
55327002721_13df3dba30_z
55327418650_a3eaf0175d_z
55327417775_25a3efe985_z
55327418585_69454371cc_z
55295022115_495c9bc5d8_b
55293699227_1100d34999_z
55294998903_fcf6276958_z (1)
55295257085_4189543693_z
55293699602_a44b8cf1b3_z (1)
55294998823_22b1f4831f_z
55294844896_a81ccb1846_z (1)
55294611521_e14e12d38c_z
55294999178_1357596fb5_c
55294844896_a81ccb1846_z
55293935307_955ab8d3f0_z
55295085929_402beaf049_z
55294844171_327a23d9d0_z
55294843796_7eee300eef_z
55293934807_983306db41_z
55293934922_97490ccb18_z
55294997918_bd68b50a00_z
55295255930_87514247df_z
55294843206_9ee356b6f9_z
55294842516_c20d7c699a_z
55293932587_eb9c10dc05_z
55294841536_5c7842d9f8_z
55295254900_b32dfbd193_z
55294998903_fcf6276958_z
55293699602_a44b8cf1b3_z
55294845186_3b04736eb0_z
55295254255_0b29cda9a9_z

Start Your Collegiate Alliance Today!

Connect with us to learn more, request a fundraising toolkit, and ask questions about forming a collegiate alliance.

Subscribe for the Newsletter

Subscribe

Keep up with the latest AIF news and updates on our programs, events and campaigns

-

Please share the name and email of the person you would like to recommend:

To automatically download the marketing collateral, please share the following details:

Skip to content
Open toolbar Accessibility Tools

Accessibility Tools

  • Increase TextIncrease Text
  • Decrease TextDecrease Text
  • GrayscaleGrayscale
  • High ContrastHigh Contrast
  • Negative ContrastNegative Contrast
  • Links UnderlineLinks Underline
  • Readable FontReadable Font
  • Reset Reset