Discussion Search Results



Search results in topics:

Viewing 15 topics - 1 through 15 (of 59 total)

Search results in replies:

  • Author
    Replies
  • #2956 Reply

    Frannie Noble
    Keymaster

    Our Save the Children Research Specialist, Jonathan Seiden, replied:

    I would say it depends on your research questions. What are you trying to answer by collecting this data? Having said that, 120 is a pretty small sample, so I would probably recommend doing a full census of them.

    #2939 Reply

    Frannie Noble
    Keymaster

    No, IDELA is an open source tool available to the public free of cost. Save the Children does ask IDELA users to sign a Memorandum of Understanding (MoU) to clarify how IDELA should be used and to encourage partners to share information and learning about ECCD. Information about the MoU is available on the IDELA website.

    #2958 Reply

    Frannie Noble
    Keymaster

    Lauren Pisani, a Research Advisor with Save the Children, also replied:

    Ideally we want the children and parents to be a 1-to-1 match. So for each child, you assess one caregiver. This allows you to look at many different aspects of equity in your analysis.

    #3568 Reply

    Fabiola Lara
    Keymaster

    Both translation and adaptation need to be taken into account before using IDELA in your context. IDELA is not a “ready-to-use” assessment, meaning that it not only needs translation to make sure children understand the activities they will be doing during the assessment but also adaptation needs to take place to ensure that objects discussed are familiar to children. See the adaptation manual for additional guidance on where it is appropriate to adapt.

    #3582 Reply

    Fabiola Lara
    Keymaster

    Yes, and you should. It is very important that you pay careful attention to the instructions, and read all questions to children exactly as they appear. Throughout the guide you will see two forms of type or font. Bold type in boxes indicates things the assessor must say to the child out loud. Please read this type aloud to the child completely and exactly as it appears. This is important to ensure that the data will be collected in a standardized manner across all children.

    Italic type indicates instructions for the assessor. Do not read these instructions aloud to the child. You should follow these instructions exactly as they are written.

    • This reply was modified 5 years, 4 months ago by Fabiola Lara.
    • This reply was modified 5 years, 4 months ago by Frannie Noble.
    #3584 Reply

    Fabiola Lara
    Keymaster

    Lauren Pisani, a Research Advisor with Save the Children and one of the developers of IDELA, replied:

    The core IDELA tool does not include indicators on learning involvement or child-wellbeing, but we do try to address these important topics in a few different ways. The IDELA tool has optional items about children’s learning approaches (persistence, curiosity, attention, etc.). The items have not been validated as part of the core tool, but we are continuing to test and analyze their utility. In addition, we encourage teams to complement the IDELA tool with other measures that do measure these topics. For example, IDELA has been alongside classroom environment tools like the ECERS as well as child well-being measures that address children’s stress and psychosocial wellbeing

    #3591 Reply

    Fabiola Lara
    Keymaster

    Probing and repeating are critical components of administering the IDELA tool, but it is important to clearly understand when and how much is appropriate. Too little probing/repeating might bias results towards an incorrect response. A child could have known the answer but not understood the question or responded to the wrong question. Too much probing/repeating might bias results towards a correct response. A child who receives many opportunities to respond may be helped by the extra chances.

    Probing should be used to clarify your understanding of a child’s response. Young child are still developing their verbal abilities so sometimes they speak very softly or say things that are unclear. We probe to make sure we clearly understand the child and their intended response.

    #3262 Reply

    Fabiola Lara
    Keymaster

    Translation is important as children need to understand what they are being asked but adaptation for contextual relevance is equally important. It is highly advisable that an expert group reviews the IDELA tool well in advance of the first IDELA training. No major adaptations should take place during this time as this affects reliability. However, things like adapting the greeting and consent section, changing animals/fruits mentioned in the tool to others more familiar to children based on their surroundings, etc. is fine.

    #3479 Reply

    Fabiola Lara
    Keymaster

    You can find more information about the validation process that IDELA underwent on this site using the following links:

    Measuring School Readiness Globally:

    Measuring School Readiness Globally

    Developing and Validating the International Development and Early Learning Assessment: https://idela-network.org/resource/developing-and-validating-idela/

    Assessing the Construct Validity of IDELA: https://idela-network.org/resource/assessing-the-construct-validity-of-save-the-childrens-international-development-and-early-learning-assessment/

    #3475 Reply

    Fabiola Lara
    Keymaster

    Probing and repeating are important when administering the IDELA, but it is equally important to understand when and how much is appropriate. Too little probing/repeating might bias results towards an incorrect response. A child could have known the answer but not understood the question or responded to the wrong question. Too much probing/repeating might bias results towards a correct response. A child who receives many opportunities to respond may be helped by the extra chances. In short, probing should be used to clarify your understanding of a child’s response.

    #3466 Reply

    Fabiola Lara
    Keymaster

    With an impact evaluation, you are typically trying to determine whether an intervention has had a significant effect on the treatment group compared to some kind of control or comparison group. You need a sample size that is large enough to conduct the statistical tests to determine the magnitude of the difference between the two groups.

    #3456 Reply

    Frannie Noble
    Keymaster

    Hi Sarah, We don’t have specific tablets that we endorse, but hope that the guidance below helps a bit: It comes from our Learning Research Specialist, Jonathan:

    KoBo has this available; http://help.kobotoolbox.org/collecting-data/recommended-devices-for-data-collection

    I’d recommend that tablets have at least 2GB of RAM and a 1.3GHz processor.

    #3367 Reply

    Jonathan Seiden
    Guest

    Hi Sarah,

    There are a lot of good tutorials on KoBo online. The official channel is here (with lots of great quick tips): https://www.youtube.com/channel/UC2v5y_Ln1IeH1W49lOj3vYg

    There are some longer videos online as well. But with IDELA, it’s pretty easy, because the XLSForm is already built, and you just have to add the translations into each question!

    #3366 Reply

    Sarah Strader
    Participant

    Hi Jonathan,

    Thanks so much for this tip! How easy is KoBo to program for someone that has never done software programming before?

    Thanks,

    Sarah

    #3352 Reply

    Fabiola Lara
    Keymaster

    Response from Jonathan Seiden, Learning Research Specialist:

    Currently, the methodology for creating domain-level and overall scores is quite simple.

    1) Calculate the %correct for each activity/task. Take the number of correct responses and dividing by the total possible. Note that some tasks are 0 and 1, whereas other tasks have different number of points possible. For example, for the Drawing a Triangle task, there are two items. For the first item (how many closed corners) a child can get up to 3 with possible scores 0, 1, 2, and 3, and for the second item (does it look like a triangle), the scores are 0 for incorrect and 1 for correct. So the total possible points for this task are 4.

    2) Calculate the Average % correct for each domain. Simply sum the % correct for each of the TASKS in the domain, and then divide by the number of tasks. So for the motor domain, you take (fold%correct + drawtriangle%correct + drawperson%correct + hopping%correct) / 4

    3) For the overall IDELA, simply take the average of all of the 4 core domain scores (Emergent Literacy, Emergent Numeracy, Motor, and Social-Emotional).

    Please note that there is a .do file if you plan to analyze data in Stata, and also an Excel template which will automatically calculate these scores for you. You can find them in the “Training, Data Collection and Analysis Resources” section of the “The IDELA Tool” page: https://idela-network.org/the-idela-tool/training-data-collection-analysis-resources/

Viewing 15 replies - 1 through 15 (of 70 total)
Questions about IDELA or need further information?