Academia.eduAcademia.edu

test-wiseness

description10 papers
group0 followers
lightbulbAbout this topic
Test-wiseness refers to the ability of individuals to utilize their knowledge of test-taking strategies and formats to enhance their performance on assessments. It encompasses skills such as understanding question types, managing time effectively, and employing elimination techniques, which can lead to improved scores independent of actual content knowledge.
lightbulbAbout this topic
Test-wiseness refers to the ability of individuals to utilize their knowledge of test-taking strategies and formats to enhance their performance on assessments. It encompasses skills such as understanding question types, managing time effectively, and employing elimination techniques, which can lead to improved scores independent of actual content knowledge.

Key research themes

1. How does test-wiseness influence test-taking performance and can it be effectively enhanced through training?

This area investigates test-wiseness as a cognitive ability and a strategic skillset that individuals use to navigate test formats, differentiate correct answers, and optimize their test results beyond raw content knowledge. Understanding the nature of test-wiseness and its teachability is crucial as it impacts test validity and fairness by possibly inflating or deflating scores based on strategic test behavior rather than actual subject mastery.

Key finding: The paper conceptualizes test-wiseness as a specific cognitive skill distinct from guessing or risk-taking and capable of improvement via targeted training. It reports that instructional programs focusing on test-taking... Read more
Key finding: This study empirically identifies common test-taking strategies used by students, distinguishing between effective ('test-wise') strategies—like excluding incorrect options and thoroughly reading instructions—and ineffective... Read more
Key finding: This work demonstrates that brief interventions teaching test-taking strategies (test-wiseness) significantly improve standardized numeracy test performance among primary school students. The findings caution against... Read more

2. How can psychometric and cognitive models capture and explain test-wiseness effects in multiple-choice and adaptive testing contexts?

This theme explores formal models and empirical methods to disentangle actual ability from test-taking strategies (test-wiseness), especially in computer adaptive testing (CAT) and multiple-choice exams. Developing models that quantify guessing, aberrant responses, and strategic elimination can improve the accuracy of ability estimation and test fairness.

Key finding: Using a mixture of binomial models reflecting different levels of incorrect answer elimination, the study quantifies test-wiseness in multiple-choice exams, finding that about 26% of responses correspond to random guessing,... Read more
Key finding: This CAT simulation study shows that aberrant responses such as lucky guesses and careless errors bias ability estimation, but modeling these via a four-parameter logistic (4PL) IRT model that incorporates an inattention... Read more
Key finding: The study establishes that adaptive test features, notably item difficulty sequencing, impact test takers' perceived performance and reactions, mediating motivation, satisfaction, and anxiety. The research suggests that... Read more

3. What approaches can improve the prediction, measurement, and evaluation of test-related behaviors like test-wiseness and their impact on testing outcomes?

This research cluster focuses on operationalizing, predicting, and evaluating test-wiseness and related constructs such as testedness and flakiness through empirical metrics, machine learning, and large-scale empirical studies. It addresses the challenge of measuring test-taking constructs that influence testing outcomes, aiming to enhance test quality, security, and interpretability.

Key finding: By integrating coverage and test suite size into a novel testability metric and leveraging 262 software metrics with machine learning, this study achieves robust prediction (R²=0.68, MSE=0.03) of source code testability. This... Read more
Key finding: Through a systematic review, this paper highlights limited maturity and lack of empirical validation in knowledge on software testing techniques, pointing to a need for stronger empirical studies in real-world settings. The... Read more
Key finding: This research introduces an approach to predict flaky (non-deterministic) tests via natural language processing of test code vocabulary. Achieving an F-measure of 0.95, it evidences that linguistic patterns in test code... Read more
Key finding: By fine-tuning CodeBERT on test case source codes, Flakify predicts flaky tests more accurately (precision and recall improvements of 10 and 18 percentage points, respectively) than prior white-box methods that use production... Read more

All papers in test-wiseness

Three variables which affect students' achievement test scores and which can be manipulated prior to test administration are discussed: testwiseness, practice tests, and test practice. Findings were presented from literature reviews.... more
This research examines the implementation and efficacy of Islamic Religious Test-Taking Strategies (RTTS) in mitigating test anxiety experienced by Saudi EFL students during reading comprehension assessments. A methodologically robust... more
In 2008, the implementation of the National Assessment Program -Literacy and Numeracy (NAPLAN) commenced in all schools across Australia. This assessment of mathematical and literacy standards across Australia raised questions about the... more
This conference paper was originally published as: Cranley, L., & Hine, G. (2016). Are there any winners in high-stakes mathematics testing? A qualitative case study exploring student, parent and teacher attitudes towards NAPLAN numeracy... more
Technology is crucial for teaching and learning in the 21st century. However, many pre-service teachers (PSTs) feel unprepared to utilize digital literacy (DL) in their future classes. This study explored PST’s perceptions of their DL... more
Black middle school students in the United States continue to perform poorly on standardized reading achievement tests in comparison to other racial and ethnic groups. The purpose of this research study was to examine the effectiveness of... more
This case study describes how one autistic learner, an 11-year-old boy, became a co-researcher with university literacy instructors to investigate how hypermedia can help him develop language and literacy skills. Data was collected for... more
This study aimed to evaluate the psychometric properties of the INAP-L instrument by applying the Rasch model. The psychometric evaluation includes item calibration and differential item functioning (DIF) assessment. Participants in this... more
This paper aims to draw reliable conclusions regarding yes-no questions and wh-questions in English and Albanian spoken discourse. The study outlines the differences and similarities in these question types between the two languages.The... more
Research methodology courses have become an important requirement for students in many undergraduate programs in Saudi Arabia. The purpose of this case study is to explore students’ perceptions of using collaborative learning (CL) in a... more
This research was intended to analyze the effect of Reading Aloud and Vocabulary Enrichment on students’ English-Speaking Skills. A survey method was applied to get accurate information about the research respondents. The population was... more
Two mathematics teacher educators (MTEs) discuss the mathematical contexts generated by prospective teachers (PTs) when pushed to look for relevant mathematics in their lives and communities. Through collaborative teacher action research... more
Background: Test score pollution explains how multifaceted factors affect the truthfulness of a test score interpretation. The pressure to raise test scores has resulted in practices which pollute the inferences we make from these scores.... more
This research investigates the topic of dynamic assessment (DA) in an Indonesian setting and to a specific degree of competence to extract key facts. In the first phase of the investigation, quantitative data were collected, and analytic... more
The present study aims to explore how the use of translated Saudi folk narratives could help improve Saudi EFL learners' reading and speaking skills. (41) EFL elementary-level students from Prince Sattam bin Abdulaziz University were... more
This study aimed to evaluate the psychometric properties of the INAP-L instrument by applying the Rasch model. The psychometric evaluation includes item calibration and differential item functioning (DIF) assessment. Participants in this... more
This research investigates the topic of dynamic assessment (DA) in an Indonesian setting and to a specific degree of competence to extract key facts. In the first phase of the investigation, quantitative data were collected, and analytic... more
The Therapy Box is a behavioral intervention being researched to determine its effectiveness as a Response to Intervention (RtI) Tier 2 and Tier 3 behavioral intervention for identified students. The Therapy Box assists students with... more
It is highly recommended that educators know the importance of test-wiseness and test-unwiseness strategies which impact learners' performance on tests. This study aims to identify the common strategies learners adopt to achieve a... more
It is highly recommended that educators know the importance of test-wiseness and test-unwiseness strategies which impact learners' performance on tests. This study aims to identify the common strategies learners adopt to achieve a... more
It is highly recommended that educators know the importance of test-wiseness and test-unwiseness strategies which impact learners' performance on tests. This study aims to identify the common strategies learners adopt to achieve a high... more
Background: Test score pollution explains how multifaceted factors affect the truthfulness of a test score interpretation. The pressure to raise test scores has resulted in practices which pollute the inferences we make from these scores.... more
Background: Test score pollution explains how multifaceted factors affect the truthfulness of a test score interpretation. The pressure to raise test scores has resulted in practices which pollute the inferences we make from these scores.... more
This paper explores a study completed with 1 st grade students while a five-week mindfulness unit was implemented in their classroom. The paper discusses tactics for teaching mindfulness strategies to students and results observed in the... more
This paper brings together educational proposals based on a framework derived from the perspectives of historic-cultural and genetic-cultural theory. This framework enables us to specify the goals, realities and alternatives for renewal... more
Two mathematics teacher educators (MTEs) discuss the mathematical contexts generated by prospective teachers (PTs) when pushed to look for relevant mathematics in their lives and communities. Through collaborative teacher action research... more
This paper focused on the notion of test score pollution and elaborated on different sources of test score pollution. These sources were test preparation, situational factors, contextual factors, disproportional importance attached to... more
Recommended Citation Russo, James A. (2019) "The impact of a short test-wiseness intervention on standardised numeracy assessment scores: A cautionary tale about using NAPLAN growth data to evaluate primary schools," Networks:
Teacher efficacy measures a teacher's perception of his or her capacity as a teacher and impacts teacher behavior in a number of different ways. This study examined teacher efficacy as well as pedagogical beliefs/practices in pre-service... more
Part of the Curriculum and Instruction Commons, Elementary Education and Teaching Commons, Higher Education and Teaching Commons, Junior High, Intermediate, Middle School Education and Teaching Commons, Other Education Commons, Other... more
Merely, introducing new technologies into the classroom does little to address the needs of students-while it might create a welcome instructional environment for them, it does not address the compelling "elephant in the room. " Being... more
Our topic became: pacing the curriculum in the context of school realities. Our 'study' stemmed from our long conversations about teaching and our observations about the changes we had each made over the years to adjust to the ebb and... more
Two early career literacy and language teacher educators who have digital literacies at the core of their professional and scholarly pursuits share their quest to enhance their online instruction. The authors wanted to identify one new... more
Field experience seminars, discussion-based courses paired with school-based practicum experiences, provide a space for teacher candidates to discuss the theories they study in their university classes and the practices they observe and... more
One goal of early childhood teacher educators is to teach in ways that model teaching young children. What better way to study curriculum than to design it? This article describes a graduate early childhood curriculum course in which the... more
Introduction: After hearing much about the Finnish education system, we recently jumped at the opportunity to visit the country to explore schools and education organizations as members of a professional organization tour. In this... more
Building on the rich tradition of 'teacher as researcher' in mathematics education, I describe a study undertaken whilst working as a mathematics specialist in an Australian primary school. The focus of the study was on examining whether... more
Download research papers for free!