Skip to main content

Wayne Gray

Followers

8

Following

9

Public Views

Beep, bip, bop!!!

less

Interests

Uploads

Papers by Wayne Gray

Human performance assessment using fNIR

Proceedings of SPIE, May 23, 2005

We explore the utility of functional Near Infra Red (fNIR) technology in providing both empirical... more We explore the utility of functional Near Infra Red (fNIR) technology in providing both empirical support and a basis for assessing and predicting dynamic changes in cognitive workload within the theoretical context of computational cognitive modeling (CCM). CCM has had many successes and in recent years has expanded from a tool for basic research to one that can tackle more complex real-world tasks. As a tool for basic research it seeks to provide a model of cognitive functionality; as a tool for cognitive engineering it seeks applications in monitoring and predicting real-time performance. With this powerful theoretical tool we combine the empirical power of fNIR technology. The fNIR technology is used to non-invasively monitor regional hemodynamic activities, namely blood volume changes and oxygenation dynamics. We examined a simple auditory classification task in four different workload conditions. We monitored the blood activity in the prefrontal cortex region of the frontal lobe during the performance of the task to assess the patterns of activity as workload changes. We associated patterns of model activity with patterns of the hemodynamic data. We used ACT-R for creating the computational cognitive model. For the fNIR analysis, we used a generalized linear regression model along with time series clustering. We found that in the highest workload condition the model predicts a cognitive 'overload', which correlated well with the fNIR cluster and classification analysis, as this condition differs significantly from the other three conditions. Linear regression on a subset of the data where workload increases monotonically shows that apart from the overload condition, there was a positive relationship between increase in workload and increase in blood volume activation. In addition, individual variations in hemodynamic response suggest that individuals differ in how they process different workload levels.

Non-Intrusive Measurement of Workload in Real-Time

Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting, Sep 1, 2005

We present a new method to measure workload that offers several advantages. First, it uses non-in... more We present a new method to measure workload that offers several advantages. First, it uses non-intrusive means: cameras and a mouse. Second, the workload is measured in real-time. Third, the setup is comparably cheap: the cameras and sensors are off-the-shelf components. Fourth, we go beyond measuring performance and demonstrate that just using such measures does not suffice to measure workload. Fifth, by using a Bayesian Network to assess the workload from the various manifesting measures the model adapts itself to the individual user as well as to a particular task. Sixth, we use a cognitive computational model to explain the cognitive mechanisms that cause the differences in workload and performance.

UC Merced Proceedings of the Annual Meeting of the Cognitive Science Society Title Human Supervisory Control: A Cognitive Perspective Publication Date Human Supervisory Control: A Cognitive Perspective

Interaction for Task Instruction and Learning

Interactive Task Learning, 2019

This chapter considers the qualities of human interaction and learning that will be most effectiv... more This chapter considers the qualities of human interaction and learning that will be most effective and natural to incorporate into any interactive task learning agent, and focuses specifi cally on the interactions involved in learning from explicit instruction. At the center of this interaction is a process that brings the common ground between a teacher agent and a learner agent into alignment. Errors or misalignments to this common ground drive the interactive learning process. The importance of timing is highlighted as is the dynamics of an interaction, as a communication channel itself, in this alignment process.

Cost of Information Acquisition and Evolving Strategies

Cost of Information Acquisition and Evolving Strategies Bella Z. Veksler Rensselaer Polytechnic I... more Cost of Information Acquisition and Evolving Strategies Bella Z. Veksler Rensselaer Polytechnic Institute Wayne D. Gray Rensselaer Polytechnic Institute Michael J. Schoelles Rensselaer Polytechnic Institute Abstract: Currently, theories of judgment and decision-making lack predictive and explanatory power when it comes to the cost of information acquisition. We ran two studies intended to determine how factors that affect immediate interactive behavior influence decision-making. In particular, we varied the duration a participant had to wait before a value would appear. Our hypothesis was that when the cost of information acquisition is higher (longer wait time involved), a participant would be more likely to satisfice i.e. decide, that he/she has enough information and make a choice even when this means making a choice with incomplete information. As a result of satisficing, we should see a drop in performance. We also predicted that strategies should evolve as participants became ...

A Life-Cycle Approach to Implementing and Evaluating Army Training Programs

This report has been cleared for release to the Defense Technical Information Center (DTIC). It h... more This report has been cleared for release to the Defense Technical Information Center (DTIC). It has been given no *or primary distribution and will be available to requestors only through DTIC or other reference services such Zthe National Technical Information Service (NTIS. The views, opinions. e nd/or findings contained in this report awe those of the author(s) and should not be construed as an official Department of the Army position, Hal or decision, unls so designated by other Official documentation. 84 06 9 UN 255 .,Ji * US Arm . A SECURITY CLASSIFICATION OF THIS PAGE (l 4 7hen D..'a Fnreed) REPORT DOCUMENTATION PAGE REA INTRCTON REPORT NUMBER 2. GOVT ACCESSION NO. 3. RECI-IE T'S C AT A..O NUM.ER Research Note 84-86 / ~ 2 _____________ 4TITLE (and Subtitle) 5. TYPE OF REPORT & PERIOD CZ.,'ERE0 '20. ABSTRACr (Cautfous acrwvw*rs* afiw It neceatry ad denz~fy by block numbor) DD 'OR 1473 EDITION OF I NOV6SS IS OBSOLETE U SECURITY CLASSIFICATION OF T~,tS PAGE 'WIV7-. D-!-.ll-e~d, #~9IWO? S -5 5 -. *..v* , -4P -9. , w -W. 40 4 . % -% ~ .

A Simple Heuristic Successfully Used by Humans, Animals, and Machines: The Story of the RAF and Luftwaffe, Hawks and Ducks, Dogs and Frisbees, Baseball Outfielders and Sidewinder Missiles-Oh My!

Topics in cognitive science, 2017

Introduction to Volume 9, Issue 1 of topiCS

Topics in cognitive science, 2017

Cognitive factors in homeland defense: the role of human factors in the novel intelligence from massive data (NIMD) program

PsycEXTRA Dataset

The Intelligence Community's Advanced Research and Development Activity (ARDA) recently issued 17... more The Intelligence Community's Advanced Research and Development Activity (ARDA) recently issued 17 contracts for innovative, creative, and high-risk research to advance the state-of-the-art in technologies and methods for supporting the intelligence analyst in discovering "novel intelligence from massive data" (NIMD). An important feature of this initiative is the role it gave to cognitive factors. The Call-for-Participation said, "Thus, NIMD is about human interaction with information in a way that permits intelligence analysts to spot the telltale signs of strategic surprise in massive data sources -building tools that capitalize on human strengths and compensate for human weaknesses to enhance and extend analytic capabilities." This symposium will provide a brief overview of NIMD as well as project reports from four of the teams that won NIMD contracts. While the approaches and projects are diverse, all attempt to bring an understanding of cognitive factors and quantitative approaches to bear on improving the intelligence analyst's success at extracting hidden patterns from massive databases.

Cognitive Science Versus Cognitive Ergonomics: A Dynamic Tension or an Inevitable Schism?

Contemporary Psychology: A Journal of Reviews, 1996

Expertise and technology: Cognition and human-computer cooperation. Hillsdale, NJ: Erlbaum, 1995.... more

Redirecting direct manipulation or what happens when the goal is in front of you but the interface says to turn left?

CHI '99 extended abstracts on Human factors in computing systems - CHI '99, 1999

The feeling of directness arises when the interface permits the user to manipulate an interface o... more The feeling of directness arises when the interface permits the user to manipulate an interface object in a way analogous to manipulating the real object. However, we argue here that the essence of direct manipulation is not directness per se, but manipulation of task relevant objects in a task relevant manner. The research reported studies users of HyperCard after 20 hours of practice. We found that when users deviated flom taught strategies that 25% of the time they invented new strategies that attempted a more direct manipulation of the task object than that permitted by the design of the interface.

When using the tool interferes with doing the task

Conference companion on Human factors in computing systems common ground - CHI '96, 1996

How much time the user spends working on a task versus fiddling with the tool is an important asp... more

Test Case Selection for Evaluating Measures of Semantic Distance

With a growing number of measures of semantic distance (MSD), such as LSA, GLSA, PMI-IR, WordNet,... more With a growing number of measures of semantic distance (MSD), such as LSA, GLSA, PMI-IR, WordNet, Normalized Google Distance (NGD), etc., we find the need for a standard direct comparison of these algorithms. A one-click browsing task affords direct comparisons of two or more MSDs. In the simplest version of the task, subjects search for a target term, T, and have to choose between one of two links, A and B. A choice of link A over link B suggests that in the subject's mind, T is more similar to A than it is to B. Here we formalize a procedure to select test case triads T-A-B, such that a human choice of A over B would directly implicate that one of the MSDs being investigated accords better with human judgment than another.

Decomposing Interactive Behavior - eScholarship

Proceedings of the Annual Meeting of the Cognitive Science Society, 2001

Interactive behavior emerges from the interaction of embodied cognition with task and the artifac... more Interactive behavior emerges from the interaction of embodied cognition with task and the artifacts designed to accomplish the task. The current study focuses on how subtle changes in interface design lead to changes in the cognition, perception, and action operations that compose interactive behavior. The Argus Prime task is explained and the nature of the modeling effort is discussed. Insights obtained by exploring differences between model and human performance in one aspect of the Argus Prime task are presented.

This Way or That: Determining Where to Look First

Proceedings of the Annual Meeting of the Cognitive Science Society, 2003

Twenty-one undergraduates from Rensselaer Polytechnic Institute volunteered to take part in the s... more Twenty-one undergraduates from Rensselaer Polytechnic Institute volunteered to take part in the study, with 8 participants removed due to poor calibration. The experimental paradigm follows a typical visual search experiment where one must find a target (L) among distractors (T). Participants were instructed to find the target as quickly as possible. Stimulus density was varied within subject such that the distribution of stimuli was either constant across all four quadrants (No Difference) or for one quadrant interstimulus density was 1/2 (Medium Density – as per Figure 1) or 1/4 (High Density) that of the other quadrants.

This Way or That: Determining Where to Look First

Proceedings of the Annual Meeting of the Cognitive Science Society, 2003

Twenty-one undergraduates from Rensselaer Polytechnic Institute volunteered to take part in the s... more Twenty-one undergraduates from Rensselaer Polytechnic Institute volunteered to take part in the study, with 8 participants removed due to poor calibration. The experimental paradigm follows a typical visual search experiment where one must find a target (L) among distractors (T). Participants were instructed to find the target as quickly as possible. Stimulus density was varied within subject such that the distribution of stimuli was either constant across all four quadrants (No Difference) or for one quadrant interstimulus density was 1/2 (Medium Density – as per Figure 1) or 1/4 (High Density) that of the other quadrants.

Introduction to Volume 10, Issue 1 of topiCS

Topics in Cognitive Science, 2018

In this issue, we lead with the topic, Coordination and Context in Cognitive Science, from Topic ... more In this issue, we lead with the topic, Coordination and Context in Cognitive Science, from Topic Editor Chris Kello (University of California, Merced). Kello's introduction begins with a quick introduction to the concepts of the dynamics of coordination and phase transitions in forms of human behavior as diverse as walking, neural activity, and dinner conversations. He then transitions to a series of short introductions to each of his six articles. His introduction provides a gentle introduction to this approach, and each of the six papers provides an update on the progress made in advancing the role of context and coordination in cognitive science. Second in this issue is a comment by Ian Apperly (University of Birmingham, England), on last October's topic, Memory and Common Ground Processes in Language Use, which was organized by Sarah Brown-Schmidt. The two next topics are both "Best Ofs"-the best papers presented at their respective conferences. The first batch was curated by Topic Editors Bill Kennedy

Introduction to Volume 11, Issue 3 of topiCS

Topics in Cognitive Science, Jul 1, 2019

HOT: Higher Order Tetris, Experts' Subgoals and Activities

Cognitive Science, 2019

Discount or disservice?

The panel will focus on Jakob Nielsen's Discount Usability approach and guidelines. Nielsen has s... more The panel will focus on Jakob Nielsen's Discount Usability approach and guidelines. Nielsen has single handily restored guidelines to CHI. After being discredited because of the sheer impracticality of using 1000+ guidelines, Nielsen has been working hard to convince practitioners that all they need to know about usability can be summarized in 10 guidelines. This may be a real disservice. While using 10 guidelines may be better than using none, do people who have learned Nielsen's 10 think that they now know all they need to know about usability? The panel proposes a wide-ranging, public discussion of these issues.