Subjects: Psychology >> Cognitive Psychology Subjects: Psychology >> Experimental Psychology submitted time 2021-02-25
Abstract： Background: Previous laboratory studies have shown that an individual’s response in the current trial can be influenced by a previous trial, and this has been described as an effect of trial history. Existing studies have shown that there is a trial history effect with visual spatial inhibition of return (IOR), and some studies have shown that changes in stimulus modalities also affect reaction times (RTs). The present study used the “prime-neutral cue-target” paradigm to examine the trial history effect in cross-modal, non-spatial IOR and attempted to decrease the trial history effect. Method: In two experiments, we mainly manipulated the cue-target modalities in the current trial (auditory-visual vs. visual-auditory modalities), cue validity in the current trial (cued vs. uncued) and cue validity in the previous trial (cued vs. uncued). Thirty participants were recruited in Experiment 1. The visual prime cue was a red or blue disk with a radius of 2° visual angle, and the auditory prime cue was a verbal sound in Chinese at 75 dB (\hong\ or \lan\). The visual neutral cue was a green disk with a radius of 2° visual angle, and the auditory neutral cue was a verbal sound in Chinese at 75 dB (\lv\); The visual target was a red or blue disk with a radius of 2° visual angle, and the auditory target was a verbal sound in Chinese at 75 dB (\hong\ and \lan\). During the experiment, each trial began with a 400 ms fixation cross in the centre of the monitor, and a 300 ms visual or auditory prime cue was followed by a 200 ms fixation cross. After the 300 ms visual or auditory neutral cue, another fixation cross was presented for 300 ms, and then a 300 ms auditory or visual target was presented. The participants were asked to discriminate the identity of the target(i.e., either a colour disk or vocalization of \hong\or \lan\) within 1500 ms. Following a 1500 ms intertrial interval (ITI) with a blank screen, the next trial was initiated. Twenty-nine participants were recruited in Experiment 2, the ITI was 4500 ms, and the other parameters were identical to those in Experiment 1. Results: Regarding the RTs results, Experiment 1 showed that the RTs for cued targets in the current trial were larger than RTs for uncued targets, which was a colour-based non-spatial IOR. The IOR effect size in the current trial showed an interaction between the cue validity in the previous trial and the cue-target modality in the current trial. The IOR effect size on the current trial after a valid cue trial was larger than the IOR effect size with an invalid cue in the previous trial when the current trial was a visual cue and auditory target; however, there was no difference in the IOR effect size when the cue was auditory, and the target was visual in the current trial. Furthermore, the analysis of the target modality across trials revealed that the valid cue, but not the invalid cue, in the previous trial, could induce a larger IOR effect size in the current trial with visual cues. A longer ITI (4500 ms) was used in Experiment 2 compared to Experiment 1, and the results showed that there was a difference in the IOR effect size in the current trial between the visual cues and auditory cues in the current trial. The IOR effect size in the current trial was not influenced by the validity of the previous trial or whether the current trial had auditory cues or visual cues. Conclusion: These results suggested an interaction between trials on cross-modal non-spatial IOR, but the effect was related to the cue-target modality. There was not only the cue validity effect across trials but also the target modality switch effect between trials. Increasing the time interval between trials can reduce the effect of the previous trial on the IOR effect size in the current trial."
Subjects: Psychology >> Social Psychology submitted time 2023-03-27 Cooperative journals: 《心理学报》
Abstract： Both inhibition of return (IOR) and emotion have the characteristics of attentional bias and improving search efficiency. Previous studies mostly used a single modality presentation of emotional stimuli to investigate the relationship between the two, but the findings are inconsistent. Existing studies have shown that the congruent emotion of audiovisual dual modality can be integrated into the perceptual stage, which is the same as the processing stage of IOR. Therefore, the present study adopted the cue-target paradigm and used audiovisual dual modality to present emotional stimuli to further investigate the interaction between emotion and IOR. Experiment 1 was a three-factor within-subject design. We manipulated the presentation of cue validity (cued vs. uncued), target modalities (visual vs. audiovisual), and emotion type (negative vs. neutral). The task of the subjects was to identify the emotional stimuli of visual modality. Experiment 2 was similar to Experiment 1, but the emotional congruency was changed. The audiovisual dual modality presented incongruent emotional stimuli (visual negative face-auditory neutral sound; visual neutral face-auditory negative sound) to further investigate whether the impact of the audiovisual dual modality emotional stimulus on IOR was caused by the emotional stimulus of the auditory modality, that is, whether the emotional stimulus of the auditory modality was processed. In Experiment 1, the responses in the cued condition were slower than those in the uncued condition, which suggested that IOR occurred. More importantly, the interaction between emotion type and cue validity in the audiovisual dual modality condition showed that congruent negative emotion produces a smaller IOR effect (11 ms) than neutral emotion (25 ms). At the same time, the audiovisual dual modality condition produced a smaller IOR effect (18 ms) than the visual single modality condition (40 ms). We also found a larger multisensory response enhancement effect in the congruent negative emotion than in the neutral emotion. In Experiment 2, the results showed that there was no interaction between emotion and IOR under the condition of audiovisual dual modality, and there was no significant difference in IOR effect between single modality and audiovisual dual modality. This indicated that the IOR effect was not influenced by the presence of incongruent emotion in the audiovisual dual modality. In summary, the present study showed that the IOR effect was influenced only when the audiovisual dual modality presented the same emotion. Our findings revealed that IOR and audiovisual dual modality congruent emotion in the same processing stage had a mutual influence. Audiovisual dual modality congruent emotion weakened the IOR effect, and the differences between the negative emotion and the neutral emotion showed the adaptability of IOR. At the same time, this study further supports the perceptual inhibition theory of IOR.
Subjects: Psychology >> Cognitive Psychology submitted time 2021-11-20
Abstract： Both inhibition of return (IOR) and emotion have the characteristics of attentional bias and improving search efficiency. Previous studies mostly used single modality presentation of emotional stimuli to investigate the relationship between the two, but the results of the research are not consistent. Existing studies have shown that the congruent emotion of audiovisual dual modality can be integrated into the perceptual stage, which is the same as the processing stage of IOR. Therefore, the present study adopted the cue-target paradigm and used audiovisual dual modality to present emotional stimuli to further investigate the interaction between emotion and IOR. Experiment 1 was a three-factors within-subject design. We mainly manipulated the presentation of cue validity (cued vs. uncued), target modalities (visual vs. audiovisual) and emotion type (negative vs. neutral). The task of the subjects was to identify the emotional stimuli of visual modality. Experiment 2 was similar to Experiment 1, but the emotional congruency was changed. The audiovisual dual modality presented incongruent emotion stimuli (visual negative face-auditory neutral sound; visual neutral face-auditory negative sound) to further investigate whether the impact of the audiovisual dual modality emotional stimulus on IOR was caused by the emotional stimulus of the auditory modality, that is, whether the emotional stimulus of the auditory modality has been processed. In Experiment 1, the responses in the cued condition were slower than those in the uncued condition, which suggested that IOR occurred. More importantly, the interaction between emotion type and cue validity in the condition of audiovisual dual modality, which showed that congruent negative emotion produces less IOR effect (11 ms) than neutral emotion (25 ms). At the same time, the audiovisual dual modality condition produced less IOR effect (18 ms) than the visual single modality condition (40 ms). We also found a larger multisensory response enhancement effect in the congruent negative emotion than in the neutral emotion. In Experiment 2, the results showed that there was no interaction between emotion and IOR under the condition of audiovisual dual modality, and there was no significant difference in IOR effect between single modality and audiovisual dual modality. This indicated that the IOR effect was not influenced by the presence of incongruent emotion in audiovisual dual modality. In summary, the present study showed that the IOR effect was influenced only when the audiovisual dual modality presented the same emotion. Our findings revealed that IOR and audiovisual dual modality congruent emotion in the same processing stage had a mutual influence. Audiovisual dual modality congruent emotion weakened the IOR effect and the differences between the negative emotion and the neutral emotion showed the adaptability of IOR. At the same time, this study further supported the perceptual inhibition theory of IOR. "
Peer Review Status:
Awaiting Review
Subjects: Other Disciplines >> Synthetic discipline submitted time 2023-10-09 Cooperative journals: 《心理学报》
Abstract： Different dimensions of visual and auditory stimuli can map to each other to influence human behavioral responses, a phenomenon known as audiovisual cross-modal correspondence. A common audiovisual cross- modal correspondence is between auditory tones and visual spatial locations, with individuals tending to map high-pitched sounds to high spatial location and low-pitched sounds to low spatial location. When a high-pitch sound is accompanied or preceded by a visual stimulus, the participants respond faster to visual stimuli presented in the high spatial location than to visual stimuli presented in the low spatial location, and vice versa. Researchers have different views on the level at which audiovisual cross-modal correspondence occurs. Some argue that audiovisual cross-modal correspondence occurs at the perceptual level, increasing the perceptual saliency of the stimulus, while others argue that audiovisual cross-modal correspondence occurs at a later semantic or decision level. As inhibition of return (IOR) in the attentional system can affect human perception, this study used a cue-target paradigm to explore the interaction between IOR and audiovisual cross-modal correspondence to elucidate the occurrence level and mechanism of audiovisual cross-modal correspondence. Audiovisual cross-modal correspondence between auditory tones and visual spatial locations was expected to occur at the perceptual level and therefore would be subject to the IOR effect occurring at the same processing level. The present study consisted of 3 experiments. Experiment 1 had a 2 × 2 within-subjects design; we manipulated the spatial cue validity (valid cue vs. invalid cue) and audiovisual cross-modal correspondence (congruent vs. incongruent). During the experiment, a fixation point was first presented in the middle of the screen for 750 ms. The box above or below the fixation point was then bolded for 50 ms, but this cue was not predictive of the spatial location of the target. After a time interval of 250 ms, a fixation point was presented in bold as a central cue. A central cue is commonly used in spatial IOR research, as it facilitates stable occurrence of IOR. The central cue was presented for 50 ms, and then the auditory stimulus (either high or low pitch) was presented for 50 ms. After a 200-ms interval, the visual target was presented for 100 ms in the box above or below the fixation point. The participants were instructed to perform a detection task for the presence of a visual target. The experimental design and procedure of Experiment 2 were identical to those of Experiment 1, except that the sound presented before the visual target was a single tone that was present or absent. Experiment 3 had a 2 × 2 × 2 within-subjects design. Experiment 3 added a factor to Experiment 1, namely, stimulus onset asynchrony (SOA) between the cue and the target (600 ms vs. 1300 ms). In all three experiments, the overall accuracy (ACC) was very high; thus, no further statistical analysis was conducted for the ACC. In terms of reaction time (RT), the results of Experiment 1 showed that both spatial IOR and audiovisual cross-modal correspondence occurred. Importantly, there was an interaction between spatial cue validity and audiovisual cross-modal correspondence. Specifically, when the cue was valid, audiovisual cross-modal correspondence occurred, and when the cue was invalid, there was no audiovisual cross-modal correspondence. The results of Experiment 2 showed that the interaction between cue validity and sound presentation was not significant, and there was no evidence that IOR influenced the sound-induced facilitation effect. The results of Experiment 3 showed that the interaction among spatial cue validity, cross-modal correspondence congruency, and SOA was significant. Specifically, at an SOA of 600 ms, the interaction between spatial cue validity and cross-modal correspondence congruency was significant. When the cue was valid, audiovisual cross-modal correspondence occurred, and when the cue was invalid, there was no audiovisual cross-modal correspondence. At an SOA of 1300 ms, the interaction between cue validity and cross-modal correspondence congruency was not significant, and cross-modal correspondence occurred in both valid-cue and invalid-cue conditions. The results of the analysis of the IOR effect showed that the IOR effect under the 600-ms SOA condition (22 ms) was significantly larger than that under the 1300-ms SOA condition (16 ms). As the SOA increased, the IOR effect size decreased. In conclusion, the present results suggested that the IOR effect, occurring at the perceptual level, moderated audiovisual cross-modal correspondence. When the IOR effect occurred, audiovisual cross-modal correspondence occurred in the cued location, but not in the non-cued location. The alerting effect induced by the sound did not interact with IOR. With the weakening of the IOR effect, the audiovisual cross-modal correspondence in the cued location decreased, and the moderating effect of the IOR effect on audiovisual cross-modal correspondence weakened. The present results support that the audiovisual cross-modal correspondence between auditory tones and visual spatial locations occurs at the perceptual level, and the occurrence of audiovisual cross-modal correspondence conforms to the principle of inverse effectiveness.
Subjects: Psychology >> Cognitive Psychology submitted time 2023-02-23
Abstract：
Different dimensions of visual and auditory stimuli can map to each other to influence human behavioral responses, a phenomenon known as audiovisual cross-modal correspondence. A common audiovisual cross-modal correspondence is between auditory tones and visual spatial locations, with individuals tending to map high-pitched sounds to high spatial location and low-pitched sounds to low spatial location. When a high-pitch sound is accompanied or preceded by a visual stimulus, the participants respond faster to visual stimuli presented in the high spatial location than to visual stimuli presented in the low spatial location, and vice versa. Researchers have different views on the level at which audiovisual cross-modal correspondence occurs. Some argue that audiovisual cross-modal correspondence occurs at the perceptual level, increasing the perceptual saliency of the stimulus, while others argue that audiovisual cross-modal correspondence occurs at a later semantic or decision level. As inhibition of return (IOR) in the attentional system can affect human perception, this study used a cue-target paradigm to explore the interaction between IOR and audiovisual cross-modal correspondence to elucidate the occurrence level and mechanism of audiovisual cross-modal correspondence. Audiovisual cross-modal correspondence between auditory tones and visual spatial locations was expected to occur at the perceptual level and therefore would be subject to the IOR effect occurring at the same processing level.
The present study consisted of 3 experiments. Experiment 1 had a 2 × 2 within-subjects design; we manipulated the spatial cue validity (valid cue vs. invalid cue) and audiovisual cross-modal correspondence (congruent vs. incongruent). During the experiment, a fixation point was first presented in the middle of the screen for 750 ms. The box above or below the fixation point was then bolded for 50 ms, but this cue was not predictive of the spatial location of the target. After a time interval of 250 ms, a fixation point was presented in bold as a central cue. A central cue is commonly used in spatial IOR research, as it facilitates stable occurrence of IOR. The central cue was presented for 50 ms, and then the auditory stimulus (either high or low pitch) was presented for 50 ms. After a 200-ms interval, the visual target was presented for 100 ms in the box above or below the fixation point. The participants were instructed to perform a detection task for the presence of a visual target. The experimental design and procedure of Experiment 2 were identical to those of Experiment 1, except that the sound presented before the visual target was a single tone that was present or absent. Experiment 3 had a 2 × 2 × 2 within-subjects design. Experiment 3 added a factor to Experiment 1, namely, stimulus onset asynchrony (SOA) between the cue and the target (600 ms vs. 1300 ms).
In all three experiments, the overall accuracy (ACC) was very high; thus, no further statistical analysis was conducted for the ACC. In terms of reaction time (RT), the results of Experiment 1 showed that both spatial IOR and audiovisual cross-modal correspondence occurred. Importantly, there was an interaction between spatial cue validity and audiovisual cross-modal correspondence. Specifically, when the cue was valid, audiovisual cross-modal correspondence occurred, and when the cue was invalid, there was no audiovisual cross-modal correspondence. The results of Experiment 2 showed that the interaction between cue validity and sound presentation was not significant, and there was no evidence that IOR influenced the sound-induced facilitation effect. The results of Experiment 3 showed that the interaction among spatial cue validity, cross-modal correspondence congruency, and SOA was significant. Specifically, at an SOA of 600 ms, the interaction between spatial cue validity and cross-modal correspondence congruency was significant. When the cue was valid, audiovisual cross-modal correspondence occurred, and when the cue was invalid, there was no audiovisual cross-modal correspondence. At an SOA of 1300 ms, the interaction between cue validity and cross-modal correspondence congruency was not significant, and cross-modal correspondence occurred in both valid-cue and invalid-cue conditions. The results of the analysis of the IOR effect showed that the IOR effect under the 600-ms SOA condition (22 ms) was significantly larger than that under the 1300-ms SOA condition (16 ms). As the SOA increased, the IOR effect size decreased.
In conclusion, the present results suggested that the IOR effect, occurring at the perceptual level, moderated audiovisual cross-modal correspondence. When the IOR effect occurred, audiovisual cross-modal correspondence occurred in the cued location, but not in the non-cued location. The alerting effect induced by the sound did not interact with IOR. With the weakening of the IOR effect, the audiovisual cross-modal correspondence in the cued location decreased, and the moderating effect of the IOR effect on audiovisual cross-modal correspondence weakened. The present results support that the audiovisual cross-modal correspondence between auditory tones and visual spatial locations occurs at the perceptual level, and the occurrence of audiovisual cross-modal correspondence conforms to the principle of inverse effectiveness.
Peer Review Status:Awaiting Review
Subjects: Psychology >> Social Psychology submitted time 2023-03-27 Cooperative journals: 《心理学报》
Abstract： Both audiovisual integration and inhibition of return (IOR) can facilitate the processing of sensory information, such as enhancing the perceptual processing. Previous studies found that IOR decreased the audiovisual integration at previously attended locations. Several hypotheses have been put forward to explain the effect of IOR on audiovisual integration: perceptual sensitivity, spatial uncertainty, and differences in unimodal signal strength. In present study, we used cue-target paradigm and manipulated the SOA conditions (400~600 ms vs. 1000~1200 ms) to investigate how audiovisual integration would be modulated by IOR induced by visual exogenous spatial cues.The current study was a 2 (SOA conditions: 400~600 ms, 1000~1200 ms) × 3 (target modalities: visual, auditory, audiovisual) × 2 (cue validities: cued, uncued) factorial design. Twenty-seven undergraduate students were recruited as paid volunteers from a university. The visual (V) target was a red and white block (1°×1°). The auditory (A) target (duration of 100 ms) was a 1000 Hz sinusoidal tone presented by speakers. The audiovisual (AV) target was composed by the simultaneous presentation of both the visual and the auditory stimuli. At the beginning of each trial, the fixation stimulus was presented for 800~1000 ms in the center of the display. Following the fixation stimulus, a visual white square served as a exogenous cue was presented for 50 ms at the left or right location randomly. Then, the fixation stimulus was randomly presented for 150~250/450~550 ms, which was followed by a central cue with a delay of 50 ms. Before the target (100 ms) occurrence, the fixation stimulus randomly appeared again for 150~250/450~550 ms. Thus, the SOA between the peripheral cue and the target was completed in 400~600/1000~1200 ms. The target (A, V, or AV) randomly appeared (6/7) for 100 ms in the left or right locations, or no stimulus appeared (1/7). During the experiment, participants were instructed to respond to the target stimulus at any possible locations by pressing a response button as quickly and accurately as possible.The results showed that the responses to AV targets were faster than V or A targets, indicating the appearance of the bimodal advancement effect. A smaller magnitude of audiovisual IOR as compared to visual IOR was found whether it’s in short or long SOA conditions. In addition, visual IOR effect was significantly reduced under the long SOA condition compared with the short SOA condition while the audiovisual integration effect increased by SOA. The results of the relative multisensory response enhancement (rMRE), race model (probability difference) and positive area under the curve (pAUC) showed that audiovisual integration decreased at cued compared to uncued locations under the short SOA condition but not the long SOA condition. Based on the aforementioned findings, it is assumed that visual IOR decreased the audiovisual integration in the short SOA, and audiovisual integration would be modulated by different SOA conditions. The current result supported the hypothesis of differences in unimodal signal strength.
Subjects: Psychology >> Social Psychology submitted time 2023-03-27 Cooperative journals: 《心理学报》
Abstract： Inhibition of return (IOR) has been greatly explored in the visual or auditory modality. Investigations on spatial IOR even have extended to the cross-modal link between visual and auditory information processing. The present study examined the generation and variation of IOR effects when targets from the visual and auditory modalities were presented simultaneously (audiovisual targets). In addition, it explored the effect of bimodal divided attention on IOR with audiovisual targets by directing the attention to different modality to form two conditions of attention. The present study consisted of 3 experiments. In these experiments, we mainly manipulated the target modalities (including visual, auditory, and audiovisual modalities) and cue validities (including cued, neutral, uncued). Thirty-seven college students in Liaoning province were recruited in Exp. 1. The visual (V) target was white horizontal square wave grating (4° × 4°; the spatial frequency was 1 cycle/degree), the auditory (A) target (duration of 100 ms) was a 1000 Hz sinusoidal tone presented by the speakers. The audiovisual (AV) target was composed by the simultaneous presentation of both the visual and the auditory stimuli. During the experiment the fixation stimulus was presented for 800~1000 ms in the center of the monitor. Following the fixation stimulus, uninformative exogenous visual spatial cues were presented between 400~600 ms prior to the onset of targets for 100 ms at the left or right location. Then, the probability of the target (A, V, or AV) appeared for 100 ms in the center was 0.6 (No-go trials), the probability of the target may occur on left or right location was 0.2 (Go trials). The participants were instructed to pay attention to both V and A modalities, then respond to the target stimulus in the left or right location by pressing the response button as quickly and accurately as possible. Thirty-two college students were recruited in Exp. 2. The auditory stimuli were unattended and presented peripherally. Thirty-nine college students were recruited in Exp. 3. The auditory stimuli were unattended and presented centrally, the others were identical to that in Exp. 2. Based on the results of accuracy (ACC), it can be seen that the overall ACC was very high in Exp. 1. The mean ACC of AV targets was significantly higher than to either V or A targets. According to the results of reaction times (RTs), the mean RT of AV targets were significantly faster than to either V or A targets as expected, indicating the appearance of the bimodal advancement effect. For V targets, the RTs in the cued condition were slower than those in the uncued condition, demonstrated a typical IOR effect. There weren’t IOR effect elicited by AV targets when paying attention to both V and A modalities (Exp. 1). From the results of the relative amount of multisensory response enhancement (rMRE), we found a larger rMRE in the cued condition than that in the uncued condition. In Exp. 2 and Exp. 3, we found the comparable IOR with V and AV targets when the simultaneous auditory stimuli were unattended and presented peripherally or centrally. In addition, we found the comparable rMRE with V and AV targets when the simultaneous auditory stimuli were unattended and presented peripherally or centrally. These results suggested that the IOR effect elicited by AV targets was reduced when paying attention to multiple modalities. However, when auditory stimuli were unattended, there was no difference between the visual and audiovisual IOR effects. Based on the aforementioned findings, it indicated that bimodal divided attention can influence IOR with audiovisual targets.
Hits
Hits
Downloads
Comment
YES