Personalizing Haptics (eBook)

Series Editors’ Foreword 7
Preface 8
Acknowledgements 9
Contents 11
1 Introduction 17
1.1 Motivation 17
1.1.1 Leveraging Haptic Utility 17
1.1.2 Informing Haptic Design and Evaluation 18
1.2 Situating Our Work 19
1.2.1 Supporting Personalization 20
1.2.2 Understanding Common Patterns and Individual Differences 21
1.2.3 Evaluating at Scale 23
1.3 Outline of the Chapters 23
1.3.1 Chapter 2—Linking Emotion Attributes to Engineering Parameters and Individual Differences 24
1.3.2 Chapter 3—Characterizing Personalization Mechanisms 24
1.3.3 Chapter 4—Choosing from a Large Library Using Facets 25
1.3.4 Chapter 5—Deriving Semantics and Interlinkages of Facets 26
1.3.5 Chapter 6—Crowdsourcing Haptic Data Collection 27
1.3.6 Chapter 7—Tuning Vibrations with Emotion Controls 28
1.4 Contributions 28
1.4.1 Effective Mechanisms for Haptic Personalization 29
1.4.2 Haptic Facets Encapsulating Common Patterns and Variations in Affect 30
1.4.3 Methodology for Evaluating Haptic Sensations at a Large Scale 30
1.4.4 Tools and Datasets 31
References 31
2 Linking Emotion Attributes to Engineering Parameters and Individual Differences 36
2.1 Introduction 36
2.2 Related Work 38
2.2.1 Affective Evaluation 38
2.2.2 Vibrotactile Stimuli 39
2.2.3 Tactile Tasks 39
2.2.4 Individual Differences in Tactile Task Performance 39
2.3 Design of Setup and Assessment Tools 40
2.3.1 Apparatus 40
2.3.2 Stimuli Design 40
2.3.3 Tactile Task Design 42
2.3.4 Affective Rating Scales Design 43
2.4 Study 44
2.4.1 Procedure 44
2.4.2 Results and Analysis 45
2.5 Discussion 47
2.5.1 Dimensionality and Utility of Affective Response 47
2.5.2 Vibration Parameters 48
2.5.3 Demographic, NFT Score and Tactile Performance 49
2.6 Conclusion 50
References 51
3 Characterizing Personalization Mechanisms 53
3.1 Introduction 53
3.2 Related Work 55
3.2.1 Haptic Design 55
3.2.2 Haptic Design Tools 56
3.2.3 Challenges and Potentials of End-User Personalization 56
3.3 Conceptualization of Haptic Personalization Tools 57
3.3.1 Three Personalization Tools 57
3.3.2 Proposed Tool-Characterization Parameter Space 59
3.4 Methods 60
3.5 Results 63
3.5.1 Comparison of the Tools 63
3.5.2 Interest in Personalization 64
3.5.3 Vibrations Designed by Participants 64
3.6 Discussion 65
3.6.1 Desirable Characteristics (Q1) 65
3.6.2 Value and Outcomes (Q2, Q3) 66
3.6.3 Wizard-of-Oz Approach 66
3.7 Conclusion 67
References 68
4 Choosing From a Large Library Using Facets 70
4.1 Introduction 70
4.2 Related Work 72
4.2.1 Vibrotactile Libraries 72
4.2.2 Vibrotactile Facets 72
4.2.3 Inspiration From Visualization and Media Collections 73
4.3 Library and Facet Construction 73
4.3.1 Library Population 73
4.3.2 Visualizing and Managing Diversity During Growth 74
4.4 VibViz: An Interactive Library Navigation Tool 75
4.4.1 Requirements 75
4.4.2 VibViz Interface 76
4.4.3 Dataset 77
4.5 User Study 77
4.6 Results 79
4.6.1 (Q1) Does VibViz Satisfy Our Design Requirements? 79
4.6.2 (Q2) How Useful and Interesting Is Each Vibration Facet? 80
4.7 Discussion 81
4.7.1 Interface Requirements 81
4.7.2 Vibrotactile Facets 82
4.8 Conclusions and Future Work 82
References 83
5 Deriving Semantics and Interlinkages of Facets 84
5.1 Introduction 84
5.1.1 Facets: Aligning Content Access with Mental Frameworks 86
5.1.2 Research Questions 89
5.1.3 Scope 90
5.2 Related Work 91
5.2.1 Tools for Vibrotactile Design and Personalization 91
5.2.2 Knowledge of Perceptual and Qualitative Attributes of Vibrations 92
5.2.3 Methodology for Evaluating Qualitative Attributes of Vibrations 92
5.2.4 Instruments for Evaluating Haptic Sensations 93
5.3 Approach 93
5.3.1 Rich Source Vibrations 94
5.3.2 Inclusive and Concise Annotation Instrument, for a Flat Descriptor Set 94
5.3.3 Scalable and Robust Data Collection Methodology 94
5.3.4 Data Analysis Methods 95
5.4 Data Collection and Pre-processing 96
5.4.1 Stage 1: Annotation by Haptics Experts 96
5.4.2 Stage 2: Validation of the Dataset by Lay Users 98
5.4.3 Pre-processing of the Dataset 100
5.4.4 Definition of Analysis Metrics 100
5.5 Analysis and Results 100
5.5.1 [Q1] Facet Substructure: What Are the Underlying Facet Dimensions That Dominate User Reactions to Vibrations? 100
5.5.2 [Q2] Between-Facet Linkages: How Are Attributes and Dimensions Linked Across Facets? 107
5.5.3 [Q3] Individual Differences: To What Extent Do People Coincide or Differ in Their Assessment of Vibration Attributes? 109
5.5.4 Methodology: How Does Staged Data Collection Impact Annotation Quality? 111
5.6 Discussion 112
5.6.1 Within-Facet Perceptual Continuity: Scenarios 113
5.6.2 Facet Dimensions and Linkages 114
5.6.3 Individuals' Annotation Reliability and Variation 116
5.6.4 Review of Our Methodology 116
5.7 Conclusion 118
References 119
6 Crowdsourcing Haptic Data Collection 123
6.1 Introduction 123
6.2 Related Work 125
6.2.1 Existing Evaluation Methods for Vibrotactile Effects 125
6.2.2 Affective Haptics 126
6.2.3 Mechanical Turk (MTurk) 126
6.3 Sourcing Reference Vibrations and Qualities 127
6.3.1 High-Fidelity Reference Library 128
6.3.2 Affective Properties and Rating Scales 128
6.4 Proxy Choice and Design 129
6.4.1 Visualization Design ( and ) 130
6.4.2 Low Fidelity Vibration Design 131
6.5 Study 1: In-Lab Proxy Vibration Validation (G1) 132
6.5.1 Comparison Metric: Equivalence Threshold 133
6.5.2 Proxy Validation (Study 1) Results and Discussion 133
6.6 Study 2: Deployment Validation with MTurk (G2) 137
6.6.1 Results 137
6.7 Discussion 138
6.7.1 Proxy Modalities Are Viable for Crowdsourcing (G1, G2: Feasibility) 138
6.7.2 Triangulation (G3: Promising Directions/Proxies) 139
6.7.3 Animate Visualizations (G3: Promising Directions) 139
6.7.4 Sound Could Represent Energy (G3: Promising Directions) 139
6.7.5 Device Dependency and Need for Energy Model for Vibrations (G4: Challenges) 140
6.7.6 Vibrotactile Affective Ratings Are Generally Noisy (G4: Challenges) 140
6.7.7 Response and Data Quality for MTurk LofiVib Vibrations (G4: Challenges) 141
6.7.8 Automatic Translation (G4: Challenges) 141
6.7.9 Limitations 141
6.8 Conclusion 142
References 142
7 Tuning Vibrations with Emotion Controls 146
7.1 Introduction 146
7.1.1 Research Questions, Approach and Contributions 148
7.2 Related Work 150
7.2.1 Haptic Design, and Inspirations from Other Domains 150
7.2.2 Affective Vibration Design 151
7.3 Starting Points: Use Cases, Initial Vibrations and Linkages 152
7.3.1 Design and Personalization Use Cases 152
7.3.2 Choosing Basis Vibrations 153
7.3.3 Identifying Influential Engineering Parameters 154
7.4 User Studies 155
7.4.1 Overview of the User Studies 155
7.4.2 Methods 155
7.4.3 Analysis 158
7.5 Results 159
7.5.1 Verbal Descriptions for Emotion Attributes 159
7.5.2 Ratings 159
7.5.3 RQ1: Impact of Engineering Parameters on Emotion Attributes (Study 1) 160
7.5.4 RQ2: Evidence of Continuity of the Engineering-Emotion Mappings (Study 2) 162
7.5.5 RQ3: Impact of Base Vibrations on Emotion Attribute Ratings 163
7.5.6 RQ4: Orthogonality of Emotion Dimensions 163
7.6 Discussion 164
7.6.1 Findings 164
7.6.2 Automatable Emotion Controls and Study Approach 164
7.6.3 What Do These Results Enable? Revisiting Our Use Cases 165
7.6.4 Future Work 168
7.7 Conclusion 169
References 170
8 Conclusion and Future Directions 173
8.1 Personalization Mechanisms 173
8.2 Facets as an Underlying Model for Personalization Tools 175
8.3 Large Scale Evaluation for Theory and Tool Development 177
8.4 Future Work 178
8.4.1 Incorporating Personalization in Users' Workflow 178
8.4.2 Expanding the Mechanisms and the Underlying Model 179
8.5 Final Remarks 179
References 180
9 Supplemental Materials for Chapter5 181
9.1 List of Tags and Their Disagreement Values 181
9.2 Tag Removal Summary 185
9.3 Rating Correlations 186
9.4 Multidimensional Scaling Graphs on Tag Distances 186
9.5 Individual Differences in Vibrations 190
9.6 Between-Facet Tag Linkages 194
10 Supplemental Materials for Chapter7 195
10.1 Linkages Between Three Emotion Dimensions and Sensory Attributes of Vibrations 196
10.2 Implementation of Sensory Parameters 197
10.3 Qualitative Description of Emotion Dimensions 198
10.4 Specification of Base Vibrations and Their Derivatives 199
References 200