Josh Urban Davis
Emily Whiting
ABSTRACT
We present a novel haptic and audio feedback device that allows blind and visually impaired (BVI) users to understand circuit diagrams. TangibleCircuits allows users to interact with a 3D printed tangible model of a circuit which provides audio tutorial directions while being touched. Our system comprises an automated parsing algorithm which extracts 3D printable models as well as an audio interfaces from a Fritzing diagram. To better understand the requirements of designing technology to assist BVI users in learning hardware computing, we conducted a series of formative inquiries into the accessibility limitations of current circuit tutorial technologies. In addition, we derived insights and design considerations gleaned from conducting a formal comparative user study to understand the effectiveness of TangibleCircuits as a tutorial system. We found that BVI users were better able to understand the geometric, spatial and structural circuit information using TangibleCircuits, as well as enjoyed learning with our tool.
Supplemental Material
Available for Download
zip
pn5779aux.zip (49.5 MB)
The zip file for auxiliary material contains tables that were included in previous drafts of the manuscript, but were removed. They may be of interest for viewers interested in a more granular perspective of the data and results mentioned in the paper. We have also included an additional copy of the revision log, as well as a copy of the manuscript which has been highlighted to indicate areas of changes between the initial and camera ready submission. This is intended to make the final review easier for our review committee.
- Hackster.io. 2019. Arduino Project Hub. Last retrieved 18 September 2019 from https://create.arduino.cc/projecthubGoogle Scholar
- Friends of Fritzing Foundation. 2019. Fritzing Hub. Last retrieved 18 September 2019 from https://fritzing.org/projects/Google Scholar
- Primo Toys. 2016. Cubetto -- Hand on coding for ages 3 and up. Last retrieved March 14th, 2016 from https://www.kickstarter.com/projects/primotoys/cubetto-hands-on-coding-for-girls-and-boys-aged-3Google Scholar
- Smith-Kettlewell Eye Research Institute. 2019. Smith-Kettlewell Technical File. Last retrieved 18 September 2019 from https://www.ski.org/smith-kettlewell-technical-fileGoogle Scholar
- Web Accessibility Initiative. 2019. Web Content Accessibility Guidelines. Last retrieved 18 September 2019 from https://www.w3.org/WAI/fundamentals/accessibility-principles/Google Scholar
- Fraser Anderson, Tovi Grossman, and George Fitzmaurice. 2017. Trigger-Action-Circuits: Leveraging Generative Design to Enable Novices to Design and Build Circuitry. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology. 331--342. DOI=https://doi.org/10.1145/3126594.3126637Google ScholarDigital Library
- Jeffrey P. Bigham, Maxwell B. Aller, Jeremy T. Brudvik, Jessica O. Leung, Lindsay A. Yazzolino, and Richard E. Ladner. 2008. Inspiring blind high school students to pursue computer science with instant messaging chatbots. In Proceedings of the 39th SIGCSE technical symposium on Computer science education (SIGCSE '08). ACM, NY, NY, USA, 449--453. DOI=http://dx.doi.org/10.1145/1352135.1352287Google ScholarDigital Library
- Tracey Booth, Simone Stumpf, Jon Bird, and Sara Jones. 2016. Crossed Wires: Investigating the Problems of End-User Developers in a Physical Computing Task. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 3485--3497. DOI=https://doi.org/10.1145/2858036.2858533Google ScholarDigital Library
- E. Brulé, G. Bailly, A. M. Brock, F. Valentin, G. Denis, and C. Jouffrais, "MapSense: Multi-Sensory Interactive Maps for Children Living with Visual Impairments," In Proceedings of the 2016 Conference for Human-Human Factors in Computing Systems (CHI 2016). ACM, San Jose, California, USA, pp. 445--457, 07-May-2016.Google Scholar
- Z. Cattaneo and T. Vecchi. 2011. Blind vision: the neuroscience of visual impairment, no. March. MIT Press. pp.83--89Google Scholar
- Daniel Drew, Julie L. Newcomb, William McGrath, Filip Maksimovic, David Mellis, and Björn Hartmann. 2016. The Toastboard: Ubiquitous Instrumentation and Automated Checking of Breadboarded Circuits. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. 677-- 686. DOI = https://doi.org/10.1145/2984511.2984566 ?Google ScholarDigital Library
- Josh Davis. 2019. IllumiWear: A Fiber-Optic eTextile for MultiMedia Interactions. In the Proceedings of the Conference on New Interfaces in Musical Expression (NIME'19).Google Scholar
- Josh Davis, Jun Gong, Yunxin Sun, Parmit Chilana, Xing-Dong Yang. 2019. CircuitStyle: A System for Peripherally Reinforcing Best Practices in Hardware Computing. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology. ACM. DOI = https://doi.org/10.1145/3332165.3347920Google ScholarDigital Library
- J. Ducasse, A. Brock, and C. Jouffrais, "Accessible Interactive Maps for Visually Impaired Users," in Mobility in Visually Impaired People - Fundamentals and ICT Assistive Technologies, E. Pissaloux and R. Velasquez, Eds. Springer, 2017.Google Scholar
- J. Ducasse, M. Macé, M. Serrano, and C. Jouffrais, "Tangible Reels: Construction and Exploration of Tangible Maps by Visually Impaired Users," in Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, 2016, pp. 2186--2197.Google Scholar
- Caitlin Duncan, Tim Bell, and Steve Tanimoto. 2014. Should your 8-year-old learn coding?. In Proceedings of the 9th Workshop in Primary and Secondary Computing Education (WiPSCE '14). ACM, 60--69. DOI = http://doi.acm.org/10.1145/2670757.2670774Google ScholarDigital Library
- S. Fleck and M. Hachet, "Making Tangible the Intangible: Hybridization of the Real and the Virtual to Enhance Learning of Abstract Phenomena," Front. ICT, vol. 3, p. 30, Dec. 2016.Google ScholarCross Ref
- Louis H. Goldish, Harry E Taylor. 1974. The Optacon: A Valuable Device for Blind Persons. In New Outlook for the Blind, 68, 2, 49--56, Feb 74.Google Scholar
- Michael S. Horn and Robert J. K. Jacob. 2007. Designing tangible programming languages for classroom use. In Proceedings of the 1st international conference on Tangible and embedded interaction (TEI '07). ACM, 159--162. DOI = http://dx.doi.org/10.1145/1226969.1227003Google ScholarDigital Library
- P.A. Ioannou ; C.C. Chien. 1993. Autonomous intelligent cruise control. Published in IEEE Transactions on Vehicular Technology. Volume: 42, Issue: 4, Nov 1993. DOI = https://doi.org/10.1109/25.260745Google ScholarCross Ref
- Shaun K. Kane and Jeffrey P. Bigham. 2014. Tracking @stemxcomet: teaching programming to blind students via 3D printing, crisis management, and twitter. In Proceedings of the 45th ACM technical symposium on Computer science education (SIGCSE '14). ACM, NY, NY, USA, 247--252. DOI = http://dx.doi.org/10.1145/2538862.2538975Google ScholarDigital Library
- Jingyi Li, Son Kim, Joshua A. Miele, Maneesh Agrawala, Sean Follmer. 2019. Editing Spatial Layouts through Tactile Templates for People with Visual Impairments. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). DOI = https://doi.org/10.1145/3290605.3300436Google ScholarDigital Library
- Jo-Yu Lo, Da-Yuan, Tzu-Sheng Kuo, Chen-Kuo, Jun, Teddy Seyed, Xing-Dong Yang, Bing-Yu Chen. 2019. AutoFritz: Autocomplete for Prototyping Virtual Breadboard Circuits. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). DOI = https://doi.org/10.1145/3290605.3300633Google ScholarDigital Library
- Stephanie Ludi, Lindsey Ellis, and Scott Jordan. 2014. An accessible robotics programming environment for visually impaired users. In Proceedings of the 16th international ACM SIGACCESS conference on Computers & accessibility (ASSETS '14). ACM, 237- 238. DOI = http://dx.doi.org/10.1145/2661334.2661385Google ScholarDigital Library
- M. S. Manshad, E. Pontelli, and S. J. Manshad, "Trackable Interactive Multimodal Manipulatives: Towards a Tangible User Environment for the Blind," in Proceedings of ICCHP 2012, 2012, vol. 7383, pp. 664-- 671.Google Scholar
- D. McGookin, E. Robertson, and S. Brewster, "Clutching at Straws: Using Tangible Interaction to Provide Non-Visual Access to Graphs," in Proceedings of the 28th Conference on Human Factors in Computing Systems - CHI '10, 2010, pp. 1715--1724.Google Scholar
- Will McGrath, Daniel Drew, Jeremy Warner, Majeed Kazemitabaar, Mitchell Karchemsky, David Mellis, and Björn Hartmann. 2017. Bifröst: Visualizing and Checking Behavior of Embedded Systems Across Hardware and Software. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology. 299--310. DOI=https://doi.org/10.1145/3126594.3126658Google ScholarDigital Library
- Orni Meerbaum-Salant, Michal Armoni, and Mordechai Ben-Ari. 2013. Learning computer science concepts with Scratch. Computer Science Education 23(3), 239--264. DOI=http://dx.doi.org/10.1080/08993408.2013.832022Google ScholarCross Ref
- David A. Mellis, Leah Buechley, Mitchel Resnick, and Björn Hartmann. 2016. Engaging Amateurs in the Design, Fabrication, and Assembly of Electronic Devices. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems. 1270--1281. DOI=https://doi.org/10.1145/2901790.2901833Google ScholarDigital Library
- Mitchel Resnick, Fred Martin, Randy Sargent and Brian Silverman. 1996. Programmable bricks: Toys to think with. IBM Systems journal, 35 (3.4). 443-452.Google Scholar
- Jaime Sánchez, and Fernando Aguayo. 2005. Blind learners programming through audio. In Extended Abstracts on Human Factors in Computing Systems (CHI EA '05). ACM, 1769--1772. http://dx.doi.org/10.1145/1056808.1057018Google ScholarDigital Library
- O. Shaer and E. Hornecker, "Tangible User Interfaces: Past, Present, and Future Directions," Found. Trends Human--Computer Interact., vol. 3, no. 1--2, pp. 1--137, Jan. 2009.Google Scholar
- Lei Shi, Zhuohao Zhang Zhejiang, Shiri Azenkot. 2019. Designing Interactive 3D Printed Models with Teachers of the Visually Impaired. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). DOI=https://doi.org/10.1145/3290605.3300427Google ScholarDigital Library
- Lei Shi Yuhang Zhao Shiri Azenkot . 2017. Markit and Talkit: A Low-Barrier Toolkit to ' Augment 3D Printed Models with Audio Annotations. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). DOI=https://doi.org/10.1145/3126594.3126650Google ScholarDigital Library
- Lei Shi Yuhang Zhao Shiri Azenkot . 2017. Designing Interactions for 3D Printed Models with Blind People. In Proceedings of the 19th international ACM SIGACCESS conference on Computers & accessibility (ASSETS '17). ACM. DOI=https://doi.org/10.1145/3132525.3132549Google ScholarDigital Library
- Lei Shi, Idan Zelzer, Catherine Feng, and Shiri Azenkot. 2016. Tickers and Talker: An Accessible Labeling Toolkit for 3D Printed Models. In Proceedings of the 2016 Conference on Human Factors in Computing Systems (CHI '16). ACM, NY, NY, USA, 4896--4907. DOI=https://doi.org/10.1145/2858036.2858507Google ScholarDigital Library
- J. Schneider and T. Strothotte, "Constructive exploration of spatial information by blind users". In Proceedings of the fourth international ACM conference on Assistive technologies - ASSETS '00, 2000, pp. 188--192.Google ScholarDigital Library
- Ann C. Smith, Joan M. Francioni, and Sam D. Matzek. 2000. A Java programming tool for students with visual disabilities. In Proceedings of the fourth international ACM conference on Assistive technologies (ASSETS '00). ACM, 142--148. DOI=http://dx.doi.org/10.1145/354324.354356Google ScholarDigital Library
- Andreas M. Stefik, Christopher Hundhausen, and Derrick Smith. 2011. On the design of an educational infrastructure for the blind and visually impaired in computer science. In Proceedings of the 42nd ACM technical symposium on Computer science education DOI=http://dx.doi.org/10.1145/1953163.1953323Google ScholarDigital Library
- Evan Strasnick, Maneesh Agrawala, and Sean Follmer. 2017. Scanalog: Interactive Design and Debugging of Analog Circuits with Programmable Hardware. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology. 321--330. DOI=https://doi.org/10.1145/3126594.3126618Google ScholarDigital Library
- Anja Thieme, Cecily Morrison, Nicolas Villar, Martin Grayson and Siân Lindley. 2017. Enabling Collaboration in Learning Computer Programing Inclusive of Children with Vision Impairments. In Proceedings of the 2017 ACM Conference on Designing Interactive Systems (DIS '17). ACM, NY, NY, USA DOI=http://dx.doi.org/10.1145/3064663.3064689Google ScholarDigital Library
- Jeremy Warner, Ben Lafreniere, George Fitzmaurice, Tovi Grossman. 2018. ElectroTutor: Test-Driven Physical Computing Tutorials. Proceedings of ACM Symposium on User Interface Software Technology. (UIST'18). ACM, NY, NY, USAGoogle ScholarDigital Library
- Sujeath Pareddy, Anhong Guo, and Jeffrey P. Bigham. 2019. X-Ray: Screenshot Accessibility via Embedded Metadata. In The 21st International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '19). Association for Computing Machinery, New York, NY, USA, 389--395. DOI=https://doi.org/10.1145/3308561.3353808Google ScholarDigital Library
- Xiaoyi Zhang, Tracy Tran, Yuqian Sun, Ian Culhane, Shobhit Jain, James Fogarty, Jennifer Mankoff. 2018. Interactiles: 3D Printed Tactile Interfaces to Enhance Mobile Touchscreen Accessibility. In The 20th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '18). Association for Computing Machinery, New York, NY, USA DOI=https://doi.org/10.1145/3234695.3236349Google ScholarDigital Library
Index Terms
- TangibleCircuits: An Interactive 3D Printed Circuit Education Tool for People with Visual Impairments
Recommendations
AccessibleCircuits: Adaptive Add-On Circuit Components for People with Blindness or Low Vision
CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing SystemsIn this paper, we propose the designs for low cost and 3D-printable add-on components to adapt existing breadboards, circuit components and electronics tools for blind or low vision (BLV) users. Through an initial user study, we identified several ...
Investigating touchscreen accessibility for people with visual impairments
NordiCHI '08: Proceedings of the 5th Nordic conference on Human-computer interaction: building bridgesTouchscreen computing devices such as the iPhone are becoming more common. However this technology is largely inaccessible to people with visual impairments. We present the results of a requirements capture study that illustrates the problems with ...
Accessible Touchscreen Technology for People with Visual Impairments: A Survey
Touchscreens have become a de facto standard of input for mobile devices as they most optimally use the limited input and output space that is imposed by their form factor. In recent years, people who are blind and visually impaired have been increasing ...
Comments