{"id":67061,"date":"2019-09-04T18:21:00","date_gmt":"2019-09-04T22:21:00","guid":{"rendered":"https:\/\/id-kayla.cms-devl.bu.edu\/wheelock\/?post_type=bu-article&p=67061"},"modified":"2023-09-05T10:23:40","modified_gmt":"2023-09-05T14:23:40","slug":"research-update-dr-naomi-caselli-collaborators-from-sdsu-tufts-and-bus-hariri-institute-to-launch-asl-lex-2-0","status":"publish","type":"bu-article","link":"https:\/\/id-kayla.cms-devl.bu.edu\/wheelock\/news\/articles\/2019\/research-update-dr-naomi-caselli-collaborators-from-sdsu-tufts-and-bus-hariri-institute-to-launch-asl-lex-2-0\/","title":{"rendered":"Research Update: Dr. Naomi Caselli & Collaborators from SDSU, Tufts, and BU\u2019s Hariri Institute to Launch ASL-LEX 2.0"},"content":{"rendered":"\t
\n\t\t
\n\n\t\t\t
\n\t\t\t\t\n\t\t\t\t\n\t\t\t\t\t\t\t<\/div>\n\n\t\t\t\n\n\t\t\t\n\t\t\t\t
\n\n\t\t\t\t\t\n\t\t\t\t\t
\n\n\t\t\t\t\t\t\t\t\t\t\t\t\t\tDeaf studies<\/span>\n\t\t\t\t\t\t\t\t

\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\tResearch Update: Dr. Naomi Caselli & Collaborators from SDSU, Tufts, and BU\u2019s Hariri Institute to Launch ASL-LEX 2.0\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/h1>\n\t\t\t\t\t\t\n\t\t\t\t\t\t\n\t\t\t\t\t<\/div>\n\n\t\t\t\t<\/div>\n\n\t\t\t\n\t\t<\/div>\n\n\t\t\n\t<\/div>\n\n\t\n
\n\t
\n\t\t\t\t\t
September 4, 2019<\/div>\n\t\t\n\t\t\t\t
\n\t\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\tTwitter<\/span><\/span>\n\t\t\tFacebook<\/span><\/span>\n\t\t\t<\/span>\n\t\t<\/div>\n\t<\/div>\n<\/div>\n\n\t\n\n\n
\"\"\/<\/figure>\n\n\n\n

Dr. Naomi Caselli<\/a>, along with researchers at San Diego State University and Tufts University, and a team of software engineers at Boston University\u2019s Rafik B. Hariri Institute for Computing and Computational Science & Engineering<\/a> are preparing to launch ASL-LEX 2.0<\/a>, the second-generation interactive visualization of the lexical and phonological properties of signs in American Sign Language. ASL-LEX has interdisciplinary applications for research in linguistics, education, and computer science, and also is widely used by educators and people interested in learning ASL.<\/p>\n\n\n\n

The database has been built and maintained by Dr. Caselli, Dr. Zed Sevcikova Sehyr<\/a> and Dr. Karen Emmorey<\/a> from San Diego State University and Dr. Ariel Cohen-Goldberg<\/a> from Tufts University. The first iteration debuted in 2016 as the first ever web-based ASL lexicon. It featured 993 ASL signs and was awarded the PopSci People\u2019s Choice award for its interactive website visualizations in the National Science Foundation Vizzies Visualization Challenge in 2017.<\/p>\n\n\n\n

ASL-LEX 2.0: A bigger, more detailed picture of the lexicon<\/h4>\n\n\n\n

ASL-LEX 2.0 will contain 2727 ASL signs, tripling the number of signs originally mapped in 1.0. Though there is currently no way of confirming how much of the ASL lexicon this database actually accounts for, Dr. Caselli estimates that ASL-LEX 2.0 brings the platform \u201cmuch closer to having full coverage of the lexicon.\u201d<\/p>\n\n\n\n

The team built out 2.0\u2019s expanded reach by cross-referencing peer projects that seek to document ASL. Dr. Sevcikova Sehyr and Dr. Emmorey drew on past in-house experiments, the ASL Sign Bank project, and other online ASL dictionaries, while Dr. Caselli identified further dialectical signs via focus groups held at Boston University.<\/p>\n\n\n\n

Throughout the process, the team held regular meetings in which they assessed existing research for gaps in the field. One gap had to do with phonology, which Dr. Sevcikova Sehyr notes \u201cmay have been inconsistently captured due to the researchers\u2019 own theoretical views\u201d in prior projects. To address that lack, Caselli\u2019s team, including Chelsea Hammond<\/a> (Wheelock\u201917\u201919), worked to layer in more detailed phonological information for all 2727 signs, adding descriptive depth to visual structure of the lexicon.<\/p>\n\n\n\n

\u201cWith 1.0, you could only see a sign\u2019s starting location,\u201d says Dr. Caselli. \u201cNow you can see where the sign ends up.\u201d This is valuable because it provides more points of connection between signs made up of visually-similar components, similar to how spoken-language words that share an onset or a rhyme or other structural components might relate.<\/p>\n\n\n\n

The team also saw a gap in documentation of sign iconicity (how much a sign \u201clooks like\u201d the object or concept it represents). \u201cOne of the neat things about sign languages is that the form of signs and their meanings are sometimes closely related, they are \u2018iconic.\u2019 Tree is a good example: in the sign the arm looks like a tree trunk and the fingers look like branches,\u201d says Dr. Caselli.<\/p>\n\n\n\n

Dr. Sevcikova Sehyr collected iconicity ratings by deaf ASL signers for all signs documented in ASL-LEX 1.0. By building them into ASL-LEX 2.0, the researchers aim to establish a standardized data set that peer researchers can use as a starting point for their own questions and assessments. Dr. Caselli has used the iconicity data already in her work on sign-language acquisition, examining how sign iconicity relates to how easily\u2014and at which age\u2014ASL learners typically learn it in publications in Psychological Science<\/em><\/a> and the Journal of Experimental Psychology: Learning Memory and Cognition<\/em><\/a>.<\/p>\n\n\n\n

\u201cThe iconicity ratings provide valuable information about deaf signers\u2019 intuitions about the resemblance between the sign form and meaning,\u201d says Dr. Sevcikova Sehyr. In an upcoming article, currently in press with the journal Language & Cognition, she and Dr. Emmorey use the data in ASL-LEX 2.0 in their exploration of how a person\u2019s knowledge of ASL influences their intuitions about the mappings between meaning and form.<\/p>\n\n\n\n

Working with SAIL: The results of a unique cross-BU partnership<\/h4>\n\n\n\n

Accessibility was another major priority for ASL-LEX 2.0, explains Dr. Caselli. \u201cWe are trying to make it more accessible to educators,\u201d she says. \u201cAs we reduce the amount of English text in the interface, we lower the barrier to access to people whose native language is ASL or another language.\u201d<\/p>\n\n\n\n

Another big step toward increased accessibility happened on the technical level. Engineers from the Boston University Hariri Institute\u2019s Software & Application Innovation Lab (SAIL)<\/a> built new graphing and visualization features into ASL-LEX 2.0, making it possible for researchers and educators who have collected and coded the lexicons of other sign languages to now use ASL-LEX\u2019s visualization tools to explore their data.<\/p>\n\n\n\n

\u201cASL-LEX 2.0 has two visualization modes that allow for a deeper dive into the lexicon,\u201d explains lead engineer Shreya Pandit. \u201cThe first shows the lexical database as a network graph, where users can see how signs group together based on a set of phonological and lexical properties including selected fingers, major location, flexion and so on. This offers a panoramic view of the data and allows us to view relationships between signs that are not otherwise apparent.\u201d<\/p>\n\n\n\n

\u201cThe other visualization shows the relationships between pairwise combinations of sign properties. This provides an in-depth understanding of how signs vary in different subspaces. Users can select a subset of signs and switch between the two visualization modes.\u201d<\/p>\n\n\n\n

To get from ASL-LEX 2.0\u2019s initial prototype, assembled by the research team, to a full-featured and launch-ready version, Shreya and her peers at SAIL pushed themselves to understand the specifics of the subject at hand.<\/p>\n\n\n\n

\u201cWorking with sign language is inherently different from working with spoken language,\u201d she says. \u201cIn sign language, words are expressed using a combination of the hands, arms, face, and head. This allows sign language to be expressed in a multitude of ways, and determines how signs are related.\u201d<\/p>\n\n\n\n

\u201cFor example, rhyming signs may be spatially related (where they are signed on the body) instead of being auditorily related. Similarly, to indicate pluralization, a sign is often reduplicated instead of adding suffixes, like many spoken languages do.\u201d<\/p>\n\n\n\n

Shreya, who recently earned her Master\u2019s in Artificial Intelligence from BU, conducted much of the work on ASL-LEX 2.0 alongside two graduate students completing internships at SAIL: Megan Fantes (GRS\u201920) and Arezoo Sadeghi (GRS\u201920)<\/a>. \u201cThis project has helped them to foster a better understanding of working on an active research project,\u201d she says. \u201cIt also provided them with an opportunity to come up with a systematic way of organizing and developing the data transformations that lie at the heart of this project.\u201d<\/p>\n\n\n\n

\u201cVia its interactive online interface, ASL-LEX 2.0 provides accessible training and learning opportunities for deaf and hearing students, scientists and educators,\u201d notes Dr. Sevcikova Sehyr. \u201cThe database can assist researchers in conducting systematic, reliable and reproducible research, something that is absolutely crucial in the age of increased demands for scientific replicability.\u201d This could lead researchers to probe questions about how language works in general, and test theories of language that have been historically limited to spoken languages only.<\/p>\n\n\n\n

Dr. Sevcikova Sehyr also points out that ASL-LEX 2.0 may be used by educators and early intervention specialists seeking to develop benchmarks for assessing vocabulary development in signing children (e.g., do children know the most frequent signs?) and to support literacy development (e.g., to find sign-based \u201crhymes\u201d).<\/p>\n\n\n\n

For Shreya, working with the ASL-LEX 2.0 research team exemplified how SAIL can support data-driven research. \u201cThis project brought researchers working in computer science, cognitive neuroscience and psychology from across the nation together,\u201d she says. \u201cThe depth of this project has allowed us to think outside the box, teaching us important lessons on how research should be made more accessible and understandable.\u201d<\/p>\n\n\n\n

On the horizon: Adding meaning to the lexicon<\/h4>\n\n\n\n

By the time ASL-LEX 2.0 officially launches, the research team will be well on their way toward developing its next iteration, which was recently funded by the National Science Foundation. \u201c3.0 will go beyond phonological mapping by including semantic relationships between signs,” says Dr. Caselli. \u201cEven though signs for \u2018cat\u2019 and \u2018dog\u2019 don\u2019t have much of a visual similarity, their meanings are related, and these relationships will be mapped in the next iteration of ASL-LEX.”<\/p>\n\n\n\n

Dr. Sevcikova Sehyr hopes develop ASL-LEX 3.0 into a \u201clexicon-wide network of how signs are interconnected via their meaning as well as their physical form, and how meaning and form possibly influence each other.\u201d She has proposed a study where the team will ask deaf ASL signers to think of signs that are associated by meaning to the signs in ASL-LEX. \u201cThis will tell us how many close or distant neighbors or \u2018friends\u2019 each sign has, how strong and diverse their neighborhoods are, or what attracts them to some friends but not others,\u201d she says. Caselli adds that \u201cASL-LEX 3.0 will also help us know not only what these signs mean, but what parts of meaning show up in the sign forms.\u201d<\/p>\n\n\n\n

Lexical databases which document these relationships have been critical to the development of the natural language processing technology that makes applications like Siri and Alexa possible for spoken languages. Sign language recognition technology has lagged behind, but by documenting the same relationships in ASL ASL-LEX opens the door for similar Artificial Intelligence developments sign recognition and automatic translation software.<\/p>\n\n\n\n

A research team that included Dr. Caselli and authors from Microsoft, Gallaudet University, Rochester Institute of Technology, Paris-Saclay University, University of Maryland, and Leiden University examined the current state and future challenges of successful sign language recognition, generation, and translation systems in their paper, “Sign Language Recognition, Generation, and Translation: An Interdisciplinary Perspective<\/a>,” which won the ASSETS 2019 Best Paper Award.<\/p>\n\n\n\n

\u201cASL-LEX 1.0 was our attempt at getting basic information about a large portion of ASL signs into one spot, and document about six phonological features per sign,\u201d says Dr. Caselli. \u201c2.0 expands the number of signs we include and the number of phonological features we track \u2014 up to 15 now. What is special about 3.0 is that it will add meaning.\u201d<\/p>\n\n\n\n

With funding secured and participation from Co-PIs at San Diego State University and Tufts University on board, ASL-LEX 3.0 should become public in 2022.<\/p>\n","protected":false},"excerpt":{"rendered":"

Dr. Naomi Caselli, along with researchers at San Diego State University and Tufts University, and a team of software engineers at Boston University\u2019s Rafik B. Hariri Institute for Computing and Computational Science & Engineering are preparing to launch ASL-LEX 2.0, the second-generation interactive visualization of the lexical and phonological properties of signs in American Sign […]<\/p>\n","protected":false},"author":9274,"featured_media":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"bu_prepress_billboard":"","_bu_prepress_primary_term":"Deaf studies","_bu_prepress_primary_term_manual":""},"tags":[4057],"bu-publication":[6614],"magazine-article-category":[],"magazine-topic":[],"news-article-category":[6751,6645,6646],"news-topic":[],"bu_edition":[],"media_type":[],"_links":{"self":[{"href":"https:\/\/id-kayla.cms-devl.bu.edu\/wheelock\/wp-json\/wp\/v2\/bu-article\/67061"}],"collection":[{"href":"https:\/\/id-kayla.cms-devl.bu.edu\/wheelock\/wp-json\/wp\/v2\/bu-article"}],"about":[{"href":"https:\/\/id-kayla.cms-devl.bu.edu\/wheelock\/wp-json\/wp\/v2\/types\/bu-article"}],"author":[{"embeddable":true,"href":"https:\/\/id-kayla.cms-devl.bu.edu\/wheelock\/wp-json\/wp\/v2\/users\/9274"}],"replies":[{"embeddable":true,"href":"https:\/\/id-kayla.cms-devl.bu.edu\/wheelock\/wp-json\/wp\/v2\/comments?post=67061"}],"version-history":[{"count":2,"href":"https:\/\/id-kayla.cms-devl.bu.edu\/wheelock\/wp-json\/wp\/v2\/bu-article\/67061\/revisions"}],"predecessor-version":[{"id":72548,"href":"https:\/\/id-kayla.cms-devl.bu.edu\/wheelock\/wp-json\/wp\/v2\/bu-article\/67061\/revisions\/72548"}],"wp:attachment":[{"href":"https:\/\/id-kayla.cms-devl.bu.edu\/wheelock\/wp-json\/wp\/v2\/media?parent=67061"}],"wp:term":[{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/id-kayla.cms-devl.bu.edu\/wheelock\/wp-json\/wp\/v2\/tags?post=67061"},{"taxonomy":"bu-publication","embeddable":true,"href":"https:\/\/id-kayla.cms-devl.bu.edu\/wheelock\/wp-json\/wp\/v2\/bu-publication?post=67061"},{"taxonomy":"magazine-article-category","embeddable":true,"href":"https:\/\/id-kayla.cms-devl.bu.edu\/wheelock\/wp-json\/wp\/v2\/magazine-article-category?post=67061"},{"taxonomy":"magazine-topic","embeddable":true,"href":"https:\/\/id-kayla.cms-devl.bu.edu\/wheelock\/wp-json\/wp\/v2\/magazine-topic?post=67061"},{"taxonomy":"news-article-category","embeddable":true,"href":"https:\/\/id-kayla.cms-devl.bu.edu\/wheelock\/wp-json\/wp\/v2\/news-article-category?post=67061"},{"taxonomy":"news-topic","embeddable":true,"href":"https:\/\/id-kayla.cms-devl.bu.edu\/wheelock\/wp-json\/wp\/v2\/news-topic?post=67061"},{"taxonomy":"bu_edition","embeddable":true,"href":"https:\/\/id-kayla.cms-devl.bu.edu\/wheelock\/wp-json\/wp\/v2\/bu_edition?post=67061"},{"taxonomy":"media_type","embeddable":true,"href":"https:\/\/id-kayla.cms-devl.bu.edu\/wheelock\/wp-json\/wp\/v2\/media_type?post=67061"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}