{"id":76,"date":"2024-09-27T11:02:31","date_gmt":"2024-09-27T15:02:31","guid":{"rendered":"https:\/\/ar.bu.edu\/2024\/?page_id=76"},"modified":"2024-11-18T14:21:16","modified_gmt":"2024-11-18T19:21:16","slug":"taking-a-scalpel-to-ai","status":"publish","type":"page","link":"https:\/\/ar.bu.edu\/2024\/ai\/taking-a-scalpel-to-ai\/","title":{"rendered":"Taking a Scalpel to AI"},"content":{"rendered":"

A first-of-its-kind program is helping Boston University computer scientist Mark Crovella<\/a> investigate AI\u2014asking, can we trust it? Should we trust it? Is it safe? Is it perpetrating biases and spreading misinformation?<\/strong><\/p>\n

The National Artificial Intelligence Research Resource (NAIRR) Pilot, backed by the National Science Foundation and Department of Energy, aims to bring a new level of scrutiny to AI\u2019s promise and peril by giving 35 projects, including Crovella\u2019s<\/a>, access to advanced supercomputing resources and data at top national laboratories.<\/p>\n

A professor of computer science and chair of academic affairs in the Faculty of Computing & Data Sciences, Crovella will audit a type of AI known as large language models (LLMs). These software tools help drive everything from ChatGPT to automated chatbots to smart speaker assistants. Evimaria Terzi<\/strong><\/a>, professor in the Department of Computer Science, will join Crovella on the project.<\/p>\n

\"\"
Computer scientist Mark Crovella<\/strong> received a novel federal grant to audit a type of AI known as large language models.<\/figcaption><\/figure>\n

The use of LLMs is spreading rapidly, Crovella says, finding uses in education, social settings, and research, among many other areas. Apple, Microsoft, and Meta have all announced integrations of LLMs into their product lines. In the near future, Crovella predicts, we will each have our own personalized LLM that will know a lot about us and help with tasks on a minute-to-minute basis.<\/p>\n

Therefore, it\u2019s critical to understand whether such models incorporate biases against protected groups, tendencies to propagate extreme or hateful views, or conversational patterns that steer users toward unreliable information.<\/p>\n

\u201cHow will we know that these \u2018giant and inscrutable\u2019 systems are trustworthy and safe?\u201d<\/p>\n

\u2014MARK CROVELLA<\/p><\/blockquote>\n

The NAIRR grant means Crovella and Terzi can start analyzing the internals of modern LLMs, which contain a huge amount of knowledge, obtained from vast training data. They also possess an enormously complex system for generating output based on billions of parameters. As a result, the internal representations used in LLMs have been referred to as \u201cgiant and inscrutable.\u201d<\/p>\n

\u201cHow will we know that these \u2018giant and inscrutable\u2019 systems are trustworthy and safe?\u201d Crovella says. \u201cIn essence, we want to study an LLM the way a neuroscientist studies a brain in an fMRI machine.\u201d<\/p>\n","protected":false},"excerpt":{"rendered":"

A first-of-its-kind program is helping Boston University computer scientist Mark Crovella investigate AI\u2014asking, can we […]<\/p>\n","protected":false},"author":1859,"featured_media":0,"parent":68,"menu_order":3,"comment_status":"closed","ping_status":"closed","template":"bu-landing","meta":[],"_links":{"self":[{"href":"https:\/\/ar.bu.edu\/2024\/wp-json\/wp\/v2\/pages\/76"}],"collection":[{"href":"https:\/\/ar.bu.edu\/2024\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/ar.bu.edu\/2024\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/ar.bu.edu\/2024\/wp-json\/wp\/v2\/users\/1859"}],"replies":[{"embeddable":true,"href":"https:\/\/ar.bu.edu\/2024\/wp-json\/wp\/v2\/comments?post=76"}],"version-history":[{"count":10,"href":"https:\/\/ar.bu.edu\/2024\/wp-json\/wp\/v2\/pages\/76\/revisions"}],"predecessor-version":[{"id":867,"href":"https:\/\/ar.bu.edu\/2024\/wp-json\/wp\/v2\/pages\/76\/revisions\/867"}],"up":[{"embeddable":true,"href":"https:\/\/ar.bu.edu\/2024\/wp-json\/wp\/v2\/pages\/68"}],"wp:attachment":[{"href":"https:\/\/ar.bu.edu\/2024\/wp-json\/wp\/v2\/media?parent=76"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}