Can You Rely on Your AI? Applying the AIR Tool to Improve Classifier Performance

Software Engineering Institute (SEI) Webcast Series

Player FM - Internet Radio Done Right

63 subscribers

Tech Videos

اضافه شده در nine سال پیش

محتوای ارائه شده توسط Carnegie Mellon University Software Engineering Institute and SEI Members of Technical Staff. تمام محتوای پادکست شامل قسمت‌ها، گرافیک‌ها و توضیحات پادکست مستقیماً توسط Carnegie Mellon University Software Engineering Institute and SEI Members of Technical Staff یا شریک پلتفرم پادکست آن‌ها آپلود و ارائه می‌شوند. اگر فکر می‌کنید شخصی بدون اجازه شما از اثر دارای حق نسخه‌برداری شما استفاده می‌کند، می‌توانید روندی که در اینجا شرح داده شده است را دنبال کنید.https://fa.player.fm/legal

Worth Knowing with Bonnie Habyan

1
#11: From OJ Simpson Case to Best Selling Author - Marcia Clark Shares Latest Real Crime Book Release and How Resilience Is Key to Success and Reinvention 34:35

12 روز پیش34:35

پخش در آینده

لیست ها

پسندیدن

دوست داشته شد

34:35

Marcia Clark, best known as the lead prosecutor in the O.J. Simpson trial, has become a trailblazer for women in law and beyond. Her journey from courtroom to bestselling author reflects her resilience and determination to redefine herself amidst intense public scrutiny. On this episode of Worth Knowing, Clark dives into her latest book, *Trial by Ambush*, which examines the 1953 Barbara Graham case—a story that highlights gender bias, media sensationalism, and the notion that all cases are subject to societal, cultural, and political winds. Clark shares how her experiences during the Simpson trial shaped her perspective on societal pressures and the role of women in high-stakes professions. Her reflections on how media, forensic science, and legal practices have evolved over decades offer valuable insights into the intersection of law and culture. This conversation is a compelling exploration of true crime, personal growth, and how Clark’s groundbreaking career continues to inspire a new generation of women to challenge norms and forge their own paths. Marcia Clark is a bestselling author and a criminal lawyer who began her career in law as a criminal defense attorney and went on to become a prosecutor in the L.A. District Attorney's Office in 1981. She spent ten years in the Special Trials Unit, where she handled a number of high-profile cases, including the prosecution of stalker/murderer Robert Bardo, whose conviction for the murder of actress Rebecca Schaeffer resulted in legislation that offered victims better protection from stalkers as well as increased punishment for the offenders. She was lead prosecutor for the O.J. Simpson murder trial. In May of 1997 her book on the Simpson case, "Without a Doubt," was published and reached #1 on the New York Times, Wall St. Journal, Washington Post, Los Angeles Times, and Publishers Weekly bestsellers lists. In February 2016, Clark re-released the book with a new foreword. Resources Sign up for the Worth Knowing LinkedIn Newsletter to stay up to date: https://www.linkedin.com/newsletters/worth-knowing-7236433935503618048/ Follow Bonnie on LinkedIn: https://www.linkedin.com/in/bonnie-habyan/ Go to the Worth Knowing website: https://www.worthknowing.show Check out The Agile Brand Guide website with articles, insights, and Martechipedia, the wiki for marketing technology: https://www.agilebrandguide.com The Agile Brand is produced by Missing Link—a Latina-owned strategy-driven, creatively fueled production co-op. From ideation to creation, they craft human connections through intelligent, engaging and informative content. https://www.missinglink.company…

حدود یک سال پیش 38:50

MP4•خانه قسمت

Modern analytic methods, including artificial intelligence (AI) and machine learning (ML) classifiers, depend on correlations; however, such approaches fail to account for confounding in the data, which prevents accurate modeling of cause and effect and often leads to prediction bias. The Software Engineering Institute (SEI) has developed a new AI Robustness (AIR) tool that allows users to gauge AI and ML classifier performance with unprecedented confidence. This project is sponsored by the Office of the Under Secretary of Defense for Research and Engineering to transition use of our AIR tool to AI users across the Department of Defense. During the webcast, the research team will hold a panel discussion on the AIR tool and discuss opportunities for collaboration. Our team efforts focus strongly on transition and provide guidance, training, and software that put our transition collaborators on a path to successful adoption of this technology to meet their AI/ML evaluation needs.

What Attendees Will Learn:

• How AIR adds analytical capability that didn’t previously exist, enabling an analysis to characterize and measure the overall accuracy of the AI as the underlying environment changes

• Examples of the AIR process and results from causal discovery to causal identification to causal inference • Opportunities for partnership and collaboration

164 قسمت

#Tech #Cybersecurity #Securecoding #Softwarearchitecture #Softwaredevelopment #Softwareengineering #Carnegie Mellon University Software Engineering Institute #SEI Members of Technical Staff #Video #Podcasting Education

Can You Rely on Your AI? Applying the AIR Tool to Improve Classifier Performance

Software Engineering Institute (SEI) Webcast Series

63 subscribers

published حدود یک سال پیش

اشتراک گذاری

MP4•خانه قسمت

What Attendees Will Learn:

• How AIR adds analytical capability that didn’t previously exist, enabling an analysis to characterize and measure the overall accuracy of the AI as the underlying environment changes

• Examples of the AIR process and results from causal discovery to causal identification to causal inference • Opportunities for partnership and collaboration

164 قسمت

همه قسمت ها

Software Engineering Institute (SEI) Webcast Series

1
I Spy with My Hacker Eye: How Hackers Use Public Info to Crack Your Creds 57:16

۳ روز پیش57:16

57:16

Did you know there are 500 million tweets per day? 3 billion monthly active Facebook users? 1 billion LinkedIn members? Are you one of them? In this webcast, Destiney Marie Plaza reveals how a hacker can use seemingly benign public information to customize an attack on a victim by showing a scenario-based attack and demo (using free and open-source tools). Additionally, you will learn how hackers can gather information about you, common mistakes that put your information at risk, and how to protect yourself. What Attendees Will Learn: how to use open-source tools used to crack passwords, along with a methodology for how hackers may gain access to your accounts what makes a strong password and how such passwords can stave off automated cracking tools how a hacker sees you, so that you can take appropriate steps to protect yourself…

Software Engineering Institute (SEI) Webcast Series

1
A New Performance Zone for Software for National Security 1:02:23

10 روز پیش1:02:23

1:02:23

Today, we have seen our national security organizations working to adopt modern software practices, particularly Agile methods and DevSecOps practices, efforts challenged by a mismatch of tempos between operational needs and development processes. The newly mandated Software Acquisition Pathway helps to align those tempos. However, to sustain a competitive advantage through software, we need to see our defense organizations recall and reapply disciplined engineering practices. What Attendees Will Learn: An assessment of current efforts to adopt modern software practices Why and where the pace of adoption faces challenges Characteristics of the needed new level of performance…

Software Engineering Institute (SEI) Webcast Series

1
Identifying and Mitigating Cyber Risk 47:33

23 روز پیش47:33

47:33

An organization’s cyber risk management practices must be rooted in organizational goals to be truly effective. In this webcast, Matt Butkovic, Greg Crabbe and Beth-Anne Bygum explore how best to align business and resilience objectives.

Software Engineering Institute (SEI) Webcast Series

1
Cyber Maturity Model Certification (CMMC): Protecting the Nation’s Defense Industrial Base 28:02

۵ weeks پیش28:02

28:02

The Defense Industrial Base (DIB) is a core element of the national security ecosystem. This point of intersection between private industry and the Department of Defense is a perpetual target for the Nation’s adversaries. In this Intersect, Matthew Butkovic and John Haller explore the development, and implementation, of the Cyber Maturity Model Certification (CMMC) as a means to better protect the DIB.…

Software Engineering Institute (SEI) Webcast Series

1
Threat Hunting: What Should Keep All of Us Up at Night 57:09

۸ weeks پیش57:09

57:09

When it comes to recognizing threats, cybersecurity professionals may become distracted by big promises or ignore some obvious inspections. New claims made by the latest and greatest new apps draw attention away from network situational awareness best practices—like a dog distracted when it spots a squirrel. We also may deviate from making routine inspections that point toward further investigation—overlooking obvious needs right under our noses. Either becoming distracted or missing obvious inspections can cause us not to detect threats. What Attendees Will Learn: • The distinction between anomalies and threats • Steps to analyze data to detect a threat • The benefits of completing work on one threat…

Software Engineering Institute (SEI) Webcast Series

1
Can a Cybersecurity Parametric Cost Model be Developed? 56:25

۹ weeks پیش56:25

56:25

Can a cybersecurity parametric cost estimation model be developed? Every Department of Defense (DoD) program needs to account for, credibly estimate, budget/plan for, and assess the performance of its cybersecurity activities. Creating a cybersecurity parametric model would allow DoD programs to reliably estimate the effort and cost of cybersecurity activities, estimate an overall cybersecurity cost for a program, and obtain a defined and normalized set of cybersecurity data. In this webcast, Christopher Miller shares insights from a Carnegie Mellon University Software Engineering Institute study on cybersecurity cost estimating that can help national security organizations successfully deploy parametric cost modeling. What Attendees Will Learn: • a proposed work breakdown structure identifying cybersecurity-related activities and cost items, and existing descriptions of secure coding practices and levels of rigor for those practices based on data availability • an approach to develop a cybersecurity parametric cost model • a methodology to develop the cost model…

Software Engineering Institute (SEI) Webcast Series

1
Elements of Effective Communications for Cybersecurity Teams 34:00

11 weeks پیش34:00

34:00

Communications, both in times of crisis and during normal operations, are essential to the overall success and sustainability of an incident response or security operations team. How you plan for and manage these communications and how they are received and actioned by your audience will influence your trustworthiness, reputation, and ultimately your ability to perform incident management services effectively. This webcast leverages the National Institute of Standards and Technology (NIST) Cybersecurity Framework and the Forum of Incident Response and Security Teams (FIRST) CSIRT Services Framework to present communications responsibilities as part of both the standard incident management lifecycle and as an integral piece of crisis management support. What Attendees Will Learn: • various communication types or mechanisms for normal and crisis situations • foundational aspects of managing communications with constituents, the public, and the media • building blocks for an effective communications plan…

Software Engineering Institute (SEI) Webcast Series

1
Operational Resilience Fundamentals: Building Blocks of a Survivable Enterprise 52:07

13 weeks پیش52:07

52:07

Surviving disruptive cyber events requires a specific form of planning. One must strike a balance between defending against threats (e.g., managing conditions) and effectively handling the effects of disruption (e.g., managing consequences). Employing a model (such as the CERT Resilience Management Model) provides a catalog of practices and a system of measurement. Focusing on key attributes of performance permits a level of prediction not possible with a basic checklist. In this webcast, Greg Crabbe and Matt Butkovic share their experiences in establishing and maintaining operational resilience programs. What Attendees Will Learn: • how to link mission outcome with asset resilience • how managing for security differs from managing for resilience • how to apply a capability maturity model to the challenge • how to begin analyzing requirements and constructing an operational resilience management program…

Software Engineering Institute (SEI) Webcast Series

1
Cybersecurity Priorities in 2025 32:21

14 weeks پیش32:21

32:21

Chief Information Security Officers (CISOs) perpetually navigate a dynamic set of challenges. Applying focus and aligning resources is imperative for success. In this Intersect, Matthew Butkovic and Gregory Touhill, reflect on 2024 and explore the topics that should be front of mind for CISOs in 2025. They provide insights and advice for those contemplating cybersecurity priorities.…

Software Engineering Institute (SEI) Webcast Series

1
Understanding the Need for Cyber Resilience: A Conversation with Ray Umerley 53:02

19 weeks پیش53:02

53:02

No organization can comprehensively avoid disruptive cyber events. All must strive to maintain operational resilience during times of organizational stress. Ransomware incidents create disruption that can be fatal to the unprepared. In this webcast, we explore how to maintain operational resilience during a ransomware incident. Experts with varied backgrounds provide practical advice for improving your resilience and survivability. What attendees will learn: • best practices for ransomware response • moving beyond security and planning for resilience • pitfalls to avoid in the planning and response processes…

Software Engineering Institute (SEI) Webcast Series

1
Exploring the Fundamentals of Counter AI 27:57

19 weeks پیش27:57

27:57

As the strategic importance of AI increases, so too does the importance of defending those AI systems. To understand AI defense, it is necessary to understand AI offense—that is, counter AI. In this session, Matthew Butkovic, CISA, CISSP, technical director for risk and resilience, and Nathan VanHoudnos, senior machine learning researcher explore the fundamentals of counter AI.…

Software Engineering Institute (SEI) Webcast Series

1
Cyber Challenges in Health Care: Managing for Operational Resilience 53:37

29 weeks پیش53:37

53:37

Health-care organizations are seemingly besieged by a complex set of cyber threats. The consequences of disruptive cyber events in health care are in many ways uniquely troubling. Health-care organizations often face these challenges with modest resources. In this webcast, Matthew Butkovic and Darrell Keeling will explore approaches to maximize return on cybersecurity investment in the health-care context. This will include applying fundamental measures of operational resilience. What Attendees Will Learn: How to yield maximum return on cybersecurity investment in health care How to shift thinking from cybersecurity to operational resilience How to employ free or low-cost cybersecurity resources in the health-care context…

Software Engineering Institute (SEI) Webcast Series

1
Independent Verification and Validation for Agile Projects 1:02:23

29 weeks پیش1:02:23

1:02:23

Traditionally, independent verification and validation (IV&V) is performed by an independent team throughout a program’s milestones or once the software is formally delivered. This approach allows the IV&V team to provide input at the various milestone gates. As more programs move to an Agile approach, those milestones aren’t as clearly defined since requirements, design, implementation, and testing all happen iteratively, sometimes over years of development. In this new paradigm, IV&V teams are struggling to figure out how to add value to the program earlier in the lifecycle by getting in phase with development. This webcast will highlight a novel approach to providing IV&V for projects using an Agile or iterative software development. What Attendees Will Learn: What adopting an Agile mindset for IV&V could look like How focusing on capabilities and using a risk-based perspective could help drive planning for your team Techniques to help the IV&V team get more in phase with the developer while remaining independent…

Software Engineering Institute (SEI) Webcast Series

1
Generative AI and Software Engineering Education 1:02:05

46 weeks پیش1:02:05

1:02:05

Within a very short amount of time, the productivity and creativity improvements envisioned by generative artificial intelligence (AI), such as using tools based on large language models (LLMs), have taken the software engineering community by storm. The industry is in a race to develop your next best software development tool. Organizations are perplexed by trying to find the right balance between staying ahead in the race and protecting their data and systems from potential risks presented by using generative AI as part of their software development tool chain. There are haters, evangelists, and everything in between. Software engineering education and educators have a special role. No matter how they perceive the opportunities and challenges of generative AI approaches, software engineering educators are going through a watershed moment that will change how they educate the next generation of software engineers. In this webcast, three experts in software engineering will discuss how generative AI is influencing software engineering education and how to balance key skills development with incorporating generative AI into software engineering curricula. What Attendees Will Learn: • how software engineering education is challenged by the increasing popularity of generative AI tools • how software engineering educators can take advantage of generative AI tools • what fundamental skills will be critical to teach to software engineering students in the era of generative AI…

Software Engineering Institute (SEI) Webcast Series

1
Secure Systems Don’t Happen by Accident 59:08

48 weeks پیش59:08

59:08

Traditionally, cybersecurity has focused on finding and removing vulnerabilities. This is like driving backward down the highway using your rearview mirror. Most breaches are due to defects in design or code; thus, the only way to truly address the issue is to design and build more secure solutions. In this webcast, Tim Chick discusses how security is an integral aspect of the entire software lifecycle as a result of following deliberate engineering practices focused on reducing security risks through the use of software assurance techniques. What Attendees Will Learn: • The importance of cybersecurity and examples of when security has failed • Qualities to look at when evaluating third-party software • The relationship between quality and security • Engineering techniques used throughout the development lifecycle to reduce cyber risks…

به Player FM خوش آمدید!

Player FM در سراسر وب را برای یافتن پادکست های با کیفیت اسکن می کند تا همین الان لذت ببرید. این بهترین برنامه ی پادکست است که در اندروید، آیفون و وب کار می کند. ثبت نام کنید تا اشتراک های شما در بین دستگاه های مختلف همگام سازی شود.

به بیش از 500 موضوع گوش کنید

63 subscribers

مشابه Software Engineering Institute (SEI) Webcast Series

Amazon Basics Multipurpose Copy Printer Paper, 8.5" x 11", 20 lb, 8 Reams, 4000 Sheets, 92 Bright, White

2025 Topps Series 1 Baseball - Factory Sealed - Value Box

2025 - American Silver Eagle .999 Fine Silver with our Smyrnacoin Certificate of Authenticity Dollar Uncirculated US Mint

پادکست هایی که ارزش شنیدن دارند

Software Engineering Institute (SEI) Webcast Series « » Can You Rely on Your AI? Applying the AIR Tool to Improve Classifier Performance

Can You Rely on Your AI? Applying the AIR Tool to Improve Classifier Performance

پادکست هایی که ارزش شنیدن دارند

به Player FM خوش آمدید!

Mini Mic Pro Wireless Microphone for iPhone, iPad, Android, Lavalier Microphone for Video Recording - 2 Pack iPhone Mic Crystal Clear Recording with USB-C for Podcast, ASMR

The Let Them Theory: A Life-Changing Tool That Millions of People Can't Stop Talking About

Amazon eGift Card - Amazon Logo (Animated)

Amazon Basics Dog and Puppy Pee Pads with Leak-Proof Quick-Dry Design for Potty Training, Standard Absorbency, Regular Size, 22 x 22 Inches, Pack of 100, Blue & White

The Let Them Theory: A Life-Changing Tool That Millions of People Can't Stop Talking About

مشابه Software Engineering Institute (SEI) Webcast Series

راهنمای مرجع سریع

Software Engineering Institute (SEI) Webcast Series « »
Can You Rely on Your AI? Applying the AIR Tool to Improve Classifier Performance