Categories
Compliance Tip of the Day

Compliance Tip of the Day: Continuous Monitoring of AI

Welcome to “Compliance Tip of the Day,” the podcast where we bring you daily insights and practical advice on navigating the ever-evolving landscape of compliance and regulatory requirements.

Whether you’re a seasoned compliance professional or just starting your journey, our aim is to provide you with bite-sized, actionable tips to help you stay on top of your compliance game.

Join us as we explore the latest industry trends, share best practices, and demystify complex compliance issues to keep your organization on the right side of the law.

Tune in daily for your dose of compliance wisdom, and let’s make compliance a little less daunting, one tip at a time.

In today’s episode, we begin a weeklong look at some of the ways Generative AI is changing compliance and risk management. Today we consider some of the key challenges that organizations need to navigate to accomplish continuous monitoring of AI.

For more information on the Ethico ROI Calculator and a free White Paper on the ROI of Compliance, click here.

Categories
Blog

AI in Compliance Week: Part 5 – Continuous Monitoring of AI

This blog post concludes a five-part series I ran this week on some of the keys intersecting AI and compliance. Yesterday, I wrote that businesses must proactively address the potential for bias at every stage of the AI lifecycle—from data collection and model development to deployment and ongoing monitoring. In this final blog post, I deeply dive into continuously monitoring your AI. We begin this final Part 5 with some key challenges organizations must navigate to accomplish this task.

As we noted yesterday, data availability and high data quality are essential. Garbage In, Garbage Out. Robust bias monitoring requires access to comprehensive, high-quality data that accurately reflects the real-world performance of your AI system. Acquiring and maintaining such datasets can be resource-intensive, especially as the scale and complexity of the AI system grow. However, this is precisely what the Department of Justice (DOJ) expects from a corporate compliance function.

How have you determined your key performance indicators (KPIs) and interpretation? Selecting the appropriate fairness metrics to track and interpret the results can be complex. Different KPIs may capture various aspects of bias, and tradeoffs between them can exist. Determining the proper thresholds and interpreting the significance of observed disparities requires deep expertise.

Has your AI engaged in Model Drift or Concept Shift? Compliance professionals are aware of the dreaded ‘mission creep. AI models can exhibit “drift” over time, where their performance and behavior gradually diverge from the original design and training. Additionally, the underlying data distributions and real-world conditions can change, leading to a “concept shift” that renders the AI’s outputs less reliable. Continuously monitoring these issues and making timely adjustments is critical but challenging. Companies will need to establish clear decision-making frameworks and processes to address model drift and concept shift.

Operational complexity is a critical issue in continuous AI monitoring. Integrating continuous bias monitoring and mitigation into the AI system’s operational lifecycle can be logistically complex. This requires coordinating data collection, model retraining, and deployment across multiple teams and systems while ensuring minimal service disruptions.

Everyone must buy in or in business-speak – Organizational Alignment must be in place.  Not surprisingly, it all starts with the tone at the top. Your organization should foster a responsible AI development and deployment culture with solid organizational alignment and leadership commitment. Maintaining a sustained focus on bias monitoring and mitigation requires buy-in and alignment across the organization, from executive leadership to individual contributors. Overcoming organizational silos, competing priorities, and resistance to change can be significant hurdles.

There will be evolving regulations and standards. The regulatory landscape governing the responsible use of AI is rapidly growing, with new laws and industry guidelines emerging. Keeping pace with these changes and adapting internal processes can be an ongoing challenge. Staying informed about evolving regulations and industry standards and adapting internal processes will be mission-critical.

The concept of AI explainability and interpretability will be critical going forward.  As AI systems become more complex, providing clear, explainable rationales for their decisions and observed biases becomes increasingly crucial. Enhancing the interpretability of these systems is essential for effective bias monitoring and mitigation. This will be improved by developing robust data management practices to ensure the availability and quality of data for bias monitoring. The bottom line is that companies should prioritize research and development to improve the explainability and interpretability of AI systems, enabling more effective bias monitoring and mitigation.

A financial commitment will be required, as continuous bias monitoring and adjustment can be resource-intensive. It requires dedicated personnel, infrastructure, and budget allocations and investing in specialized expertise, both in-house and through external partnerships, to enhance the selection and interpretation of fairness metrics. Organizations must balance these needs against other business priorities and operational constraints. Companies must allocate the necessary resources, including dedicated personnel, infrastructure, and budget, to sustain continuous bias monitoring and adjustment efforts.

Organizations should adopt a comprehensive, well-resourced approach to AI governance and bias management to overcome these challenges. This includes developing robust data management practices, investing in specialized expertise, establishing clear decision-making frameworks, and fostering a responsible AI development and deployment culture.

Continuous monitoring and adjusting AI systems for bias is a complex, ongoing endeavor, but it is critical to ensure these powerful technologies’ ethical and equitable use. By proactively addressing the challenges, organizations can unlock AI’s full potential while upholding their commitment to fairness and non-discrimination.

By proactively addressing these challenges, organizations can unlock AI’s full potential while upholding their commitment to fairness and non-discrimination. Continuous monitoring and adjusting AI systems for bias is a complex, ongoing endeavor, but it is a critical component of responsible AI development and deployment.

As the AI landscape continues to evolve, organizations prioritizing this crucial task will be well-positioned to navigate the ethical and regulatory landscape, build trust with their stakeholders, and drive sustainable innovation that benefits society.

Categories
Blog

AI in Compliance Week: Part 4 – Keeping Your AI – Powered Decisions Fair and Unbiased

As artificial intelligence (AI) becomes increasingly integrated into business operations and decision-making, ensuring the fairness and lack of bias in these AI systems is paramount. This is especially critical for companies operating in highly regulated industries, where prejudice and discrimination can lead to significant legal, financial, and reputational consequences. Implementing AI responsibly requires a multifaceted approach beyond simply training the models on large datasets. Companies must proactively address the potential for bias at every stage of the AI lifecycle – from data collection and model development to deployment and ongoing monitoring.

Based upon what the Department of Justice said in the 2020 Evaluation of Corporate Compliance Programs, a corporate compliance function is the keeper of both Institutional Justice and Institutional Fairness in every organization. This will require compliance to be at your organization’s forefront of ensuring your AI-based decisions are fair and unbiased. What strategies does a Chief Compliance Officer (CCO) or compliance professional employ to help make sure your AI-powered decisions remain fair and unbiased?

The adage GIGO (garbage in, garbage out) applies equally to the data used to train AI models. If the underlying data contains inherent biases or lacks representation of particular demographic groups, the resulting models will inevitably reflect those biases. It would help if you made a concerted effort to collect training data that is diverse, representative, and inclusive. Audit your datasets for potential skews or imbalances and supplement them with additional data sources to address gaps. Regularly review your data collection and curation processes to identify and mitigate biases.

The composition of your AI development teams can also significantly impact the fairness and inclusiveness of the resulting systems. Bring together individuals with diverse backgrounds, experiences, and perspectives to participate in every stage of the AI lifecycle. A multidisciplinary team including domain experts, data scientists, ethicists, and end-users can help surface blind spots, challenge assumptions, and introduce alternative viewpoints. This diversity helps ensure your AI systems are designed with inclusivity and fairness in mind from the outset.

It would help if you employed comprehensive testing for bias, which is essential to identify and address issues before your AI systems are deployed. By Incorporating bias testing procedures into your model development lifecycle and then making iterative adjustments to address any problems identified. There are a variety of techniques and metrics a compliance professional can use to evaluate your models for potential biases:

  • Demographic Parity: Measure the differences in outcomes between demographic groups to ensure equal treatment.
  • Equal Opportunity: Assess the accurate favorable rates across groups to verify that the model’s ability to identify positive outcomes is balanced.
  • Disparate Impact: Calculate the ratio of selection rates for different groups to detect potential discrimination.
  • Calibration: Evaluate whether the model’s predicted probabilities align with actual outcomes consistently across groups.
  • Counterfactual Fairness: Assess whether the model’s decisions would change if an individual’s protected attributes were altered.

As AI systems become more complex and opaque, transparency and explainability become increasingly important, especially in regulated industries. (Matt Kelly and I discussed this topic on this week’s Compliance into the Weeds.) It would help if you worked to implement explainable AI techniques that provide interpretable insights into how your models arrive at their decisions. By making the decision-making process more visible and understandable, explainable AI can help you identify potential sources of bias, validate the fairness of your models, and ensure compliance with regulatory requirements around algorithmic accountability.

As Jonathan Marks continually reminds us, corporations rise and fall on their government models and how they operate in practice. Compliance professionals must cultivate a strong culture of AI governance within your organization, with clear policies, methods, and oversight mechanisms in place. This should include:

  • Executive-level Oversight: Ensure senior leadership is actively involved in setting your AI initiatives’ strategic direction and ethical priorities.
  • Cross-functional Governance Teams: Assemble diverse stakeholders, including domain experts, legal/compliance professionals, and community representatives, to provide guidance and decision-making on AI-related matters.
  • Auditing and Monitoring: Implement regular, independent audits of your AI systems to assess their ongoing performance, fairness, and compliance. Continuously monitor for any emerging issues or drift from your established standards.
  • Accountability Measures: Clearly define roles, responsibilities, and escalation procedures to address problems or concerns and empower teams to take corrective action.

By embedding these governance practices into your organizational DNA, you can foster a sense of shared responsibility and proactively manage the risks associated with AI-powered decision-making. As with all other areas of compliance, maintaining transparency and actively engaging with key stakeholders is essential for building trust and ensuring your AI initiatives align with societal values, your organization’s culture, and overall stakeholder expectations. A CCO and compliance function can do so through a variety of ways:

  • Regulatory Bodies: Stay abreast of evolving regulations and industry guidelines and collaborate with policymakers to help shape the frameworks governing the responsible use of AI.
  • Stakeholder Representatives: Seek input from diverse community groups, civil rights organizations, and other stakeholders to understand their concerns and incorporate their perspectives into your AI development and deployment processes.
  • End-users: Carsten Tams continually reminds us that it is all about the UX. A compliance professional in and around AI should engage with the employees and other groups directly impacted by your AI-powered decisions and incorporate their feedback to improve your systems’ fairness and user experience.

By embracing a spirit of transparency and collaboration, CCOs and compliance professionals will help your company navigate the complex ethical landscape of AI and position your organization as a trusted, responsible leader in your industry. Similar to the management of third parties, ensuring fairness and lack of bias in your AI-powered decisions is an ongoing process, not a one-time event. Your company should dedicate resources to continuously monitor the performance of your AI systems, identify any emerging issues or drift from your established standards, and make timely adjustments as needed. You must regularly review your fairness metrics, solicit feedback from stakeholders, and be prepared to retrain or fine-tune your models to maintain high levels of ethical and unbiased decision-making. Finally, fostering a culture of continuous improvement will help you stay ahead of the curve and demonstrate your commitment to responsible AI.

As AI is increasingly embedded in business operations, the stakes for ensuring fairness and mitigating bias have never been higher. By adopting a comprehensive, multifaceted approach to AI governance, your organization can harness this transformative technology’s power while upholding ethical and unbiased decision-making principles. The path to responsible AI may be complex, but the benefits – trust, compliance, and long-term sustainability – are worth the effort.

Categories
Compliance Into the Weeds

Compliance into the Weeds: AI Accountability and Explainability

The award-winning Compliance into the Weeds is the only weekly podcast that takes a deep dive into a compliance-related topic, literally going into the weeds to more fully explore a subject.

Looking for some hard-hitting insights on compliance? Look no further than Compliance into the Weeds!

In this episode, Tom Fox and Matt Kelly delve into the recent speech by Michael Hsu, the head of the Office of the Comptroller of the Currency, on the accountability challenges posed by artificial intelligence in the banking sector.

The discussion highlights Hsu’s emphasis on the lack of a robust accountability framework for AI, illustrating the issue with the Air Canada chatbot incident. The conversation also touches on potential systemic risks AI could pose to the financial sector, the need for explainable AI, and the shared responsibility model used in cloud computing as a potential template for addressing these challenges. The episode underscores the necessity for compliance officers to ensure contracts and IT controls are in place and stresses the importance of developing trust and accountability mechanisms before widespread AI adoption.

Key Highlights:

  • AI Accountability: A Regulator’s Perspective
  • Case Study: Air Canada’s AI Mishap
  • Legal and Technological Challenges
  • Exploring Solutions and Shared Responsibility

Resources:

Matt on Radical Compliance

 Tom 

Instagram

Facebook

YouTube

Twitter

LinkedIn

Categories
Great Women in Compliance

Great Women in Compliance: Privacy and AI Compliance – A Principled Approach

In this episode of the Great Women in Compliance podcast, Hemma and Ellen host a roundtable with Hope Anderson, a partner in White & Case’s Data, Privacy & Cybersecurity Practice, and Jean Liu, Assistant General Counsel, Privacy, Safety, and Regulatory Affairs who joined Microsoft in 2023 as part of the Nuance Communications, Inc. acquisition.

Hope and Jean have a wealth of experience advising on privacy, AI, and data governance compliance issues, and they are well-positioned to leverage this experience in the wake of a rapidly evolving regulatory landscape. Hemma and Ellen didn’t waste a minute mining these two experts for practical tips and recommendations for those of us looking to get smart quickly and grapple with what seems like a behemoth task of keeping up with developments in technology and legislation while at the same time, making sure we don’t get left behind in learning to leverage AI in our functions.

Join us for an engaging ride through the ups and downs of privacy and AI compliance, and be inspired as we were by the great opportunities to develop new and exciting use cases while mitigating risk and the chance to unlock the power of responsible and ethical AI for our businesses.

Key Highlights:

  • Getting up to speed with the rapidly evolving regulatory landscape

  • The role of AI principles vs policies and procedures

  • Human Rights, Bias, and AI

  • Keeping the “Human in the Loop”

  • Thoughts on a US Federal AI or Privacy Law

  • Leveraging AI for Ethics and Compliance

  • Key resources and recommendations

Resources:

Join the Great Women in Compliance community on LinkedIn here.

Guest Bios:

Hope Anderson is a partner in White & Case’s Data, Privacy & Cybersecurity Practice, based in Los Angeles. She has extensive experience advising on all aspects of privacy and is at the forefront of Generative AI, advising on the technology’s legal implications and practical applications. A member of the Firm’s Global Technology Industry Group, Hope has extensive experience in privacy and product counseling. She advises on e-commerce, privacy by design, Generative AI, AR/VR, biometrics, analytics, and issues implicating consumer protection, marketing, and advertising laws.

Jean C. Liu is an Assistant General Counsel in the Privacy, Safety, and Regulatory Affairs division and joined Microsoft in 2023 as part of the Nuance Communications, Inc. acquisition. Immediately before its acquisition, Jean served as Nuance’s Vice President and Chief Legal, Compliance, and Privacy Officer, leading the global legal, compliance, and privacy functions. She developed and implemented data privacy policies and practices to ensure that customer and business data, including protected health information, is strictly governed and privacy is maintained. Jean has over 29 years of experience leading compliance and privacy programs, successfully managing data incidents, including regulatory investigations, and implementing best governance and risk management practices across multiple industries.

Categories
Compliance Tip of the Day

Compliance Tip of the Day: AI Powered Internal Controls

Welcome to “Compliance Tip of the Day,” the podcast where we bring you daily insights and practical advice on navigating the ever-evolving landscape of compliance and regulatory requirements.

Whether you’re a seasoned compliance professional or just starting your journey, our aim is to provide you with bite-sized, actionable tips to help you stay on top of your compliance game.

Join us as we explore the latest industry trends, share best practices, and demystify complex compliance issues to keep your organization on the right side of the law.

Tune in daily for your dose of compliance wisdom, and let’s make compliance a little less daunting, one tip at a time.

In today’s episode, we begin a weeklong look at some of the ways Generative AI is changing compliance and risk management. Today we look at how to set up AI-powered internal controls from a compliance perspective.

 

For more information on the Ethico ROI Calculator and a free White Paper on the ROI of Compliance, click here.

Categories
Blog

AI in Compliance Week: Part 3 – Embracing AI-Powered Internal Controls

Integrating artificial intelligence (AI) into internal controls is pivotal in the ever-evolving corporate governance landscape. We have closely followed the discussion around this emerging trend and the insights from industry experts like Jonathan Marks. In Part 3 of my five-part blog post series, I will explore the key considerations and best practices for leveraging AI to enhance an organization’s internal control framework.

Let’s start with the basics: ‘ What are internal controls?’ The best answer I have ever heard is still provided by Jonathan Marks, who says, “Internal controls are the mechanisms, rules, and procedures implemented by an organization to ensure the integrity of financial and accounting information, promote accountability, and prevent fraud. They encompass the entire control environment, including the attitude, awareness, and actions of management and others concerning the internal control system and its importance to the entity.”

Consider that the foundation of any successful AI application lies in the quality and accessibility of data. Organizations must ensure that the data feeding into their AI systems is accurate, comprehensive, and the definitive “source of truth.” Failure to address data quality issues can lead to incorrect outputs that undermine the effectiveness of specific control mechanisms. Establishing robust data management practices, including data governance and integration, is crucial for unlocking the full potential of AI-powered internal controls. This is equally true for internal controls.

Effective implementation of AI-driven internal controls requires a skilled workforce. Companies must invest in developing internal capabilities to handle these advanced tools and accurately analyze the results. This may involve training existing employees, hiring specialized talent, and fostering a culture of continuous learning. Understanding the nuances of machine learning, natural language processing, and other AI techniques is essential for internal teams to leverage these technologies successfully. For the compliance professional, it may mean adding expertise or partnering with internal audit or your internal controls team to garner the talent needed to move to AI-powered internal controls.

The integration of AI into internal controls raises important ethical considerations. Acknowledging and addressing the inherent biases that can exist within specific AI algorithms is imperative. By creating AI systems that are open, fair, and responsible, organizations can preserve stakeholder trust and uphold their ethical norms. Incorporating ethical principles and bias mitigation strategies into designing and deploying AI-powered internal controls is critical.

Successful implementation of AI-driven internal controls often requires close collaboration with technology providers. Companies and compliance professionals should seek out respected partners who can offer customized solutions that align with their specific internal requirements. These collaborations can provide continuous assistance as the intelligence and capabilities of the AI systems evolve. By fostering a collaborative environment, companies can ensure that the integration of AI into their internal control framework is seamless and practical.

Key Considerations for AI-Powered Internal Controls

There are a few key considerations for organizations to ensure the ethical deployment of AI-powered internal controls:

  1. Transparency and Explainability: The AI system’s decision-making process should be as transparent and explainable as possible. Organizations should be able to explain how the system arrives at its decisions and recommendations and provide clear documentation on the data, algorithms, and assumptions used.
  2. Fairness and Non-Discrimination: The AI system should be carefully audited to ensure it does not exhibit biases or discriminate against protected groups. Organizations should implement testing and monitoring processes to detect and mitigate unfair or discriminatory outcomes.
  3. Human Oversight and Accountability: Clear human oversight and accountability measures should be implemented. Employees should be able to understand, challenge, and override the AI system’s decisions when appropriate. There should also be defined processes for addressing errors or unintended consequences.
  4. Data Privacy and Security: The data used to train and operate the AI system must be adequately secured and protected to respect employee privacy. Organizations should have robust data governance policies and procedures in place.
  5. Ongoing Monitoring and Adjustment: The ethical performance of the AI system should be continuously monitored, and organizations should be prepared to adjust or refine as issues are identified. This may require establishing an AI ethics review board or similar governance structure.
  6. Alignment with Organizational Values: The deployment of the AI system should be aligned with the organization’s ethical principles and values. There should be a clear understanding of how the system supports the organization’s mission and commitment to employee wellbeing.
  7. Employee Engagement and Education: Employees should be informed about using AI-powered internal controls and receive training on interacting with the system. This can help build trust and ensure the system is used appropriately.

By addressing these key areas, organizations can work towards the ethical deployment of AI-powered internal controls and build trust with their employees. Collaboration with ethicists, legal experts, and other stakeholders can help refine best practices in this rapidly evolving landscape. However, this remains an evolving and complex area that requires ongoing vigilance and adaptation.

Ethical AI Deployment

There are some examples of organizations that have successfully navigated the challenges of ethical AI deployment.

Microsoft has been faced with ensuring fairness and mitigating bias in AI systems. To meet this, the company developed a comprehensive, Responsible AI Standard outlining principles and practices for ethical AI development.

IBM was challenged to achieve transparency and explainability in AI-powered decision-making. To meet this challenge, IBM has invested in explainable AI (XAI) technologies, such as its AI Explainability 360 toolkit. This enables developers to understand and interpret the inner workings of their AI models.

Google faced privacy and security concerns when using employee data for AI development. Google has established a Responsible AI Principles framework emphasizing data privacy and security, including differential privacy and secure multi-party computation techniques.

Salesforce must ensure alignment between AI-powered tools and the organization’s ethical values. To this end, it developed guidance through its AI Ethics & Humanism Council on the responsible development and use of AI across the company. This includes aligning AI systems with Salesforce’s core values.

Anthem needs to gain employee trust and acceptance in using AI-powered internal controls. To do so, Anthem has implemented an “AI Ambassadors” program, where select employees are trained to help their colleagues understand and navigate the company’s AI-powered systems, fostering greater acceptance and trust.

These examples demonstrate how leading organizations have proactively addressed the ethical challenges of AI deployment through a combination of technical, policy, and organizational approaches. By prioritizing principles like fairness, transparency, privacy, and alignment with corporate values, these companies have made progress in ensuring the responsible and trustworthy use of AI within their organizations, particularly around AI-powered internal controls.

Both compliance and internal audit professionals must recognize the pivotal role that AI can play in enhancing the effectiveness of internal controls. By proactively exploring the incorporation of AI into their control mechanisms, organizations can gain a significant advantage in managing the complexities of modern enterprises and the ever-increasing data landscape. The deliberate integration of AI into internal controls will be a crucial factor in determining the success and resilience of an organization’s overall governance framework.

Integrating artificial intelligence into internal controls represents an opportunity for organizations to strengthen their control environment and make more informed decisions. Compliance professionals can help AI-powered internal controls become a cornerstone of effective corporate governance by addressing data quality, skill development, ethical considerations, and collaboration. I am excited to see how this technology continues to evolve and reshape the way we approach internal control systems and your compliance program.

Join us tomorrow as we examine the role of compliance in keeping AI decisions fair and unbiased.

Categories
Compliance Tip of the Day

Compliance Tip of the Day: AI Governance Framework

Welcome to “Compliance Tip of the Day,” the podcast where we bring you daily insights and practical advice on navigating the ever-evolving landscape of compliance and regulatory requirements.

Whether you’re a seasoned compliance professional or just starting your journey, our aim is to provide you with bite-sized, actionable tips to help you stay on top of your compliance game.

Join us as we explore the latest industry trends, share best practices, and demystify complex compliance issues to keep your organization on the right side of the law.

Tune in daily for your dose of compliance wisdom, and let’s make compliance a little less daunting, one tip at a time.

In today’s episode, we begin a weeklong look at some of the ways generative AI is changing compliance and risk management. Today, we consider how to approach a comprehensive AI governance framework.

For more information on the Ethico ROI Calculator and a free White Paper on the ROI of Compliance, click here.

Categories
Blog

AI in Compliance Week: Part 2 – A Comprehensive Governance Approach

We continue our weeklong exploration of issues related to using Generative AI in compliance by examining some AI governance issues. In the rapidly evolving landscape of AI, the importance of robust governance frameworks cannot be overstated. The need for comprehensive governance structures to ensure compliance, ethical alignment, and trustworthiness has become paramount as AI systems become increasingly integrated into compliance. Today, we will consider the critical areas of compliance governance and ethics governance and present a holistic approach to mitigating the risks associated with these issues.

MIA AI Governance: The Problems

Missing compliance governance can have far-reaching consequences, undermining the integrity of an entire AI-driven initiative. Businesses must ensure alignment with enterprise-wide governance, compliance, and control (GRC) frameworks. This includes aligning with model risk management practices and embedding robust compliance checks throughout the AI model lifecycle. By promoting awareness of how the AI model works at your organization, you can minimize information asymmetries between development teams, users, and target audiences, fostering a culture of transparency and accountability.

The lack of ethical governance can lead to misalignment with an organization’s values, brand identity, or social responsibility. The answer is that companies should develop comprehensive AI ethics governance methods, including defining ethical principles, establishing an AI ethics review board, and creating a compliance program that addresses ethical concerns. Adopting frameworks like Ethically Aligned AI Design (EAAID) can help integrate ethical considerations into the design process while incorporating AI governance benchmarks beyond traditional measurements to encompass social and moral accountability.

Another outcome of the lack of trustworthy or responsible AI governance can result in unintentional and significant damage. To address this, compliance professionals should help develop accountable and trustworthy AI governance methods that augment enterprise-wide GRC structures. This can include establishing a committee such as an AI Advancement Council or similar structure in your company to oversee mission priorities and strategic AI advancement planning, collaborating with service line leaders and program offices to align with ethical AI guidelines and practices, and developing compliance programs to guide conformance with ethical AI principles and relevant legislation. Finally, implementing AI-independent verification and validation processes can help identify and manage unintentional outcomes.

The Solution

By addressing the critical areas of compliance governance and ethics governance through a more holistic approach, businesses can create a comprehensive framework that mitigates the risks associated with the absence of these crucial elements. This approach ensures that AI systems comply with relevant regulations and standards and align with your company’s values, ethical principles, and the pursuit of trustworthy and responsible AI. As the AI landscape evolves, this comprehensive governance framework will be essential in navigating the complexities and safeguarding the integrity of AI-driven initiatives.

Here are some key steps compliance professionals and businesses can think through to facilitate AI governance in your company:

  1. Establish a Centralized AI Governance Body:
    • Create an AI Governance Council that oversees your organization’s AI strategy, policies, and practices.
    • Ensure the council includes representatives from various stakeholder groups, such as legal, compliance, ethics, risk management, IT, and other subject matter experts.
    • Empower the council to develop and enforce AI governance frameworks, guidelines, and processes.
  2. Conduct AI Risk Assessments:
    • Identify and assess the risks associated with the organization’s AI initiatives, including compliance, ethical, and other compliance-related risks.
    • Prioritize the risks based on their potential impact and likelihood of occurrence.
    • Develop mitigation strategies and action plans to address the identified risks.
  3. Align AI Governance with Enterprise-wide Frameworks:
    • Ensure the AI governance framework is integrated with the organization’s existing GRC and Risk Management processes.
    • Establish clear lines of accountability and responsibility for AI-related activities across the organization.
    • Integrate AI governance into the organization’s broader risk management and compliance programs.
  4. Implement Compliance Governance Processes:
    • Develop and enforce AI-specific compliance controls, policies, and procedures.
    • Embed compliance checks throughout the AI model lifecycle, from development to deployment and monitoring.
    • Provide training and awareness programs to educate employees on AI compliance requirements.
  5. Establish Ethics Governance Mechanisms:
    • Define the organization’s AI ethics principles, values, and code of conduct.
    • Create an AI Ethics Review Board to assess and monitor the ethical implications of AI initiatives.
    • Implement processes for ethical AI design, such as the Ethically Aligned AI Design methodology.
    • Incorporate ethical AI benchmarks and accountability measures into the organization’s performance management and reporting processes.
  6. Implement Reliance-Related Governance:
    • Develop responsible and trustworthy AI governance practices that align with the organization’s enterprise-wide GRC frameworks.
    • Establish an AI Advancement Council to oversee strategic AI planning and alignment with ethical guidelines.
    • Implement AI-independent verification and validation processes to identify and manage unintended outcomes.
    • Provide comprehensive training and awareness programs on AI risk management for employees, contractors, and other stakeholders.
  7. Foster a Culture of AI Governance:
    • Promote a culture of accountability, transparency, and continuous improvement around AI governance.
    • Encourage cross-functional collaboration and communication to address AI-related challenges and opportunities.
    • Review and update the AI governance framework regularly to adapt to evolving regulatory requirements, technological advancements, and organizational needs.

By following these steps, organizations can implement a comprehensive governance framework that addresses compliance, ethics, and reliance-related governance. This framework enables organizations to harness the power of AI while mitigating the associated risks. 

AI Governance Resources

There are several notable resources the compliance professional can tap into around this issue of AI governance practices. The Partnership on AI Partnership on AI is a multi-stakeholder coalition of leading technology companies, academic institutions, and nonprofit organizations. It has been at the forefront of developing best practices and guidelines for the responsible development and deployment of AI systems. It has published influential reports and frameworks, such as the Tenets of Responsible AI and the Model Cards for Model Reporting, which have been widely adopted across the industry.

The Algorithmic Justice League (ALJ) is a nonprofit organization dedicated to raising awareness about AI’s social implications and advocating algorithmic justice. It has developed initiatives such as the Algorithmic Bias Bounty Program, encouraging researchers and developers to identify and report biases in AI systems. The AJL has highlighted the importance of addressing algorithmic bias and discrimination in AI.

IEEE Global Initiative on Ethics of Autonomous and Intelligent Systems is a multidisciplinary effort to develop standards, guidelines, and best practices for the ethical design, development, and deployment of autonomous and intelligent systems. It has produced key documents and reports, such as the Ethically Aligned Design framework, which guides the incorporation of ethical considerations into AI development.

The AI Ethics & Governance Roundtable is an initiative led by the University of Cambridge’s Leverhulme Centre for the Future of Intelligence. It brings together industry, academia, and policymaking experts to discuss emerging issues, share best practices, and develop collaborative solutions for AI governance. The roundtable’s insights and recommendations have influenced AI governance frameworks and policies at the organizational and regulatory levels.

These examples demonstrate the power of industry collaboration in advancing AI governance practices. By pooling resources, expertise, and diverse perspectives, these initiatives have developed comprehensive frameworks, guidelines, and standards being adopted across the AI ecosystem. Compliance professionals should avail themselves of these resources to prepare your company to take the next brave steps in the intersection of compliance, governance, and AI.

Categories
Compliance Tip of the Day

Compliance Tip of the Day: How AI is Transforming Risk Management

Welcome to “Compliance Tip of the Day,” the podcast where we bring you daily insights and practical advice on navigating the ever-evolving landscape of compliance and regulatory requirements.

Whether you’re a seasoned compliance professional or just starting your journey, our aim is to provide you with bite-sized, actionable tips to help you stay on top of your compliance game.

Join us as we explore the latest industry trends, share best practices, and demystify complex compliance issues to keep your organization on the right side of the law.

Tune in daily for your dose of compliance wisdom, and let’s make compliance a little less daunting, one tip at a time.

In today’s episode, we begin a week-long look at some of the ways Generative AI is changing compliance and Risk Management.

For more information on the Ethico ROI Calculator and a free White Paper on the ROI of Compliance, click here.