California’s AI Policy: Delving into Senate Bill 896

The Senate Bill 896, known as the Artificial Intelligence Accountability Act and introduced by Senator Dodd to the California Senate on January 3, 2024, has been referred to the Senate Committee on Governmental Organization. It aims to bolster innovation, consumer protection, and adherence to Executive Orders on AI issued by President Biden and Governor Newsom.

The bill proposes regulations for state agencies regarding the use of emerging technology, including the requirement of risk assessments for AI systems and emphasis on ethical AI practices. Here’s an overview of its key facets:

Applicability

• This bill aims to direct the decision-making processes of state agencies, departments, and subdivisions in their handling of automated decision-making technologies, encompassing review, adoption, management, governance, and regulation.
• It also emphasizes that state leadership should encourage the private sector to adopt the best practices and safeguards laid down in different statutes and regulations.

Prioritizing Responsible AI Use

• Recognizing AI’s potential to improve citizens’ lives and governmental functions, the bill emphasizes principles of fairness, transparency, privacy, and accountability in its deployment by state agencies to ensure protection of the rights and opportunities of Californians.
• It provides that pilot projects for GenAI applications will explore innovative solutions while upholding these values.

Prevention of risks associated with GenAI

• The bill highlights the need to mitigate potential risks such as violation of privacy, cyberattacks, and biases based on demographics, and safeguard against harmful effects associated with the use of GenAI.

Collaborations

• The bill advocates for partnerships between state universities, private enterprises and relevant state agencies to train students in AI, empowering individuals to effectively harness the technology.

Requirements for state agencies

• The Government Operations Agency, along with the Department of Technology and the Office of Data and Innovation, is tasked with formulating and periodically updating guidelines for state agencies and departments. These guidelines aim to assess the potential impact of adopting GenAI on vulnerable communities.
• Additionally, these entities are required to produce a comprehensive report, titled the “State of California Benefits and Risks of Generative Artificial Intelligence Report,” which entails:
  • Conducting an examination of notable and potentially advantageous applications of GenAI tools by the state;
  • Providing an elucidation of the potential risks of the uses accruing to individuals, communities, and government employees; and
  • Providing an explanation of the risks posed by malicious actors and poorly protected government systems, as well as the risks associated with democratic and legal processes, public health and safety, and the economy.
• The bill requires the Director of Emergency Services, in conjunction with the California Cybersecurity Integration Center and the State Threat Assessment Center, to conduct a collaborative risk analysis pertaining to the potential threats posed by the implementation of GenAI on California’s critical energy infrastructure, such as mass casualty events and environmental emergencies, and present the resulting analysis to the Governor.
• Additionally, the Government Operations Agency, in conjunction with the Department of General Services, the Department of Technology, and the California Cybersecurity Integration Center, will take on the responsibility of establishing general guidelines pertaining to public sector procurement, uses, and trainings for the integration and use of GenAI.

Additional requirements for state agencies

• Some of the additional requirements for various state agencies include:
  • Documenting and submitting an inventory detailing all ongoing high-risk deployments of GenAI;  
  • Clearly identifying and communicating whenever GenAI engages directly with individuals, either through online platforms or telephonic means;
  • Conducting evaluations of any automated decision-making systems intended for adoption by state agencies or departments to ascertain their risk before implementation; and
  • Providing support to the state government workforce by organizing training programs for state government employees on use of state-approved GenAI tools.

Senate Bill 896 signals the dawn of a new era in AI governance, setting the stage for ethical AI adoption across state agencies. Through steadfast prioritization of transparency and collaboration, this legislation will establish a robust framework aimed at safeguarding citizens while nurturing technological progress.

You can access the bill by following this link. 

Looking for guidance on your AI implementation journey?

Connect with Ajay Mago or any member of EM3’s Artificial Intelligence practice for professional support. 

---

Disclaimer: This publication is for information purposes only and should not be construed as legal advice or a substitute for legal counsel. This information is not intended to create an attorney-client relationship. Do not send us any unsolicited confidential information unless and until a formal attorney-client relationship has been established. EM3 Law is under no duty of confidentiality to persons sending unsolicited messages, e-mails, mail, facsimiles and/or any other information by any other means to our firm or attorneys prior to the formal establishment of such relationship. The views and opinions expressed herein are those of the author(s) and do not necessarily reflect the views of the firm.