Standards in Artificial Intelligence

AD25403:

Standards in Artificial Intelligence

Overview of Standards

Basic concepts of standardization: Purpose of Standardization, marking and certification of articles and processes; Importance of standards to industry, policy makers, trade, sustainability and innovation. Objectives, roles and functions of BIS, Bureau of Indian Standards Act, ISO/IEC Directives; WTO Good Practices for Standardization. Important Indian and International Standards.

International Standards in Artificial Intelligence

Introduction - Importance of standards in IT-Overview of key international standards organizations ISO Standards – ISO/IEC 23053:2022 Framework for AI systems using machine learning, ISO/IEC 42001:2023AI management systems, ISO/IEC 23894:2023AI – Guidance on risk management,

IEEE Standards IEEE P3123™ – Standard for Artificial Intelligence and Machine Learning (AI/ML) Terminology and Data Formats, IEEE P7015™ – Standard for Data and Artificial Intelligence (AI) Literacy, Skills, and Readiness, IEEE P3198™ – Standard for Evaluation Method of Machine Learning Fairness, IEEE P1948. 1™ – Standard for Artificial Intelligence Based Network Applications in 5G and Beyond Mobile Networks, IEEE 2801™-2022 – IEEE Recommended Practice for the Quality Management of Datasets for Medical Artificial Intelligence, IEEE 2941™-2021 – IEEE Standard for Artificial Intelligence (AI) Model Representation, Compression, Distribution, and Management, IEEE 2941. 2™-2023 – IEEE Standard for Application Programming Interfaces (APIs) for Deep Learning (DL) Inference Engines, IEEE P2975. 2™ – Standard for Model Verification & Validation of Industrial Artificial Intelligence Systems, IEEE P2976™ – Standard for XAI – eXplainable Artificial Intelligence – for Achieving Clarity and Interoperability of AI Systems Design, IEEE P3127™ – Guide for an Architectural Framework for Blockchain-based Federated Machine Learning, IEEE 3129™-2023 – IEEE Standard for Robustness Testing and Evaluation of Artificial Intelligence (AI) -based Image Recognition Service, IEEE 3333. 1. 3™-2022 – IEEE Standard for the Deep Learning-Based Assessment of Visual Experience Based on Human Factors, IEEE P3157™ – Recommended Practice for Vulnerability Test for Machine Learning Models for Computer Vision Applications, IEEE 3168™-2024 – IEEE Standard for Robustness Evaluation Test Methods for a Natural Language Processing Service That Uses Machine Learning, IEEE P3419™ – Standard for Large Language Model Evaluation, IEEE 7010™-2020 – IEEE Recommended Practice for Assessing the Impact of Autonomous and Intelligent Systems on Human Well-Being, IEEE P7018™ – Standard for Security and Trustworthiness Requirements in Generative Pretrained Artificial Intelligence (AI) Models,IEEE P7100™ – Standard for Measurement of Environmental Impacts of Artificial Intelligence Systems,

ACM Standards and Guidelines -ACM Code of Ethics and Professional Conduct-ACM Computing Classification System (CCS) and its role in standardization

References:

1. Manual for Standards Formulation 2022, Bureau of Indian Standards

2. Kunas, Michael, “Implementing service quality based on ISO/IEC 20000: A management guide” IT Governance publishing, 2012.

3. Sid Ahmed Benraouane, AI Management System Certification According to the ISO/IEC 42001 Standard: How to Audit, Certify, and Build Responsible AI Systems, Productivity Press; 1st edition, June 2024.

4. ISO/IEC 42001:2023 Information technology — Artificial intelligence — Management system, Edition 1, 2023.

5. ISO/IEC 23894:2023 Information technology — Artificial intelligence — Guidance on risk management, Edition 1, 2023.

6. ISO/IEC 23053:2022 Framework for Artificial Intelligence (AI) Systems Using Machine Learning (ML), Edition 1, 2022.

7. IEEE portfolio of AIS technology and impact standards and standards projects [https://standards.ieee.org/initiatives/autonomous-intelligence-systems/standards/]

8. Kan, S. H. “Standards for Information Technology and Systems”, Prentice Hall, 2017.

9. Association for Computing Machinery. “ACM Code of Ethics and Professional Conduct: A Guide” ACM, 2018.