Data Integration - Technical Standards ()
Data Integration - Technical Standards
Technical Standards for Data Integration (opengroup.org): https://publications.opengroup.org/white-papers/architecture/w211 Copy available in SP2010: https://dialogue/proj/ITCD-RMTI/SAS-SAS/Documents/Governance/Training/TOGAF%209.2/The%20Open%20Group%20Documents DETAILS This document identifies and briefly describes the technical standards relevant to structured data integration, and discusses some wider non-technical considerations. It covers de facto best practice standards, standards from industry consortia, and standards from formal standards bodies. It is intended for Technical Architects and Data Architects. By listing relevant standards, this document provides a useful body of reference. It helps Enterprise Architects to achieve Boundaryless Information Flow™ by improving data integration in their enterprises. It also provides a basis for future work from The Open Group to identify and describe data integration best practices. Author(s) Chris Harding, Principal, Lacibus Ltd. and The Data Integration Work Group of the Architecture Forum Published 24 Jun 2021 Pages 45 Type White Papers Subject Enterprise Architecture Document No.: W211 Published by The Open Group, June 2021. Any comments relating to the material contained in this document may be submitted to: The Open Group, Apex Plaza, Forbury Road, Reading, Berkshire, RG1 1AX, United Kingdom or by email to: ogpubs@opengroup.org
Boundaryless Information Flow
Improve Data Integration In The Enterprise
Technical Standards for Data Integration
Provides Basis For Future Data Integration Best Practices
List Relevant Data Integration Standards
Provide Useful Body of Reference
Enterprise Architect
References
An Information Architecture Vision: Moving from Data Rich to Information Smart
Data Management Body of Knowledge
Encyclopedia of Computer Science
Gartner Identifies Top Ten Data and Analytics Technology Trends for 2021
Information Architecture: Business Intelligence & Analytics and Metadata Management Reference Models
ISO-IEC 10646.2020 Information Technology - Universal Coded Character Set (UCS)
ISO-IEC 11179-1.2015 Information Technology - Metadata Registries (MDR)
Merriam-Webster Dictionary
O-DEF The Open Data Element Framework
The Rise of Big Data
TOGAF Standard v9.2
Dr. Chris Harding
Data Integration Challenges
Avoid Poor Data Quality
Keep Data Synchronized
Make Efforts To Understand the Data
Address Organizational and Cultural Issues
Contribute To Data Defense
View Data Integration As A Continuous Process
Manage Complexity In Mapping Between Different Data Models
Data Integration Context
Data Discover & Extract
Data Transform & Integrate
Data Planning
Data Verify
Lifecycle Management
Data Disposition
Archive Data
Store Data
Data Use
Document Scope
How Data Integration Works
Analysis and Transformation
Source Data
Contextual Metadata
Integrated Data
Document Structure
Data Fabric and Data Mesh
Data Fabric
Data Mesh
Data Platforms
Representation Standards
Data Encoding Standards
Content Display Standards
HyperText Markup Language (HTML)
Standard Generalized Markup Language (SGML)
Open Document Format (ODF)
Microsoft Office Word
Hybrid Data
Structure Standards
Generic Data Structure Standards
Relational Data Standards
Structured Query Language (SQL)
SQL or Call-Level Interface (CLI)
Open Database Connectivity (ODBC)
Spreadsheets
RDF Triple Stores Standards
Resource Description Framework (RDF)
SPARQL Protocol and RDF Query Language (SPARQL)
RDF Mapping
JSON and YAML Standards
JavaScript Notation Object (JSON)
YAML (YAML Ain’t Markup Language)
XML Standards
XML Path Language (XPath)
Document Type Definition (DTD)
Extensible Markup Language (XML)
XML Query (XQuery)
XPath Data Model (XDM)
XML Schema Definition (XSD) Language
Domain-Specific Standards
UN Electronic Data Interchange for Administration, Commerce and Transport (UN-EDIFACT)
Open Banking Standard
Open Financial Exchange (OFX)
Fast Healthcare Interoperability Resources (FHIR)
API Standards
Wider Considerations for Data Integration Standards
Metadata Standards
Structure-Independent Metadata
Data Warehouse Metadata
Common Warehouse Metamodel (CWM)
Identification Codes
United Nations Standard Products and Services Code (UNSPSC)
Standard Industrial Classification (SIC) Codes
Global Trade Item Numbers (GTIN)
Harmonized System (HS) Codes
ISO 3166 Country Codes
Dictionaries
ISO 22745
ECCMA Open Technical Dictionary (EOTD)
Data Storage Systems
UNIX File Store
Apache Hadoop Distributed File System (HDFS)
Blockchain System
Relational Data Standards
Metadata Registries
O-DEF Standard
ERA Models
Standard Data Models
RDF Triple Stores
Dublin Core Vocabulary
Friend Of A Friend (FOAF) Vocabulary Specification
XML Standard
JSON and YAML
Hybrid Data
BNF Standard
Domain-Specific Structures
Data Analysis and Transformation Standards
DMBOK
Template Languages
Django Template Processor
The Apache FreeMarker
Hugo Templating
Liquid Template Language
Transformation Utilities
Description Source-URL
Perl
eXtensible Stylesheet Language (XSL)
Turing eXtender Language (TXL)
Data Science
Structured Data Query Languages
Machine Learning
Document Acronyms and Abbreviations
Boundaryless Information Flow Enterprise Architect
Improve Data Integration In The Enterprise Boundaryless Information Flow
Technical Standards for Data Integration Improve Data Integration In The Enterprise
Technical Standards for Data Integration List Relevant Data Integration Standards
Technical Standards for Data Integration Provides Basis For Future Data Integration Best Practices
List Relevant Data Integration Standards Provide Useful Body of Reference
References An Information Architecture Vision: Moving from Data Rich to Information Smart
References Data Management Body of Knowledge
References Encyclopedia of Computer Science
References Gartner Identifies Top Ten Data and Analytics Technology Trends for 2021
References Information Architecture: Business Intelligence & Analytics and Metadata Management Reference Models
References ISO-IEC 10646.2020 Information Technology - Universal Coded Character Set (UCS)
References ISO-IEC 11179-1.2015 Information Technology - Metadata Registries (MDR)
References Merriam-Webster Dictionary
References O-DEF The Open Data Element Framework
References The Rise of Big Data
References TOGAF Standard v9.2
Dr. Chris Harding Technical Standards for Data Integration
Data Integration Challenges Avoid Poor Data Quality
Data Integration Challenges Keep Data Synchronized
Data Integration Challenges Manage Complexity In Mapping Between Different Data Models
Data Integration Challenges Make Efforts To Understand the Data
Data Integration Challenges Address Organizational and Cultural Issues
Data Integration Challenges Contribute To Data Defense
Data Integration Challenges View Data Integration As A Continuous Process
Data Integration Context Data Discover & Extract
Data Integration Context Data Transform & Integrate
Data Integration Context Data Planning
Data Integration Context Data Verify
Data Integration Context Lifecycle Management
Data Discover & Extract Data Transform & Integrate
Data Transform & Integrate Data Verify
Data Planning Data Discover & Extract
Go Live Data Verify Lifecycle Management
Lifecycle Management Data Disposition
Lifecycle Management Archive Data
Lifecycle Management Store Data
Lifecycle Management Data Use
Document Scope Technical Standards for Data Integration
How Data Integration Works Analysis and Transformation
How Data Integration Works Source Data
How Data Integration Works Contextual Metadata
How Data Integration Works Integrated Data
Source Data Analysis and Transformation
Contextual Metadata Analysis and Transformation
Integrated Data Analysis and Transformation
Document Structure Technical Standards for Data Integration
Data Fabric and Data Mesh Data Fabric
Data Fabric and Data Mesh Data Mesh
Data Fabric and Data Mesh Data Platforms
Representation Standards Data Encoding Standards
Representation Standards Content Display Standards
Representation Standards Hybrid Data
Content Display Standards HyperText Markup Language (HTML)
Content Display Standards Standard Generalized Markup Language (SGML)
Content Display Standards Open Document Format (ODF)
Content Display Standards Microsoft Office Word
Structure Standards Generic Data Structure Standards
Structure Standards Domain-Specific Standards
Generic Data Structure Standards Relational Data Standards
Generic Data Structure Standards Spreadsheets
Generic Data Structure Standards RDF Triple Stores Standards
Generic Data Structure Standards JSON and YAML Standards
Generic Data Structure Standards XML Standards
Relational Data Standards Structured Query Language (SQL)
Relational Data Standards SQL or Call-Level Interface (CLI)
Relational Data Standards Open Database Connectivity (ODBC)
Spreadsheets Relational Data Standards
RDF Triple Stores Standards Resource Description Framework (RDF)
RDF Triple Stores Standards SPARQL Protocol and RDF Query Language (SPARQL)
RDF Triple Stores Standards RDF Mapping
JSON and YAML Standards JavaScript Notation Object (JSON)
JSON and YAML Standards YAML (YAML Ain’t Markup Language)
XML Standards XML Path Language (XPath)
XML Standards Document Type Definition (DTD)
XML Standards Extensible Markup Language (XML)
XML Standards XML Query (XQuery)
XML Standards XPath Data Model (XDM)
XML Standards XML Schema Definition (XSD) Language
Domain-Specific Standards UN Electronic Data Interchange for Administration, Commerce and Transport (UN-EDIFACT)
Domain-Specific Standards Open Banking Standard
Domain-Specific Standards Open Financial Exchange (OFX)
Domain-Specific Standards Fast Healthcare Interoperability Resources (FHIR)
Metadata Standards Structure-Independent Metadata
Metadata Standards Data Storage Systems
Metadata Standards Relational Data Standards
Metadata Standards RDF Triple Stores
Metadata Standards XML Standard
Metadata Standards JSON and YAML
Metadata Standards Hybrid Data
Metadata Standards BNF Standard
Metadata Standards Domain-Specific Structures
Structure-Independent Metadata Data Warehouse Metadata
Structure-Independent Metadata Identification Codes
Structure-Independent Metadata Dictionaries
Data Warehouse Metadata Common Warehouse Metamodel (CWM)
Identification Codes United Nations Standard Products and Services Code (UNSPSC)
Identification Codes Standard Industrial Classification (SIC) Codes
Identification Codes Global Trade Item Numbers (GTIN)
Identification Codes Harmonized System (HS) Codes
Identification Codes ISO 3166 Country Codes
Dictionaries ISO 22745
Dictionaries ECCMA Open Technical Dictionary (EOTD)
Data Storage Systems UNIX File Store
Data Storage Systems Apache Hadoop Distributed File System (HDFS)
Data Storage Systems Blockchain System
Relational Data Standards Metadata Registries
Relational Data Standards O-DEF Standard
Relational Data Standards ERA Models
Relational Data Standards Standard Data Models
RDF Triple Stores Dublin Core Vocabulary
RDF Triple Stores Friend Of A Friend (FOAF) Vocabulary Specification
Data Analysis and Transformation Standards DMBOK
Data Analysis and Transformation Standards Template Languages
Data Analysis and Transformation Standards Transformation Utilities
Data Analysis and Transformation Standards Data Science
Data Analysis and Transformation Standards Structured Data Query Languages
Data Analysis and Transformation Standards Machine Learning
Template Languages Django Template Processor
Template Languages The Apache FreeMarker
Template Languages Hugo Templating
Template Languages Liquid Template Language
Transformation Utilities Description Source-URL
Transformation Utilities Perl
Transformation Utilities eXtensible Stylesheet Language (XSL)
Transformation Utilities Turing eXtender Language (TXL)
Document Acronyms and Abbreviations Technical Standards for Data Integration