As a one-stop multi-cloud big data management platform, CyberData includes:
Data integration: Supports data synchronization between heterogeneous networks and heterogeneous data sources. It supports transmission modes such as full/incremental offline synchronization, offline synchronization of database shards and tables, real-time synchronization, and full database synchronization.
Data development: Data development IDE, integrating batch flow development, and various task DAG orchestration forms to achieve task dependency across cycles and business processes. The main functions include data development, temporary queries, table management, resource management, function management, connectors, code templates, and recycle bins. Supports single environment mode/development and production isolation mode.
Operation and maintenance center: Supports operation and maintenance capabilities such as operation and maintenance overview, task batch data correction, intelligent baseline alarms, etc., to effectively increase the rate of troubleshooting problems, reduce the cost of troubleshooting problems, and run tasks smoothly. It provides different operation and maintenance management capabilities based on the different execution characteristics of offline and real-time tasks.
Data quality: Supports quality verification, notification and management services for various heterogeneous data sources, including comparison, SQL scan, and intelligent alarm functions.
Data assets: Provides a unified data query service, covering functions such as global data retrieval, detailed metadata review, metadata collection, data lineage, and data management to help users better search, understand and use data.
Data modeling: supports data warehouse model design to ensure that the modeling process is standardized and controllable. At the same time, it also supports reverse modeling to quickly manage the enterprise's existing data model. Supports associated data standards.
Data standards: Normative constraints that guarantee the consistency, accuracy, and completeness of data definition and use. Specifically, it includes standard definition, code table maintenance, measurement units, root management, and standard publication.
Data security: Provides the ability to request and approve data permissions, classify and classify data, and identify and desensitize sensitive data. It has control of database and table permissions, and supports permission application and renewal restrictions. It supports the creation and management of sensitive data identification tasks, and supports dynamic masking and static masking.
Data service: Provides the ability to quickly generate an API for data tables, and also supports existing APIs to registration management. The data service allows external application systems to call the API to obtain data through application authorization, supports API policy configuration, and uniformly manages and publishes the API.