Change Password

Please enter the password
Please enter the password Length between [8, 64] ASCII characters Not identical to your email address At least 3 character types from uppercase, lowercase, numbers, and single-byte character symbols
Please enter the password
Submit

Change Nickname

Current Nickname:
Submit
Search
v4.0
    v4.0

    Project

    Manage Projects

    User can add, view, and manage projects in Project page.

    Viewable project details include: Project_Name, Etl_count (the number of ETLs in a project), Create_Time (Project's created time), Start_Time (the last time when ETL is operated), Status (the status of project).

    Click "View" to enter a project's configuration; or click "Delete" and confirm to delete a project.

    Create Projects

    As shown below:

    Diagram: Add a new project

    Configure Projects & Migrate Data

    ETL (Extract, Transfer, Load) is the smallest unit of data migration in projects. It represents a single data migration process composed of extraction, transfer, and loading of data. Each project must contain at least one ETL.

    Hence create, configure ETLs and set the order of operating ETLs is the major operations for projects' data migration.

    1. Create ETL

    As shown below:

    Diagram: Create an ETL

    2. Configure ETL

    • Firstly, set the import startegy for an ETL:
    Parameters
    Description
    batchSize The largest batch size allowed, must be equal to or less then 1,000,000.
    importMode When there is no data in current ETL, select "Normal" as the mode of imports; when current ETL has history data, select "Overwrite" to update or clear all properties other than unique identifiers UUID and ID, and properties carried by data inserting will be updated with uncarried data; "Upsert" means to update values of properties other than UUID and ID; only properties carried in the data will be updated, while those are not will remain unchanged. User can decide dependent on projects.
    stopWhenError Select "Yes" represents to automatically stop ETL process; "No" represents to continue ETL progress in the occasion of error.
    threads Operatable threads at maximum, must be equal to or less than 100.

    When "Yes" is selected for stopWhenError, system will stop data importing in the occurence of errors, and keeps imported data. Users will neeed to select "Overwrite" as importMode, operate this ETL again to complete data migration; if selecting options other than "Overwrite", there might chances that this ETL fails again.

    For instance:

    Diagram: Configure ETL's Import Strategy

    • Choose extraction source for ETL

    Click "Edit" icon of ETL Extraction Source in current ETL to view all available extraction sources, and click "Select" to complete. Or click "Add Source" to create more available sources.

    As shown below:

    Diagram: Select ETL's extraction source

    • Select loading source for ETL

    Click "Edit" icon of ETL Loading Source in current ETL to view all available loading sources, and click "Select" to complete. Or click "Add Source" to create more available loading sources.

    As shown below:

    Diagram: Select ETL loading sources

    • Set Query Script

    ETL query scripts come from query commands from different data platforms and are syntatically different. Maker imbeds query templates for each platforms for users to match with selected extraction sources.

    An example of Neo4j query scripts:

    MATCH (n:Person) RETURN n
    

    Meaning: find all Person nodes and return.

    An example of Mysql query scripts:

    Diagram: View log

    Meaning: find all `Student` nodes and return.

    An example of Hive query scripts:

    select * from mini_circle_edge_agree2 limit 10
    

    Meaning: find 10 nodes from graphset named mini_circle_edge_agree2.

    CSV and DAT do not require query scripts.

    • Set graph schema and schema properties

    Click to select ETL cards, and click the editing icon in front of graph schema, select schema for graph inputting, and choose schema properties in Ultipa Graph for selected schema to form a mapping relation:

    Diagram: Set Schema and Schema Properties

    3. Set ETL's operating sequence

    ETL's operating sequence should be set dependent on projects' demands, for instance:

    Diagram: 调整 ETL 运行顺序

    Operate Data Migration for Projects & View Logs

    After project configuration is completed, user can click "Operate in Set Order" to start data migration for a project and view operation logs:

    Diagram: 查看运行日志

    Note: projects in operating status can not be modified, users need to stop projects before any re-configurations.

    Please complete the following information to download this book
    *
    公司名称不能为空
    *
    公司邮箱必须填写
    *
    你的名字必须填写
    *
    你的电话必须填写
    *
    你的电话必须填写