imbajin commented on code in PR #113: URL: https://github.com/apache/incubator-hugegraph-doc/pull/113#discussion_r858217686
########## content/en/docs/quickstart/hugegraph-loader.md: ########## @@ -4,252 +4,251 @@ linkTitle: "Load data with HugeGraph-Loader" weight: 2 --- -### 1 HugeGraph-Loader概述 +### 1 HugeGraph-Loader overview -HugeGraph-Loader 是 HugeGragh 的数据导入组件，能够将多种数据源的数据转化为图的顶点和边并批量导入到图数据库中。 +HugeGraph-Loader is the data import component of HugeGragh, which can convert data from various data sources into graph vertices and edges and import them into the graph database in batches. -目前支持的数据源包括： +Currently supported data sources include: +- Local disk file or directory, supports TEXT, CSV and JSON format files, supports compressed files +- HDFS file or directory, supports compressed files +- Mainstream relational databases, such as MySQL, PostgreSQL, Oracle, SQL Server -- 本地磁盘文件或目录，支持 TEXT、CSV 和 JSON 格式的文件，支持压缩文件 -- HDFS 文件或目录，支持压缩文件 -- 主流关系型数据库，如 MySQL、PostgreSQL、Oracle、SQL Server +Local disk files and HDFS files support resumable uploads. -本地磁盘文件和 HDFS 文件支持断点续传。 +It will be explained in detail later. -后面会具体说明。 +> Note: HugeGraph-Loader requires HugeGraph Server service, please refer to [HugeGraph-Server Quick Start](/docs/quickstart/hugegraph-server) to download and start Server -> 注意：使用 HugeGraph-Loader 需要依赖 HugeGraph Server 服务，下载和启动 Server 请参考 [HugeGraph-Server Quick Start](/docs/quickstart/hugegraph-server) +### 2 Get HugeGraph-Loader -### 2 获取 HugeGraph-Loader +There are two ways to get HugeGraph-Loader: -有两种方式可以获取 HugeGraph-Loader： +- Download the compiled tarball +- Clone source code to compile and install -- 下载已编译的压缩包 -- 克隆源码编译安装 +#### 2.1 Download the compiled archive -#### 2.1 下载已编译的压缩包 - -下载最新版本的 HugeGraph-Loader release 包： +Download the latest version of the HugeGraph-Loader release package: ```bash wget https://github.com/hugegraph/hugegraph-loader/releases/download/v${version}/hugegraph-loader-${version}.tar.gz tar zxvf hugegraph-loader-${version}.tar.gz ``` -#### 2.2 克隆源码编译安装 +#### 2.2 Clone source code to compile and install -克隆最新版本的 HugeGraph-Loader 源码包： +Clone the latest version of HugeGraph-Loader source package: ```bash $ git clone https://github.com/hugegraph/hugegraph-loader.git ``` -由于Oracle ojdbc license的限制，需要手动安装ojdbc到本地maven仓库。 -访问[Oracle jdbc 下载](https://www.oracle.com/database/technologies/appdev/jdbc-downloads.html) 页面。选择Oracle Database 12c Release 2 (12.2.0.1) drivers，如下图所示。 +Due to the limitation of the Oracle ojdbc license, you need to manually install ojdbc to the local maven repository. +Visit the [Oracle jdbc downloads](https://www.oracle.com/database/technologies/appdev/jdbc-downloads.html) page. Select Oracle Database 12c Release 2 (12.2.0.1) drivers, as shown in the following figure. <center> <img src="/docs/images/oracle-download.png" alt="image"> </center> -打开链接后，选择“ojdbc8.jar”, 如下图所示。 +After opening the link, select "ojdbc8.jar" as shown below. <center> <img src="/docs/images/ojdbc8.png" alt="image"> </center> - 把ojdbc8安装到本地maven仓库，进入``ojdbc8.jar``所在目录，执行以下命令。 + Install ojdbc8 to the local maven repository, enter the directory where ``ojdbc8.jar`` is located, and execute the following command. ``` mvn install:install-file -Dfile=./ojdbc8.jar -DgroupId=com.oracle -DartifactId=ojdbc8 -Dversion=12.2.0.1 -Dpackaging=jar ``` -编译生成 tar 包: +Compile and generate tar package: ```bash cd hugegraph-loader mvn clean package -DskipTests ``` -### 3 使用流程 +### 3 Use the process -使用 HugeGraph-Loader 的基本流程分为以下几步： +The basic process of using HugeGraph-Loader is divided into the following steps: -- 编写图模型 -- 准备数据文件 -- 编写输入源映射文件 -- 执行命令导入 +- Write graph models +- Prepare data files +- Write input source map files +- Execute command import -#### 3.1 编写图模型 +#### 3.1 Writing a graph model -这一步是建模的过程，用户需要对自己已有的数据和想要创建的图模型有一个清晰的构想，然后编写 schema 建立图模型。 +This step is the modeling process. Users need to have a clear idea of their existing data and the graph model they want to create, and then write the schema to build the graph model. -比如想创建一个拥有两类顶点及两类边的图，顶点是"人"和"软件"，边是"人认识人"和"人创造软件"，并且这些顶点和边都带有一些属性，比如顶点"人"有："姓名"、"年龄"等属性， -"软件"有："名字"、"售卖价格"等属性；边"认识"有: "日期"属性等。 +For example, if you want to create a graph with two types of vertices and two types of edges, the vertices are "people" and "software", the edges are "people know people" and "people create software", and these vertices and edges have some attributes, For example, the vertex "person" has: "name", "age" and other attributes, +"Software" includes: "name", "sale price" and other attributes; side "knowledge" includes: "date" attribute and so on. <center> <img src="/docs/images/demo-graph-model.png" alt="image"> - <p>示例图模型</p> + <p>graph model example</p> </center> -在设计好了图模型之后，我们可以用`groovy`编写出`schema`的定义，并保存至文件中，这里命名为`schema.groovy`。 +After designing the graph model, we can use `groovy` to write the definition of `schema` and save it to a file, here named `schema.groovy`. ```groovy -// 创建一些属性 +// create some properties schema.propertyKey("name").asText().ifNotExist().create(); schema.propertyKey("age").asInt().ifNotExist().create(); schema.propertyKey("city").asText().ifNotExist().create(); schema.propertyKey("date").asText().ifNotExist().create(); schema.propertyKey("price").asDouble().ifNotExist().create(); -// 创建 person 顶点类型，其拥有三个属性：name, age, city，主键是 name +// Create the person vertex type, which has three attributes: name, age, city, and the primary key is name schema.vertexLabel("person").properties("name", "age", "city").primaryKeys("name").ifNotExist().create(); -// 创建 software 顶点类型，其拥有两个属性：name, price，主键是 name +// Create a software vertex type, which has two properties: name, price, the primary key is name schema.vertexLabel("software").properties("name", "price").primaryKeys("name").ifNotExist().create(); -// 创建 knows 边类型，这类边是从 person 指向 person 的 +// Create the knows edge type, which goes from person to person schema.edgeLabel("knows").sourceLabel("person").targetLabel("person").ifNotExist().create(); -// 创建 created 边类型，这类边是从 person 指向 software 的 +// Create the created edge type, which points from person to software schema.edgeLabel("created").sourceLabel("person").targetLabel("software").ifNotExist().create(); ``` -> 关于 schema 的详细说明请参考 [hugegraph-client](/docs/clients/hugegraph-client) 中对应部分。 +> Please refer to the corresponding section in [hugegraph-client](/docs/clients/hugegraph-client) for the detailed description of the schema. -#### 3.2 准备数据 +#### 3.2 Prepare data -目前 HugeGraph-Loader 支持的数据源包括： +The data sources currently supported by HugeGraph-Loader include: -- 本地磁盘文件或目录 -- HDFS 文件或目录 -- 部分关系型数据库 +- local disk file or directory +- HDFS file or directory +- Partial relational database Review Comment: keep the `-` order ########## content/en/docs/quickstart/hugegraph-loader.md: ########## @@ -4,252 +4,251 @@ linkTitle: "Load data with HugeGraph-Loader" weight: 2 --- -### 1 HugeGraph-Loader概述 +### 1 HugeGraph-Loader overview -HugeGraph-Loader 是 HugeGragh 的数据导入组件，能够将多种数据源的数据转化为图的顶点和边并批量导入到图数据库中。 +HugeGraph-Loader is the data import component of HugeGragh, which can convert data from various data sources into graph vertices and edges and import them into the graph database in batches. -目前支持的数据源包括： +Currently supported data sources include: +- Local disk file or directory, supports TEXT, CSV and JSON format files, supports compressed files +- HDFS file or directory, supports compressed files +- Mainstream relational databases, such as MySQL, PostgreSQL, Oracle, SQL Server -- 本地磁盘文件或目录，支持 TEXT、CSV 和 JSON 格式的文件，支持压缩文件 -- HDFS 文件或目录，支持压缩文件 -- 主流关系型数据库，如 MySQL、PostgreSQL、Oracle、SQL Server +Local disk files and HDFS files support resumable uploads. -本地磁盘文件和 HDFS 文件支持断点续传。 +It will be explained in detail later. -后面会具体说明。 +> Note: HugeGraph-Loader requires HugeGraph Server service, please refer to [HugeGraph-Server Quick Start](/docs/quickstart/hugegraph-server) to download and start Server -> 注意：使用 HugeGraph-Loader 需要依赖 HugeGraph Server 服务，下载和启动 Server 请参考 [HugeGraph-Server Quick Start](/docs/quickstart/hugegraph-server) +### 2 Get HugeGraph-Loader -### 2 获取 HugeGraph-Loader +There are two ways to get HugeGraph-Loader: -有两种方式可以获取 HugeGraph-Loader： +- Download the compiled tarball +- Clone source code to compile and install -- 下载已编译的压缩包 -- 克隆源码编译安装 +#### 2.1 Download the compiled archive -#### 2.1 下载已编译的压缩包 - -下载最新版本的 HugeGraph-Loader release 包： +Download the latest version of the HugeGraph-Loader release package: ```bash wget https://github.com/hugegraph/hugegraph-loader/releases/download/v${version}/hugegraph-loader-${version}.tar.gz tar zxvf hugegraph-loader-${version}.tar.gz ``` -#### 2.2 克隆源码编译安装 +#### 2.2 Clone source code to compile and install -克隆最新版本的 HugeGraph-Loader 源码包： +Clone the latest version of HugeGraph-Loader source package: ```bash $ git clone https://github.com/hugegraph/hugegraph-loader.git ``` -由于Oracle ojdbc license的限制，需要手动安装ojdbc到本地maven仓库。 -访问[Oracle jdbc 下载](https://www.oracle.com/database/technologies/appdev/jdbc-downloads.html) 页面。选择Oracle Database 12c Release 2 (12.2.0.1) drivers，如下图所示。 +Due to the limitation of the Oracle ojdbc license, you need to manually install ojdbc to the local maven repository. +Visit the [Oracle jdbc downloads](https://www.oracle.com/database/technologies/appdev/jdbc-downloads.html) page. Select Oracle Database 12c Release 2 (12.2.0.1) drivers, as shown in the following figure. <center> <img src="/docs/images/oracle-download.png" alt="image"> </center> -打开链接后，选择“ojdbc8.jar”, 如下图所示。 +After opening the link, select "ojdbc8.jar" as shown below. <center> <img src="/docs/images/ojdbc8.png" alt="image"> </center> - 把ojdbc8安装到本地maven仓库，进入``ojdbc8.jar``所在目录，执行以下命令。 + Install ojdbc8 to the local maven repository, enter the directory where ``ojdbc8.jar`` is located, and execute the following command. ``` mvn install:install-file -Dfile=./ojdbc8.jar -DgroupId=com.oracle -DartifactId=ojdbc8 -Dversion=12.2.0.1 -Dpackaging=jar ``` -编译生成 tar 包: +Compile and generate tar package: ```bash cd hugegraph-loader mvn clean package -DskipTests ``` -### 3 使用流程 +### 3 Use the process -使用 HugeGraph-Loader 的基本流程分为以下几步： +The basic process of using HugeGraph-Loader is divided into the following steps: -- 编写图模型 -- 准备数据文件 -- 编写输入源映射文件 -- 执行命令导入 +- Write graph models +- Prepare data files +- Write input source map files +- Execute command import -#### 3.1 编写图模型 +#### 3.1 Writing a graph model -这一步是建模的过程，用户需要对自己已有的数据和想要创建的图模型有一个清晰的构想，然后编写 schema 建立图模型。 +This step is the modeling process. Users need to have a clear idea of their existing data and the graph model they want to create, and then write the schema to build the graph model. -比如想创建一个拥有两类顶点及两类边的图，顶点是"人"和"软件"，边是"人认识人"和"人创造软件"，并且这些顶点和边都带有一些属性，比如顶点"人"有："姓名"、"年龄"等属性， -"软件"有："名字"、"售卖价格"等属性；边"认识"有: "日期"属性等。 +For example, if you want to create a graph with two types of vertices and two types of edges, the vertices are "people" and "software", the edges are "people know people" and "people create software", and these vertices and edges have some attributes, For example, the vertex "person" has: "name", "age" and other attributes, +"Software" includes: "name", "sale price" and other attributes; side "knowledge" includes: "date" attribute and so on. <center> <img src="/docs/images/demo-graph-model.png" alt="image"> - <p>示例图模型</p> + <p>graph model example</p> </center> -在设计好了图模型之后，我们可以用`groovy`编写出`schema`的定义，并保存至文件中，这里命名为`schema.groovy`。 +After designing the graph model, we can use `groovy` to write the definition of `schema` and save it to a file, here named `schema.groovy`. ```groovy -// 创建一些属性 +// create some properties schema.propertyKey("name").asText().ifNotExist().create(); schema.propertyKey("age").asInt().ifNotExist().create(); schema.propertyKey("city").asText().ifNotExist().create(); schema.propertyKey("date").asText().ifNotExist().create(); schema.propertyKey("price").asDouble().ifNotExist().create(); -// 创建 person 顶点类型，其拥有三个属性：name, age, city，主键是 name +// Create the person vertex type, which has three attributes: name, age, city, and the primary key is name schema.vertexLabel("person").properties("name", "age", "city").primaryKeys("name").ifNotExist().create(); -// 创建 software 顶点类型，其拥有两个属性：name, price，主键是 name +// Create a software vertex type, which has two properties: name, price, the primary key is name schema.vertexLabel("software").properties("name", "price").primaryKeys("name").ifNotExist().create(); -// 创建 knows 边类型，这类边是从 person 指向 person 的 +// Create the knows edge type, which goes from person to person schema.edgeLabel("knows").sourceLabel("person").targetLabel("person").ifNotExist().create(); -// 创建 created 边类型，这类边是从 person 指向 software 的 +// Create the created edge type, which points from person to software schema.edgeLabel("created").sourceLabel("person").targetLabel("software").ifNotExist().create(); ``` -> 关于 schema 的详细说明请参考 [hugegraph-client](/docs/clients/hugegraph-client) 中对应部分。 +> Please refer to the corresponding section in [hugegraph-client](/docs/clients/hugegraph-client) for the detailed description of the schema. -#### 3.2 准备数据 +#### 3.2 Prepare data -目前 HugeGraph-Loader 支持的数据源包括： +The data sources currently supported by HugeGraph-Loader include: -- 本地磁盘文件或目录 -- HDFS 文件或目录 -- 部分关系型数据库 +- local disk file or directory +- HDFS file or directory +- Partial relational database Review Comment: adjust the `-` order -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
