This is an automated email from the ASF dual-hosted git repository.
weibin pushed a commit to branch research
in repository https://gitbox.apache.org/repos/asf/incubator-graphar.git
The following commit(s) were added to refs/heads/research by this push:
new f7e1cf09 Add datagen of is3
f7e1cf09 is described below
commit f7e1cf0950ee23453365a577e73b9972a2131d37
Author: acezen <[email protected]>
AuthorDate: Fri Sep 20 03:41:36 2024 +0800
Add datagen of is3
Signed-off-by: acezen <[email protected]>
---
scripts/6.5/gen-is3-data.sh | 18 ++++++++++++++++++
1 file changed, 18 insertions(+)
diff --git a/scripts/6.5/gen-is3-data.sh b/scripts/6.5/gen-is3-data.sh
new file mode 100644
index 00000000..6ecea91f
--- /dev/null
+++ b/scripts/6.5/gen-is3-data.sh
@@ -0,0 +1,18 @@
+!/bin/bash
+
+# Generate the base dataset
+# ./release/Csv2Parquet-is3 sourcefile output_file_prefix ignore_rows type
[to_undirected]
+./release/Csv2Parquet-is3
/mnt/ldbc/mengke.mk/datagen/sf30/social_network/dynamic/person_knows_person_0_0.csv
/tmp/sf30/parquet/person_knows_person 0 edge to_undirected
+./release/Csv2Parquet-is3
/mnt/ldbc/mengke.mk/datagen/sf30/social_network/dynamic/person_0_0.csv
/tmp/sf30/person_knows_person 0 vertex
+# sf100
+./release/Csv2Parquet-is3
/mnt/ldbc/mengke.mk/datagen/sf100/social_network/dynamic/person_knows_person_0_0.csv
/tmp/sf100/person_knows_person 0 edge to_undirected
+./release/Csv2Parquet-is3
/mnt/ldbc/mengke.mk/datagen/sf100/social_network/dynamic/person_0_0.csv
/tmp/sf100/person_knows_person 0 vertex
+# sf300
+./release/Csv2Parquet-is3
/mnt/ldbc/mengke.mk/datagen/sf300/social_network/dynamic/person_knows_person_0_0.csv
/tmp/sf100/person_knows_person 0 edge to_undirected
+./release/Csv2Parquet-is3
/mnt/ldbc/mengke.mk/datagen/sf300/social_network/dynamic/person_0_0.csv
/tmp/sf100/person_knows_person 0 vertex
+
+# Generate the graphar dataset
+# ./data-generator-label edge_source_file src_vertex_source_file
dst_vertex_source_file src_label dst_label src_file_type dst_file_type
output_file_prefix reverse/not-reverse to_undirected/not_to_undirected
+./release/data-generator-label
/mnt/ldbc/mengke.mk/datagen/sf30/social_network/dynamic/person_knows_person_0_0.csv
/mnt/ldbc/mengke.mk/datagen/sf30/social_network/dynamic/person_0_0.csv
/mnt/ldbc/mengke.mk/datagen/sf30/social_network/dynamic/person_0_0.csv person
person csv csv /tmp/sf30/person_knows_person not-reverse to_undirected
+./release/data-generator-label
/mnt/ldbc/mengke.mk/datagen/sf100/social_network/dynamic/person_knows_person_0_0.csv
/mnt/ldbc/mengke.mk/datagen/sf100/social_network/dynamic/person_0_0.csv
/mnt/ldbc/mengke.mk/datagen/sf100/social_network/dynamic/person_0_0.csv person
person csv csv /tmp/sf100/person_knows_person not-reverse to_undirected
+./release/data-generator-label
/mnt/ldbc/mengke.mk/datagen/sf300/social_network/dynamic/person_knows_person_0_0.csv
/mnt/ldbc/mengke.mk/datagen/sf300/social_network/dynamic/person_0_0.csv
/mnt/ldbc/mengke.mk/datagen/sf300/social_network/dynamic/person_0_0.csv person
person csv csv /tmp/sf300/person_knows_person not-reverse to_undirected
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]