This is an automated email from the ASF dual-hosted git repository.
ycai pushed a commit to branch trunk
in repository https://gitbox.apache.org/repos/asf/cassandra-analytics.git
The following commit(s) were added to refs/heads/trunk by this push:
new ee1c837 CASSANDRA-18574: Fix sample job documentation after Sidecar
changes
ee1c837 is described below
commit ee1c83722bfb1155bef762cdfb2c86034857f2d0
Author: Francisco Guerrero <[email protected]>
AuthorDate: Wed Jun 7 12:40:50 2023 -0700
CASSANDRA-18574: Fix sample job documentation after Sidecar changes
This commit fixes the README file with documentation to setup and run the
Sample job provided in the repository.
During Sidecar review, there was a suggestion to change the yaml property
`uploads_staging_dir` to `staging_dir`.
That change however was not reflected as part of the sample job README.md.
patch by Francisco Guerrero; reviewed by Dinesh Joshi, Yifan Cai for
CASSANDRA-18574
---
cassandra-analytics-core-example/README.md | 20 +++++++++-----------
1 file changed, 9 insertions(+), 11 deletions(-)
diff --git a/cassandra-analytics-core-example/README.md
b/cassandra-analytics-core-example/README.md
index 6204000..549dca8 100644
--- a/cassandra-analytics-core-example/README.md
+++ b/cassandra-analytics-core-example/README.md
@@ -49,13 +49,13 @@ In this step, we will clone and configure the Cassandra
Sidecar project. Finally
connecting to our local Cassandra 3-node cluster.
```shell
-git clone https://github.com/frankgh/cassandra-sidecar/tree/CEP-28-bulk-apis
+git clone https://github.com/apache/cassandra-sidecar
cd cassandra-sidecar
```
-Configure the `main/dist/sidecar.yaml` file for your local environment. You
will most likely only need to configure
+Configure the `src/main/dist/sidecar.yaml` file for your local environment.
You will most likely only need to configure
the `cassandra_instances` section in your file pointing to your local
Cassandra data directories. Here is what my
-configuration looks like for this tutorial:
+`cassandra_instances` configuration section looks like for this tutorial:
```yaml
cassandra_instances:
@@ -63,7 +63,7 @@ cassandra_instances:
host: localhost
port: 9042
data_dirs: <your_ccm_parent_path>/.ccm/test/node1/data0
- uploads_staging_dir: <your_ccm_parent_path>/.ccm/test/node1/sstable-staging
+ staging_dir: <your_ccm_parent_path>/.ccm/test/node1/sstable-staging
jmx_host: 127.0.0.1
jmx_port: 7100
jmx_ssl_enabled: false
@@ -71,7 +71,7 @@ cassandra_instances:
host: localhost2
port: 9042
data_dirs: <your_ccm_parent_path>/.ccm/test/node2/data0
- uploads_staging_dir: <your_ccm_parent_path>/.ccm/test/node2/sstable-staging
+ staging_dir: <your_ccm_parent_path>/.ccm/test/node2/sstable-staging
jmx_host: 127.0.0.1
jmx_port: 7200
jmx_ssl_enabled: false
@@ -79,22 +79,20 @@ cassandra_instances:
host: localhost3
port: 9042
data_dirs: <your_ccm_parent_path>/.ccm/test/node3/data0
- uploads_staging_dir: <your_ccm_parent_path>/.ccm/test/node3/sstable-staging
+ staging_dir: <your_ccm_parent_path>/.ccm/test/node3/sstable-staging
jmx_host: 127.0.0.1
jmx_port: 7300
jmx_ssl_enabled: false
```
I have a 3 node setup, so I configure Sidecar for those 3 nodes. CCM creates
the Cassandra cluster under
-`${HOME}/.ccm/test`, so I update my `data_dirs` and `uploads_staging_dir`
configuration to use my local path.
+`${HOME}/.ccm/test`, so I update my `data_dirs` and `staging_dir`
configuration to use my local path.
-Next, create the `uploads_staging_dir` where Sidecar will stage SSTables
coming from Cassandra Spark bulk writer.
+Next, create the `staging_dir` where Sidecar will stage SSTables coming from
Cassandra Spark bulk writer.
In my case, I have decided to keep the `sstable-staging` directory inside each
of the node's directories.
```shell
-mkdir -p ${HOME}/.ccm/test/node1/sstable-staging
-mkdir -p ${HOME}/.ccm/test/node2/sstable-staging
-mkdir -p ${HOME}/.ccm/test/node3/sstable-staging
+mkdir -p ${HOME}/.ccm/test/node{1..3}/sstable-staging
```
Finally, run Cassandra Sidecar, we skip running integration tests because we
need docker for integration tests. You
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
