This is an automated email from the ASF dual-hosted git repository.
xiangfu pushed a commit to branch fixing-help
in repository https://gitbox.apache.org/repos/asf/pinot-site.git
The following commit(s) were added to refs/heads/fixing-help by this push:
new deddcc97 fixing helm scripts
deddcc97 is described below
commit deddcc97e5df067c03d87de9a71c6bbf224d90fc
Author: Xiang Fu <[email protected]>
AuthorDate: Fri Sep 22 15:07:01 2023 -0700
fixing helm scripts
---
.../installation/cloud/on-premise.md | 63 +++++++---------------
website/src/pages/index.js | 2 +-
2 files changed, 20 insertions(+), 45 deletions(-)
diff --git a/website/docs/administration/installation/cloud/on-premise.md
b/website/docs/administration/installation/cloud/on-premise.md
index 94d3aa45..06d3f778 100644
--- a/website/docs/administration/installation/cloud/on-premise.md
+++ b/website/docs/administration/installation/cloud/on-premise.md
@@ -8,6 +8,7 @@ draft: true
This QuickStart assumes the existence of Kubernetes Cluster. Please follow
below links to setup your Kubernetes cluster in local or major cloud vendors.
> <b>Prerequisites:</b> <br/>
+>
> <p> <a href="https://docs.docker.com/docker-for-mac/kubernetes/";
> target="_blank">Enable Kubernetes on Docker-Desktop</a><br/>
> <a href="https://kubernetes.io/docs/tasks/tools/install-minikube/";
> target="_blank">Setup a Kubernetes Cluster using Amazon Elastic Kubernetes
> Service (Amazon EKS)</a> <br/>
> <a href="https://kubernetes.io/docs/tasks/tools/install-minikube/";
> target="_blank">Setup a Kubernetes Cluster using Google Kubernetes
> Engine(GKE)</a> <br/>
@@ -26,22 +27,6 @@ helm dependency update
### Start Pinot with Helm
-- For Helm v2.12.1
-
-If cluster is just initialized, ensure helm is initialized by running:
-
-```bash
-helm init --service-account tiller
-```
-
-Then deploy pinot cluster by:
-
-```bash
-helm install --namespace "pinot-quickstart" --name "pinot" .
-```
-
-- For Helm v3.0.0
-
```bash
kubectl create ns pinot-quickstart
helm install -n pinot-quickstart pinot .
@@ -49,13 +34,13 @@ helm install -n pinot-quickstart pinot .
## Troubleshooting (For helm v2.12.1)
-- Error: Please run below command if encountering issue:
+- Error: Please run below command if encountering issue:
```bash
Error: could not find tiller".
```
-- Resolution:
+- Resolution:
```bash
kubectl -n kube-system delete deployment tiller-deploy
@@ -63,19 +48,19 @@ kubectl -n kube-system delete service/tiller-deploy
helm init --service-account tiller
```
-- Error: Please run below command if encountering permission issue:
+- Error: Please run below command if encountering permission issue:
```bash
Error: release pinot failed: namespaces "pinot-quickstart" is forbidden: User
"system:serviceaccount:kube-system:default" cannot get resource "namespaces" in
API group "" in the namespace "pinot-quickstart"
```
-- Resolution:
+- Resolution:
```bash
kubectl apply -f helm-rbac.yaml
```
-- Check deployment status
+- Check deployment status
```bash
kubectl get all -n pinot-quickstart
@@ -85,18 +70,9 @@ kubectl get all -n pinot-quickstart
### Bring up a Kafka Cluster for realtime data ingestion
-- For helm v2.12.1
-
-```bash
-helm repo add incubator https://charts.helm.sh/incubator
-helm install --namespace "pinot-quickstart" --name kafka incubator/kafka
-```
-
-- For helm v3.0.0
-
```bash
-helm repo add incubator https://charts.helm.sh/incubator
-helm install -n pinot-quickstart kafka incubator/kafka --set replicas=1
+helm repo add kafka https://charts.bitnami.com/bitnami
+helm install -n pinot-quickstart kafka kafka/kafka --set
replicas=1,zookeeper.image.tag=latest
```
### Check Kafka deployment status
@@ -114,25 +90,24 @@ pod/kafka-zookeeper-1
1/1 Running
pod/kafka-zookeeper-2 1/1 Running
0 8m
```
-
### Create Kafka topics
Below scripts will create two Kafka topics for data ingestion:
```bash
-kubectl -n pinot-quickstart exec kafka-0 -- kafka-topics --zookeeper
kafka-zookeeper:2181 --topic flights-realtime --create --partitions 1
--replication-factor 1
-kubectl -n pinot-quickstart exec kafka-0 -- kafka-topics --zookeeper
kafka-zookeeper:2181 --topic flights-realtime-avro --create --partitions 1
--replication-factor 1
+kubectl -n pinot-quickstart exec kafka-0 -- kafka-topics.sh --bootstrap-server
kafka-0:9092 --topic flights-realtime --create --partitions 1
--replication-factor 1
+kubectl -n pinot-quickstart exec kafka-0 -- kafka-topics.sh --bootstrap-server
kafka-0:9092 --topic flights-realtime-avro --create --partitions 1
--replication-factor 1
```
### Load data into Kafka and Create Pinot Schema/Tables
Below script will deploy 3 batch jobs
-- Ingest 19492 Json messages to Kafka topic `flights-realtime` at a speed of
1 msg/sec
-- Ingest 19492 Avro messages to Kafka topic `flights-realtime-avro` at a
speed of 1 msg/sec
-- Upload Pinot schema `airlineStats`
-- Create Pinot Table `airlineStats` to ingest data from Json encoded Kafka
topic `flights-realtime`
-- Create Pinot Table `airlineStatsAvro` to ingest data from Avro encoded
Kafka topic `flights-realtime-avro`
+- Ingest 19492 Json messages to Kafka topic `flights-realtime` at a speed of
1 msg/sec
+- Ingest 19492 Avro messages to Kafka topic `flights-realtime-avro` at a
speed of 1 msg/sec
+- Upload Pinot schema `airlineStats`
+- Create Pinot Table `airlineStats` to ingest data from Json encoded Kafka
topic `flights-realtime`
+- Create Pinot Table `airlineStatsAvro` to ingest data from Avro encoded
Kafka topic `flights-realtime-avro`
```bash
kubectl apply -f pinot-realtime-quickstart.yml
@@ -204,7 +179,7 @@ Once Presto is deployed, you could run below command.
### Sample queries to execute
-- List all catalogs
+- List all catalogs
```SQL
presto:default> show catalogs;
@@ -222,7 +197,7 @@ Splits: 19 total, 19 done (100.00%)
0:01 [0 rows, 0B] [0 rows/s, 0B/s]
```
-- List All tables
+- List All tables
```SQL
presto:default> show tables;
@@ -239,7 +214,7 @@ Splits: 19 total, 19 done (100.00%)
0:01 [1 rows, 29B] [1 rows/s, 41B/s]
```
-- Show schema
+- Show schema
```sql
presto:default> DESCRIBE pinot.dontcare.airlinestats;
@@ -260,7 +235,7 @@ Splits: 19 total, 19 done (100.00%)
0:02 [80 rows, 6.06KB] [35 rows/s, 2.66KB/s]
```
-- Count total documents
+- Count total documents
```SQL
presto:default> select count(*) as cnt from pinot.dontcare.airlinestats limit
10;
diff --git a/website/src/pages/index.js b/website/src/pages/index.js
index 0f4fada4..2b1dc72b 100755
--- a/website/src/pages/index.js
+++ b/website/src/pages/index.js
@@ -295,7 +295,7 @@ function Installation() {
>
<TabItem value="helm">
<CodeBlock className="language-bash">
- {`helm repo add pinot
https://raw.githubusercontent.com/apache/pinot/master/kubernetes/helm\nkubectl
create ns pinot\nhelm install pinot pinot/pinot -n pinot --set
cluster.name=pinot`}
+ {`helm repo add pinot
https://raw.githubusercontent.com/apache/pinot/master/helm\nkubectl create ns
pinot\nhelm install pinot pinot/pinot -n pinot --set cluster.name=pinot`}
</CodeBlock>
</TabItem>
<TabItem value="binary">
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
