soumilshah1995 commented on issue #10287:
URL: https://github.com/apache/hudi/issues/10287#issuecomment-1848711118

   launched 
   ```
   spark-submit \
     --master 'local[*]' \
     --conf spark.executor.extraJavaOptions=-Duser.timezone=Etc/UTC \
     --conf spark.eventLog.enabled=false \
     --conf spark.sql.warehouse.dir=file:///Users/soumilshah/Desktop/soumil/dbt 
\
     --class org.apache.spark.sql.hive.thriftserver.HiveThriftServer2 \
     --name "Thrift JDBC/ODBC Server" \
     --executor-memory 3g \
     --conf spark.serializer=org.apache.spark.serializer.KryoSerializer \
     --conf 
spark.sql.extensions=org.apache.spark.sql.hudi.HoodieSparkSessionExtension \
     --conf 
spark.sql.catalog.spark_catalog=org.apache.spark.sql.hudi.catalog.HoodieCatalog 
\
     --conf hive.metastore.warehouse.dir=/Users/soumilshah/Desktop/soumil/dbt \
     --conf hive.metastore.schema.verification=false \
     --conf datanucleus.schema.autoCreateAll=true \
     --conf 
javax.jdo.option.ConnectionDriverName=org.apache.derby.jdbc.ClientDriver \
     --conf 
'javax.jdo.option.ConnectionURL=jdbc:derby://localhost:1527/MyDatabase;create=true'
   ```
   
   Launched 
   ```
   $DERBY_HOME/bin/startNetworkServer -h localhost
   ```
   
   
   ## DBT Debug 
   ```
   
   dbt debug 
   21:36:47  Running with dbt=1.7.3
   21:36:47  dbt version: 1.7.3
   21:36:47  python version: 3.9.6
   21:36:47  python path: 
/Users/soumilshah/IdeaProjects/mdbt/Youtube/dbt-env/bin/python
   21:36:47  os info: macOS-13.6.1-x86_64-i386-64bit
   21:36:47  Using profiles dir at /Users/soumilshah/.dbt
   21:36:47  Using profiles.yml file at /Users/soumilshah/.dbt/profiles.yml
   21:36:47  Using dbt_project.yml file at 
/Users/soumilshah/IdeaProjects/mdbt/Youtube/dbtspark/dbt_project.yml
   21:36:47  adapter type: spark
   21:36:47  adapter version: 1.7.1
   21:36:47  Configuration:
   21:36:47    profiles.yml file [OK found and valid]
   21:36:47    dbt_project.yml file [OK found and valid]
   21:36:47  Required dependencies:
   21:36:47   - git [OK found]
   
   21:36:47  Connection:
   21:36:47    host: localhost
   21:36:47    port: 10000
   21:36:47    cluster: None
   21:36:47    endpoint: None
   21:36:47    schema: hudi_examples_dbt
   21:36:47    organization: 0
   21:36:47  Registered adapter: spark=1.7.1
   21:36:48    Connection test: [OK connection ok]
   
   21:36:48  All checks passed!
   (dbt-env) soumilshah@Soumils-MBP dbtspark %
   ```
   
   after running dbt run terminal crashes 
   ![Screenshot 2023-12-09 at 4 38 12 
PM](https://github.com/apache/hudi/assets/39345855/7b1d1cb6-288b-411c-84de-05f25f1df964)
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to