amrishlal commented on issue #7244:
URL: https://github.com/apache/hudi/issues/7244#issuecomment-1650363772
Verified using the latest master using the same model as @ad1happy2go above
and successfully ran the model
**DBT run**
```amrish@Amrishs-MBP github-issue-7244 % dbt run
18:45:29 Running with dbt=1.5.3
18:45:29 [WARNING]: Deprecated functionality
The `source-paths` config has been renamed to `model-paths`. Please update
your
`dbt_project.yml` configuration to reflect this change.
18:45:29 [WARNING]: Deprecated functionality
The `data-paths` config has been renamed to `seed-paths`. Please update your
`dbt_project.yml` configuration to reflect this change.
18:45:29 Registered adapter: spark=1.5.0
18:45:29 Found 1 model, 2 tests, 0 snapshots, 0 analyses, 357 macros, 0
operations, 0 seed files, 0 sources, 0 exposures, 0 metrics, 0 groups
18:45:29
18:45:31 Concurrency: 1 threads (target='dev')
18:45:31
18:45:31 1 of 1 START sql incremental model default.issue_7244_model
.................... [RUN]
18:45:38 1 of 1 OK created sql incremental model default.issue_7244_model
............... [OK in 7.93s]
18:45:39
18:45:39 Finished running 1 incremental model in 0 hours 0 minutes and 9.22
seconds (9.22s).
18:45:39
18:45:39 Completed successfully
18:45:39
18:45:39 Done. PASS=1 WARN=0 ERROR=0 SKIP=0 TOTAL=1
amrish@Amrishs-MBP github-issue-7244 %
```
**spark-sql verification**
```
spark-sql> show databases;
default
test_database1
Time taken: 2.562 seconds, Fetched 2 row(s)
spark-sql> use default
> ;
23/07/25 11:47:20 WARN ObjectStore: Failed to get database global_temp,
returning NoSuchObjectException
Time taken: 0.125 seconds
spark-sql> show tables;
issue_7244_model
my_first_dbt_model
my_first_dbt_model1
my_second_dbt_model
Time taken: 0.263 seconds, Fetched 4 row(s)
spark-sql> select * from issue_7244_model
> ;
23/07/25 11:47:43 WARN DFSPropertiesConfiguration: Cannot find
HUDI_CONF_DIR, please set it as the dir of hudi-defaults.conf
23/07/25 11:47:43 WARN DFSPropertiesConfiguration: Properties file
file:/etc/hudi/conf/hudi-defaults.conf not found. Ignoring to load props file
20230725114531327 20230725114531327_1_4 2
fbb84dbc-e72f-4ac6-990a-d0205e2aaab3-0_1-33-0_20230725114531327.parquet 2
anyway 2023-07-25 11:45:31.367
20230725114531327 20230725114531327_2_5 3
c1d85730-7a1a-4845-bb4a-1b7128f6de3d-0_2-34-0_20230725114531327.parquet 3
bye 2023-07-25 11:45:31.367
20230725114531327 20230725114531327_0_6 1
1da126fe-eb3a-4982-ab77-f294458eefea-0_0-32-0_20230725114531327.parquet 1
yo 2023-07-25 11:45:31.367
Time taken: 4.461 seconds, Fetched 3 row(s)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
