[
https://issues.apache.org/jira/browse/HUDI-8648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17903026#comment-17903026
]
Lin Liu edited comment on HUDI-8648 at 12/4/24 3:21 PM:
--------------------------------------------------------
Confirmed that the data files are correct. That is, the data before, after
deletion, deletes are correct after checking their numbers.
Therefore, this is a pure SI issue.
{code:java}
Deleted Record
+-------------------+-----------------------+------------------------------------+----------------------+-----------------------------------------------------------------------------+------------------+------------------------------------+------------------+------------------+--------+----------+-------------------+-------------------+------------------+----------+--------------+---------+---------+---------+
|_hoodie_commit_time|_hoodie_commit_seqno |_hoodie_record_key
|_hoodie_partition_path|_hoodie_file_name
|_hoodie_is_deleted|_row_key
|begin_lat |begin_lon |currency|driver |end_lat
|end_lon |fare |partition |partition_path|rider
|timestamp|trip_type|
+-------------------+-----------------------+------------------------------------+----------------------+-----------------------------------------------------------------------------+------------------+------------------------------------+------------------+------------------+--------+----------+-------------------+-------------------+------------------+----------+--------------+---------+---------+---------+
|20241204150609831
|20241204150609831_1_522|7d3374cf-dca4-4b72-bcbc-7ba0d2eb19c9|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|7d3374cf-dca4-4b72-bcbc-7ba0d2eb19c9|0.2165672621754512|0.5242790647150243|USD
|driver-072|0.05641001459656936|0.03530815356187822|42.973545869794606|2015/03/16|2015/03/16
|rider-072|0 |UBERX |
+-------------------+-----------------------+------------------------------------+----------------------+-----------------------------------------------------------------------------+------------------+------------------------------------+------------------+------------------+--------+----------+-------------------+-------------------+------------------+----------+--------------+---------+---------+---------+
table after deletion
+-------------------+-----------------------+------------------------------------+----------------------+-----------------------------------------------------------------------------+------------------+------------------------------------+-------------------+--------------------+--------+----------+--------------------+-------------------+------------------+----------+--------------+---------+---------+---------+
|_hoodie_commit_time|_hoodie_commit_seqno |_hoodie_record_key
|_hoodie_partition_path|_hoodie_file_name
|_hoodie_is_deleted|_row_key
|begin_lat |begin_lon |currency|driver |end_lat
|end_lon |fare |partition |partition_path|rider
|timestamp|trip_type|
+-------------------+-----------------------+------------------------------------+----------------------+-----------------------------------------------------------------------------+------------------+------------------------------------+-------------------+--------------------+--------+----------+--------------------+-------------------+------------------+----------+--------------+---------+---------+---------+
|20241204150616439
|20241204150616439_1_533|e856715c-2428-46e4-aa30-fe354fca6e3a|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0
|false |e856715c-2428-46e4-aa30-fe354fca6e3a|0.5874052958818854
|0.6031449776911632 |USD |driver-073|0.9112808948611031
|0.8354468050877537 |52.60940387787188 |2015/03/16|2015/03/16 |rider-073|0
|UBERX |
|20241204150600191 |20241204150600191_1_2
|f3861a94-b8f0-48b8-b1d3-7c680a4c1724|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|f3861a94-b8f0-48b8-b1d3-7c680a4c1724|0.3461148061512298
|0.4232292248024734 |USD |driver-070|0.6198882503124046
|0.3595542721435352 |96.47097769665639 |2015/03/16|2015/03/16 |rider-070|0
|UBERX |
|20241204150616439
|20241204150616439_1_531|3d9dd7ff-027c-4d5c-9aba-1051374449a9|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0
|false
|3d9dd7ff-027c-4d5c-9aba-1051374449a9|0.44390771822904995|0.9043969724773593
|USD |driver-073|0.15035290876410057 |0.5186489253773559
|30.812696381319927|2015/03/16|2015/03/16 |rider-073|0 |BLACK |
|20241204150600191 |20241204150600191_1_4
|15d4c0ae-bd1e-46a7-9593-c6c958e3c378|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|15d4c0ae-bd1e-46a7-9593-c6c958e3c378|0.0741467894429374
|0.4871162393065156 |USD |driver-070|0.6189057273545401
|0.8897308879633529 |77.40580225241546 |2015/03/16|2015/03/16 |rider-070|0
|UBERX |
|20241204150600191 |20241204150600191_1_5
|a6928e33-5533-4f9b-b45c-e8958dbef03c|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|a6928e33-5533-4f9b-b45c-e8958dbef03c|0.3793943821206921
|0.8534950221755219 |USD |driver-070|0.8031316524052362
|0.5585491829799133 |84.26957459220016 |2015/03/16|2015/03/16 |rider-070|0
|UBERX |
|20241204150604821
|20241204150604821_1_517|c867b36f-4f13-4d18-a3b7-cc21f2b9e9ab|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|c867b36f-4f13-4d18-a3b7-cc21f2b9e9ab|0.2735972259977213
|0.15207329562483696 |USD |driver-071|0.80389038785619
|0.9975324632191459 |59.81022393535782 |2015/03/16|2015/03/16 |rider-071|0
|UBERX |
|20241204150600191 |20241204150600191_1_7
|a4b81cd3-11af-4df1-96a8-6b61fc3fb4c5|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|a4b81cd3-11af-4df1-96a8-6b61fc3fb4c5|0.7331705266718346
|0.023734696611152017|USD |driver-070|0.30680826368246406
|0.9645825541647315 |85.0240043948057 |2015/03/16|2015/03/16 |rider-070|0
|BLACK |
|20241204150609831
|20241204150609831_1_521|425f47f4-1222-436a-aa06-f1dbec813ba8|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|425f47f4-1222-436a-aa06-f1dbec813ba8|0.27685979427682494|0.7601751080241289
|USD |driver-072|0.7152638258352478 |0.09297572723995418|34.88024404326485
|2015/03/16|2015/03/16 |rider-072|0 |UBERX |
|20241204150600191 |20241204150600191_1_9
|3aec0901-bd07-4f9f-b64f-aaded343462c|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|3aec0901-bd07-4f9f-b64f-aaded343462c|0.01490256498846021|0.06971485394351151
|USD |driver-070|0.3472912340472365 |0.8505996598006605 |88.9151936118867
|2015/03/16|2015/03/16 |rider-070|0 |BLACK |
|20241204150600191 |20241204150600191_1_10
|ed453470-d0bc-4942-9c04-7ca304221d6e|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|ed453470-d0bc-4942-9c04-7ca304221d6e|0.4372473706122517
|0.9315622458544462 |USD |driver-070|0.14781683342041918
|0.8563266248271696 |27.331384804875103|2015/03/16|2015/03/16 |rider-070|0
|UBERX |
|20241204150600191 |20241204150600191_1_11
|6ca19f52-878c-42d2-b78c-6487c0c1501a|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|6ca19f52-878c-42d2-b78c-6487c0c1501a|0.7117355777782244
|0.6455694898336716 |USD |driver-070|0.3450947417446646
|0.6964490646998845 |28.86765279787131 |2015/03/16|2015/03/16 |rider-070|0
|UBERX |
|20241204150600191 |20241204150600191_1_12
|e40fc5ae-7805-4f9c-a089-e83398dc8f14|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|e40fc5ae-7805-4f9c-a089-e83398dc8f14|0.9641957292204617
|0.3812515518608759 |USD |driver-070|0.6041849016540516
|0.32585936767553325|5.79094434767401 |2015/03/16|2015/03/16 |rider-070|0
|BLACK |
|20241204150600191 |20241204150600191_1_13
|5657b9c2-cd37-4057-a286-4fe8e34aa503|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|5657b9c2-cd37-4057-a286-4fe8e34aa503|0.3030321891289054
|0.06745629633248351 |USD |driver-070|0.3209354871687474
|0.9185899386213338 |11.314883888952764|2015/03/16|2015/03/16 |rider-070|0
|BLACK |
|20241204150600191 |20241204150600191_1_14
|91c3ebe7-3797-464b-af89-604cf68cc3db|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|91c3ebe7-3797-464b-af89-604cf68cc3db|0.76370292415892
|0.3470969517406177 |USD |driver-070|0.26116740480875233
|0.5870178324524938 |72.43456133868803 |2015/03/16|2015/03/16 |rider-070|0
|BLACK |
|20241204150616439
|20241204150616439_1_532|3ea83d36-60dc-43ff-9f9f-791cc824f323|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0
|false |3ea83d36-60dc-43ff-9f9f-791cc824f323|0.5684632487248058
|0.37215847803798197 |USD
|driver-073|0.054661595019326104|0.24810431636010344|53.45669058400514
|2015/03/16|2015/03/16 |rider-073|0 |UBERX |
|20241204150600191 |20241204150600191_1_16
|34b730f6-c19f-4f6a-bf95-703c61dc3fa4|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|34b730f6-c19f-4f6a-bf95-703c61dc3fa4|0.9769970791360354
|0.9126162358158342 |USD |driver-070|0.20092033943627996
|0.5004521125628215 |95.29810539357332 |2015/03/16|2015/03/16 |rider-070|0
|BLACK |
|20241204150600191 |20241204150600191_0_0
|33c67d4b-d72d-45ea-b94e-285134cc7261|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|33c67d4b-d72d-45ea-b94e-285134cc7261|0.5295299471018257
|0.8796342384821229 |USD |driver-070|0.7477900383772803
|0.17871094201072368|14.039049113466096|2016/03/15|2016/03/15 |rider-070|0
|UBERX |
|20241204150600191 |20241204150600191_0_1
|c5304b84-6638-456e-9c63-faf3a37466b2|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|c5304b84-6638-456e-9c63-faf3a37466b2|0.6957210956161899
|0.6840305752968967 |USD |driver-070|0.4102831260234211
|0.22012113386766918|80.4122013976756 |2016/03/15|2016/03/15 |rider-070|0
|UBERX |
|20241204150600191 |20241204150600191_0_2
|82a0293a-b95c-4c5b-96ad-ac6098732b35|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|82a0293a-b95c-4c5b-96ad-ac6098732b35|0.5139184718380677
|0.2505739793056264 |USD |driver-070|0.1179051996084779
|0.7046801244916295 |84.98654138861065 |2016/03/15|2016/03/15 |rider-070|0
|UBERX |
|20241204150600191 |20241204150600191_0_3
|98f2fae2-507c-4af7-975e-e1713ffe4d09|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|98f2fae2-507c-4af7-975e-e1713ffe4d09|0.06611427533082836|0.788222336963299
|USD |driver-070|0.06671517994699039 |0.786493460186979 |94.45926125086118
|2016/03/15|2016/03/15 |rider-070|0 |UBERX |
|20241204150604821
|20241204150604821_0_514|de9dff6a-591b-482d-bb41-4a3c8a79e631|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|de9dff6a-591b-482d-bb41-4a3c8a79e631|0.1878054936680329
|0.01879889138787716 |USD |driver-071|0.4485493700070595
|0.7238770702991649 |78.22199805445177 |2016/03/15|2016/03/15 |rider-071|0
|BLACK |
|20241204150604821
|20241204150604821_0_512|0f7d8518-269e-47ff-b52c-0d083de918be|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|0f7d8518-269e-47ff-b52c-0d083de918be|0.5575851097958935
|0.1562523255339201 |USD |driver-071|0.43569700697390645
|0.35674304879736285|65.69533532145876 |2016/03/15|2016/03/15 |rider-071|0
|BLACK |
|20241204150600191 |20241204150600191_0_6
|615281d8-4636-4d6a-954f-03043618907f|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|615281d8-4636-4d6a-954f-03043618907f|0.41684117736066284|0.40427662848330415
|USD |driver-070|0.9094383420738296
|0.04860848373412596|36.397193900236466|2016/03/15|2016/03/15 |rider-070|0
|BLACK |
|20241204150604821
|20241204150604821_0_516|9ca4cfef-1df2-4b71-841d-6562c9ce6842|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|9ca4cfef-1df2-4b71-841d-6562c9ce6842|0.6284760957595001
|0.4765950340886149 |USD |driver-071|0.1216417932901912
|0.9975584711751252 |87.03128950423871 |2016/03/15|2016/03/15 |rider-071|0
|BLACK |
|20241204150616439
|20241204150616439_0_534|cbc086c6-4936-442e-8962-1f7bef79d072|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0
|false |cbc086c6-4936-442e-8962-1f7bef79d072|0.9151392407429653
|0.8058749127810513 |USD |driver-073|0.4109754791872877
|0.13960696212916768|36.3643551507392 |2016/03/15|2016/03/15 |rider-073|0
|UBERX |
|20241204150609831
|20241204150609831_0_529|3ab3d79f-edba-4182-8285-aab74cac1f56|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|3ab3d79f-edba-4182-8285-aab74cac1f56|0.330366816224278
|0.7321416055163578 |USD |driver-072|0.252074607122732
|0.7818192743089926 |69.02458690241536 |2016/03/15|2016/03/15 |rider-072|0
|UBERX |
|20241204150604821
|20241204150604821_0_513|b9c7bc8c-b027-4f46-9959-668067516f53|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|b9c7bc8c-b027-4f46-9959-668067516f53|0.9872898768793127
|0.3206772909391603 |USD |driver-071|0.7393757399954017
|0.8229493726180523 |80.22954578292044 |2016/03/15|2016/03/15 |rider-071|0
|UBERX |
|20241204150609831
|20241204150609831_0_530|7b05ef2f-0120-43a5-93c1-68ad9bc3924d|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|7b05ef2f-0120-43a5-93c1-68ad9bc3924d|0.512729897800753
|0.8408144614796756 |USD |driver-072|0.6934187325203937
|0.992327632998625 |33.674612100034516|2016/03/15|2016/03/15 |rider-072|0
|BLACK |
|20241204150600191 |20241204150600191_0_12
|c4ae071b-13b4-44da-b37e-0ba8de525f89|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|c4ae071b-13b4-44da-b37e-0ba8de525f89|0.6049239453837221
|0.9313564512445435 |USD |driver-070|0.1959158255075305
|0.3775703824159009 |82.08748305521034 |2016/03/15|2016/03/15 |rider-070|0
|BLACK |
|20241204150604821
|20241204150604821_0_511|c96ed9e8-83f9-4691-8ed5-4ba6cdd49e57|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|c96ed9e8-83f9-4691-8ed5-4ba6cdd49e57|0.3063896359769538
|0.676726038869916 |USD |driver-071|0.5206916773641883
|0.7508961494548403 |43.70502045148351 |2016/03/15|2016/03/15 |rider-071|0
|UBERX |
|20241204150616439
|20241204150616439_0_536|6edd6b70-6936-453c-96bc-215d342fa8f5|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0
|false |6edd6b70-6936-453c-96bc-215d342fa8f5|0.2980278638105116
|0.14613853342099636 |USD |driver-073|0.8551626497735585
|0.03433553370268205|29.224097481704792|2016/03/15|2016/03/15 |rider-073|0
|UBERX |
|20241204150600191 |20241204150600191_0_15
|1d46c9d2-ef0d-4a3c-aadd-ec36a21976b6|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|1d46c9d2-ef0d-4a3c-aadd-ec36a21976b6|0.1322967369714605
|0.7930789069995893 |USD |driver-070|0.8967005520421634
|0.28297812156228164|91.41578669662796 |2016/03/15|2016/03/15 |rider-070|0
|UBERX |
|20241204150616439
|20241204150616439_0_535|feba8352-6e5d-423b-b43a-6fa03d180c7d|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0
|false |feba8352-6e5d-423b-b43a-6fa03d180c7d|0.7246264335247615
|0.15163955377372784 |USD |driver-073|0.31869327673539605
|0.19455671784122086|58.48033373395598 |2016/03/15|2016/03/15 |rider-073|0
|BLACK |
|20241204150616439
|20241204150616439_2_538|1e40d120-cc3c-4de7-a85a-242591cb475f|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0
|false
|1e40d120-cc3c-4de7-a85a-242591cb475f|0.23214150377933496|0.5266318711252643
|USD |driver-073|0.12350647347943444 |0.8741043242174295 |35.60384350116569
|2015/03/17|2015/03/17 |rider-073|0 |BLACK |
|20241204150616439
|20241204150616439_2_540|f80e03bd-34f1-4c91-983f-0707f1433512|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0
|false
|f80e03bd-34f1-4c91-983f-0707f1433512|0.46011052568020516|0.15082236303129448
|USD |driver-073|0.6405338495368493 |0.21487670808886683|92.00424394066677
|2015/03/17|2015/03/17 |rider-073|0 |BLACK |
|20241204150600191 |20241204150600191_2_2
|a3565704-2302-48bd-90d6-5f22b2105e74|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|a3565704-2302-48bd-90d6-5f22b2105e74|0.8616030391205203
|0.24686237288332835 |USD |driver-070|0.08026319218679445
|0.36091392808312783|1.2402943399241417|2015/03/17|2015/03/17 |rider-070|0
|BLACK |
|20241204150609831
|20241204150609831_2_525|d4af6051-3f61-48a7-bdb6-f94aecef892c|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|d4af6051-3f61-48a7-bdb6-f94aecef892c|0.4418656411552184
|0.20380214851801082 |USD |driver-072|0.7024078023523515
|0.5560959213386791 |28.432774333142696|2015/03/17|2015/03/17 |rider-072|0
|UBERX |
|20241204150600191 |20241204150600191_2_4
|e0d1e347-9e1e-4b16-9384-209de28463ad|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|e0d1e347-9e1e-4b16-9384-209de28463ad|0.21480612076837624|0.7734537934685566
|USD |driver-070|0.15638021739154395 |0.5413247791299718 |89.32327168066406
|2015/03/17|2015/03/17 |rider-070|0 |UBERX |
|20241204150600191 |20241204150600191_2_5
|d985812a-6bce-453c-89d3-e32bdebe7441|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|d985812a-6bce-453c-89d3-e32bdebe7441|0.1066097509473195
|0.6323263473920159 |USD |driver-070|0.5171970706764893
|0.5884188092036249 |75.61627331267051 |2015/03/17|2015/03/17 |rider-070|0
|UBERX |
|20241204150609831
|20241204150609831_2_524|0c897c91-b17f-4e06-85bb-95dc525542e5|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|0c897c91-b17f-4e06-85bb-95dc525542e5|0.48341044721222115|0.7783588752585501
|USD |driver-072|0.8105844069167545 |0.7556355235178576 |36.25092377209559
|2015/03/17|2015/03/17 |rider-072|0 |UBERX |
|20241204150616439
|20241204150616439_2_539|d4d3e4d7-d80c-4fd1-bc28-58d975561f8c|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0
|false |d4d3e4d7-d80c-4fd1-bc28-58d975561f8c|0.9387506848597982
|0.21554499574709152 |USD |driver-073|0.8257683543049836
|0.22095845719120266|45.38832104830463 |2015/03/17|2015/03/17 |rider-073|0
|BLACK |
|20241204150600191 |20241204150600191_2_8
|4a5dda50-52e6-4d4a-99a6-14885df536aa|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|4a5dda50-52e6-4d4a-99a6-14885df536aa|0.9152344120643987
|0.661611637881472 |USD |driver-070|0.49661724449042355
|0.4515339872367127 |14.66765875628331 |2015/03/17|2015/03/17 |rider-070|0
|UBERX |
|20241204150600191 |20241204150600191_2_9
|f3344b6a-f441-4887-aed4-ff32ca51336d|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|f3344b6a-f441-4887-aed4-ff32ca51336d|0.4005153811072475
|0.603831078282567 |USD |driver-070|0.21339081869333554
|0.20651517191822233|12.785746837871736|2015/03/17|2015/03/17 |rider-070|0
|BLACK |
|20241204150600191 |20241204150600191_2_10
|736ce3e4-2546-44f3-a9e9-eee7e5e00d66|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|736ce3e4-2546-44f3-a9e9-eee7e5e00d66|0.8836806996621173
|0.417755379804704 |USD |driver-070|0.15504377738626696
|0.9646093195950337 |76.83510630683561 |2015/03/17|2015/03/17 |rider-070|0
|BLACK |
|20241204150609831
|20241204150609831_2_527|c7f17b56-257f-4acc-b279-28e0633c2ab9|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|c7f17b56-257f-4acc-b279-28e0633c2ab9|0.894014614318913
|0.3562120043692295 |USD |driver-072|0.4468980604294439
|0.7801124003446892 |2.612301074915313 |2015/03/17|2015/03/17 |rider-072|0
|UBERX |
|20241204150604821
|20241204150604821_2_520|7cb8b2d9-7ed9-4244-a645-bcdda805cfa6|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|7cb8b2d9-7ed9-4244-a645-bcdda805cfa6|0.7537892059745742
|0.17348385378301368 |USD |driver-071|0.09998795889862999
|0.8570816800874261 |7.539726533477465 |2015/03/17|2015/03/17 |rider-071|0
|UBERX |
|20241204150609831
|20241204150609831_2_528|51bbbaca-45e4-413b-a360-08ed8e95cecc|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|51bbbaca-45e4-413b-a360-08ed8e95cecc|0.8504635255080416
|0.029931485779198685|USD |driver-072|0.6595942017862979
|0.6293739670305403 |34.709364997053335|2015/03/17|2015/03/17 |rider-072|0
|UBERX |
|20241204150616439
|20241204150616439_2_537|1c25f623-cbee-4859-924e-4c0266ff32ef|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0
|false |1c25f623-cbee-4859-924e-4c0266ff32ef|0.4797372706538726
|0.9801234965812413 |USD |driver-073|0.44707430870890963
|0.09686588023302611|36.42400334704722 |2015/03/17|2015/03/17 |rider-073|0
|UBERX |
|20241204150604821
|20241204150604821_2_519|1bce6171-5a57-4755-b0f8-6192c96bd149|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|1bce6171-5a57-4755-b0f8-6192c96bd149|0.49318043200219774|0.964753965970299
|USD |driver-071|0.593306367417992 |0.7669546871042435
|17.688084927938707|2015/03/17|2015/03/17 |rider-071|0 |BLACK |
+-------------------+-----------------------+------------------------------------+----------------------+-----------------------------------------------------------------------------+------------------+------------------------------------+-------------------+--------------------+--------+----------+--------------------+-------------------+------------------+----------+--------------+---------+---------+---------+{code}
{code:java}
Table before deletion
+-------------------+-----------------------+------------------------------------+----------------------+-----------------------------------------------------------------------------+------------------+------------------------------------+-------------------+--------------------+--------+----------+--------------------+-------------------+------------------+----------+--------------+---------+---------+---------+
|_hoodie_commit_time|_hoodie_commit_seqno |_hoodie_record_key
|_hoodie_partition_path|_hoodie_file_name
|_hoodie_is_deleted|_row_key
|begin_lat |begin_lon |currency|driver |end_lat
|end_lon |fare |partition |partition_path|rider
|timestamp|trip_type|
+-------------------+-----------------------+------------------------------------+----------------------+-----------------------------------------------------------------------------+------------------+------------------------------------+-------------------+--------------------+--------+----------+--------------------+-------------------+------------------+----------+--------------+---------+---------+---------+
|20241204150609831
|20241204150609831_1_522|7d3374cf-dca4-4b72-bcbc-7ba0d2eb19c9|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|7d3374cf-dca4-4b72-bcbc-7ba0d2eb19c9|0.2165672621754512
|0.5242790647150243 |USD |driver-072|0.05641001459656936
|0.03530815356187822|42.973545869794606|2015/03/16|2015/03/16 |rider-072|0
|UBERX |
|20241204150616439
|20241204150616439_1_533|e856715c-2428-46e4-aa30-fe354fca6e3a|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0
|false |e856715c-2428-46e4-aa30-fe354fca6e3a|0.5874052958818854
|0.6031449776911632 |USD |driver-073|0.9112808948611031
|0.8354468050877537 |52.60940387787188 |2015/03/16|2015/03/16 |rider-073|0
|UBERX |
|20241204150600191 |20241204150600191_1_2
|f3861a94-b8f0-48b8-b1d3-7c680a4c1724|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|f3861a94-b8f0-48b8-b1d3-7c680a4c1724|0.3461148061512298
|0.4232292248024734 |USD |driver-070|0.6198882503124046
|0.3595542721435352 |96.47097769665639 |2015/03/16|2015/03/16 |rider-070|0
|UBERX |
|20241204150616439
|20241204150616439_1_531|3d9dd7ff-027c-4d5c-9aba-1051374449a9|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0
|false
|3d9dd7ff-027c-4d5c-9aba-1051374449a9|0.44390771822904995|0.9043969724773593
|USD |driver-073|0.15035290876410057 |0.5186489253773559
|30.812696381319927|2015/03/16|2015/03/16 |rider-073|0 |BLACK |
|20241204150600191 |20241204150600191_1_4
|15d4c0ae-bd1e-46a7-9593-c6c958e3c378|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|15d4c0ae-bd1e-46a7-9593-c6c958e3c378|0.0741467894429374
|0.4871162393065156 |USD |driver-070|0.6189057273545401
|0.8897308879633529 |77.40580225241546 |2015/03/16|2015/03/16 |rider-070|0
|UBERX |
|20241204150600191 |20241204150600191_1_5
|a6928e33-5533-4f9b-b45c-e8958dbef03c|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|a6928e33-5533-4f9b-b45c-e8958dbef03c|0.3793943821206921
|0.8534950221755219 |USD |driver-070|0.8031316524052362
|0.5585491829799133 |84.26957459220016 |2015/03/16|2015/03/16 |rider-070|0
|UBERX |
|20241204150604821
|20241204150604821_1_517|c867b36f-4f13-4d18-a3b7-cc21f2b9e9ab|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|c867b36f-4f13-4d18-a3b7-cc21f2b9e9ab|0.2735972259977213
|0.15207329562483696 |USD |driver-071|0.80389038785619
|0.9975324632191459 |59.81022393535782 |2015/03/16|2015/03/16 |rider-071|0
|UBERX |
|20241204150600191 |20241204150600191_1_7
|a4b81cd3-11af-4df1-96a8-6b61fc3fb4c5|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|a4b81cd3-11af-4df1-96a8-6b61fc3fb4c5|0.7331705266718346
|0.023734696611152017|USD |driver-070|0.30680826368246406
|0.9645825541647315 |85.0240043948057 |2015/03/16|2015/03/16 |rider-070|0
|BLACK |
|20241204150609831
|20241204150609831_1_521|425f47f4-1222-436a-aa06-f1dbec813ba8|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|425f47f4-1222-436a-aa06-f1dbec813ba8|0.27685979427682494|0.7601751080241289
|USD |driver-072|0.7152638258352478 |0.09297572723995418|34.88024404326485
|2015/03/16|2015/03/16 |rider-072|0 |UBERX |
|20241204150600191 |20241204150600191_1_9
|3aec0901-bd07-4f9f-b64f-aaded343462c|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|3aec0901-bd07-4f9f-b64f-aaded343462c|0.01490256498846021|0.06971485394351151
|USD |driver-070|0.3472912340472365 |0.8505996598006605 |88.9151936118867
|2015/03/16|2015/03/16 |rider-070|0 |BLACK |
|20241204150600191 |20241204150600191_1_10
|ed453470-d0bc-4942-9c04-7ca304221d6e|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|ed453470-d0bc-4942-9c04-7ca304221d6e|0.4372473706122517
|0.9315622458544462 |USD |driver-070|0.14781683342041918
|0.8563266248271696 |27.331384804875103|2015/03/16|2015/03/16 |rider-070|0
|UBERX |
|20241204150600191 |20241204150600191_1_11
|6ca19f52-878c-42d2-b78c-6487c0c1501a|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|6ca19f52-878c-42d2-b78c-6487c0c1501a|0.7117355777782244
|0.6455694898336716 |USD |driver-070|0.3450947417446646
|0.6964490646998845 |28.86765279787131 |2015/03/16|2015/03/16 |rider-070|0
|UBERX |
|20241204150600191 |20241204150600191_1_12
|e40fc5ae-7805-4f9c-a089-e83398dc8f14|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|e40fc5ae-7805-4f9c-a089-e83398dc8f14|0.9641957292204617
|0.3812515518608759 |USD |driver-070|0.6041849016540516
|0.32585936767553325|5.79094434767401 |2015/03/16|2015/03/16 |rider-070|0
|BLACK |
|20241204150600191 |20241204150600191_1_13
|5657b9c2-cd37-4057-a286-4fe8e34aa503|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|5657b9c2-cd37-4057-a286-4fe8e34aa503|0.3030321891289054
|0.06745629633248351 |USD |driver-070|0.3209354871687474
|0.9185899386213338 |11.314883888952764|2015/03/16|2015/03/16 |rider-070|0
|BLACK |
|20241204150600191 |20241204150600191_1_14
|91c3ebe7-3797-464b-af89-604cf68cc3db|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|91c3ebe7-3797-464b-af89-604cf68cc3db|0.76370292415892
|0.3470969517406177 |USD |driver-070|0.26116740480875233
|0.5870178324524938 |72.43456133868803 |2015/03/16|2015/03/16 |rider-070|0
|BLACK |
|20241204150616439
|20241204150616439_1_532|3ea83d36-60dc-43ff-9f9f-791cc824f323|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0
|false |3ea83d36-60dc-43ff-9f9f-791cc824f323|0.5684632487248058
|0.37215847803798197 |USD
|driver-073|0.054661595019326104|0.24810431636010344|53.45669058400514
|2015/03/16|2015/03/16 |rider-073|0 |UBERX |
|20241204150600191 |20241204150600191_1_16
|34b730f6-c19f-4f6a-bf95-703c61dc3fa4|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|34b730f6-c19f-4f6a-bf95-703c61dc3fa4|0.9769970791360354
|0.9126162358158342 |USD |driver-070|0.20092033943627996
|0.5004521125628215 |95.29810539357332 |2015/03/16|2015/03/16 |rider-070|0
|BLACK |
|20241204150600191 |20241204150600191_0_0
|33c67d4b-d72d-45ea-b94e-285134cc7261|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|33c67d4b-d72d-45ea-b94e-285134cc7261|0.5295299471018257
|0.8796342384821229 |USD |driver-070|0.7477900383772803
|0.17871094201072368|14.039049113466096|2016/03/15|2016/03/15 |rider-070|0
|UBERX |
|20241204150600191 |20241204150600191_0_1
|c5304b84-6638-456e-9c63-faf3a37466b2|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|c5304b84-6638-456e-9c63-faf3a37466b2|0.6957210956161899
|0.6840305752968967 |USD |driver-070|0.4102831260234211
|0.22012113386766918|80.4122013976756 |2016/03/15|2016/03/15 |rider-070|0
|UBERX |
|20241204150600191 |20241204150600191_0_2
|82a0293a-b95c-4c5b-96ad-ac6098732b35|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|82a0293a-b95c-4c5b-96ad-ac6098732b35|0.5139184718380677
|0.2505739793056264 |USD |driver-070|0.1179051996084779
|0.7046801244916295 |84.98654138861065 |2016/03/15|2016/03/15 |rider-070|0
|UBERX |
|20241204150600191 |20241204150600191_0_3
|98f2fae2-507c-4af7-975e-e1713ffe4d09|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|98f2fae2-507c-4af7-975e-e1713ffe4d09|0.06611427533082836|0.788222336963299
|USD |driver-070|0.06671517994699039 |0.786493460186979 |94.45926125086118
|2016/03/15|2016/03/15 |rider-070|0 |UBERX |
|20241204150604821
|20241204150604821_0_514|de9dff6a-591b-482d-bb41-4a3c8a79e631|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|de9dff6a-591b-482d-bb41-4a3c8a79e631|0.1878054936680329
|0.01879889138787716 |USD |driver-071|0.4485493700070595
|0.7238770702991649 |78.22199805445177 |2016/03/15|2016/03/15 |rider-071|0
|BLACK |
|20241204150604821
|20241204150604821_0_512|0f7d8518-269e-47ff-b52c-0d083de918be|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|0f7d8518-269e-47ff-b52c-0d083de918be|0.5575851097958935
|0.1562523255339201 |USD |driver-071|0.43569700697390645
|0.35674304879736285|65.69533532145876 |2016/03/15|2016/03/15 |rider-071|0
|BLACK |
|20241204150600191 |20241204150600191_0_6
|615281d8-4636-4d6a-954f-03043618907f|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|615281d8-4636-4d6a-954f-03043618907f|0.41684117736066284|0.40427662848330415
|USD |driver-070|0.9094383420738296
|0.04860848373412596|36.397193900236466|2016/03/15|2016/03/15 |rider-070|0
|BLACK |
|20241204150604821
|20241204150604821_0_516|9ca4cfef-1df2-4b71-841d-6562c9ce6842|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|9ca4cfef-1df2-4b71-841d-6562c9ce6842|0.6284760957595001
|0.4765950340886149 |USD |driver-071|0.1216417932901912
|0.9975584711751252 |87.03128950423871 |2016/03/15|2016/03/15 |rider-071|0
|BLACK |
|20241204150616439
|20241204150616439_0_534|cbc086c6-4936-442e-8962-1f7bef79d072|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0
|false |cbc086c6-4936-442e-8962-1f7bef79d072|0.9151392407429653
|0.8058749127810513 |USD |driver-073|0.4109754791872877
|0.13960696212916768|36.3643551507392 |2016/03/15|2016/03/15 |rider-073|0
|UBERX |
|20241204150609831
|20241204150609831_0_529|3ab3d79f-edba-4182-8285-aab74cac1f56|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|3ab3d79f-edba-4182-8285-aab74cac1f56|0.330366816224278
|0.7321416055163578 |USD |driver-072|0.252074607122732
|0.7818192743089926 |69.02458690241536 |2016/03/15|2016/03/15 |rider-072|0
|UBERX |
|20241204150604821
|20241204150604821_0_513|b9c7bc8c-b027-4f46-9959-668067516f53|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|b9c7bc8c-b027-4f46-9959-668067516f53|0.9872898768793127
|0.3206772909391603 |USD |driver-071|0.7393757399954017
|0.8229493726180523 |80.22954578292044 |2016/03/15|2016/03/15 |rider-071|0
|UBERX |
|20241204150609831
|20241204150609831_0_530|7b05ef2f-0120-43a5-93c1-68ad9bc3924d|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|7b05ef2f-0120-43a5-93c1-68ad9bc3924d|0.512729897800753
|0.8408144614796756 |USD |driver-072|0.6934187325203937
|0.992327632998625 |33.674612100034516|2016/03/15|2016/03/15 |rider-072|0
|BLACK |
|20241204150600191 |20241204150600191_0_12
|c4ae071b-13b4-44da-b37e-0ba8de525f89|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|c4ae071b-13b4-44da-b37e-0ba8de525f89|0.6049239453837221
|0.9313564512445435 |USD |driver-070|0.1959158255075305
|0.3775703824159009 |82.08748305521034 |2016/03/15|2016/03/15 |rider-070|0
|BLACK |
|20241204150604821
|20241204150604821_0_511|c96ed9e8-83f9-4691-8ed5-4ba6cdd49e57|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|c96ed9e8-83f9-4691-8ed5-4ba6cdd49e57|0.3063896359769538
|0.676726038869916 |USD |driver-071|0.5206916773641883
|0.7508961494548403 |43.70502045148351 |2016/03/15|2016/03/15 |rider-071|0
|UBERX |
|20241204150616439
|20241204150616439_0_536|6edd6b70-6936-453c-96bc-215d342fa8f5|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0
|false |6edd6b70-6936-453c-96bc-215d342fa8f5|0.2980278638105116
|0.14613853342099636 |USD |driver-073|0.8551626497735585
|0.03433553370268205|29.224097481704792|2016/03/15|2016/03/15 |rider-073|0
|UBERX |
|20241204150600191 |20241204150600191_0_15
|1d46c9d2-ef0d-4a3c-aadd-ec36a21976b6|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|1d46c9d2-ef0d-4a3c-aadd-ec36a21976b6|0.1322967369714605
|0.7930789069995893 |USD |driver-070|0.8967005520421634
|0.28297812156228164|91.41578669662796 |2016/03/15|2016/03/15 |rider-070|0
|UBERX |
|20241204150616439
|20241204150616439_0_535|feba8352-6e5d-423b-b43a-6fa03d180c7d|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0
|false |feba8352-6e5d-423b-b43a-6fa03d180c7d|0.7246264335247615
|0.15163955377372784 |USD |driver-073|0.31869327673539605
|0.19455671784122086|58.48033373395598 |2016/03/15|2016/03/15 |rider-073|0
|BLACK |
|20241204150616439
|20241204150616439_2_538|1e40d120-cc3c-4de7-a85a-242591cb475f|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0
|false
|1e40d120-cc3c-4de7-a85a-242591cb475f|0.23214150377933496|0.5266318711252643
|USD |driver-073|0.12350647347943444 |0.8741043242174295 |35.60384350116569
|2015/03/17|2015/03/17 |rider-073|0 |BLACK |
|20241204150616439
|20241204150616439_2_540|f80e03bd-34f1-4c91-983f-0707f1433512|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0
|false
|f80e03bd-34f1-4c91-983f-0707f1433512|0.46011052568020516|0.15082236303129448
|USD |driver-073|0.6405338495368493 |0.21487670808886683|92.00424394066677
|2015/03/17|2015/03/17 |rider-073|0 |BLACK |
|20241204150600191 |20241204150600191_2_2
|a3565704-2302-48bd-90d6-5f22b2105e74|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|a3565704-2302-48bd-90d6-5f22b2105e74|0.8616030391205203
|0.24686237288332835 |USD |driver-070|0.08026319218679445
|0.36091392808312783|1.2402943399241417|2015/03/17|2015/03/17 |rider-070|0
|BLACK |
|20241204150609831
|20241204150609831_2_525|d4af6051-3f61-48a7-bdb6-f94aecef892c|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|d4af6051-3f61-48a7-bdb6-f94aecef892c|0.4418656411552184
|0.20380214851801082 |USD |driver-072|0.7024078023523515
|0.5560959213386791 |28.432774333142696|2015/03/17|2015/03/17 |rider-072|0
|UBERX |
|20241204150600191 |20241204150600191_2_4
|e0d1e347-9e1e-4b16-9384-209de28463ad|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|e0d1e347-9e1e-4b16-9384-209de28463ad|0.21480612076837624|0.7734537934685566
|USD |driver-070|0.15638021739154395 |0.5413247791299718 |89.32327168066406
|2015/03/17|2015/03/17 |rider-070|0 |UBERX |
|20241204150600191 |20241204150600191_2_5
|d985812a-6bce-453c-89d3-e32bdebe7441|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|d985812a-6bce-453c-89d3-e32bdebe7441|0.1066097509473195
|0.6323263473920159 |USD |driver-070|0.5171970706764893
|0.5884188092036249 |75.61627331267051 |2015/03/17|2015/03/17 |rider-070|0
|UBERX |
|20241204150609831
|20241204150609831_2_524|0c897c91-b17f-4e06-85bb-95dc525542e5|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|0c897c91-b17f-4e06-85bb-95dc525542e5|0.48341044721222115|0.7783588752585501
|USD |driver-072|0.8105844069167545 |0.7556355235178576 |36.25092377209559
|2015/03/17|2015/03/17 |rider-072|0 |UBERX |
|20241204150616439
|20241204150616439_2_539|d4d3e4d7-d80c-4fd1-bc28-58d975561f8c|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0
|false |d4d3e4d7-d80c-4fd1-bc28-58d975561f8c|0.9387506848597982
|0.21554499574709152 |USD |driver-073|0.8257683543049836
|0.22095845719120266|45.38832104830463 |2015/03/17|2015/03/17 |rider-073|0
|BLACK |
|20241204150600191 |20241204150600191_2_8
|4a5dda50-52e6-4d4a-99a6-14885df536aa|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|4a5dda50-52e6-4d4a-99a6-14885df536aa|0.9152344120643987
|0.661611637881472 |USD |driver-070|0.49661724449042355
|0.4515339872367127 |14.66765875628331 |2015/03/17|2015/03/17 |rider-070|0
|UBERX |
|20241204150600191 |20241204150600191_2_9
|f3344b6a-f441-4887-aed4-ff32ca51336d|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|f3344b6a-f441-4887-aed4-ff32ca51336d|0.4005153811072475
|0.603831078282567 |USD |driver-070|0.21339081869333554
|0.20651517191822233|12.785746837871736|2015/03/17|2015/03/17 |rider-070|0
|BLACK |
|20241204150600191 |20241204150600191_2_10
|736ce3e4-2546-44f3-a9e9-eee7e5e00d66|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|736ce3e4-2546-44f3-a9e9-eee7e5e00d66|0.8836806996621173
|0.417755379804704 |USD |driver-070|0.15504377738626696
|0.9646093195950337 |76.83510630683561 |2015/03/17|2015/03/17 |rider-070|0
|BLACK |
|20241204150609831
|20241204150609831_2_527|c7f17b56-257f-4acc-b279-28e0633c2ab9|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|c7f17b56-257f-4acc-b279-28e0633c2ab9|0.894014614318913
|0.3562120043692295 |USD |driver-072|0.4468980604294439
|0.7801124003446892 |2.612301074915313 |2015/03/17|2015/03/17 |rider-072|0
|UBERX |
|20241204150604821
|20241204150604821_2_520|7cb8b2d9-7ed9-4244-a645-bcdda805cfa6|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|7cb8b2d9-7ed9-4244-a645-bcdda805cfa6|0.7537892059745742
|0.17348385378301368 |USD |driver-071|0.09998795889862999
|0.8570816800874261 |7.539726533477465 |2015/03/17|2015/03/17 |rider-071|0
|UBERX |
|20241204150609831
|20241204150609831_2_528|51bbbaca-45e4-413b-a360-08ed8e95cecc|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|51bbbaca-45e4-413b-a360-08ed8e95cecc|0.8504635255080416
|0.029931485779198685|USD |driver-072|0.6595942017862979
|0.6293739670305403 |34.709364997053335|2015/03/17|2015/03/17 |rider-072|0
|UBERX |
|20241204150616439
|20241204150616439_2_537|1c25f623-cbee-4859-924e-4c0266ff32ef|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0
|false |1c25f623-cbee-4859-924e-4c0266ff32ef|0.4797372706538726
|0.9801234965812413 |USD |driver-073|0.44707430870890963
|0.09686588023302611|36.42400334704722 |2015/03/17|2015/03/17 |rider-073|0
|UBERX |
|20241204150604821
|20241204150604821_2_519|1bce6171-5a57-4755-b0f8-6192c96bd149|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|1bce6171-5a57-4755-b0f8-6192c96bd149|0.49318043200219774|0.964753965970299
|USD |driver-071|0.593306367417992 |0.7669546871042435
|17.688084927938707|2015/03/17|2015/03/17 |rider-071|0 |BLACK |
+-------------------+-----------------------+------------------------------------+----------------------+-----------------------------------------------------------------------------+------------------+------------------------------------+-------------------+--------------------+--------+----------+--------------------+-------------------+------------------+----------+--------------+---------+---------+---------+
{code}
was (Author: JIRAUSER301185):
Confirmed that the data files are correct. That is, the data before, after
deletion, deletes are correct after checking their numbers.
Therefore, this is a pure SI issue.
{code:java}
Deleted Record
+-------------------+-----------------------+------------------------------------+----------------------+-----------------------------------------------------------------------------+------------------+------------------------------------+------------------+------------------+--------+----------+-------------------+-------------------+------------------+----------+--------------+---------+---------+---------+
|_hoodie_commit_time|_hoodie_commit_seqno |_hoodie_record_key
|_hoodie_partition_path|_hoodie_file_name
|_hoodie_is_deleted|_row_key
|begin_lat |begin_lon |currency|driver |end_lat
|end_lon |fare |partition |partition_path|rider
|timestamp|trip_type|
+-------------------+-----------------------+------------------------------------+----------------------+-----------------------------------------------------------------------------+------------------+------------------------------------+------------------+------------------+--------+----------+-------------------+-------------------+------------------+----------+--------------+---------+---------+---------+
|20241204150609831
|20241204150609831_1_522|7d3374cf-dca4-4b72-bcbc-7ba0d2eb19c9|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|7d3374cf-dca4-4b72-bcbc-7ba0d2eb19c9|0.2165672621754512|0.5242790647150243|USD
|driver-072|0.05641001459656936|0.03530815356187822|42.973545869794606|2015/03/16|2015/03/16
|rider-072|0 |UBERX |
+-------------------+-----------------------+------------------------------------+----------------------+-----------------------------------------------------------------------------+------------------+------------------------------------+------------------+------------------+--------+----------+-------------------+-------------------+------------------+----------+--------------+---------+---------+---------+
table after deletion
+-------------------+-----------------------+------------------------------------+----------------------+-----------------------------------------------------------------------------+------------------+------------------------------------+-------------------+--------------------+--------+----------+--------------------+-------------------+------------------+----------+--------------+---------+---------+---------+
|_hoodie_commit_time|_hoodie_commit_seqno |_hoodie_record_key
|_hoodie_partition_path|_hoodie_file_name
|_hoodie_is_deleted|_row_key
|begin_lat |begin_lon |currency|driver |end_lat
|end_lon |fare |partition |partition_path|rider
|timestamp|trip_type|
+-------------------+-----------------------+------------------------------------+----------------------+-----------------------------------------------------------------------------+------------------+------------------------------------+-------------------+--------------------+--------+----------+--------------------+-------------------+------------------+----------+--------------+---------+---------+---------+
|20241204150616439
|20241204150616439_1_533|e856715c-2428-46e4-aa30-fe354fca6e3a|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0
|false |e856715c-2428-46e4-aa30-fe354fca6e3a|0.5874052958818854
|0.6031449776911632 |USD |driver-073|0.9112808948611031
|0.8354468050877537 |52.60940387787188 |2015/03/16|2015/03/16 |rider-073|0
|UBERX |
|20241204150600191 |20241204150600191_1_2
|f3861a94-b8f0-48b8-b1d3-7c680a4c1724|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|f3861a94-b8f0-48b8-b1d3-7c680a4c1724|0.3461148061512298
|0.4232292248024734 |USD |driver-070|0.6198882503124046
|0.3595542721435352 |96.47097769665639 |2015/03/16|2015/03/16 |rider-070|0
|UBERX |
|20241204150616439
|20241204150616439_1_531|3d9dd7ff-027c-4d5c-9aba-1051374449a9|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0
|false
|3d9dd7ff-027c-4d5c-9aba-1051374449a9|0.44390771822904995|0.9043969724773593
|USD |driver-073|0.15035290876410057 |0.5186489253773559
|30.812696381319927|2015/03/16|2015/03/16 |rider-073|0 |BLACK |
|20241204150600191 |20241204150600191_1_4
|15d4c0ae-bd1e-46a7-9593-c6c958e3c378|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|15d4c0ae-bd1e-46a7-9593-c6c958e3c378|0.0741467894429374
|0.4871162393065156 |USD |driver-070|0.6189057273545401
|0.8897308879633529 |77.40580225241546 |2015/03/16|2015/03/16 |rider-070|0
|UBERX |
|20241204150600191 |20241204150600191_1_5
|a6928e33-5533-4f9b-b45c-e8958dbef03c|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|a6928e33-5533-4f9b-b45c-e8958dbef03c|0.3793943821206921
|0.8534950221755219 |USD |driver-070|0.8031316524052362
|0.5585491829799133 |84.26957459220016 |2015/03/16|2015/03/16 |rider-070|0
|UBERX |
|20241204150604821
|20241204150604821_1_517|c867b36f-4f13-4d18-a3b7-cc21f2b9e9ab|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|c867b36f-4f13-4d18-a3b7-cc21f2b9e9ab|0.2735972259977213
|0.15207329562483696 |USD |driver-071|0.80389038785619
|0.9975324632191459 |59.81022393535782 |2015/03/16|2015/03/16 |rider-071|0
|UBERX |
|20241204150600191 |20241204150600191_1_7
|a4b81cd3-11af-4df1-96a8-6b61fc3fb4c5|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|a4b81cd3-11af-4df1-96a8-6b61fc3fb4c5|0.7331705266718346
|0.023734696611152017|USD |driver-070|0.30680826368246406
|0.9645825541647315 |85.0240043948057 |2015/03/16|2015/03/16 |rider-070|0
|BLACK |
|20241204150609831
|20241204150609831_1_521|425f47f4-1222-436a-aa06-f1dbec813ba8|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|425f47f4-1222-436a-aa06-f1dbec813ba8|0.27685979427682494|0.7601751080241289
|USD |driver-072|0.7152638258352478 |0.09297572723995418|34.88024404326485
|2015/03/16|2015/03/16 |rider-072|0 |UBERX |
|20241204150600191 |20241204150600191_1_9
|3aec0901-bd07-4f9f-b64f-aaded343462c|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|3aec0901-bd07-4f9f-b64f-aaded343462c|0.01490256498846021|0.06971485394351151
|USD |driver-070|0.3472912340472365 |0.8505996598006605 |88.9151936118867
|2015/03/16|2015/03/16 |rider-070|0 |BLACK |
|20241204150600191 |20241204150600191_1_10
|ed453470-d0bc-4942-9c04-7ca304221d6e|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|ed453470-d0bc-4942-9c04-7ca304221d6e|0.4372473706122517
|0.9315622458544462 |USD |driver-070|0.14781683342041918
|0.8563266248271696 |27.331384804875103|2015/03/16|2015/03/16 |rider-070|0
|UBERX |
|20241204150600191 |20241204150600191_1_11
|6ca19f52-878c-42d2-b78c-6487c0c1501a|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|6ca19f52-878c-42d2-b78c-6487c0c1501a|0.7117355777782244
|0.6455694898336716 |USD |driver-070|0.3450947417446646
|0.6964490646998845 |28.86765279787131 |2015/03/16|2015/03/16 |rider-070|0
|UBERX |
|20241204150600191 |20241204150600191_1_12
|e40fc5ae-7805-4f9c-a089-e83398dc8f14|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|e40fc5ae-7805-4f9c-a089-e83398dc8f14|0.9641957292204617
|0.3812515518608759 |USD |driver-070|0.6041849016540516
|0.32585936767553325|5.79094434767401 |2015/03/16|2015/03/16 |rider-070|0
|BLACK |
|20241204150600191 |20241204150600191_1_13
|5657b9c2-cd37-4057-a286-4fe8e34aa503|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|5657b9c2-cd37-4057-a286-4fe8e34aa503|0.3030321891289054
|0.06745629633248351 |USD |driver-070|0.3209354871687474
|0.9185899386213338 |11.314883888952764|2015/03/16|2015/03/16 |rider-070|0
|BLACK |
|20241204150600191 |20241204150600191_1_14
|91c3ebe7-3797-464b-af89-604cf68cc3db|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|91c3ebe7-3797-464b-af89-604cf68cc3db|0.76370292415892
|0.3470969517406177 |USD |driver-070|0.26116740480875233
|0.5870178324524938 |72.43456133868803 |2015/03/16|2015/03/16 |rider-070|0
|BLACK |
|20241204150616439
|20241204150616439_1_532|3ea83d36-60dc-43ff-9f9f-791cc824f323|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0
|false |3ea83d36-60dc-43ff-9f9f-791cc824f323|0.5684632487248058
|0.37215847803798197 |USD
|driver-073|0.054661595019326104|0.24810431636010344|53.45669058400514
|2015/03/16|2015/03/16 |rider-073|0 |UBERX |
|20241204150600191 |20241204150600191_1_16
|34b730f6-c19f-4f6a-bf95-703c61dc3fa4|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|34b730f6-c19f-4f6a-bf95-703c61dc3fa4|0.9769970791360354
|0.9126162358158342 |USD |driver-070|0.20092033943627996
|0.5004521125628215 |95.29810539357332 |2015/03/16|2015/03/16 |rider-070|0
|BLACK |
|20241204150600191 |20241204150600191_0_0
|33c67d4b-d72d-45ea-b94e-285134cc7261|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|33c67d4b-d72d-45ea-b94e-285134cc7261|0.5295299471018257
|0.8796342384821229 |USD |driver-070|0.7477900383772803
|0.17871094201072368|14.039049113466096|2016/03/15|2016/03/15 |rider-070|0
|UBERX |
|20241204150600191 |20241204150600191_0_1
|c5304b84-6638-456e-9c63-faf3a37466b2|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|c5304b84-6638-456e-9c63-faf3a37466b2|0.6957210956161899
|0.6840305752968967 |USD |driver-070|0.4102831260234211
|0.22012113386766918|80.4122013976756 |2016/03/15|2016/03/15 |rider-070|0
|UBERX |
|20241204150600191 |20241204150600191_0_2
|82a0293a-b95c-4c5b-96ad-ac6098732b35|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|82a0293a-b95c-4c5b-96ad-ac6098732b35|0.5139184718380677
|0.2505739793056264 |USD |driver-070|0.1179051996084779
|0.7046801244916295 |84.98654138861065 |2016/03/15|2016/03/15 |rider-070|0
|UBERX |
|20241204150600191 |20241204150600191_0_3
|98f2fae2-507c-4af7-975e-e1713ffe4d09|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|98f2fae2-507c-4af7-975e-e1713ffe4d09|0.06611427533082836|0.788222336963299
|USD |driver-070|0.06671517994699039 |0.786493460186979 |94.45926125086118
|2016/03/15|2016/03/15 |rider-070|0 |UBERX |
|20241204150604821
|20241204150604821_0_514|de9dff6a-591b-482d-bb41-4a3c8a79e631|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|de9dff6a-591b-482d-bb41-4a3c8a79e631|0.1878054936680329
|0.01879889138787716 |USD |driver-071|0.4485493700070595
|0.7238770702991649 |78.22199805445177 |2016/03/15|2016/03/15 |rider-071|0
|BLACK |
|20241204150604821
|20241204150604821_0_512|0f7d8518-269e-47ff-b52c-0d083de918be|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|0f7d8518-269e-47ff-b52c-0d083de918be|0.5575851097958935
|0.1562523255339201 |USD |driver-071|0.43569700697390645
|0.35674304879736285|65.69533532145876 |2016/03/15|2016/03/15 |rider-071|0
|BLACK |
|20241204150600191 |20241204150600191_0_6
|615281d8-4636-4d6a-954f-03043618907f|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|615281d8-4636-4d6a-954f-03043618907f|0.41684117736066284|0.40427662848330415
|USD |driver-070|0.9094383420738296
|0.04860848373412596|36.397193900236466|2016/03/15|2016/03/15 |rider-070|0
|BLACK |
|20241204150604821
|20241204150604821_0_516|9ca4cfef-1df2-4b71-841d-6562c9ce6842|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|9ca4cfef-1df2-4b71-841d-6562c9ce6842|0.6284760957595001
|0.4765950340886149 |USD |driver-071|0.1216417932901912
|0.9975584711751252 |87.03128950423871 |2016/03/15|2016/03/15 |rider-071|0
|BLACK |
|20241204150616439
|20241204150616439_0_534|cbc086c6-4936-442e-8962-1f7bef79d072|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0
|false |cbc086c6-4936-442e-8962-1f7bef79d072|0.9151392407429653
|0.8058749127810513 |USD |driver-073|0.4109754791872877
|0.13960696212916768|36.3643551507392 |2016/03/15|2016/03/15 |rider-073|0
|UBERX |
|20241204150609831
|20241204150609831_0_529|3ab3d79f-edba-4182-8285-aab74cac1f56|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|3ab3d79f-edba-4182-8285-aab74cac1f56|0.330366816224278
|0.7321416055163578 |USD |driver-072|0.252074607122732
|0.7818192743089926 |69.02458690241536 |2016/03/15|2016/03/15 |rider-072|0
|UBERX |
|20241204150604821
|20241204150604821_0_513|b9c7bc8c-b027-4f46-9959-668067516f53|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|b9c7bc8c-b027-4f46-9959-668067516f53|0.9872898768793127
|0.3206772909391603 |USD |driver-071|0.7393757399954017
|0.8229493726180523 |80.22954578292044 |2016/03/15|2016/03/15 |rider-071|0
|UBERX |
|20241204150609831
|20241204150609831_0_530|7b05ef2f-0120-43a5-93c1-68ad9bc3924d|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|7b05ef2f-0120-43a5-93c1-68ad9bc3924d|0.512729897800753
|0.8408144614796756 |USD |driver-072|0.6934187325203937
|0.992327632998625 |33.674612100034516|2016/03/15|2016/03/15 |rider-072|0
|BLACK |
|20241204150600191 |20241204150600191_0_12
|c4ae071b-13b4-44da-b37e-0ba8de525f89|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|c4ae071b-13b4-44da-b37e-0ba8de525f89|0.6049239453837221
|0.9313564512445435 |USD |driver-070|0.1959158255075305
|0.3775703824159009 |82.08748305521034 |2016/03/15|2016/03/15 |rider-070|0
|BLACK |
|20241204150604821
|20241204150604821_0_511|c96ed9e8-83f9-4691-8ed5-4ba6cdd49e57|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|c96ed9e8-83f9-4691-8ed5-4ba6cdd49e57|0.3063896359769538
|0.676726038869916 |USD |driver-071|0.5206916773641883
|0.7508961494548403 |43.70502045148351 |2016/03/15|2016/03/15 |rider-071|0
|UBERX |
|20241204150616439
|20241204150616439_0_536|6edd6b70-6936-453c-96bc-215d342fa8f5|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0
|false |6edd6b70-6936-453c-96bc-215d342fa8f5|0.2980278638105116
|0.14613853342099636 |USD |driver-073|0.8551626497735585
|0.03433553370268205|29.224097481704792|2016/03/15|2016/03/15 |rider-073|0
|UBERX |
|20241204150600191 |20241204150600191_0_15
|1d46c9d2-ef0d-4a3c-aadd-ec36a21976b6|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|1d46c9d2-ef0d-4a3c-aadd-ec36a21976b6|0.1322967369714605
|0.7930789069995893 |USD |driver-070|0.8967005520421634
|0.28297812156228164|91.41578669662796 |2016/03/15|2016/03/15 |rider-070|0
|UBERX |
|20241204150616439
|20241204150616439_0_535|feba8352-6e5d-423b-b43a-6fa03d180c7d|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0
|false |feba8352-6e5d-423b-b43a-6fa03d180c7d|0.7246264335247615
|0.15163955377372784 |USD |driver-073|0.31869327673539605
|0.19455671784122086|58.48033373395598 |2016/03/15|2016/03/15 |rider-073|0
|BLACK |
|20241204150616439
|20241204150616439_2_538|1e40d120-cc3c-4de7-a85a-242591cb475f|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0
|false
|1e40d120-cc3c-4de7-a85a-242591cb475f|0.23214150377933496|0.5266318711252643
|USD |driver-073|0.12350647347943444 |0.8741043242174295 |35.60384350116569
|2015/03/17|2015/03/17 |rider-073|0 |BLACK |
|20241204150616439
|20241204150616439_2_540|f80e03bd-34f1-4c91-983f-0707f1433512|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0
|false
|f80e03bd-34f1-4c91-983f-0707f1433512|0.46011052568020516|0.15082236303129448
|USD |driver-073|0.6405338495368493 |0.21487670808886683|92.00424394066677
|2015/03/17|2015/03/17 |rider-073|0 |BLACK |
|20241204150600191 |20241204150600191_2_2
|a3565704-2302-48bd-90d6-5f22b2105e74|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|a3565704-2302-48bd-90d6-5f22b2105e74|0.8616030391205203
|0.24686237288332835 |USD |driver-070|0.08026319218679445
|0.36091392808312783|1.2402943399241417|2015/03/17|2015/03/17 |rider-070|0
|BLACK |
|20241204150609831
|20241204150609831_2_525|d4af6051-3f61-48a7-bdb6-f94aecef892c|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|d4af6051-3f61-48a7-bdb6-f94aecef892c|0.4418656411552184
|0.20380214851801082 |USD |driver-072|0.7024078023523515
|0.5560959213386791 |28.432774333142696|2015/03/17|2015/03/17 |rider-072|0
|UBERX |
|20241204150600191 |20241204150600191_2_4
|e0d1e347-9e1e-4b16-9384-209de28463ad|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|e0d1e347-9e1e-4b16-9384-209de28463ad|0.21480612076837624|0.7734537934685566
|USD |driver-070|0.15638021739154395 |0.5413247791299718 |89.32327168066406
|2015/03/17|2015/03/17 |rider-070|0 |UBERX |
|20241204150600191 |20241204150600191_2_5
|d985812a-6bce-453c-89d3-e32bdebe7441|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|d985812a-6bce-453c-89d3-e32bdebe7441|0.1066097509473195
|0.6323263473920159 |USD |driver-070|0.5171970706764893
|0.5884188092036249 |75.61627331267051 |2015/03/17|2015/03/17 |rider-070|0
|UBERX |
|20241204150609831
|20241204150609831_2_524|0c897c91-b17f-4e06-85bb-95dc525542e5|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|0c897c91-b17f-4e06-85bb-95dc525542e5|0.48341044721222115|0.7783588752585501
|USD |driver-072|0.8105844069167545 |0.7556355235178576 |36.25092377209559
|2015/03/17|2015/03/17 |rider-072|0 |UBERX |
|20241204150616439
|20241204150616439_2_539|d4d3e4d7-d80c-4fd1-bc28-58d975561f8c|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0
|false |d4d3e4d7-d80c-4fd1-bc28-58d975561f8c|0.9387506848597982
|0.21554499574709152 |USD |driver-073|0.8257683543049836
|0.22095845719120266|45.38832104830463 |2015/03/17|2015/03/17 |rider-073|0
|BLACK |
|20241204150600191 |20241204150600191_2_8
|4a5dda50-52e6-4d4a-99a6-14885df536aa|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|4a5dda50-52e6-4d4a-99a6-14885df536aa|0.9152344120643987
|0.661611637881472 |USD |driver-070|0.49661724449042355
|0.4515339872367127 |14.66765875628331 |2015/03/17|2015/03/17 |rider-070|0
|UBERX |
|20241204150600191 |20241204150600191_2_9
|f3344b6a-f441-4887-aed4-ff32ca51336d|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|f3344b6a-f441-4887-aed4-ff32ca51336d|0.4005153811072475
|0.603831078282567 |USD |driver-070|0.21339081869333554
|0.20651517191822233|12.785746837871736|2015/03/17|2015/03/17 |rider-070|0
|BLACK |
|20241204150600191 |20241204150600191_2_10
|736ce3e4-2546-44f3-a9e9-eee7e5e00d66|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|736ce3e4-2546-44f3-a9e9-eee7e5e00d66|0.8836806996621173
|0.417755379804704 |USD |driver-070|0.15504377738626696
|0.9646093195950337 |76.83510630683561 |2015/03/17|2015/03/17 |rider-070|0
|BLACK |
|20241204150609831
|20241204150609831_2_527|c7f17b56-257f-4acc-b279-28e0633c2ab9|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|c7f17b56-257f-4acc-b279-28e0633c2ab9|0.894014614318913
|0.3562120043692295 |USD |driver-072|0.4468980604294439
|0.7801124003446892 |2.612301074915313 |2015/03/17|2015/03/17 |rider-072|0
|UBERX |
|20241204150604821
|20241204150604821_2_520|7cb8b2d9-7ed9-4244-a645-bcdda805cfa6|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|7cb8b2d9-7ed9-4244-a645-bcdda805cfa6|0.7537892059745742
|0.17348385378301368 |USD |driver-071|0.09998795889862999
|0.8570816800874261 |7.539726533477465 |2015/03/17|2015/03/17 |rider-071|0
|UBERX |
|20241204150609831
|20241204150609831_2_528|51bbbaca-45e4-413b-a360-08ed8e95cecc|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|51bbbaca-45e4-413b-a360-08ed8e95cecc|0.8504635255080416
|0.029931485779198685|USD |driver-072|0.6595942017862979
|0.6293739670305403 |34.709364997053335|2015/03/17|2015/03/17 |rider-072|0
|UBERX |
|20241204150616439
|20241204150616439_2_537|1c25f623-cbee-4859-924e-4c0266ff32ef|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0
|false |1c25f623-cbee-4859-924e-4c0266ff32ef|0.4797372706538726
|0.9801234965812413 |USD |driver-073|0.44707430870890963
|0.09686588023302611|36.42400334704722 |2015/03/17|2015/03/17 |rider-073|0
|UBERX |
|20241204150604821
|20241204150604821_2_519|1bce6171-5a57-4755-b0f8-6192c96bd149|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|1bce6171-5a57-4755-b0f8-6192c96bd149|0.49318043200219774|0.964753965970299
|USD |driver-071|0.593306367417992 |0.7669546871042435
|17.688084927938707|2015/03/17|2015/03/17 |rider-071|0 |BLACK |
+-------------------+-----------------------+------------------------------------+----------------------+-----------------------------------------------------------------------------+------------------+------------------------------------+-------------------+--------------------+--------+----------+--------------------+-------------------+------------------+----------+--------------+---------+---------+---------+Table
before deletion
+-------------------+-----------------------+------------------------------------+----------------------+-----------------------------------------------------------------------------+------------------+------------------------------------+-------------------+--------------------+--------+----------+--------------------+-------------------+------------------+----------+--------------+---------+---------+---------+
|_hoodie_commit_time|_hoodie_commit_seqno |_hoodie_record_key
|_hoodie_partition_path|_hoodie_file_name
|_hoodie_is_deleted|_row_key
|begin_lat |begin_lon |currency|driver |end_lat
|end_lon |fare |partition |partition_path|rider
|timestamp|trip_type|
+-------------------+-----------------------+------------------------------------+----------------------+-----------------------------------------------------------------------------+------------------+------------------------------------+-------------------+--------------------+--------+----------+--------------------+-------------------+------------------+----------+--------------+---------+---------+---------+
|20241204150609831
|20241204150609831_1_522|7d3374cf-dca4-4b72-bcbc-7ba0d2eb19c9|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|7d3374cf-dca4-4b72-bcbc-7ba0d2eb19c9|0.2165672621754512
|0.5242790647150243 |USD |driver-072|0.05641001459656936
|0.03530815356187822|42.973545869794606|2015/03/16|2015/03/16 |rider-072|0
|UBERX |
|20241204150616439
|20241204150616439_1_533|e856715c-2428-46e4-aa30-fe354fca6e3a|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0
|false |e856715c-2428-46e4-aa30-fe354fca6e3a|0.5874052958818854
|0.6031449776911632 |USD |driver-073|0.9112808948611031
|0.8354468050877537 |52.60940387787188 |2015/03/16|2015/03/16 |rider-073|0
|UBERX |
|20241204150600191 |20241204150600191_1_2
|f3861a94-b8f0-48b8-b1d3-7c680a4c1724|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|f3861a94-b8f0-48b8-b1d3-7c680a4c1724|0.3461148061512298
|0.4232292248024734 |USD |driver-070|0.6198882503124046
|0.3595542721435352 |96.47097769665639 |2015/03/16|2015/03/16 |rider-070|0
|UBERX |
|20241204150616439
|20241204150616439_1_531|3d9dd7ff-027c-4d5c-9aba-1051374449a9|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0
|false
|3d9dd7ff-027c-4d5c-9aba-1051374449a9|0.44390771822904995|0.9043969724773593
|USD |driver-073|0.15035290876410057 |0.5186489253773559
|30.812696381319927|2015/03/16|2015/03/16 |rider-073|0 |BLACK |
|20241204150600191 |20241204150600191_1_4
|15d4c0ae-bd1e-46a7-9593-c6c958e3c378|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|15d4c0ae-bd1e-46a7-9593-c6c958e3c378|0.0741467894429374
|0.4871162393065156 |USD |driver-070|0.6189057273545401
|0.8897308879633529 |77.40580225241546 |2015/03/16|2015/03/16 |rider-070|0
|UBERX |
|20241204150600191 |20241204150600191_1_5
|a6928e33-5533-4f9b-b45c-e8958dbef03c|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|a6928e33-5533-4f9b-b45c-e8958dbef03c|0.3793943821206921
|0.8534950221755219 |USD |driver-070|0.8031316524052362
|0.5585491829799133 |84.26957459220016 |2015/03/16|2015/03/16 |rider-070|0
|UBERX |
|20241204150604821
|20241204150604821_1_517|c867b36f-4f13-4d18-a3b7-cc21f2b9e9ab|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|c867b36f-4f13-4d18-a3b7-cc21f2b9e9ab|0.2735972259977213
|0.15207329562483696 |USD |driver-071|0.80389038785619
|0.9975324632191459 |59.81022393535782 |2015/03/16|2015/03/16 |rider-071|0
|UBERX |
|20241204150600191 |20241204150600191_1_7
|a4b81cd3-11af-4df1-96a8-6b61fc3fb4c5|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|a4b81cd3-11af-4df1-96a8-6b61fc3fb4c5|0.7331705266718346
|0.023734696611152017|USD |driver-070|0.30680826368246406
|0.9645825541647315 |85.0240043948057 |2015/03/16|2015/03/16 |rider-070|0
|BLACK |
|20241204150609831
|20241204150609831_1_521|425f47f4-1222-436a-aa06-f1dbec813ba8|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|425f47f4-1222-436a-aa06-f1dbec813ba8|0.27685979427682494|0.7601751080241289
|USD |driver-072|0.7152638258352478 |0.09297572723995418|34.88024404326485
|2015/03/16|2015/03/16 |rider-072|0 |UBERX |
|20241204150600191 |20241204150600191_1_9
|3aec0901-bd07-4f9f-b64f-aaded343462c|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|3aec0901-bd07-4f9f-b64f-aaded343462c|0.01490256498846021|0.06971485394351151
|USD |driver-070|0.3472912340472365 |0.8505996598006605 |88.9151936118867
|2015/03/16|2015/03/16 |rider-070|0 |BLACK |
|20241204150600191 |20241204150600191_1_10
|ed453470-d0bc-4942-9c04-7ca304221d6e|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|ed453470-d0bc-4942-9c04-7ca304221d6e|0.4372473706122517
|0.9315622458544462 |USD |driver-070|0.14781683342041918
|0.8563266248271696 |27.331384804875103|2015/03/16|2015/03/16 |rider-070|0
|UBERX |
|20241204150600191 |20241204150600191_1_11
|6ca19f52-878c-42d2-b78c-6487c0c1501a|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|6ca19f52-878c-42d2-b78c-6487c0c1501a|0.7117355777782244
|0.6455694898336716 |USD |driver-070|0.3450947417446646
|0.6964490646998845 |28.86765279787131 |2015/03/16|2015/03/16 |rider-070|0
|UBERX |
|20241204150600191 |20241204150600191_1_12
|e40fc5ae-7805-4f9c-a089-e83398dc8f14|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|e40fc5ae-7805-4f9c-a089-e83398dc8f14|0.9641957292204617
|0.3812515518608759 |USD |driver-070|0.6041849016540516
|0.32585936767553325|5.79094434767401 |2015/03/16|2015/03/16 |rider-070|0
|BLACK |
|20241204150600191 |20241204150600191_1_13
|5657b9c2-cd37-4057-a286-4fe8e34aa503|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|5657b9c2-cd37-4057-a286-4fe8e34aa503|0.3030321891289054
|0.06745629633248351 |USD |driver-070|0.3209354871687474
|0.9185899386213338 |11.314883888952764|2015/03/16|2015/03/16 |rider-070|0
|BLACK |
|20241204150600191 |20241204150600191_1_14
|91c3ebe7-3797-464b-af89-604cf68cc3db|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|91c3ebe7-3797-464b-af89-604cf68cc3db|0.76370292415892
|0.3470969517406177 |USD |driver-070|0.26116740480875233
|0.5870178324524938 |72.43456133868803 |2015/03/16|2015/03/16 |rider-070|0
|BLACK |
|20241204150616439
|20241204150616439_1_532|3ea83d36-60dc-43ff-9f9f-791cc824f323|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0
|false |3ea83d36-60dc-43ff-9f9f-791cc824f323|0.5684632487248058
|0.37215847803798197 |USD
|driver-073|0.054661595019326104|0.24810431636010344|53.45669058400514
|2015/03/16|2015/03/16 |rider-073|0 |UBERX |
|20241204150600191 |20241204150600191_1_16
|34b730f6-c19f-4f6a-bf95-703c61dc3fa4|2015/03/16
|72678953-ce37-4ca0-8a05-b925af2323cc-0_0-9387-38072_20241204150611758.parquet|false
|34b730f6-c19f-4f6a-bf95-703c61dc3fa4|0.9769970791360354
|0.9126162358158342 |USD |driver-070|0.20092033943627996
|0.5004521125628215 |95.29810539357332 |2015/03/16|2015/03/16 |rider-070|0
|BLACK |
|20241204150600191 |20241204150600191_0_0
|33c67d4b-d72d-45ea-b94e-285134cc7261|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|33c67d4b-d72d-45ea-b94e-285134cc7261|0.5295299471018257
|0.8796342384821229 |USD |driver-070|0.7477900383772803
|0.17871094201072368|14.039049113466096|2016/03/15|2016/03/15 |rider-070|0
|UBERX |
|20241204150600191 |20241204150600191_0_1
|c5304b84-6638-456e-9c63-faf3a37466b2|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|c5304b84-6638-456e-9c63-faf3a37466b2|0.6957210956161899
|0.6840305752968967 |USD |driver-070|0.4102831260234211
|0.22012113386766918|80.4122013976756 |2016/03/15|2016/03/15 |rider-070|0
|UBERX |
|20241204150600191 |20241204150600191_0_2
|82a0293a-b95c-4c5b-96ad-ac6098732b35|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|82a0293a-b95c-4c5b-96ad-ac6098732b35|0.5139184718380677
|0.2505739793056264 |USD |driver-070|0.1179051996084779
|0.7046801244916295 |84.98654138861065 |2016/03/15|2016/03/15 |rider-070|0
|UBERX |
|20241204150600191 |20241204150600191_0_3
|98f2fae2-507c-4af7-975e-e1713ffe4d09|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|98f2fae2-507c-4af7-975e-e1713ffe4d09|0.06611427533082836|0.788222336963299
|USD |driver-070|0.06671517994699039 |0.786493460186979 |94.45926125086118
|2016/03/15|2016/03/15 |rider-070|0 |UBERX |
|20241204150604821
|20241204150604821_0_514|de9dff6a-591b-482d-bb41-4a3c8a79e631|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|de9dff6a-591b-482d-bb41-4a3c8a79e631|0.1878054936680329
|0.01879889138787716 |USD |driver-071|0.4485493700070595
|0.7238770702991649 |78.22199805445177 |2016/03/15|2016/03/15 |rider-071|0
|BLACK |
|20241204150604821
|20241204150604821_0_512|0f7d8518-269e-47ff-b52c-0d083de918be|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|0f7d8518-269e-47ff-b52c-0d083de918be|0.5575851097958935
|0.1562523255339201 |USD |driver-071|0.43569700697390645
|0.35674304879736285|65.69533532145876 |2016/03/15|2016/03/15 |rider-071|0
|BLACK |
|20241204150600191 |20241204150600191_0_6
|615281d8-4636-4d6a-954f-03043618907f|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|615281d8-4636-4d6a-954f-03043618907f|0.41684117736066284|0.40427662848330415
|USD |driver-070|0.9094383420738296
|0.04860848373412596|36.397193900236466|2016/03/15|2016/03/15 |rider-070|0
|BLACK |
|20241204150604821
|20241204150604821_0_516|9ca4cfef-1df2-4b71-841d-6562c9ce6842|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|9ca4cfef-1df2-4b71-841d-6562c9ce6842|0.6284760957595001
|0.4765950340886149 |USD |driver-071|0.1216417932901912
|0.9975584711751252 |87.03128950423871 |2016/03/15|2016/03/15 |rider-071|0
|BLACK |
|20241204150616439
|20241204150616439_0_534|cbc086c6-4936-442e-8962-1f7bef79d072|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0
|false |cbc086c6-4936-442e-8962-1f7bef79d072|0.9151392407429653
|0.8058749127810513 |USD |driver-073|0.4109754791872877
|0.13960696212916768|36.3643551507392 |2016/03/15|2016/03/15 |rider-073|0
|UBERX |
|20241204150609831
|20241204150609831_0_529|3ab3d79f-edba-4182-8285-aab74cac1f56|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|3ab3d79f-edba-4182-8285-aab74cac1f56|0.330366816224278
|0.7321416055163578 |USD |driver-072|0.252074607122732
|0.7818192743089926 |69.02458690241536 |2016/03/15|2016/03/15 |rider-072|0
|UBERX |
|20241204150604821
|20241204150604821_0_513|b9c7bc8c-b027-4f46-9959-668067516f53|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|b9c7bc8c-b027-4f46-9959-668067516f53|0.9872898768793127
|0.3206772909391603 |USD |driver-071|0.7393757399954017
|0.8229493726180523 |80.22954578292044 |2016/03/15|2016/03/15 |rider-071|0
|UBERX |
|20241204150609831
|20241204150609831_0_530|7b05ef2f-0120-43a5-93c1-68ad9bc3924d|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|7b05ef2f-0120-43a5-93c1-68ad9bc3924d|0.512729897800753
|0.8408144614796756 |USD |driver-072|0.6934187325203937
|0.992327632998625 |33.674612100034516|2016/03/15|2016/03/15 |rider-072|0
|BLACK |
|20241204150600191 |20241204150600191_0_12
|c4ae071b-13b4-44da-b37e-0ba8de525f89|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|c4ae071b-13b4-44da-b37e-0ba8de525f89|0.6049239453837221
|0.9313564512445435 |USD |driver-070|0.1959158255075305
|0.3775703824159009 |82.08748305521034 |2016/03/15|2016/03/15 |rider-070|0
|BLACK |
|20241204150604821
|20241204150604821_0_511|c96ed9e8-83f9-4691-8ed5-4ba6cdd49e57|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|c96ed9e8-83f9-4691-8ed5-4ba6cdd49e57|0.3063896359769538
|0.676726038869916 |USD |driver-071|0.5206916773641883
|0.7508961494548403 |43.70502045148351 |2016/03/15|2016/03/15 |rider-071|0
|UBERX |
|20241204150616439
|20241204150616439_0_536|6edd6b70-6936-453c-96bc-215d342fa8f5|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0
|false |6edd6b70-6936-453c-96bc-215d342fa8f5|0.2980278638105116
|0.14613853342099636 |USD |driver-073|0.8551626497735585
|0.03433553370268205|29.224097481704792|2016/03/15|2016/03/15 |rider-073|0
|UBERX |
|20241204150600191 |20241204150600191_0_15
|1d46c9d2-ef0d-4a3c-aadd-ec36a21976b6|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0_2-9387-38074_20241204150611758.parquet|false
|1d46c9d2-ef0d-4a3c-aadd-ec36a21976b6|0.1322967369714605
|0.7930789069995893 |USD |driver-070|0.8967005520421634
|0.28297812156228164|91.41578669662796 |2016/03/15|2016/03/15 |rider-070|0
|UBERX |
|20241204150616439
|20241204150616439_0_535|feba8352-6e5d-423b-b43a-6fa03d180c7d|2016/03/15
|d58c1769-b659-4cb7-8487-84d53f56e4cf-0
|false |feba8352-6e5d-423b-b43a-6fa03d180c7d|0.7246264335247615
|0.15163955377372784 |USD |driver-073|0.31869327673539605
|0.19455671784122086|58.48033373395598 |2016/03/15|2016/03/15 |rider-073|0
|BLACK |
|20241204150616439
|20241204150616439_2_538|1e40d120-cc3c-4de7-a85a-242591cb475f|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0
|false
|1e40d120-cc3c-4de7-a85a-242591cb475f|0.23214150377933496|0.5266318711252643
|USD |driver-073|0.12350647347943444 |0.8741043242174295 |35.60384350116569
|2015/03/17|2015/03/17 |rider-073|0 |BLACK |
|20241204150616439
|20241204150616439_2_540|f80e03bd-34f1-4c91-983f-0707f1433512|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0
|false
|f80e03bd-34f1-4c91-983f-0707f1433512|0.46011052568020516|0.15082236303129448
|USD |driver-073|0.6405338495368493 |0.21487670808886683|92.00424394066677
|2015/03/17|2015/03/17 |rider-073|0 |BLACK |
|20241204150600191 |20241204150600191_2_2
|a3565704-2302-48bd-90d6-5f22b2105e74|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|a3565704-2302-48bd-90d6-5f22b2105e74|0.8616030391205203
|0.24686237288332835 |USD |driver-070|0.08026319218679445
|0.36091392808312783|1.2402943399241417|2015/03/17|2015/03/17 |rider-070|0
|BLACK |
|20241204150609831
|20241204150609831_2_525|d4af6051-3f61-48a7-bdb6-f94aecef892c|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|d4af6051-3f61-48a7-bdb6-f94aecef892c|0.4418656411552184
|0.20380214851801082 |USD |driver-072|0.7024078023523515
|0.5560959213386791 |28.432774333142696|2015/03/17|2015/03/17 |rider-072|0
|UBERX |
|20241204150600191 |20241204150600191_2_4
|e0d1e347-9e1e-4b16-9384-209de28463ad|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|e0d1e347-9e1e-4b16-9384-209de28463ad|0.21480612076837624|0.7734537934685566
|USD |driver-070|0.15638021739154395 |0.5413247791299718 |89.32327168066406
|2015/03/17|2015/03/17 |rider-070|0 |UBERX |
|20241204150600191 |20241204150600191_2_5
|d985812a-6bce-453c-89d3-e32bdebe7441|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|d985812a-6bce-453c-89d3-e32bdebe7441|0.1066097509473195
|0.6323263473920159 |USD |driver-070|0.5171970706764893
|0.5884188092036249 |75.61627331267051 |2015/03/17|2015/03/17 |rider-070|0
|UBERX |
|20241204150609831
|20241204150609831_2_524|0c897c91-b17f-4e06-85bb-95dc525542e5|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|0c897c91-b17f-4e06-85bb-95dc525542e5|0.48341044721222115|0.7783588752585501
|USD |driver-072|0.8105844069167545 |0.7556355235178576 |36.25092377209559
|2015/03/17|2015/03/17 |rider-072|0 |UBERX |
|20241204150616439
|20241204150616439_2_539|d4d3e4d7-d80c-4fd1-bc28-58d975561f8c|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0
|false |d4d3e4d7-d80c-4fd1-bc28-58d975561f8c|0.9387506848597982
|0.21554499574709152 |USD |driver-073|0.8257683543049836
|0.22095845719120266|45.38832104830463 |2015/03/17|2015/03/17 |rider-073|0
|BLACK |
|20241204150600191 |20241204150600191_2_8
|4a5dda50-52e6-4d4a-99a6-14885df536aa|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|4a5dda50-52e6-4d4a-99a6-14885df536aa|0.9152344120643987
|0.661611637881472 |USD |driver-070|0.49661724449042355
|0.4515339872367127 |14.66765875628331 |2015/03/17|2015/03/17 |rider-070|0
|UBERX |
|20241204150600191 |20241204150600191_2_9
|f3344b6a-f441-4887-aed4-ff32ca51336d|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|f3344b6a-f441-4887-aed4-ff32ca51336d|0.4005153811072475
|0.603831078282567 |USD |driver-070|0.21339081869333554
|0.20651517191822233|12.785746837871736|2015/03/17|2015/03/17 |rider-070|0
|BLACK |
|20241204150600191 |20241204150600191_2_10
|736ce3e4-2546-44f3-a9e9-eee7e5e00d66|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|736ce3e4-2546-44f3-a9e9-eee7e5e00d66|0.8836806996621173
|0.417755379804704 |USD |driver-070|0.15504377738626696
|0.9646093195950337 |76.83510630683561 |2015/03/17|2015/03/17 |rider-070|0
|BLACK |
|20241204150609831
|20241204150609831_2_527|c7f17b56-257f-4acc-b279-28e0633c2ab9|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|c7f17b56-257f-4acc-b279-28e0633c2ab9|0.894014614318913
|0.3562120043692295 |USD |driver-072|0.4468980604294439
|0.7801124003446892 |2.612301074915313 |2015/03/17|2015/03/17 |rider-072|0
|UBERX |
|20241204150604821
|20241204150604821_2_520|7cb8b2d9-7ed9-4244-a645-bcdda805cfa6|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|7cb8b2d9-7ed9-4244-a645-bcdda805cfa6|0.7537892059745742
|0.17348385378301368 |USD |driver-071|0.09998795889862999
|0.8570816800874261 |7.539726533477465 |2015/03/17|2015/03/17 |rider-071|0
|UBERX |
|20241204150609831
|20241204150609831_2_528|51bbbaca-45e4-413b-a360-08ed8e95cecc|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|51bbbaca-45e4-413b-a360-08ed8e95cecc|0.8504635255080416
|0.029931485779198685|USD |driver-072|0.6595942017862979
|0.6293739670305403 |34.709364997053335|2015/03/17|2015/03/17 |rider-072|0
|UBERX |
|20241204150616439
|20241204150616439_2_537|1c25f623-cbee-4859-924e-4c0266ff32ef|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0
|false |1c25f623-cbee-4859-924e-4c0266ff32ef|0.4797372706538726
|0.9801234965812413 |USD |driver-073|0.44707430870890963
|0.09686588023302611|36.42400334704722 |2015/03/17|2015/03/17 |rider-073|0
|UBERX |
|20241204150604821
|20241204150604821_2_519|1bce6171-5a57-4755-b0f8-6192c96bd149|2015/03/17
|245c1b73-6213-45fb-bdc2-9acd495ff492-0_1-9387-38073_20241204150611758.parquet|false
|1bce6171-5a57-4755-b0f8-6192c96bd149|0.49318043200219774|0.964753965970299
|USD |driver-071|0.593306367417992 |0.7669546871042435
|17.688084927938707|2015/03/17|2015/03/17 |rider-071|0 |BLACK |
+-------------------+-----------------------+------------------------------------+----------------------+-----------------------------------------------------------------------------+------------------+------------------------------------+-------------------+--------------------+--------+----------+--------------------+-------------------+------------------+----------+--------------+---------+---------+---------+
{code}
> Flaky test: TestSecondaryIndex. "Secondary Index With Updates Compaction
> Clustering Deletes"
> --------------------------------------------------------------------------------------------
>
> Key: HUDI-8648
> URL: https://issues.apache.org/jira/browse/HUDI-8648
> Project: Apache Hudi
> Issue Type: Bug
> Reporter: Lin Liu
> Assignee: Lin Liu
> Priority: Major
>
> The error stack:
>
> {code:java}
> - Test Secondary Index With Updates Compaction Clustering Deletes *** FAILED
> ***
> org.opentest4j.AssertionFailedError: expected: <true> but was: <false>
> at org.junit.jupiter.api.AssertionUtils.fail(AssertionUtils.java:55)
> at org.junit.jupiter.api.AssertTrue.assertTrue(AssertTrue.java:40)
> at org.junit.jupiter.api.AssertTrue.assertTrue(AssertTrue.java:35)
> at org.junit.jupiter.api.Assertions.assertTrue(Assertions.java:179)
> at
> org.apache.spark.sql.hudi.command.index.TestSecondaryIndex.$anonfun$validateSecondaryIndex$1(TestSecondaryIndex.scala:547)
> at
> org.apache.spark.sql.hudi.command.index.TestSecondaryIndex.$anonfun$validateSecondaryIndex$1$adapted(TestSecondaryIndex.scala:540)
> at
> scala.collection.IndexedSeqOptimized.foreach(IndexedSeqOptimized.scala:36)
> at
> scala.collection.IndexedSeqOptimized.foreach$(IndexedSeqOptimized.scala:33)
> at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:198)
> at
> org.apache.spark.sql.hudi.command.index.TestSecondaryIndex.validateSecondaryIndex(TestSecondaryIndex.scala:540)
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
