SudhirSaxena commented on issue #10587: URL: https://github.com/apache/hudi/issues/10587#issuecomment-1928793715
@ad1happy2go as discussed for this issue, please find the driver logs, 24/02/06 05:04:07 INFO MemoryStore: 2 blocks selected for dropping (468.0 KiB bytes) 24/02/06 05:04:07 INFO BlockManager: Dropping block broadcast_12999_piece0 from memory 24/02/06 05:04:07 INFO BlockManager: Writing block broadcast_12999_piece0 to disk 24/02/06 05:04:07 INFO BlockManagerInfo: Updated broadcast_12999_piece0 on disk on ip-10-156-17-116.ec2.internal:35559 (current size: 47.4 KiB, original size: 0.0 B) 24/02/06 05:04:07 INFO BlockManager: Dropping block broadcast_13000 from memory 24/02/06 05:04:07 INFO BlockManager: Writing block broadcast_13000 to disk 24/02/06 05:04:07 INFO MemoryStore: After dropping 2 blocks, free memory is 1342.0 KiB 24/02/06 05:04:07 INFO MemoryStore: Block broadcast_48457 stored as values in memory (estimated size 420.5 KiB, free 921.5 KiB) 24/02/06 05:04:07 INFO MemoryStore: Block broadcast_48457_piece0 stored as bytes in memory (estimated size 47.4 KiB, free 874.0 KiB) 24/02/06 05:04:07 INFO BlockManagerInfo: Added broadcast_48457_piece0 in memory on ip-10-156-17-116.ec2.internal:35559 (size: 47.4 KiB, free: 14.2 GiB) 24/02/06 05:04:07 INFO SparkContext: Created broadcast 48457 from take at /mnt/tmp/spark-7f0d7e5b-8199-405d-aadf-6da6fd1c5cd0/RES_PNR_prod_HRLI.py:1191 24/02/06 05:04:07 INFO MemoryStore: 2 blocks selected for dropping (468.0 KiB bytes) 24/02/06 05:04:07 INFO BlockManager: Dropping block broadcast_13000_piece0 from memory 24/02/06 05:04:07 INFO BlockManager: Writing block broadcast_13000_piece0 to disk 24/02/06 05:04:07 INFO BlockManagerInfo: Updated broadcast_13000_piece0 on disk on ip-10-156-17-116.ec2.internal:35559 (current size: 47.4 KiB, original size: 0.0 B) 24/02/06 05:04:07 INFO BlockManager: Dropping block broadcast_13001 from memory 24/02/06 05:04:07 INFO BlockManager: Writing block broadcast_13001 to disk 24/02/06 05:04:07 INFO MemoryStore: After dropping 2 blocks, free memory is 1342.0 KiB 24/02/06 05:04:07 INFO MemoryStore: Block broadcast_48458 stored as values in memory (estimated size 420.5 KiB, free 921.5 KiB) 24/02/06 05:04:07 INFO MemoryStore: Block broadcast_48458_piece0 stored as bytes in memory (estimated size 47.4 KiB, free 874.0 KiB) 24/02/06 05:04:07 INFO BlockManagerInfo: Added broadcast_48458_piece0 in memory on ip-10-156-17-116.ec2.internal:35559 (size: 47.4 KiB, free: 14.2 GiB) 24/02/06 05:04:07 INFO SparkContext: Created broadcast 48458 from take at /mnt/tmp/spark-7f0d7e5b-8199-405d-aadf-6da6fd1c5cd0/RES_PNR_prod_HRLI.py:1191 24/02/06 05:04:07 INFO MemoryStore: 2 blocks selected for dropping (468.0 KiB bytes) 24/02/06 05:04:07 INFO BlockManager: Dropping block broadcast_13001_piece0 from memory 24/02/06 05:04:07 INFO BlockManager: Writing block broadcast_13001_piece0 to disk 24/02/06 05:04:07 INFO BlockManagerInfo: Updated broadcast_13001_piece0 on disk on ip-10-156-17-116.ec2.internal:35559 (current size: 47.4 KiB, original size: 0.0 B) 24/02/06 05:04:07 INFO BlockManager: Dropping block broadcast_13002 from memory 24/02/06 05:04:07 INFO BlockManager: Writing block broadcast_13002 to disk 24/02/06 05:04:07 INFO MemoryStore: After dropping 2 blocks, free memory is 1342.0 KiB 24/02/06 05:04:07 INFO MemoryStore: Block broadcast_48459 stored as values in memory (estimated size 420.5 KiB, free 921.5 KiB) 24/02/06 05:04:07 INFO MemoryStore: Block broadcast_48459_piece0 stored as bytes in memory (estimated size 47.4 KiB, free 874.0 KiB) 24/02/06 05:04:07 INFO BlockManagerInfo: Added broadcast_48459_piece0 in memory on ip-10-156-17-116.ec2.internal:35559 (size: 47.4 KiB, free: 14.2 GiB) 24/02/06 05:04:07 INFO SparkContext: Created broadcast 48459 from take at /mnt/tmp/spark-7f0d7e5b-8199-405d-aadf-6da6fd1c5cd0/RES_PNR_prod_HRLI.py:1191 24/02/06 05:04:07 INFO MemoryStore: 2 blocks selected for dropping (468.0 KiB bytes) 24/02/06 05:04:07 INFO BlockManager: Dropping block broadcast_13002_piece0 from memory 24/02/06 05:04:07 INFO BlockManager: Writing block broadcast_13002_piece0 to disk 24/02/06 05:04:07 INFO BlockManagerInfo: Updated broadcast_13002_piece0 on disk on ip-10-156-17-116.ec2.internal:35559 (current size: 47.4 KiB, original size: 0.0 B) 24/02/06 05:04:07 INFO BlockManager: Dropping block broadcast_13003 from memory 24/02/06 05:04:07 INFO BlockManager: Writing block broadcast_13003 to disk 24/02/06 05:04:07 INFO MemoryStore: After dropping 2 blocks, free memory is 1342.0 KiB 24/02/06 05:04:07 INFO MemoryStore: Block broadcast_48460 stored as values in memory (estimated size 420.5 KiB, free 921.5 KiB) 24/02/06 05:04:07 INFO MemoryStore: Block broadcast_48460_piece0 stored as bytes in memory (estimated size 47.4 KiB, free 874.0 KiB) 24/02/06 05:04:07 INFO BlockManagerInfo: Added broadcast_48460_piece0 in memory on ip-10-156-17-116.ec2.internal:35559 (size: 47.4 KiB, free: 14.2 GiB) 24/02/06 05:04:07 INFO SparkContext: Created broadcast 48460 from take at /mnt/tmp/spark-7f0d7e5b-8199-405d-aadf-6da6fd1c5cd0/RES_PNR_prod_HRLI.py:1191 24/02/06 05:04:07 INFO MemoryStore: 2 blocks selected for dropping (468.0 KiB bytes) 24/02/06 05:04:07 INFO BlockManager: Dropping block broadcast_13003_piece0 from memory 24/02/06 05:04:07 INFO BlockManager: Writing block broadcast_13003_piece0 to disk 24/02/06 05:04:07 INFO BlockManagerInfo: Updated broadcast_13003_piece0 on disk on ip-10-156-17-116.ec2.internal:35559 (current size: 47.4 KiB, original size: 0.0 B) 24/02/06 05:04:07 INFO BlockManager: Dropping block broadcast_13004 from memory 24/02/06 05:04:07 INFO BlockManager: Writing block broadcast_13004 to disk -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
