vinodkc commented on PR #41144: URL: https://github.com/apache/spark/pull/41144#issuecomment-1576034499
> For the Python, the information is printed at every task execution. Could you find a proper place to print that info once, @vinodkc ? > > ``` > 23/06/03 18:29:46 INFO PythonRunner: Python version info: python3(3.11) > 23/06/03 18:29:46 INFO PythonRunner: Python version info: python3(3.11) > 23/06/03 18:29:46 INFO PythonRunner: Times: total = 38, boot = -8568, init = 8606, finish = 0 > 23/06/03 18:29:46 INFO PythonRunner: Times: total = 38, boot = -8571, init = 8609, finish = 0 > 23/06/03 18:29:46 INFO Executor: Finished task 0.0 in stage 18.0 (TID 26). 1393 bytes result sent to driver > 23/06/03 18:29:46 INFO Executor: Finished task 1.0 in stage 18.0 (TID 27). 1396 bytes result sent to driver > 23/06/03 18:29:50 INFO CoarseGrainedExecutorBackend: Got assigned task 28 > 23/06/03 18:29:50 INFO CoarseGrainedExecutorBackend: Got assigned task 29 > 23/06/03 18:29:50 INFO Executor: Running task 0.0 in stage 19.0 (TID 28) > 23/06/03 18:29:50 INFO Executor: Running task 1.0 in stage 19.0 (TID 29) > 23/06/03 18:29:50 INFO TorrentBroadcast: Started reading broadcast variable 14 with 1 pieces (estimated total size 4.0 MiB) > 23/06/03 18:29:50 INFO MemoryStore: Block broadcast_14_piece0 stored as bytes in memory (estimated size 3.7 KiB, free 366.2 MiB) > 23/06/03 18:29:50 INFO TorrentBroadcast: Reading broadcast variable 14 took 20 ms > 23/06/03 18:29:50 INFO MemoryStore: Block broadcast_14 stored as values in memory (estimated size 5.7 KiB, free 366.2 MiB) > 23/06/03 18:29:50 INFO PythonRunner: Python version info: python3(3.11) > 23/06/03 18:29:50 INFO PythonRunner: Python version info: python3(3.11) > ``` Done -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
