[GitHub] [airflow] Kiollpt opened a new issue #18827: read_parquet use a lot of memor in airflow

[GitBox]

Kiollpt opened a new issue #18827:
URL: https://github.com/apache/airflow/issues/18827


   ### Apache Airflow version
   
   2.1.1
   
   ### Operating System
   
   Ubuntu
   
   ### Versions of Apache Airflow Providers
   
   _No response_
   
   ### Deployment
   
   Docker-Compose
   
   ### Deployment details
   
   _No response_
   
   ### What happened
   
   Each parquets files is about 5GB. but running it at airflow. The memory 
usage keeps increasing until the task is killed.
   
   
![image](https://drive.google.com/uc?export=view&id=15G1E-1XNUzdd0BqVwYLmyr18jvRfRdoB)
   
   
   ```bash
   
   [2021-10-03 01:00:41,553] {core.py:344} DEBUG - GET: b/{}/o/{}, 
('harry-airflow-dev', 
'userprofile/user_game_label/dt=20210922/file-000000000000.parquet'), None
   [2021-10-03 01:00:41,601] {core.py:344} DEBUG - GET: b/{}/o/{}, 
('harry-airflow-dev', 
'userprofile/user_game_label/dt=20210922/file-000000000000.parquet'), None
   [2021-10-03 01:00:41,627] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12613865 - 12679401
   [2021-10-03 01:00:41,627] {core.py:344} DEBUG - GET: 
https://storage.googleapis.com/download/storage/v1/b/harry-airflow-dev/o/userprofile%2Fuser_game_label%2Fdt=20210922%2Ffile-000000000000.parquet?generation=1633194033609120&alt=media,
 (), {'Range': 'bytes=12613865-12679400'}
   [2021-10-03 01:00:41,712] {core.py:344} DEBUG - GET: b/{}/o/{}, 
('harry-airflow-dev', 
'userprofile/user_game_label/dt=20210922/file-000000000000.parquet'), None
   [2021-10-03 01:00:41,730] {core.py:344} DEBUG - GET: b/{}/o/{}, 
('harry-airflow-dev', 
'userprofile/user_game_label/dt=20210922/file-000000000000.parquet'), None
   [2021-10-03 01:00:41,758] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12613865 - 12679401
   [2021-10-03 01:00:41,759] {core.py:344} DEBUG - GET: 
https://storage.googleapis.com/download/storage/v1/b/harry-airflow-dev/o/userprofile%2Fuser_game_label%2Fdt=20210922%2Ffile-000000000000.parquet?generation=1633194033609120&alt=media,
 (), {'Range': 'bytes=12613865-12679400'}
   [2021-10-03 01:00:41,838] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 4 - 213
   [2021-10-03 01:00:41,839] {core.py:344} DEBUG - GET: 
https://storage.googleapis.com/download/storage/v1/b/harry-airflow-dev/o/userprofile%2Fuser_game_label%2Fdt=20210922%2Ffile-000000000000.parquet?generation=1633194033609120&alt=media,
 (), {'Range': 'bytes=4-5243092'}
   [2021-10-03 01:00:41,913] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 284 - 93784
   [2021-10-03 01:00:41,913] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 93870 - 205260
   [2021-10-03 01:00:41,913] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 205367 - 234605
   [2021-10-03 01:00:41,914] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 234769 - 346159
   [2021-10-03 01:00:41,914] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 346269 - 375762
   [2021-10-03 01:00:41,914] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 375929 - 487319
   [2021-10-03 01:00:41,914] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 487430 - 517342
   [2021-10-03 01:00:41,914] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 517510 - 628900
   [2021-10-03 01:00:41,914] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 629015 - 659708
   [2021-10-03 01:00:41,914] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 659880 - 660075
   [2021-10-03 01:00:41,914] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 660221 - 660307
   [2021-10-03 01:00:41,914] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 660388 - 660829
   [2021-10-03 01:00:41,915] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 660978 - 661144
   [2021-10-03 01:00:41,915] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 661228 - 661828
   [2021-10-03 01:00:41,915] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 661978 - 662212
   [2021-10-03 01:00:41,915] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 662297 - 663105
   [2021-10-03 01:00:41,915] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 663259 - 663589
   [2021-10-03 01:00:41,915] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 663678 - 663854
   [2021-10-03 01:00:41,915] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 663964 - 664182
   [2021-10-03 01:00:41,915] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 664293 - 664592
   [2021-10-03 01:00:41,915] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 664707 - 665039
   [2021-10-03 01:00:41,915] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 665123 - 665261
   [2021-10-03 01:00:41,915] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 665376 - 776766
   [2021-10-03 01:00:41,915] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 776870 - 806108
   [2021-10-03 01:00:41,916] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 806269 - 917659
   [2021-10-03 01:00:41,916] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 917771 - 947009
   [2021-10-03 01:00:41,916] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 947178 - 947429
   [2021-10-03 01:00:41,916] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 947547 - 1058937
   [2021-10-03 01:00:41,916] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 1059045 - 1088538
   [2021-10-03 01:00:41,916] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 1088705 - 1200095
   [2021-10-03 01:00:41,916] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 1200213 - 1229682
   [2021-10-03 01:00:41,916] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 1229857 - 1230217
   [2021-10-03 01:00:41,916] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 1230339 - 1341729
   [2021-10-03 01:00:41,917] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 1341840 - 1371697
   [2021-10-03 01:00:41,917] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 1371865 - 1483255
   [2021-10-03 01:00:41,917] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 1483374 - 1513174
   [2021-10-03 01:00:41,917] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 1513350 - 1513805
   [2021-10-03 01:00:41,917] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 1513931 - 1625321
   [2021-10-03 01:00:41,917] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 1625436 - 1656000
   [2021-10-03 01:00:41,917] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 1656172 - 1767562
   [2021-10-03 01:00:41,917] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 1767685 - 1798196
   [2021-10-03 01:00:41,918] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 1798376 - 1798471
   [2021-10-03 01:00:41,918] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 1798586 - 1909976
   [2021-10-03 01:00:41,918] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 1910080 - 1939229
   [2021-10-03 01:00:41,918] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 1939390 - 2050780
   [2021-10-03 01:00:41,918] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 2050892 - 2080041
   [2021-10-03 01:00:41,918] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 2080210 - 2080305
   [2021-10-03 01:00:41,918] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 2080423 - 2191813
   [2021-10-03 01:00:41,918] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 2191920 - 2221069
   [2021-10-03 01:00:41,918] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 2221233 - 2332623
   [2021-10-03 01:00:41,919] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 2332738 - 2361887
   [2021-10-03 01:00:41,919] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 2362059 - 2362154
   [2021-10-03 01:00:41,919] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 2362273 - 2473663
   [2021-10-03 01:00:41,919] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 2473771 - 2502920
   [2021-10-03 01:00:41,919] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 2503085 - 2614475
   [2021-10-03 01:00:41,919] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 2614591 - 2643740
   [2021-10-03 01:00:41,919] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 2643913 - 2644008
   [2021-10-03 01:00:41,919] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 2644131 - 2755521
   [2021-10-03 01:00:41,919] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 2755633 - 2784782
   [2021-10-03 01:00:41,919] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 2784951 - 2896341
   [2021-10-03 01:00:41,920] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 2896461 - 2925610
   [2021-10-03 01:00:41,920] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 2925787 - 2925882
   [2021-10-03 01:00:41,920] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 2925997 - 3037387
   [2021-10-03 01:00:41,920] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 3037491 - 3066640
   [2021-10-03 01:00:41,920] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 3066801 - 3178191
   [2021-10-03 01:00:41,920] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 3178303 - 3207452
   [2021-10-03 01:00:41,920] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 3207621 - 3207716
   [2021-10-03 01:00:41,920] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 3207834 - 3319224
   [2021-10-03 01:00:41,920] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 3319331 - 3348480
   [2021-10-03 01:00:41,921] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 3348644 - 3460034
   [2021-10-03 01:00:41,921] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 3460149 - 3489298
   [2021-10-03 01:00:41,921] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 3489470 - 3489565
   [2021-10-03 01:00:41,921] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 3489684 - 3601074
   [2021-10-03 01:00:41,921] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 3601182 - 3630331
   [2021-10-03 01:00:41,921] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 3630496 - 3741886
   [2021-10-03 01:00:41,921] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 3742002 - 3771151
   [2021-10-03 01:00:41,921] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 3771324 - 3771419
   [2021-10-03 01:00:41,921] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 3771542 - 3882932
   [2021-10-03 01:00:41,922] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 3883044 - 3912193
   [2021-10-03 01:00:41,922] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 3912362 - 4023752
   [2021-10-03 01:00:41,922] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 4023872 - 4053021
   [2021-10-03 01:00:41,922] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 4053198 - 4053293
   [2021-10-03 01:00:41,922] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 4053408 - 4164798
   [2021-10-03 01:00:41,922] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 4164902 - 4194051
   [2021-10-03 01:00:41,922] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 4194212 - 4305602
   [2021-10-03 01:00:41,922] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 4305714 - 4334863
   [2021-10-03 01:00:41,922] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 4335032 - 4335127
   [2021-10-03 01:00:41,923] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 4335245 - 4446635
   [2021-10-03 01:00:41,923] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 4446742 - 4475891
   [2021-10-03 01:00:41,923] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 4476055 - 4587445
   [2021-10-03 01:00:41,923] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 4587560 - 4616709
   [2021-10-03 01:00:41,923] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 4616881 - 4616989
   [2021-10-03 01:00:41,923] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 4617108 - 4728498
   [2021-10-03 01:00:41,923] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 4728606 - 4757776
   [2021-10-03 01:00:41,923] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 4757941 - 4869331
   [2021-10-03 01:00:41,923] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 4869447 - 4898617
   [2021-10-03 01:00:41,924] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 4898790 - 4898912
   [2021-10-03 01:00:41,924] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 4899035 - 5010425
   [2021-10-03 01:00:41,924] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 5010537 - 5039730
   [2021-10-03 01:00:41,924] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 5039899 - 5151289
   [2021-10-03 01:00:41,924] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 5151409 - 5180579
   [2021-10-03 01:00:41,924] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 5180756 - 5180851
   [2021-10-03 01:00:41,924] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 5180971 - 5292361
   [2021-10-03 01:00:41,925] {core.py:344} DEBUG - GET: 
https://storage.googleapis.com/download/storage/v1/b/harry-airflow-dev/o/userprofile%2Fuser_game_label%2Fdt=20210922%2Ffile-000000000000.parquet?generation=1633194033609120&alt=media,
 (), {'Range': 'bytes=5243093-10535240'}
   [2021-10-03 01:00:42,008] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 5292470 - 5321619
   [2021-10-03 01:00:42,008] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 5321785 - 5433175
   [2021-10-03 01:00:42,008] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 5433292 - 5462441
   [2021-10-03 01:00:42,008] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 5462615 - 5462710
   [2021-10-03 01:00:42,008] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 5462833 - 5574223
   [2021-10-03 01:00:42,009] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 5574335 - 5603484
   [2021-10-03 01:00:42,009] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 5603653 - 5715043
   [2021-10-03 01:00:42,009] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 5715163 - 5744312
   [2021-10-03 01:00:42,009] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 5744489 - 5744597
   [2021-10-03 01:00:42,009] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 5744721 - 5856111
   [2021-10-03 01:00:42,009] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 5856224 - 5885394
   [2021-10-03 01:00:42,009] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 5885564 - 5996954
   [2021-10-03 01:00:42,009] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 5997075 - 6026224
   [2021-10-03 01:00:42,009] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 6026402 - 6026573
   [2021-10-03 01:00:42,010] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 6026701 - 6138091
   [2021-10-03 01:00:42,010] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 6138208 - 6167584
   [2021-10-03 01:00:42,010] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 6167758 - 6279148
   [2021-10-03 01:00:42,010] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 6279273 - 6308550
   [2021-10-03 01:00:42,010] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 6308732 - 6308827
   [2021-10-03 01:00:42,010] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 6308942 - 6420332
   [2021-10-03 01:00:42,010] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 6420436 - 6449585
   [2021-10-03 01:00:42,010] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 6449746 - 6561136
   [2021-10-03 01:00:42,010] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 6561248 - 6590397
   [2021-10-03 01:00:42,011] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 6590566 - 6590661
   [2021-10-03 01:00:42,011] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 6590779 - 6702169
   [2021-10-03 01:00:42,011] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 6702276 - 6731425
   [2021-10-03 01:00:42,011] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 6731589 - 6842979
   [2021-10-03 01:00:42,011] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 6843094 - 6872243
   [2021-10-03 01:00:42,011] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 6872415 - 6872510
   [2021-10-03 01:00:42,011] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 6872629 - 6984019
   [2021-10-03 01:00:42,011] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 6984127 - 7013276
   [2021-10-03 01:00:42,011] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 7013441 - 7124831
   [2021-10-03 01:00:42,012] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 7124947 - 7154096
   [2021-10-03 01:00:42,012] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 7154269 - 7154364
   [2021-10-03 01:00:42,012] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 7154487 - 7265877
   [2021-10-03 01:00:42,012] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 7265989 - 7295138
   [2021-10-03 01:00:42,012] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 7295307 - 7406697
   [2021-10-03 01:00:42,012] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 7406817 - 7435966
   [2021-10-03 01:00:42,012] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 7436143 - 7436238
   [2021-10-03 01:00:42,012] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 7436354 - 7547744
   [2021-10-03 01:00:42,013] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 7547849 - 7576998
   [2021-10-03 01:00:42,013] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 7577160 - 7688550
   [2021-10-03 01:00:42,013] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 7688663 - 7717812
   [2021-10-03 01:00:42,013] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 7717982 - 7718077
   [2021-10-03 01:00:42,013] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 7718196 - 7829586
   [2021-10-03 01:00:42,013] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 7829694 - 7858843
   [2021-10-03 01:00:42,013] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 7859008 - 7970398
   [2021-10-03 01:00:42,013] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 7970514 - 7999663
   [2021-10-03 01:00:42,013] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 7999836 - 7999931
   [2021-10-03 01:00:42,013] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 8000051 - 8111441
   [2021-10-03 01:00:42,014] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 8111550 - 8140699
   [2021-10-03 01:00:42,014] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 8140865 - 8252255
   [2021-10-03 01:00:42,014] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 8252372 - 8281521
   [2021-10-03 01:00:42,014] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 8281695 - 8281790
   [2021-10-03 01:00:42,014] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 8281914 - 8393304
   [2021-10-03 01:00:42,014] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 8393417 - 8422566
   [2021-10-03 01:00:42,014] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 8422736 - 8534126
   [2021-10-03 01:00:42,014] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 8534247 - 8563396
   [2021-10-03 01:00:42,015] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 8563574 - 8563669
   [2021-10-03 01:00:42,015] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 8563785 - 8675175
   [2021-10-03 01:00:42,015] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 8675280 - 8704429
   [2021-10-03 01:00:42,015] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 8704591 - 8815981
   [2021-10-03 01:00:42,015] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 8816094 - 8845243
   [2021-10-03 01:00:42,015] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 8845413 - 8845508
   [2021-10-03 01:00:42,015] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 8845627 - 8957017
   [2021-10-03 01:00:42,015] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 8957125 - 8986274
   [2021-10-03 01:00:42,015] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 8986439 - 9097829
   [2021-10-03 01:00:42,016] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 9097945 - 9127094
   [2021-10-03 01:00:42,016] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 9127267 - 9127362
   [2021-10-03 01:00:42,016] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 9127482 - 9238872
   [2021-10-03 01:00:42,016] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 9238981 - 9268130
   [2021-10-03 01:00:42,016] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 9268296 - 9379686
   [2021-10-03 01:00:42,016] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 9379803 - 9408952
   [2021-10-03 01:00:42,016] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 9409126 - 9409221
   [2021-10-03 01:00:42,016] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 9409345 - 9520735
   [2021-10-03 01:00:42,016] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 9520848 - 9549997
   [2021-10-03 01:00:42,017] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 9550167 - 9661557
   [2021-10-03 01:00:42,017] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 9661678 - 9690827
   [2021-10-03 01:00:42,017] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 9691005 - 9691100
   [2021-10-03 01:00:42,017] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 9691215 - 9802605
   [2021-10-03 01:00:42,017] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 9802709 - 9831858
   [2021-10-03 01:00:42,017] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 9832019 - 9943409
   [2021-10-03 01:00:42,017] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 9943521 - 9972670
   [2021-10-03 01:00:42,017] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 9972839 - 9972934
   [2021-10-03 01:00:42,017] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 9973052 - 10084442
   [2021-10-03 01:00:42,018] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10084549 - 10113698
   [2021-10-03 01:00:42,018] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10113862 - 10225252
   [2021-10-03 01:00:42,018] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10225367 - 10254516
   [2021-10-03 01:00:42,018] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10254688 - 10254783
   [2021-10-03 01:00:42,018] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10254902 - 10366292
   [2021-10-03 01:00:42,018] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10366400 - 10395549
   [2021-10-03 01:00:42,018] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10395714 - 10507104
   [2021-10-03 01:00:42,018] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10507220 - 10536369
   [2021-10-03 01:00:42,019] {core.py:344} DEBUG - GET: 
https://storage.googleapis.com/download/storage/v1/b/harry-airflow-dev/o/userprofile%2Fuser_game_label%2Fdt=20210922%2Ffile-000000000000.parquet?generation=1633194033609120&alt=media,
 (), {'Range': 'bytes=10535241-12679400'}
   [2021-10-03 01:00:42,083] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10536542 - 10536637
   [2021-10-03 01:00:42,083] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10536760 - 10648150
   [2021-10-03 01:00:42,083] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10648262 - 10677411
   [2021-10-03 01:00:42,083] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10677580 - 10788970
   [2021-10-03 01:00:42,083] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10789090 - 10818239
   [2021-10-03 01:00:42,084] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10818416 - 10818491
   [2021-10-03 01:00:42,084] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10818577 - 10818672
   [2021-10-03 01:00:42,962] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10818774 - 10818838
   [2021-10-03 01:00:42,962] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10818917 - 10833542
   [2021-10-03 01:00:42,963] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10833632 - 10851809
   [2021-10-03 01:00:42,963] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10851919 - 10856767
   [2021-10-03 01:00:42,963] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10856932 - 10875109
   [2021-10-03 01:00:42,963] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10875222 - 10880070
   [2021-10-03 01:00:42,963] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10880238 - 10898415
   [2021-10-03 01:00:42,963] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10898529 - 10903377
   [2021-10-03 01:00:42,963] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10903546 - 10921723
   [2021-10-03 01:00:42,963] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10921841 - 10926689
   [2021-10-03 01:00:42,963] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10926862 - 10926907
   [2021-10-03 01:00:42,963] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10926982 - 10927043
   [2021-10-03 01:00:42,963] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10927126 - 10927171
   [2021-10-03 01:00:42,963] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10927249 - 10927310
   [2021-10-03 01:00:42,963] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10927396 - 10927441
   [2021-10-03 01:00:42,963] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10927520 - 10927581
   [2021-10-03 01:00:42,963] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10927668 - 10927713
   [2021-10-03 01:00:42,963] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10927796 - 10927857
   [2021-10-03 01:00:42,964] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10927948 - 10928043
   [2021-10-03 01:00:42,964] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10928156 - 10928251
   [2021-10-03 01:00:42,964] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10928365 - 10928460
   [2021-10-03 01:00:42,964] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10928578 - 10928623
   [2021-10-03 01:00:42,964] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10928684 - 10928779
   [2021-10-03 01:00:42,964] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10928897 - 10947074
   [2021-10-03 01:00:42,964] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10947181 - 10952029
   [2021-10-03 01:00:42,964] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10952191 - 10970368
   [2021-10-03 01:00:42,964] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10970483 - 10975331
   [2021-10-03 01:00:42,964] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10975501 - 10975596
   [2021-10-03 01:00:42,964] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10975717 - 10993894
   [2021-10-03 01:00:42,964] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10994004 - 10998852
   [2021-10-03 01:00:42,964] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 10999017 - 11017194
   [2021-10-03 01:00:42,964] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11017312 - 11022160
   [2021-10-03 01:00:42,964] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11022333 - 11022428
   [2021-10-03 01:00:42,964] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11022550 - 11040727
   [2021-10-03 01:00:42,965] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11040838 - 11045686
   [2021-10-03 01:00:42,965] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11045852 - 11064029
   [2021-10-03 01:00:42,965] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11064148 - 11068996
   [2021-10-03 01:00:42,965] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11069170 - 11069265
   [2021-10-03 01:00:42,965] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11069391 - 11087568
   [2021-10-03 01:00:42,965] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11087683 - 11092531
   [2021-10-03 01:00:42,965] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11092701 - 11110878
   [2021-10-03 01:00:42,965] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11111001 - 11115849
   [2021-10-03 01:00:42,965] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11116027 - 11116122
   [2021-10-03 01:00:42,965] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11116237 - 11134414
   [2021-10-03 01:00:42,965] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11134518 - 11139366
   [2021-10-03 01:00:42,965] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11139525 - 11157702
   [2021-10-03 01:00:42,965] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11157814 - 11162662
   [2021-10-03 01:00:42,965] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11162829 - 11162924
   [2021-10-03 01:00:42,966] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11163042 - 11181219
   [2021-10-03 01:00:42,966] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11181326 - 11186174
   [2021-10-03 01:00:42,966] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11186336 - 11204513
   [2021-10-03 01:00:42,966] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11204628 - 11209476
   [2021-10-03 01:00:42,966] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11209646 - 11209741
   [2021-10-03 01:00:42,966] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11209860 - 11228037
   [2021-10-03 01:00:42,966] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11228145 - 11232993
   [2021-10-03 01:00:42,966] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11233156 - 11251333
   [2021-10-03 01:00:42,966] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11251449 - 11256297
   [2021-10-03 01:00:42,966] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11256468 - 11256563
   [2021-10-03 01:00:42,966] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11256686 - 11274863
   [2021-10-03 01:00:42,966] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11274975 - 11279823
   [2021-10-03 01:00:42,966] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11279990 - 11298167
   [2021-10-03 01:00:42,966] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11298287 - 11303135
   [2021-10-03 01:00:42,966] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11303310 - 11303405
   [2021-10-03 01:00:42,967] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11303520 - 11321697
   [2021-10-03 01:00:42,967] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11321801 - 11326649
   [2021-10-03 01:00:42,967] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11326808 - 11344985
   [2021-10-03 01:00:42,967] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11345097 - 11349945
   [2021-10-03 01:00:42,967] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11350112 - 11350207
   [2021-10-03 01:00:42,967] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11350325 - 11368502
   [2021-10-03 01:00:42,967] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11368609 - 11373457
   [2021-10-03 01:00:42,967] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11373619 - 11391796
   [2021-10-03 01:00:42,967] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11391911 - 11396759
   [2021-10-03 01:00:42,967] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11396929 - 11397024
   [2021-10-03 01:00:42,967] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11397143 - 11415320
   [2021-10-03 01:00:42,967] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11415428 - 11420276
   [2021-10-03 01:00:42,967] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11420439 - 11438616
   [2021-10-03 01:00:42,967] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11438732 - 11443580
   [2021-10-03 01:00:42,967] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11443751 - 11443846
   [2021-10-03 01:00:42,967] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11443969 - 11462146
   [2021-10-03 01:00:42,967] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11462258 - 11467106
   [2021-10-03 01:00:42,968] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11467273 - 11485450
   [2021-10-03 01:00:42,968] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11485570 - 11490418
   [2021-10-03 01:00:42,968] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11490593 - 11490688
   [2021-10-03 01:00:42,968] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11490803 - 11508980
   [2021-10-03 01:00:42,968] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11509084 - 11513932
   [2021-10-03 01:00:42,968] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11514091 - 11532268
   [2021-10-03 01:00:42,968] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11532380 - 11537228
   [2021-10-03 01:00:42,968] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11537395 - 11537490
   [2021-10-03 01:00:42,968] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11537608 - 11555785
   [2021-10-03 01:00:42,968] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11555892 - 11560740
   [2021-10-03 01:00:42,968] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11560902 - 11579079
   [2021-10-03 01:00:42,968] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11579194 - 11584042
   [2021-10-03 01:00:42,968] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11584212 - 11584307
   [2021-10-03 01:00:42,968] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11584426 - 11602603
   [2021-10-03 01:00:42,968] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11602711 - 11607559
   [2021-10-03 01:00:42,969] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11607722 - 11625899
   [2021-10-03 01:00:42,969] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11626015 - 11630863
   [2021-10-03 01:00:42,969] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11631034 - 11631129
   [2021-10-03 01:00:42,969] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11631252 - 11649429
   [2021-10-03 01:00:42,969] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11649541 - 11654389
   [2021-10-03 01:00:42,969] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11654556 - 11672733
   [2021-10-03 01:00:42,969] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11672853 - 11677701
   [2021-10-03 01:00:42,969] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11677876 - 11677971
   [2021-10-03 01:00:42,969] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11678091 - 11696268
   [2021-10-03 01:00:42,969] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11696377 - 11701225
   [2021-10-03 01:00:42,969] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11701389 - 11719566
   [2021-10-03 01:00:42,969] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11719683 - 11724531
   [2021-10-03 01:00:42,969] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11724703 - 11724798
   [2021-10-03 01:00:42,969] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11724921 - 11743098
   [2021-10-03 01:00:42,969] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11743210 - 11748058
   [2021-10-03 01:00:42,969] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11748225 - 11766402
   [2021-10-03 01:00:42,970] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11766522 - 11771370
   [2021-10-03 01:00:42,970] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11771545 - 11771640
   [2021-10-03 01:00:42,970] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11771764 - 11789941
   [2021-10-03 01:00:42,970] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11790054 - 11794902
   [2021-10-03 01:00:42,970] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11795070 - 11813247
   [2021-10-03 01:00:42,970] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11813368 - 11818216
   [2021-10-03 01:00:42,970] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11818392 - 11818487
   [2021-10-03 01:00:42,970] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11818615 - 11836792
   [2021-10-03 01:00:42,970] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11836909 - 11841757
   [2021-10-03 01:00:42,970] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11841929 - 11860106
   [2021-10-03 01:00:42,970] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11860231 - 11865079
   [2021-10-03 01:00:42,970] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11865259 - 11865354
   [2021-10-03 01:00:42,970] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11865469 - 11883646
   [2021-10-03 01:00:42,970] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11883750 - 11888598
   [2021-10-03 01:00:42,970] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11888757 - 11906934
   [2021-10-03 01:00:42,970] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11907046 - 11911894
   [2021-10-03 01:00:42,971] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11912061 - 11912156
   [2021-10-03 01:00:42,971] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11912274 - 11930451
   [2021-10-03 01:00:42,971] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11930558 - 11935406
   [2021-10-03 01:00:42,971] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11935568 - 11953745
   [2021-10-03 01:00:42,971] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11953860 - 11958708
   [2021-10-03 01:00:42,971] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11958878 - 11958973
   [2021-10-03 01:00:42,971] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11959092 - 11977269
   [2021-10-03 01:00:42,971] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11977377 - 11982225
   [2021-10-03 01:00:42,971] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 11982388 - 12000565
   [2021-10-03 01:00:42,971] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12000681 - 12005529
   [2021-10-03 01:00:42,971] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12005700 - 12005795
   [2021-10-03 01:00:42,971] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12005918 - 12024095
   [2021-10-03 01:00:42,971] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12024207 - 12029055
   [2021-10-03 01:00:42,971] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12029222 - 12047399
   [2021-10-03 01:00:42,971] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12047519 - 12052367
   [2021-10-03 01:00:42,971] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12052542 - 12052637
   [2021-10-03 01:00:42,972] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12052753 - 12070930
   [2021-10-03 01:00:42,972] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12071035 - 12075883
   [2021-10-03 01:00:42,972] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12076043 - 12094220
   [2021-10-03 01:00:42,972] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12094333 - 12099181
   [2021-10-03 01:00:42,972] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12099349 - 12099444
   [2021-10-03 01:00:42,972] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12099563 - 12117740
   [2021-10-03 01:00:42,972] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12117848 - 12122696
   [2021-10-03 01:00:42,972] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12122859 - 12141036
   [2021-10-03 01:00:42,972] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12141152 - 12146000
   [2021-10-03 01:00:42,972] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12146171 - 12146266
   [2021-10-03 01:00:42,972] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12146386 - 12164563
   [2021-10-03 01:00:42,972] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12164672 - 12169520
   [2021-10-03 01:00:42,972] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12169684 - 12187861
   [2021-10-03 01:00:42,972] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12187978 - 12192826
   [2021-10-03 01:00:42,972] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12192998 - 12193093
   [2021-10-03 01:00:42,972] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12193217 - 12211394
   [2021-10-03 01:00:42,973] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12211507 - 12216355
   [2021-10-03 01:00:42,973] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12216523 - 12234700
   [2021-10-03 01:00:42,973] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12234821 - 12239669
   [2021-10-03 01:00:42,973] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12239845 - 12239940
   [2021-10-03 01:00:42,973] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12240056 - 12258233
   [2021-10-03 01:00:42,973] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12258338 - 12263186
   [2021-10-03 01:00:42,973] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12263346 - 12281523
   [2021-10-03 01:00:42,973] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12281636 - 12286484
   [2021-10-03 01:00:42,973] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12286652 - 12286747
   [2021-10-03 01:00:42,973] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12286866 - 12305043
   [2021-10-03 01:00:42,973] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12305151 - 12309999
   [2021-10-03 01:00:42,973] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12310162 - 12328339
   [2021-10-03 01:00:42,973] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12328455 - 12333303
   [2021-10-03 01:00:42,973] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12333474 - 12333569
   [2021-10-03 01:00:42,973] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12333689 - 12351866
   [2021-10-03 01:00:42,974] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12351975 - 12356823
   [2021-10-03 01:00:42,974] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12356987 - 12375164
   [2021-10-03 01:00:42,974] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12375281 - 12380129
   [2021-10-03 01:00:42,974] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12380301 - 12380396
   [2021-10-03 01:00:42,974] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12380520 - 12398697
   [2021-10-03 01:00:42,974] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12398810 - 12403658
   [2021-10-03 01:00:42,974] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12403826 - 12422003
   [2021-10-03 01:00:42,974] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12422124 - 12426972
   [2021-10-03 01:00:42,974] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12427148 - 12427243
   [2021-10-03 01:00:42,974] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12427358 - 12445535
   [2021-10-03 01:00:42,974] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12445639 - 12450487
   [2021-10-03 01:00:42,974] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12450646 - 12468823
   [2021-10-03 01:00:42,974] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12468935 - 12473783
   [2021-10-03 01:00:42,974] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12473950 - 12474045
   [2021-10-03 01:00:42,974] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12474163 - 12492340
   [2021-10-03 01:00:42,974] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12492447 - 12497295
   [2021-10-03 01:00:42,975] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12497457 - 12515634
   [2021-10-03 01:00:42,975] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12515749 - 12520597
   [2021-10-03 01:00:42,975] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12520767 - 12520862
   [2021-10-03 01:00:42,975] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12520981 - 12539158
   [2021-10-03 01:00:42,975] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12539266 - 12544114
   [2021-10-03 01:00:42,975] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12544277 - 12562454
   [2021-10-03 01:00:42,975] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12562570 - 12567418
   [2021-10-03 01:00:42,975] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12567589 - 12567684
   [2021-10-03 01:00:42,975] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12567807 - 12585984
   [2021-10-03 01:00:42,975] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12586096 - 12590944
   [2021-10-03 01:00:42,975] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12591111 - 12609288
   [2021-10-03 01:00:42,975] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12609408 - 12614256
   [2021-10-03 01:00:42,975] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12614431 - 12614506
   [2021-10-03 01:00:42,975] {spec.py:1529} DEBUG - <File-like object 
GCSFileSystem, 
harry-airflow-dev/userprofile/user_game_label/dt=20210922/file-000000000000.parquet>
 read: 12614592 - 12614687
   ```
   
   ### What you expected to happen
   
   the memory usage  is not  supposed to increase intensely
   
   ### How to reproduce
   
   Read parquet from GCS  in your DAG.
   
   ```python3
   
   def read_from_gcs(**context):
   
       def read(serial_num):
   
           file = f'gs://airflow-harry/dt=20210922/file-{serial_num}.parquet'
           logging.info(file)
           df = pd.read_parquet(path=file,
                   storage_options={"token": 
"/opt/airflow/.config/gcloud/application_default_credentials.json"})
           return df
       
       for ix in range(0,10):
           serial_num  = str(ix).zfill(12)
           df = read(serial_num)
           # del df
           # gc.collect()
           df = pd.DataFrame()
   
           logging.info(df.head())
   ```
   
   ### Anything else
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org