Unfortunately I cannot use Python SDK to access Storage Gen2 anymore, previously there was an option to access gen2 through gen's 1 API, but Microsoft turned it off. I wanted to use hdfs because the amount of files and size can really grow and I don't really want to load them to vm, but process in memory. And I saw that abfs is supported by hdfs, it is fast and reliable, so this option seemed to be really convenient for this situation, maybe You can suggest something else, hope it doesn't looks too rude, I really appreciate
Thanks,
