pyspark reading lzo in a spitable way

2020-10-08 Thread Lavallen Pablo
hi everyone! a question: someone knows if it's possible to read a lzo compressed file from hdfs to pyspark dataframe directly. In a splitable way? Something like :spark.read.csv("codec...", file.lzo) all the options I've seen use rdd instead of a DF, and then toDF to get a dataframe

capture video with spark streaming

2015-11-30 Thread Lavallen Pablo
Hello! Can anyone guide me please, on how to capture video from a camera with spark streaming ? any article or book to read to recommend me ? thank you