We have solved it using an orchestrator, which copied data from FTP to
HDFS. But of course, you can just use a Java FTP client to just read files,
put them somewhere, and then read with Spark.
пн, 9 авг. 2021 г. в 06:39, Sean Owen :
> FTP is definitely not supported. Read the files to
FTP is definitely not supported. Read the files to distributed storage
first then read from there.
On Sun, Aug 8, 2021, 10:18 PM igyu wrote:
> val ftpUrl = "ftp://ftpuser:ftpuser@10.3.87.51:21/sparkftp/;
>
> val schemas = StructType(List(
> new StructField("name", DataTypes.StringType,
val ftpUrl = "ftp://ftpuser:ftpuser@10.3.87.51:21/sparkftp/;
val schemas = StructType(List(
new StructField("name", DataTypes.StringType, true),
new StructField("age", DataTypes.IntegerType, true),
new StructField("remk", DataTypes.StringType, true))) val DF =
