Submitted a pull request and confirmed it worked with arabic characters
against a public server I was able to test GFF -> PutFTP as well as ListFTP
-> FetchFTP.
We may have a 1.13.1 release coming soon so it would likely be included.

Thanks,
Pierre

Le mar. 23 févr. 2021 à 15:30, Jens M. Kofoed <[email protected]> a
écrit :

> Jira bug created: https://issues.apache.org/jira/browse/NIFI-8220
>
> kind regards
> Jens M. Kofoed
>
> Den tir. 23. feb. 2021 kl. 12.28 skrev Jens M. Kofoed <
> [email protected]>:
>
>> no problem,
>>
>> By the way I just tried PutFTP and it also have some issue.
>> I created a flowfile, used an UpdateAttribute to set the filename to:
>> امتحان.txt   used a PutFTP (with utf8 enabled) and the filename at the ftp
>> server become: امتحان.txt
>>
>> Den tir. 23. feb. 2021 kl. 12.20 skrev Pierre Villard <
>> [email protected]>:
>>
>>> Do you mind filing a JIRA? I had a quick look and the fix should be
>>> fairly straightforward. Will give it a try to confirm.
>>>
>>> Thanks,
>>> Pierre
>>>
>>> Le mar. 23 févr. 2021 à 15:09, Jens M. Kofoed <[email protected]>
>>> a écrit :
>>>
>>>> Hi
>>>>
>>>> I have now tried with NiFi version 1.13.0, and there are still issues
>>>> with non-English characters.
>>>> The ListFTP process does not have an attribute "Use UTF-8 Encoding" but
>>>> FetchFTP has.
>>>> I have created a file with this filename: امتحان.txt
>>>> ListFTP list the filename as: ??????.txt which does not exist and
>>>> therefore FetchFTP fails.
>>>>
>>>> I tried to use an UpdateAttribute process to change the filename into
>>>> امتحان.txt but FetchFTP give my an error again
>>>>
>>>> FetchFTP[id=ce85ca8e-0177-1000-ffff-ffff95e1e5f7] Failed to fetch content 
>>>> for 
>>>> StandardFlowFileRecord[uuid=823c600d-c7fa-406e-ae66-b1ac70f5e212,claim=,offset=0,name=امتحان.txt,size=0]
>>>>  from filename FTP/امتحان.txt on remote host 192.168.1.2:21 due to 
>>>> java.io.IOException: 550 The system cannot find the file specified.
>>>> ; routing to comms.failure: java.io.IOException: 550 The system cannot 
>>>> find the file specified.
>>>>
>>>>
>>>> Kind regards
>>>> Jens
>>>>
>>>> Den tir. 23. feb. 2021 kl. 09.14 skrev Pierre Villard <
>>>> [email protected]>:
>>>>
>>>>> Let us know if this still doesn't work, we will definitely want to
>>>>> look into it!
>>>>>
>>>>> Le mar. 23 févr. 2021 à 11:47, Jens M. Kofoed <[email protected]>
>>>>> a écrit :
>>>>>
>>>>>> Hi Pierre
>>>>>>
>>>>>> Many thanks, I will definitely try the new version 1.13.0. I have
>>>>>> already tried the List+Fetch processers in 1.12.1. And these 2 processors
>>>>>> can take some non-English characters like Danish and Swedish character
>>>>>> which GetFTP can't. But they still can't read my Arabic characters.
>>>>>> I will try 1.13.0
>>>>>>
>>>>>> Thanks,
>>>>>> Jens
>>>>>>
>>>>>> Den tir. 23. feb. 2021 kl. 08.17 skrev Pierre Villard <
>>>>>> [email protected]>:
>>>>>>
>>>>>>> Hi Jens,
>>>>>>>
>>>>>>> You may want to try NiFi 1.13.0 with List+Fetch processors. The
>>>>>>> addition of https://issues.apache.org/jira/browse/NIFI-7685 may
>>>>>>> help. Worth a try at least.
>>>>>>>
>>>>>>> Thanks,
>>>>>>> Pierre
>>>>>>>
>>>>>>> Le mar. 23 févr. 2021 à 10:56, Jens M. Kofoed <
>>>>>>> [email protected]> a écrit :
>>>>>>>
>>>>>>>> Dear community
>>>>>>>>
>>>>>>>> I have an issue which I hope some of you might be able to help me
>>>>>>>> with or point me in the right direction.
>>>>>>>> We have a FTP server (MS IIS 7) where utf-8 is enabled. If I
>>>>>>>> connect with FileZilla I have no problems with uploading and 
>>>>>>>> downloading
>>>>>>>> files with Arabic letters in the filename.
>>>>>>>> But then NiFi (v. 1.12.1) connect with a GetFTP process it list the
>>>>>>>> filenames as ???? instead of the Arabic letters, and is not able to 
>>>>>>>> get the
>>>>>>>> file since that filename does not exist. The GetFTP process is also
>>>>>>>> configured with utf-8 enabled.
>>>>>>>> The NiFi server is using Ubuntu 18.04 and if I connect from the
>>>>>>>> NiFi server to the FTP server I see the same behavior, Arabic letters 
>>>>>>>> is
>>>>>>>> showing as ???
>>>>>>>>
>>>>>>>> But since FileZilla can see Arabic letters correctly, I can't see
>>>>>>>> that the issue is at the FTP server.
>>>>>>>> So please help
>>>>>>>>
>>>>>>>> Kind regards
>>>>>>>> Jens M. Kofoed
>>>>>>>>
>>>>>>>>

Reply via email to