William Lo created GOBBLIN-1952:
-----------------------------------

             Summary: GaaS JobNames with long lengths cause issues with HDFS 
folders
                 Key: GOBBLIN-1952
                 URL: https://issues.apache.org/jira/browse/GOBBLIN-1952
             Project: Apache Gobblin
          Issue Type: Bug
          Components: gobblin-service
            Reporter: William Lo
            Assignee: Abhishek Tiwari


Gobblin-as-a-Service creates jobnames using flowgroups flownames, edges, and 
jobnames from the template. However, this tends to create a very long string 
which then causes issues in Gobblin job when creating files that use the 
jobname to create working directories or state stores. Although there has been 
previous code that shortens job name lengths, we want to further increase this 
by being more aggressive with the maximum length of the jobname to reduce the 
odds of exceeding 255 chars (max length of HDFS component)



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to