[jira] [Updated] (ATLAS-3595) Data Migration: Support zip file for data migration
[ https://issues.apache.org/jira/browse/ATLAS-3595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikhil Bonte updated ATLAS-3595: Fix Version/s: trunk > Data Migration: Support zip file for data migration > --- > > Key: ATLAS-3595 > URL: https://issues.apache.org/jira/browse/ATLAS-3595 > Project: Atlas > Issue Type: Improvement >Reporter: Nikhil Bonte >Assignee: Nikhil Bonte >Priority: Major > Fix For: trunk > > > Data migration service added under [ATLAS-2461|http://example.com/] works > with json files as input. > This improvement will enable Data Migration service to import data using a > zip file. > Approach: > * Property value for migration should contain full path of file, below is > the example. > * Data migration service will first check migration property if value refers > to a zip file. > * If true, it will call ZipMigrationImporter to import data in zip file. > * ZipMigrationImporter internally uses existing ImportService to ingest zip. > * Audit service & Notification service will also be started as a part of zip > import. > E.g. properties to enable zip data migration: > * atlas.migration.data.filename=/path/fileName.zip > atlas.migration.mode.workers=5 > atlas.migration.mode.batch.size=20 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (ATLAS-3595) Data Migration: Support zip file for data migration
[ https://issues.apache.org/jira/browse/ATLAS-3595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikhil Bonte updated ATLAS-3595: Attachment: (was: ATLAS-3603-ATLAS-3595-Data-Migration-Auto-start-zip-migration.patch) > Data Migration: Support zip file for data migration > --- > > Key: ATLAS-3595 > URL: https://issues.apache.org/jira/browse/ATLAS-3595 > Project: Atlas > Issue Type: Improvement >Reporter: Nikhil Bonte >Assignee: Nikhil Bonte >Priority: Major > > Data migration service added under [ATLAS-2461|http://example.com/] works > with json files as input. > This improvement will enable Data Migration service to import data using a > zip file. > Approach: > * Property value for migration should contain full path of file, below is > the example. > * Data migration service will first check migration property if value refers > to a zip file. > * If true, it will call ZipMigrationImporter to import data in zip file. > * ZipMigrationImporter internally uses existing ImportService to ingest zip. > * Audit service & Notification service will also be started as a part of zip > import. > E.g. properties to enable zip data migration: > * atlas.migration.data.filename=/path/fileName.zip > atlas.migration.mode.workers=5 > atlas.migration.mode.batch.size=20 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (ATLAS-3595) Data Migration: Support zip file for data migration
[ https://issues.apache.org/jira/browse/ATLAS-3595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikhil Bonte updated ATLAS-3595: Attachment: (was: zip-direct-2.zip) > Data Migration: Support zip file for data migration > --- > > Key: ATLAS-3595 > URL: https://issues.apache.org/jira/browse/ATLAS-3595 > Project: Atlas > Issue Type: Improvement >Reporter: Nikhil Bonte >Assignee: Nikhil Bonte >Priority: Major > Attachments: > ATLAS-3603-ATLAS-3595-Data-Migration-Auto-start-zip-migration.patch > > > Data migration service added under [ATLAS-2461|http://example.com/] works > with json files as input. > This improvement will enable Data Migration service to import data using a > zip file. > Approach: > * Property value for migration should contain full path of file, below is > the example. > * Data migration service will first check migration property if value refers > to a zip file. > * If true, it will call ZipMigrationImporter to import data in zip file. > * ZipMigrationImporter internally uses existing ImportService to ingest zip. > * Audit service & Notification service will also be started as a part of zip > import. > E.g. properties to enable zip data migration: > * atlas.migration.data.filename=/path/fileName.zip > atlas.migration.mode.workers=5 > atlas.migration.mode.batch.size=20 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (ATLAS-3595) Data Migration: Support zip file for data migration
[ https://issues.apache.org/jira/browse/ATLAS-3595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikhil Bonte updated ATLAS-3595: Attachment: zip-direct-2.zip > Data Migration: Support zip file for data migration > --- > > Key: ATLAS-3595 > URL: https://issues.apache.org/jira/browse/ATLAS-3595 > Project: Atlas > Issue Type: Improvement >Reporter: Nikhil Bonte >Assignee: Nikhil Bonte >Priority: Major > Attachments: > ATLAS-3603-ATLAS-3595-Data-Migration-Auto-start-zip-migration.patch, > zip-direct-2.zip > > > Data migration service added under [ATLAS-2461|http://example.com/] works > with json files as input. > This improvement will enable Data Migration service to import data using a > zip file. > Approach: > * Property value for migration should contain full path of file, below is > the example. > * Data migration service will first check migration property if value refers > to a zip file. > * If true, it will call ZipMigrationImporter to import data in zip file. > * ZipMigrationImporter internally uses existing ImportService to ingest zip. > * Audit service & Notification service will also be started as a part of zip > import. > E.g. properties to enable zip data migration: > * atlas.migration.data.filename=/path/fileName.zip > atlas.migration.mode.workers=5 > atlas.migration.mode.batch.size=20 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (ATLAS-3595) Data Migration: Support zip file for data migration
[ https://issues.apache.org/jira/browse/ATLAS-3595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikhil Bonte updated ATLAS-3595: Attachment: (was: ATLAS-3595-Migration-import-support-zip-file-for-dat-v6.patch) > Data Migration: Support zip file for data migration > --- > > Key: ATLAS-3595 > URL: https://issues.apache.org/jira/browse/ATLAS-3595 > Project: Atlas > Issue Type: Improvement >Reporter: Nikhil Bonte >Assignee: Nikhil Bonte >Priority: Major > Attachments: > ATLAS-3603-ATLAS-3595-Data-Migration-Auto-start-zip-migration.patch > > > Data migration service added under [ATLAS-2461|http://example.com/] works > with json files as input. > This improvement will enable Data Migration service to import data using a > zip file. > Approach: > * Property value for migration should contain full path of file, below is > the example. > * Data migration service will first check migration property if value refers > to a zip file. > * If true, it will call ZipMigrationImporter to import data in zip file. > * ZipMigrationImporter internally uses existing ImportService to ingest zip. > * Audit service & Notification service will also be started as a part of zip > import. > E.g. properties to enable zip data migration: > * atlas.migration.data.filename=/path/fileName.zip > atlas.migration.mode.workers=5 > atlas.migration.mode.batch.size=20 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (ATLAS-3595) Data Migration: Support zip file for data migration
[ https://issues.apache.org/jira/browse/ATLAS-3595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikhil Bonte updated ATLAS-3595: Attachment: ATLAS-3603-ATLAS-3595-Data-Migration-Auto-start-zip-migration.patch > Data Migration: Support zip file for data migration > --- > > Key: ATLAS-3595 > URL: https://issues.apache.org/jira/browse/ATLAS-3595 > Project: Atlas > Issue Type: Improvement >Reporter: Nikhil Bonte >Assignee: Nikhil Bonte >Priority: Major > Attachments: > ATLAS-3603-ATLAS-3595-Data-Migration-Auto-start-zip-migration.patch > > > Data migration service added under [ATLAS-2461|http://example.com/] works > with json files as input. > This improvement will enable Data Migration service to import data using a > zip file. > Approach: > * Property value for migration should contain full path of file, below is > the example. > * Data migration service will first check migration property if value refers > to a zip file. > * If true, it will call ZipMigrationImporter to import data in zip file. > * ZipMigrationImporter internally uses existing ImportService to ingest zip. > * Audit service & Notification service will also be started as a part of zip > import. > E.g. properties to enable zip data migration: > * atlas.migration.data.filename=/path/fileName.zip > atlas.migration.mode.workers=5 > atlas.migration.mode.batch.size=20 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (ATLAS-3595) Data Migration: Support zip file for data migration
[ https://issues.apache.org/jira/browse/ATLAS-3595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikhil Bonte updated ATLAS-3595: Description: Data migration service added under [ATLAS-2461|http://example.com/] works with json files as input. This improvement will enable Data Migration service to import data using a zip file. Approach: * Property value for migration should contain full path of file, below is the example. * Data migration service will first check migration property if value refers to a zip file. * If true, it will call ZipMigrationImporter to import data in zip file. * ZipMigrationImporter internally uses existing ImportService to ingest zip. * Audit service & Notification service will also be started as a part of zip import. E.g. properties to enable zip data migration: * atlas.migration.data.filename=/path/fileName.zip atlas.migration.mode.workers=5 atlas.migration.mode.batch.size=20 was: Data migration service added under [ATLAS-2461|http://example.com/] works with json files as input. This improvement will enable Data Migration service to import data using a zip file. Approach: * Property value for migration should contain full path of file, below is the example. * Data migration service will first check migration property if value refers to a zip file. * If true, it will call ZipMigrator to import data in zip file. * ZipMigrator internally uses existing ImportService to ingest zip. * Audit service & Notification service will also be started as a part of zip import. E.g. properties to enable zip data migration: * atlas.migration.data.filename=/path/fileName.zip atlas.migration.mode.workers=5 atlas.migration.mode.batch.size=20 > Data Migration: Support zip file for data migration > --- > > Key: ATLAS-3595 > URL: https://issues.apache.org/jira/browse/ATLAS-3595 > Project: Atlas > Issue Type: Improvement >Reporter: Nikhil Bonte >Assignee: Nikhil Bonte >Priority: Major > Attachments: > ATLAS-3595-Migration-import-support-zip-file-for-dat-v6.patch > > > Data migration service added under [ATLAS-2461|http://example.com/] works > with json files as input. > This improvement will enable Data Migration service to import data using a > zip file. > Approach: > * Property value for migration should contain full path of file, below is > the example. > * Data migration service will first check migration property if value refers > to a zip file. > * If true, it will call ZipMigrationImporter to import data in zip file. > * ZipMigrationImporter internally uses existing ImportService to ingest zip. > * Audit service & Notification service will also be started as a part of zip > import. > E.g. properties to enable zip data migration: > * atlas.migration.data.filename=/path/fileName.zip > atlas.migration.mode.workers=5 > atlas.migration.mode.batch.size=20 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (ATLAS-3595) Data Migration: Support zip file for data migration
[ https://issues.apache.org/jira/browse/ATLAS-3595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikhil Bonte updated ATLAS-3595: Description: Data migration service added under [ATLAS-2461|http://example.com/] works with json files as input. This improvement will enable Data Migration service to import data using a zip file. Approach: * Property value for migration should contain full path of file, below is the example. * Data migration service will first check migration property if value refers to a zip file. * If true, it will call ZipMigrator to import data in zip file. * ZipMigrator internally uses existing ImportService to ingest zip. * Audit service & Notification service will also be started as a part of zip import. E.g. properties to enable zip data migration: * atlas.migration.data.filename=/path/fileName.zip atlas.migration.mode.workers=5 atlas.migration.mode.batch.size=20 was: Data migration service added under [ATLAS-2461|http://example.com/] works with json files as input. This improvement will enable Data Migration service to import data using a zip file. Approach: * Property value for migration should contain full path of file, below is the example. * Data migration service will first check in input directory for a zip file. * If zip file found, it will call ZipMigrator to import data in file. * ZipMigrator internally uses existing import functionality in ImportService. * Audit service & Notification service will also be started as a part of zip import. E.g. properties to enable zip data migration: * atlas.migration.data.filename=/path/fileName.zip atlas.migration.mode.workers=5 atlas.migration.mode.batch.size=20 > Data Migration: Support zip file for data migration > --- > > Key: ATLAS-3595 > URL: https://issues.apache.org/jira/browse/ATLAS-3595 > Project: Atlas > Issue Type: Improvement >Reporter: Nikhil Bonte >Assignee: Nikhil Bonte >Priority: Major > > Data migration service added under [ATLAS-2461|http://example.com/] works > with json files as input. > This improvement will enable Data Migration service to import data using a > zip file. > Approach: > * Property value for migration should contain full path of file, below is > the example. > * Data migration service will first check migration property if value refers > to a zip file. > * If true, it will call ZipMigrator to import data in zip file. > * ZipMigrator internally uses existing ImportService to ingest zip. > * Audit service & Notification service will also be started as a part of zip > import. > E.g. properties to enable zip data migration: > * atlas.migration.data.filename=/path/fileName.zip > atlas.migration.mode.workers=5 > atlas.migration.mode.batch.size=20 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (ATLAS-3595) Data Migration: Support zip file for data migration
[ https://issues.apache.org/jira/browse/ATLAS-3595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikhil Bonte updated ATLAS-3595: Description: Data migration service added under [ATLAS-2461|http://example.com/] works with json files as input. This improvement will enable Data Migration service to import data using a zip file. Approach: * Property value for migration should contain full path of file, below is the example. * Data migration service will first check in input directory for a zip file. * If zip file found, it will call ZipMigrator to import data in file. * ZipMigrator internally uses existing import functionality in ImportService. * Audit service & Notification service will also be started as a part of zip import. E.g. properties to enable zip data migration: * atlas.migration.data.filename=/path/fileName.zip atlas.migration.mode.workers=5 atlas.migration.mode.batch.size=20 was: Data migration service added under [ATLAS-2461|http://example.com/] works with json files as input. This improvement will enable Data Migration service to import data using a zip file. Approach: * Data migration service will first check in input directory for a zip file. * If zip file found, it will call ZipMigrator to import data in file. * ZipMigrator internally uses existing import functionality in ImportService. * Audit service & Notification service will also be started as a part of zip import. > Data Migration: Support zip file for data migration > --- > > Key: ATLAS-3595 > URL: https://issues.apache.org/jira/browse/ATLAS-3595 > Project: Atlas > Issue Type: Improvement >Reporter: Nikhil Bonte >Assignee: Nikhil Bonte >Priority: Major > > Data migration service added under [ATLAS-2461|http://example.com/] works > with json files as input. > This improvement will enable Data Migration service to import data using a > zip file. > Approach: > * Property value for migration should contain full path of file, below is > the example. > * Data migration service will first check in input directory for a zip file. > * If zip file found, it will call ZipMigrator to import data in file. > * ZipMigrator internally uses existing import functionality in ImportService. > * Audit service & Notification service will also be started as a part of zip > import. > E.g. properties to enable zip data migration: > * atlas.migration.data.filename=/path/fileName.zip > atlas.migration.mode.workers=5 > atlas.migration.mode.batch.size=20 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (ATLAS-3595) Data Migration: Support zip file for data migration
[ https://issues.apache.org/jira/browse/ATLAS-3595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikhil Bonte updated ATLAS-3595: Description: Data migration service added under [ATLAS-2461|http://example.com/] works with json files as input. This improvement will enable Data Migration service to import data using a zip file. Approach: * Data migration service will first check in input directory for a zip file. * If zip file found, it will call ZipMigrator to import data in file. * ZipMigrator internally uses existing import functionality in ImportService. * Audit service & Notification service will also be started as a part of zip import. was: Data migration service added under [ATLAS-2461|http://example.com/] works with json files as input. This improvement will enable Data Migration service to import data using a zip file. Approach: * Data migration service will first check in input directory for a zip file. * If zip file found, it will call ZipMigrator to import data in file. * ZipMigrator internally uses existing import functionality in ImportService. > Data Migration: Support zip file for data migration > --- > > Key: ATLAS-3595 > URL: https://issues.apache.org/jira/browse/ATLAS-3595 > Project: Atlas > Issue Type: Improvement >Reporter: Nikhil Bonte >Assignee: Nikhil Bonte >Priority: Major > > Data migration service added under [ATLAS-2461|http://example.com/] works > with json files as input. > This improvement will enable Data Migration service to import data using a > zip file. > Approach: > * Data migration service will first check in input directory for a zip file. > * If zip file found, it will call ZipMigrator to import data in file. > * ZipMigrator internally uses existing import functionality in ImportService. > * Audit service & Notification service will also be started as a part of zip > import. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (ATLAS-3595) Data Migration: Support zip file for data migration
[ https://issues.apache.org/jira/browse/ATLAS-3595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikhil Bonte updated ATLAS-3595: Description: Data migration service added under [ATLAS-2461|http://example.com/] works with json files as input. This improvement will enable Data Migration service to import data using a zip file. Approach: * Data migration service will first check in input directory for a zip file. * If zip file found, it will call ZipMigrator to import data in file. * ZipMigrator internally uses existing import functionality in ImportService. was: Data migration service added under [ATLAS-2461|http://example.com/] works with json files as input. This improvement will enable Data Migration service to import data using a zip file. Approach: * Data migration service will first check in input directory for any zip file. * If zip file found it will call ZipMigrator to import data in file. * ZipMigrator internally uses existing import functionality in ImportService. > Data Migration: Support zip file for data migration > --- > > Key: ATLAS-3595 > URL: https://issues.apache.org/jira/browse/ATLAS-3595 > Project: Atlas > Issue Type: Improvement >Reporter: Nikhil Bonte >Assignee: Nikhil Bonte >Priority: Major > > Data migration service added under [ATLAS-2461|http://example.com/] works > with json files as input. > This improvement will enable Data Migration service to import data using a > zip file. > Approach: > * Data migration service will first check in input directory for a zip file. > * If zip file found, it will call ZipMigrator to import data in file. > * ZipMigrator internally uses existing import functionality in ImportService. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (ATLAS-3595) Data Migration: Support zip file for data migration
[ https://issues.apache.org/jira/browse/ATLAS-3595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikhil Bonte updated ATLAS-3595: Description: Data migration service added under [ATLAS-2461|http://example.com/] works with json files as input. This improvement will enable Data Migration service to import data using a zip file. Approach: * Data migration service will first check in input directory for any zip file. * If zip file found it will call ZipMigrator to import data in file. * ZipMigrator internally uses existing import functionality in ImportService. was: Data migration service added in [ATLAS-2461|http://example.com/] works with json files as input. This improvement will enable Data Migration service to import data using a zip file. Approach: * Data migration service will first check in input directory for any zip file. * If zip file found it will call ZipMigrator to import data in file. * ZipMigrator internally uses existing import functionality in ImportService. > Data Migration: Support zip file for data migration > --- > > Key: ATLAS-3595 > URL: https://issues.apache.org/jira/browse/ATLAS-3595 > Project: Atlas > Issue Type: Improvement >Reporter: Nikhil Bonte >Assignee: Nikhil Bonte >Priority: Major > > Data migration service added under [ATLAS-2461|http://example.com/] works > with json files as input. > This improvement will enable Data Migration service to import data using a > zip file. > Approach: > * Data migration service will first check in input directory for any zip > file. > * If zip file found it will call ZipMigrator to import data in file. > * ZipMigrator internally uses existing import functionality in ImportService. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (ATLAS-3595) Data Migration: Support zip file for data migration
[ https://issues.apache.org/jira/browse/ATLAS-3595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikhil Bonte updated ATLAS-3595: Description: Data migration service added in [ATLAS-2461|http://example.com/] works with json files as input. This improvement will enable Data Migration service to import data using a zip file. Approach: * Data migration service will first check in input directory for any zip file. * If zip file found it will call ZipMigrator to import data in file. * ZipMigrator internally uses existing import functionality in ImportService. was: Currently Data migration service works with json files as input. This improvement will enable Data Migration service to import data using a zip file. > Data Migration: Support zip file for data migration > --- > > Key: ATLAS-3595 > URL: https://issues.apache.org/jira/browse/ATLAS-3595 > Project: Atlas > Issue Type: Improvement >Reporter: Nikhil Bonte >Assignee: Nikhil Bonte >Priority: Major > > Data migration service added in [ATLAS-2461|http://example.com/] works with > json files as input. > This improvement will enable Data Migration service to import data using a > zip file. > Approach: > * Data migration service will first check in input directory for any zip > file. > * If zip file found it will call ZipMigrator to import data in file. > * ZipMigrator internally uses existing import functionality in ImportService. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (ATLAS-3595) Data Migration: Support zip file for data migration
[ https://issues.apache.org/jira/browse/ATLAS-3595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikhil Bonte updated ATLAS-3595: Summary: Data Migration: Support zip file for data migration (was: Data Migration: support zip file for data migration) > Data Migration: Support zip file for data migration > --- > > Key: ATLAS-3595 > URL: https://issues.apache.org/jira/browse/ATLAS-3595 > Project: Atlas > Issue Type: Improvement >Reporter: Nikhil Bonte >Assignee: Nikhil Bonte >Priority: Major > > Currently Data migration service works with json files as input. > This improvement will enable Data Migration service to import data using a > zip file. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (ATLAS-3595) Data Migration: support zip file for data migration
[ https://issues.apache.org/jira/browse/ATLAS-3595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikhil Bonte updated ATLAS-3595: Summary: Data Migration: support zip file for data migration (was: Migration import: support zip file for data migration) > Data Migration: support zip file for data migration > --- > > Key: ATLAS-3595 > URL: https://issues.apache.org/jira/browse/ATLAS-3595 > Project: Atlas > Issue Type: Improvement >Reporter: Nikhil Bonte >Assignee: Nikhil Bonte >Priority: Major > > Currently Data migration service works with json files as input. > This improvement will enable Data Migration service to import data using a > zip file. -- This message was sent by Atlassian Jira (v8.3.4#803005)
