[jira] [Updated] (ATLAS-4754) Download Search with Basic Search gives java.io.FileNotFoundException

2023-05-23 Thread Mandar Ambawane (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-4754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mandar Ambawane updated ATLAS-4754:
---
Component/s:  atlas-core
 (was: atlas-webui)

> Download Search with Basic Search gives java.io.FileNotFoundException
> -
>
> Key: ATLAS-4754
> URL: https://issues.apache.org/jira/browse/ATLAS-4754
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Reporter: Abhishek Pal
>Assignee: Mandar Ambawane
>Priority: Major
>
> Currently when trying to download search results, the download task is stuck 
> on pending.
> Upon checking the logs the following error is being seen:
> {code:java|title=application.log}
> 2023-05-17 22:09:47,321 INFO - [etp1158258131-199 - 
> a6302f98-7e3d-4cbc-bd06-883fbfa21d11:] ~ TaskManagement: Processing stats: 
> total=1, sinceLastStatsReport=2 completedWithErrors=1, succeded=0 
> (TaskExecutor$TaskLogger:166)
> 2023-05-17 22:09:47,330 ERROR - [atlas-task-0-etp1158258131-282 - 
> b9a5a4ef-6e3f-440c-9f65-d446a6da9720:] ~ Task: 
> f4e26459-746f-4f31-90db-144c31a9696f: Error performing task! 
> (SearchResultDownloadTask:126)
> java.io.FileNotFoundException: 
> /search_result_downloads//.csv (No such file 
> or directory)
> at java.base/java.io.FileOutputStream.open0(Native Method)
> at java.base/java.io.FileOutputStream.open(FileOutputStream.java:298)
> at java.base/java.io.FileOutputStream.(FileOutputStream.java:237)
> at java.base/java.io.FileOutputStream.(FileOutputStream.java:187)
> at java.base/java.io.FileWriter.(FileWriter.java:96)
> at 
> org.apache.atlas.repository.store.graph.v2.tasks.searchdownload.SearchResultDownloadTask.generateCSVFileFromSearchResult(SearchResultDownloadTask.java:185)
> at 
> org.apache.atlas.repository.store.graph.v2.tasks.searchdownload.SearchResultDownloadTask.run(SearchResultDownloadTask.java:163)
> at 
> org.apache.atlas.repository.store.graph.v2.tasks.searchdownload.SearchResultDownloadTask.perform(SearchResultDownloadTask.java:122)
> at org.apache.atlas.tasks.AbstractTask.run(AbstractTask.java:33)
> at 
> org.apache.atlas.tasks.TaskExecutor$TaskConsumer.performTask(TaskExecutor.java:150)
> at org.apache.atlas.tasks.TaskExecutor$TaskConsumer.run(TaskExecutor.java:109)
> at 
> java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
> at 
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> at 
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> at java.base/java.lang.Thread.run(Thread.java:834){code}
> h2. Steps to Reproduce:
> h4. Create type: test_download_entity
> {code:java|title=/api/atlas/v2/types/typedefs}
> {
> "enumDefs": [],
> "structDefs": [],
> "classificationDefs": [],
> "entityDefs": [
> {
> "attributeDefs": [
> {
> "name": "name",
> "typeName": "string",
> "isOptional": true,
> "cardinality": "SINGLE",
> "valuesMinCount": 0,
> "valuesMaxCount": 1,
> "isUnique": false,
> "isIndexable": false
> },
> {
> "name": "type_str",
> "typeName": "string",
> "isOptional": true,
> "cardinality": "SINGLE",
> "valuesMinCount": 0,
> "valuesMaxCount": 1,
> "isUnique": false,
> "isIndexable": false
> }
> ],
> "description": "description",
> "name": "test_download_entity",
> "guid": "-32062751815011",
> "category": "ENTITY",
> "superTypes": []
> }
> ],
> "relationshipDefs": [],
> "businessMetadataDefs": []
> }
> {code}
> h4. Create entity of type: test_download_entity
> {code:java|title=/api/atlas/v2/entity/bulk}
> {
>   "entities": [{
>   "typeName": "test_download_entity",
>   "attributes": {
>   "name": "downloadable_entity_1",
>   "type_str": "str1"
>   },
>   "guid": "-08727943682221"
>   },
>   {
>   "typeName": "test_download_entity",
>   "attributes": {
>   "name": "downloadable_entity_2",
>   "type_str": "str2"
>   },
>   "guid": "-0872794368"
>   }
>   ]
> 

[jira] [Updated] (ATLAS-4754) Download Search with Basic Search gives java.io.FileNotFoundException

2023-05-17 Thread Abhishek Pal (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-4754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Abhishek Pal updated ATLAS-4754:

Description: 
Currently when trying to download search results, the download task is stuck on 
pending.
Upon checking the logs the following error is being seen:
{code:java|title=application.log}
2023-05-17 22:09:47,321 INFO - [etp1158258131-199 - 
a6302f98-7e3d-4cbc-bd06-883fbfa21d11:] ~ TaskManagement: Processing stats: 
total=1, sinceLastStatsReport=2 completedWithErrors=1, succeded=0 
(TaskExecutor$TaskLogger:166)
2023-05-17 22:09:47,330 ERROR - [atlas-task-0-etp1158258131-282 - 
b9a5a4ef-6e3f-440c-9f65-d446a6da9720:] ~ Task: 
f4e26459-746f-4f31-90db-144c31a9696f: Error performing task! 
(SearchResultDownloadTask:126)
java.io.FileNotFoundException: 
/search_result_downloads//.csv (No such file or 
directory)
at java.base/java.io.FileOutputStream.open0(Native Method)
at java.base/java.io.FileOutputStream.open(FileOutputStream.java:298)
at java.base/java.io.FileOutputStream.(FileOutputStream.java:237)
at java.base/java.io.FileOutputStream.(FileOutputStream.java:187)
at java.base/java.io.FileWriter.(FileWriter.java:96)
at 
org.apache.atlas.repository.store.graph.v2.tasks.searchdownload.SearchResultDownloadTask.generateCSVFileFromSearchResult(SearchResultDownloadTask.java:185)
at 
org.apache.atlas.repository.store.graph.v2.tasks.searchdownload.SearchResultDownloadTask.run(SearchResultDownloadTask.java:163)
at 
org.apache.atlas.repository.store.graph.v2.tasks.searchdownload.SearchResultDownloadTask.perform(SearchResultDownloadTask.java:122)
at org.apache.atlas.tasks.AbstractTask.run(AbstractTask.java:33)
at 
org.apache.atlas.tasks.TaskExecutor$TaskConsumer.performTask(TaskExecutor.java:150)
at org.apache.atlas.tasks.TaskExecutor$TaskConsumer.run(TaskExecutor.java:109)
at 
java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at 
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at 
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:834){code}
h2. Steps to Reproduce:
h4. Create type: test_download_entity
{code:java|title=/api/atlas/v2/types/typedefs}
{
"enumDefs": [],
"structDefs": [],
"classificationDefs": [],
"entityDefs": [
{
"attributeDefs": [
{
"name": "name",
"typeName": "string",
"isOptional": true,
"cardinality": "SINGLE",
"valuesMinCount": 0,
"valuesMaxCount": 1,
"isUnique": false,
"isIndexable": false
},
{
"name": "type_str",
"typeName": "string",
"isOptional": true,
"cardinality": "SINGLE",
"valuesMinCount": 0,
"valuesMaxCount": 1,
"isUnique": false,
"isIndexable": false
}
],
"description": "description",
"name": "test_download_entity",
"guid": "-32062751815011",
"category": "ENTITY",
"superTypes": []
}
],
"relationshipDefs": [],
"businessMetadataDefs": []
}
{code}
h4. Create entity of type: test_download_entity
{code:java|title=/api/atlas/v2/entity/bulk}
{
"entities": [{
"typeName": "test_download_entity",
"attributes": {
"name": "downloadable_entity_1",
"type_str": "str1"
},
"guid": "-08727943682221"
},
{
"typeName": "test_download_entity",
"attributes": {
"name": "downloadable_entity_2",
"type_str": "str2"
},
"guid": "-0872794368"
}
]
}{code}
h4. Search for type "test_download_entity"

Now on the host if we search for the type "
test_download_entity" and then download the search results, we will see the 
entity being queued for download, but then it stays in the pending state.

 
{color:red}*Note*:{color} The text marked in <> (angular brackets) are 
placeholders. Ex:  is placeholder for the Atlas URL
 

  was:
Currently when trying to download search results, the download task is stuck on 
pending.
Upon checking the logs the following error is being seen:
{code:java|title=application.log}
2023-05-17 22:09:47,321 INFO - [etp1158258131-199 - 
a6302f98-7e3d-4cbc-bd06-883fbfa21d11:] ~ TaskManagement: