[Wikidata-bugs] [Maniphest] T342416: Set data permission on new snapshot generation (discovery.wikibase_rdf)

Gehel closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T342416 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: EBernhardson, Gehel Cc: dcausse, BTullis, AndrewTavis_WMDE, Aklapper, JAllemandou, Danny_Benjafield_WMDE,

[Wikidata-bugs] [Maniphest] T342416: Set data permission on new snapshot generation (discovery.wikibase_rdf)

EBernhardson added a comment. New dataset for 20230821 has updated permissions as expected. TASK DETAIL https://phabricator.wikimedia.org/T342416 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: EBernhardson Cc: dcausse, BTullis, AndrewTavis_WMDE,

[Wikidata-bugs] [Maniphest] T342416: Set data permission on new snapshot generation (discovery.wikibase_rdf)

JAllemandou added a comment. In T342416#9101868 , @EBernhardson wrote: > These are both generated by spark. The rdf is being imported by a scala application while the cirrus dump is imported by pyspark, but they should both be using

[Wikidata-bugs] [Maniphest] T342416: Set data permission on new snapshot generation (discovery.wikibase_rdf)

EBernhardson added a comment. In T342416#9101474 , @JAllemandou wrote: > In T342416#9091146 , @EBernhardson wrote: > >> Similarly we have other jobs that still run today and emit

[Wikidata-bugs] [Maniphest] T342416: Set data permission on new snapshot generation (discovery.wikibase_rdf)

JAllemandou added a comment. In T342416#9091146 , @EBernhardson wrote: > I looked into these, the attached patch should fix it but it leaves an open question (@JAllemandou): > > The `core-site.xml`, along with puppet which writes it

[Wikidata-bugs] [Maniphest] T342416: Set data permission on new snapshot generation (discovery.wikibase_rdf)

EBernhardson moved this task from Needs review to To Be Deployed on the Discovery-Search (Current work) board. EBernhardson added a comment. Airflow instance has been updated. I manually changed the permissions of the existing files to 644 and dirs to 755 in

[Wikidata-bugs] [Maniphest] T342416: Set data permission on new snapshot generation (discovery.wikibase_rdf)

CodeReviewBot added a comment. ebernhardson merged https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/478 Make wikibase ttl imports world readable TASK DETAIL https://phabricator.wikimedia.org/T342416 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T342416: Set data permission on new snapshot generation (discovery.wikibase_rdf)

CodeReviewBot added a comment. ebernhardson updated https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/478 Make wikibase ttl imports world readable TASK DETAIL https://phabricator.wikimedia.org/T342416 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T342416: Set data permission on new snapshot generation (discovery.wikibase_rdf)

EBernhardson added a comment. It seems the CodeReviewBot doesn't update the ticket when changing the ticket in a patch on gitlab, the relevant patch is: ebernhardson opened https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/478 Make wikibase ttl

[Wikidata-bugs] [Maniphest] T342416: Set data permission on new snapshot generation (discovery.wikibase_rdf)

EBernhardson added a comment. I looked into these, the attached patch should fix it but it leaves an open question (@JAllemandou): The `core-site.xml`, along with puppet which writes it out, has the default umask of 027 since at least 2021, which prevents world readability. So why do

[Wikidata-bugs] [Maniphest] T342416: Set data permission on new snapshot generation (discovery.wikibase_rdf)

EBernhardson claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T342416 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: EBernhardson Cc: dcausse, BTullis, AndrewTavis_WMDE, Aklapper, JAllemandou, Danny_Benjafield_WMDE,

[Wikidata-bugs] [Maniphest] T342416: Set data permission on new snapshot generation (discovery.wikibase_rdf)

Gehel set the point value for this task to "1". TASK DETAIL https://phabricator.wikimedia.org/T342416 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: dcausse, BTullis, AndrewTavis_WMDE, Aklapper, JAllemandou, Danny_Benjafield_WMDE,

[Wikidata-bugs] [Maniphest] T342416: Set data permission on new snapshot generation (discovery.wikibase_rdf)

Gehel moved this task from needs triage to Current work on the Discovery-Search board. Gehel edited projects, added Discovery-Search (Current work); removed Discovery-Search. TASK DETAIL https://phabricator.wikimedia.org/T342416 WORKBOARD

[Wikidata-bugs] [Maniphest] T342416: Set data permission on new snapshot generation (discovery.wikibase_rdf)

Gehel added a project: Data-Engineering. TASK DETAIL https://phabricator.wikimedia.org/T342416 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: dcausse, BTullis, AndrewTavis_WMDE, Aklapper, JAllemandou, Mohamed-Awnallah, Astuthiodit_1,

[Wikidata-bugs] [Maniphest] T342416: Set data permission on new snapshot generation (discovery.wikibase_rdf)

Maintenance_bot added a project: Wikidata. TASK DETAIL https://phabricator.wikimedia.org/T342416 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Maintenance_bot Cc: dcausse, BTullis, AndrewTavis_WMDE, Aklapper, JAllemandou, Astuthiodit_1,

[Wikidata-bugs] [Maniphest] T342416: Set data permission on new snapshot generation (discovery.wikibase_rdf)

dcausse added a project: Wikidata-Query-Service. TASK DETAIL https://phabricator.wikimedia.org/T342416 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse Cc: BTullis, AndrewTavis_WMDE, Aklapper, JAllemandou, AWesterinen, Namenlos314, Gq86,