[Wikidata-bugs] [Maniphest] T47925: [Task] Apply normalization to string values in statements

Manuel closed this task as "Resolved". Manuel claimed this task. Manuel added a comment. I am closing this task as the original scope seems solved already! TASK DETAIL https://phabricator.wikimedia.org/T47925 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T47925: [Task] Apply normalization to string values in statements

Manuel added a comment. Hi @Dominicbm, thank you for your additional input! > I do think I observe this issue in the UI, but I've only tried in SDC, not Wikidata. > Maybe this issue should be split out if it's only in Commons. Yes, this should be specific to SDC. There seems to

[Wikidata-bugs] [Maniphest] T47925: [Task] Apply normalization to string values in statements

Dominicbm added a comment. In T47925#7800934 , @Manuel wrote: > Hi @Dominicbm, thank you for your comment. Are you using the API or the UI for your edits? In case you are using the API, please try to use the parse API (wbparsevalue)

[Wikidata-bugs] [Maniphest] T47925: [Task] Apply normalization to string values in statements

Herzi.Pinki added a comment. Let's consider this to be an epic fail of problem management in Wikidata. This is now open for more than 7 years, and it is about trimming whitespaces. facepalm. Everybody paralysed? The current proposal is to improve documentation and error messages, needless

[Wikidata-bugs] [Maniphest] T47925: [Task] Apply normalization to string values in statements

Manuel added a comment. Hi @Dominicbm, thank you for your comment. Are you using the API or the UI for your edits? In case you are using the API, please try to use the parse API (wbparsevalue) before making the actual edit. In case you are using the UI, could you please provide us with

[Wikidata-bugs] [Maniphest] T47925: [Task] Apply normalization to string values in statements

Lucas_Werkmeister_WMDE added a comment. Our UI uses the parse API for strings (since T261071#6493792 ), but if I understand correctly, @Dominicbm is using the API directly, not editing via the UI. We could decide to do more of these

[Wikidata-bugs] [Maniphest] T47925: [Task] Apply normalization to string values in statements

Manuel added a comment. Hi @Lucas_Werkmeister_WMDE, how about "illegal non-breaking space characters" (see Dominicbm's comment)? Shouldn't these already be normalized? (wbparsevalue shows me a warning, but it seems to do the job). Can you confirm this or are we also not using the parse API

[Wikidata-bugs] [Maniphest] T47925: [Task] Apply normalization to string values in statements

Dominicbm added a comment. I've run into this a lot recently. It can be difficult when you are importing from a data source that may have less clean data, and tracking down something like an illegal non-breaking space character in a value is a major pain, especially when it can't even be

[Wikidata-bugs] [Maniphest] T47925: [Task] Apply normalization to string values in statements

thiemowmde added a comment. I suggest two separate data types for strings that should be trimmed (which should be the norm) and "binary" strings that aren't. TASK DETAIL https://phabricator.wikimedia.org/T47925 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T47925: [Task] Apply normalization to string values in statements

Addshore added a comment. The only real option that I see working if we want to allow whitespace values in the UI is - Have a list of whitespace chars that we want to trim - If a string is made up ONLY of these whitespace chars, do not trim - If a string has these whitespace

[Wikidata-bugs] [Maniphest] T47925: [Task] Apply normalization to string values in statements

Lydia_Pintscher added a project: Wikidata-Campsite. Lydia_Pintscher added a comment. Because unfortunately there are too many to not loose track of some important ones :( TASK DETAIL https://phabricator.wikimedia.org/T47925 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T47925: [Task] Apply normalization to string values in statements

Nikki added a comment. This has been known about for SEVEN YEARS?? Why do I even bother reporting anything TASK DETAIL https://phabricator.wikimedia.org/T47925 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Nikki Cc: Nikki, Herzi.Pinki,

[Wikidata-bugs] [Maniphest] T47925: [Task] Apply normalization to string values in statements

Bugreporter merged a task: T261071: Malformed input error on text which is not malformed. Bugreporter added a subscriber: Nikki. TASK DETAIL https://phabricator.wikimedia.org/T47925 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Bugreporter Cc: