Build failed in Jenkins: POI » POI-DSL-Windows-1.8 #85

2020-12-30 Thread Apache Jenkins Server
See 


Changes:

[Andreas Beeker] workaround NullPointerException when font family (of bullets) 
can't be determined

[Andreas Beeker] workaround "Width (0) and height (0) cannot be <= 0" error 
while rendering text with textures

[Andreas Beeker] add failing regression test files
fix ooxml-lite packaging
fix PP97 dual storage file handling in extractor

[Dominik Stadler] Bug 64986: Support missing or blank match_type for function 
Match

Excel and LibreOffice use the default value in this case

[Dominik Stadler] Bug 64838: Do not populate cells with a paragraph when 
loading an existing document

[Dominik Stadler] Add unfixed test for bug 64759 and make the ones fail which 
depend on manual opening of files in Microsoft Excel for verification

[Dominik Stadler] Also replace for JUnit 5 in comments


--
[...truncated 289.53 KB...]
 [echo] Tests run: 3, Failures: 0, Aborted: 0, Skipped: 0, Time elapsed: 
0.003000 sec
 [echo] Ran 
org.apache.poi.ss.formula.functions.TestIndirectFunctionFromSpreadsheet
 [echo] Tests run: 11, Failures: 0, Aborted: 0, Skipped: 0, Time elapsed: 
0.007000 sec
 [echo] Ran org.apache.poi.ss.formula.functions.TestIntercept
 [echo] Tests run: 4, Failures: 0, Aborted: 0, Skipped: 0, Time elapsed: 
0.004000 sec
 [echo] Ran org.apache.poi.ss.formula.functions.TestIrr
 [echo] Tests run: 3, Failures: 0, Aborted: 0, Skipped: 0, Time elapsed: 
0.003000 sec
 [echo] Ran org.apache.poi.ss.formula.functions.TestIsBlank
 [echo] Tests run: 1, Failures: 0, Aborted: 0, Skipped: 0, Time elapsed: 
0.001000 sec
 [echo] Ran org.apache.poi.ss.formula.functions.TestLeftRight
 [echo] Tests run: 2, Failures: 0, Aborted: 0, Skipped: 0, Time elapsed: 
0.001000 sec
 [echo] Ran org.apache.poi.ss.formula.functions.TestLen
 [echo] Tests run: 3, Failures: 0, Aborted: 0, Skipped: 0, Time elapsed: 
0.001000 sec
 [echo] Ran org.apache.poi.ss.formula.functions.TestLogicalFunction
 [echo] Tests run: 2, Failures: 0, Aborted: 0, Skipped: 0, Time elapsed: 
0.001000 sec
 [echo] Ran 
org.apache.poi.ss.formula.functions.TestLogicalFunctionsFromSpreadsheet
 [echo] Tests run: 15, Failures: 0, Aborted: 0, Skipped: 0, Time elapsed: 
0.008000 sec
 [echo] Ran 
org.apache.poi.ss.formula.functions.TestLookupFunctionsFromSpreadsheet
 [echo] Tests run: 205, Failures: 0, Aborted: 0, Skipped: 0, Time elapsed: 
0.083000 sec
 [echo] Ran org.apache.poi.ss.formula.functions.TestMatch
 [echo] Tests run: 9, Failures: 0, Aborted: 0, Skipped: 0, Time elapsed: 
0.003000 sec
 [echo] Ran 
org.apache.poi.ss.formula.functions.TestMatchFunctionsFromSpreadsheet
 [echo] Tests run: 14, Failures: 0, Aborted: 0, Skipped: 0, Time elapsed: 
0.005000 sec
 [echo] Ran org.apache.poi.ss.formula.functions.TestMathX
 [echo] Tests run: 23, Failures: 0, Aborted: 0, Skipped: 0, Time elapsed: 
0.004000 sec
 [echo] Ran org.apache.poi.ss.formula.functions.TestMid
 [echo] Tests run: 4, Failures: 0, Aborted: 0, Skipped: 0, Time elapsed: 
0.001000 sec
 [echo] Ran org.apache.poi.ss.formula.functions.TestMirr
 [echo] Tests run: 4, Failures: 0, Aborted: 0, Skipped: 0, Time elapsed: 
0.002000 sec
 [echo] Ran 
org.apache.poi.ss.formula.functions.TestMultiOperandNumericFunction
 [echo] Tests run: 3, Failures: 0, Aborted: 0, Skipped: 0, Time elapsed: 
0.001000 sec
 [echo] Ran org.apache.poi.ss.formula.functions.TestNper
 [echo] Tests run: 2, Failures: 0, Aborted: 0, Skipped: 0, Time elapsed: 
0.00 sec
 [echo] Ran org.apache.poi.ss.formula.functions.TestNpv
 [echo] Tests run: 2, Failures: 0, Aborted: 0, Skipped: 0, Time elapsed: 
0.001000 sec
 [echo] Ran org.apache.poi.ss.formula.functions.TestOct2Dec
 [echo] Tests run: 2, Failures: 0, Aborted: 0, Skipped: 0, Time elapsed: 
0.00 sec
 [echo] Ran org.apache.poi.ss.formula.functions.TestOffset
 [echo] Tests run: 21, Failures: 0, Aborted: 0, Skipped: 0, Time elapsed: 
0.005000 sec
 [echo] Ran org.apache.poi.ss.formula.functions.TestPPMT
 [echo] Tests run: 1, Failures: 0, Aborted: 0, Skipped: 0, Time elapsed: 
0.001000 sec
 [echo] Ran org.apache.poi.ss.formula.functions.TestPmt
 [echo] Tests run: 2, Failures: 0, Aborted: 0, Skipped: 0, Time elapsed: 
0.00 sec
 [echo] Ran org.apache.poi.ss.formula.functions.TestPoisson
 [echo] Tests run: 6, Failures: 0, Aborted: 0, Skipped: 0, Time elapsed: 
0.001000 sec
 [echo] Ran org.apache.poi.ss.formula.functions.TestProduct
 [echo] Tests run: 3, Failures: 0, Aborted: 0, Skipped: 0, Time elapsed: 
0.00 sec
 [echo] Ran org.apache.poi.ss.formula.functions.TestQuotient
 [echo] Tests run: 2, Failures: 0, Aborted: 0, Skipped: 0, Time elapsed: 
0.00 sec
 [echo] Ran 
org.apache.poi.ss.formula.functions.TestQuotientFunctionsFromSpreadsheet
 [echo] 

[Bug 64633] [PATCH] Support of function TEXTJOIN

2020-12-30 Thread bugzilla
https://bz.apache.org/bugzilla/show_bug.cgi?id=64633

Dominik Stadler  changed:

   What|Removed |Added

 Blocks||60924


Referenced Bugs:

https://bz.apache.org/bugzilla/show_bug.cgi?id=60924
[Bug 60924] New Excel 2016 Statements Not Supported
-- 
You are receiving this mail because:
You are the assignee for the bug.
-
To unsubscribe, e-mail: dev-unsubscr...@poi.apache.org
For additional commands, e-mail: dev-h...@poi.apache.org



[Bug 60924] New Excel 2016 Statements Not Supported

2020-12-30 Thread bugzilla
https://bz.apache.org/bugzilla/show_bug.cgi?id=60924

Dominik Stadler  changed:

   What|Removed |Added

 Depends on||64633


Referenced Bugs:

https://bz.apache.org/bugzilla/show_bug.cgi?id=64633
[Bug 64633] [PATCH] Support of function TEXTJOIN
-- 
You are receiving this mail because:
You are the assignee for the bug.
-
To unsubscribe, e-mail: dev-unsubscr...@poi.apache.org
For additional commands, e-mail: dev-h...@poi.apache.org



[Bug 64674] the formula of cell is disabled when ExcelToHtmlConverter is used

2020-12-30 Thread bugzilla
https://bz.apache.org/bugzilla/show_bug.cgi?id=64674

Dominik Stadler  changed:

   What|Removed |Added

 Status|NEW |NEEDINFO

--- Comment #1 from Dominik Stadler  ---
Can you provide an source-example which allows to reproduce this? Preferably as
a self-contained unit-test so it can be added to the test-suite?

-- 
You are receiving this mail because:
You are the assignee for the bug.
-
To unsubscribe, e-mail: dev-unsubscr...@poi.apache.org
For additional commands, e-mail: dev-h...@poi.apache.org



[Bug 64689] WordToHtmlConverter does not support "Text Wrapping: Around" for tables

2020-12-30 Thread bugzilla
https://bz.apache.org/bugzilla/show_bug.cgi?id=64689

Dominik Stadler  changed:

   What|Removed |Added

   Severity|minor   |enhancement

-- 
You are receiving this mail because:
You are the assignee for the bug.
-
To unsubscribe, e-mail: dev-unsubscr...@poi.apache.org
For additional commands, e-mail: dev-h...@poi.apache.org



[Bug 64759] Can't clone sheet - unknown relation type found: http://schemas.microsoft.com/office/2017/10/relationships/threadedComment

2020-12-30 Thread bugzilla
https://bz.apache.org/bugzilla/show_bug.cgi?id=64759

Dominik Stadler  changed:

   What|Removed |Added

   Severity|normal  |enhancement

-- 
You are receiving this mail because:
You are the assignee for the bug.
-
To unsubscribe, e-mail: dev-unsubscr...@poi.apache.org
For additional commands, e-mail: dev-h...@poi.apache.org



[Bug 64811] autoSizeColumn too small if cell contains special characters

2020-12-30 Thread bugzilla
https://bz.apache.org/bugzilla/show_bug.cgi?id=64811

Dominik Stadler  changed:

   What|Removed |Added

 Status|NEW |NEEDINFO

--- Comment #1 from Dominik Stadler  ---
When running this locally on Linux Ubuntu 20.04, the width of the cells is
fine, so it may be related to the fonts that are installed on the system where
you run the auto-size operation (OS rendering functionality is used to draw the
actual characters of the Font of the cell). 

Please verify if default fonts and some basic X-window libraries are installed
as those might be needed for proper execution of the auto-sizing functionality.

-- 
You are receiving this mail because:
You are the assignee for the bug.
-
To unsubscribe, e-mail: dev-unsubscr...@poi.apache.org
For additional commands, e-mail: dev-h...@poi.apache.org



[Bug 64851] ctr.getTArray() returns empty array

2020-12-30 Thread bugzilla
https://bz.apache.org/bugzilla/show_bug.cgi?id=64851

Dominik Stadler  changed:

   What|Removed |Added

 Resolution|--- |INFORMATIONPROVIDED
 Status|NEW |RESOLVED

--- Comment #3 from Dominik Stadler  ---
I am not an expert on the underlying XML, but I think oyu only provide the
inner XML here, and the "w:r" is actually provided via the CTR.Factory anyway.

Anyway I don't think there is anything for Apache POI to fix, so closing this
for now.

-- 
You are receiving this mail because:
You are the assignee for the bug.
-
To unsubscribe, e-mail: dev-unsubscr...@poi.apache.org
For additional commands, e-mail: dev-h...@poi.apache.org



[Bug 64980] org.apache.poi.openxml4j.exceptions.PartAlreadyExistsException

2020-12-30 Thread bugzilla
https://bz.apache.org/bugzilla/show_bug.cgi?id=64980

Dominik Stadler  changed:

   What|Removed |Added

 Status|NEW |NEEDINFO

-- 
You are receiving this mail because:
You are the assignee for the bug.
-
To unsubscribe, e-mail: dev-unsubscr...@poi.apache.org
For additional commands, e-mail: dev-h...@poi.apache.org



[Bug 65040] Cell IFERROR don't work with other formula cells with POI

2020-12-30 Thread bugzilla
https://bz.apache.org/bugzilla/show_bug.cgi?id=65040

Dominik Stadler  changed:

   What|Removed |Added

 Status|NEW |NEEDINFO

-- 
You are receiving this mail because:
You are the assignee for the bug.
-
To unsubscribe, e-mail: dev-unsubscr...@poi.apache.org
For additional commands, e-mail: dev-h...@poi.apache.org



[Bug 64032] FormulaEvaluator executes IFERROR function bug

2020-12-30 Thread bugzilla
https://bz.apache.org/bugzilla/show_bug.cgi?id=64032

Dominik Stadler  changed:

   What|Removed |Added

 Resolution|--- |WORKSFORME
 Status|NEW |RESOLVED

--- Comment #1 from Dominik Stadler  ---
There is a method for all formula-evaluators to ignore such missing workbooks,
see BaseFormulaEvaluator#setIgnoreMissingWorkbooks().

Please try to use this method to configure how Apache POI behaves here. 

Please reopen tihs issue if this does not solve it in your case together with
more information to reproduce it, i.e. ideally a self-contained piece of code
which reproduces the situation that you encounter.

-- 
You are receiving this mail because:
You are the assignee for the bug.
-
To unsubscribe, e-mail: dev-unsubscr...@poi.apache.org
For additional commands, e-mail: dev-h...@poi.apache.org



[Bug 64986] Cannot evaluate formulas with extra comma before missing optional parameter

2020-12-30 Thread bugzilla
https://bz.apache.org/bugzilla/show_bug.cgi?id=64986

Dominik Stadler  changed:

   What|Removed |Added

 Status|NEW |RESOLVED
 Resolution|--- |FIXED

--- Comment #1 from Dominik Stadler  ---
This should be fixed via r1884959, we now handle missing or blank match_type as
default value "1".

-- 
You are receiving this mail because:
You are the assignee for the bug.
-
To unsubscribe, e-mail: dev-unsubscr...@poi.apache.org
For additional commands, e-mail: dev-h...@poi.apache.org



[Bug 64838] Loading and saving a file adds an unwanted tag resulting in additional newlines in the document

2020-12-30 Thread bugzilla
https://bz.apache.org/bugzilla/show_bug.cgi?id=64838

Dominik Stadler  changed:

   What|Removed |Added

 Resolution|--- |FIXED
 Status|NEW |RESOLVED

--- Comment #6 from Dominik Stadler  ---
I thought some more about this and decided to try to remove this behavior as it
seems unwanted and is likely a very old remnant of the early implementation
here. 

We'll see if there are cases that need this behavior and can then re-add it
under some better conditions that do not change files in such an unexpected
way.

This is done via r1884958.

-- 
You are receiving this mail because:
You are the assignee for the bug.
-
To unsubscribe, e-mail: dev-unsubscr...@poi.apache.org
For additional commands, e-mail: dev-h...@poi.apache.org



Jenkins build is back to normal : POI » POI-DSL-Windows-1.14 #25

2020-12-30 Thread Apache Jenkins Server
See 



-
To unsubscribe, e-mail: dev-unsubscr...@poi.apache.org
For additional commands, e-mail: dev-h...@poi.apache.org



Build failed in Jenkins: POI » POI-DSL-Windows-1.14 #24

2020-12-30 Thread Apache Jenkins Server
doc] 
<https://ci-builds.apache.org/job/POI/job/POI-DSL-Windows-1.14/ws/src\ooxml\java\org\apache\poi\openxml4j\opc\internal\unmarshallers\PackagePropertiesUnmarshaller.java>:231:
 error: malformed HTML
  [javadoc]  * the xsi:type attribute, except for a  or
  [javadoc] ^
  [javadoc] 
<https://ci-builds.apache.org/job/POI/job/POI-DSL-Windows-1.14/ws/src\ooxml\java\org\apache\poi\openxml4j\opc\internal\unmarshallers\PackagePropertiesUnmarshaller.java>:231:
 error: bad use of '>'
  [javadoc]  * the xsi:type attribute, except for a  or
  [javadoc] ^
  [javadoc] 
<https://ci-builds.apache.org/job/POI/job/POI-DSL-Windows-1.14/ws/src\ooxml\java\org\apache\poi\openxml4j\opc\internal\unmarshallers\PackagePropertiesUnmarshaller.java>:232:
 error: malformed HTML
  [javadoc]  *  element where the xsi:type attribute 
shall be present
  [javadoc]^
  [javadoc] 
<https://ci-builds.apache.org/job/POI/job/POI-DSL-Windows-1.14/ws/src\ooxml\java\org\apache\poi\openxml4j\opc\internal\unmarshallers\PackagePropertiesUnmarshaller.java>:232:
 error: bad use of '>'
  [javadoc]  *  element where the xsi:type attribute 
shall be present
  [javadoc] ^
  [javadoc] 
<https://ci-builds.apache.org/job/POI/job/POI-DSL-Windows-1.14/ws/src\ooxml\java\org\apache\poi\xslf\usermodel\XSLFSheet.java>:348:
 error: tag not supported in the generated HTML version: tt
  [javadoc]  * @return true if this sheet contained the specified 
element
  [javadoc]^
  [javadoc] 
<https://ci-builds.apache.org/job/POI/job/POI-DSL-Windows-1.14/ws/src\ooxml\java\org\apache\poi\xssf\eventusermodel\XSSFReader.java>:291:
 error: tag not supported in the generated HTML version: tt
  [javadoc]  * Returns true if the iteration has more elements.
  [javadoc]^
  [javadoc] 100 errors
  [javadoc] 100 warnings
  [jar] Building jar: 
<https://ci-builds.apache.org/job/POI/job/POI-DSL-Windows-1.14/ws/build\dist\maven\poi-ooxml\poi-ooxml-5.0.0-SNAPSHOT-javadoc.jar>

assemble:
  [zip] Building zip: 
<https://ci-builds.apache.org/job/POI/job/POI-DSL-Windows-1.14/ws/build\dist\poi-bin-5.0.0-SNAPSHOT-20201230.zip>
  [tar] Building tar: 
<https://ci-builds.apache.org/job/POI/job/POI-DSL-Windows-1.14/ws/build\dist\poi-bin-5.0.0-SNAPSHOT-20201230.tar.gz>
  [zip] Building zip: 
<https://ci-builds.apache.org/job/POI/job/POI-DSL-Windows-1.14/ws/build\dist\poi-src-5.0.0-SNAPSHOT-20201230.zip>
  [tar] Building tar: 
<https://ci-builds.apache.org/job/POI/job/POI-DSL-Windows-1.14/ws/build\dist\poi-src-5.0.0-SNAPSHOT-20201230.tar.gz>
 [echo] Creating Maven POMs

maven-poms:
 [copy] Copying 7 files to 
<https://ci-builds.apache.org/job/POI/job/POI-DSL-Windows-1.14/ws/build\dist\maven>
 [echo] Maven POMs are located in 
<https://ci-builds.apache.org/job/POI/job/POI-DSL-Windows-1.14/ws/build\dist>
 [echo] Use ant dist-nexus to deploy the artifacts in the remote repository
 [echo] Distribution located in 
<https://ci-builds.apache.org/job/POI/job/POI-DSL-Windows-1.14/ws/build\dist>
 [echo] Use "ant dist-checksum" to create sha256/sha512 checksums and GPG 
signatures

findbugs:
[mkdir] Created dir: 
<https://ci-builds.apache.org/job/POI/job/POI-DSL-Windows-1.14/ws/build\findbugs\lib\config>
  [get] Getting: 
https://repo1.maven.org/maven2/com/github/spotbugs/spotbugs/4.2.0/spotbugs-4.2.0.jar
  [get] To: 
<https://ci-builds.apache.org/job/POI/job/POI-DSL-Windows-1.14/ws/build\findbugs\lib\spotbugs.jar>
  [get] Getting: 
https://repo1.maven.org/maven2/com/github/spotbugs/spotbugs-ant/4.2.0/spotbugs-ant-4.2.0.jar
  [get] To: 
<https://ci-builds.apache.org/job/POI/job/POI-DSL-Windows-1.14/ws/build\findbugs\lib\spotbugs-ant.jar>
  [get] Getting: 
https://repo1.maven.org/maven2/com/github/spotbugs/spotbugs-annotations/4.2.0/spotbugs-annotations-4.2.0.jar
  [get] To: 
<https://ci-builds.apache.org/job/POI/job/POI-DSL-Windows-1.14/ws/build\findbugs\lib\spotbugs-annotations.jar>
  [get] Getting: 
https://repo1.maven.org/maven2/org/dom4j/dom4j/2.1.3/dom4j-2.1.3.jar
  [get] To: 
<https://ci-builds.apache.org/job/POI/job/POI-DSL-Windows-1.14/ws/build\findbugs\lib\dom4j-2.1.3.jar>
  [get] Getting: 
https://repo1.maven.org/maven2/jaxen/jaxen/1.2.0/jaxen-1.2.0.jar
  [get] To: 
<https://ci-builds.apache.org/job/POI/job/POI-DSL-Windows-1.14/ws/build\findbugs\lib\jaxen-1.2.0.jar>
  [get] Getting: 
https://repo1.maven.org/maven2/org/apache/bcel/bcel/6.5.0/bcel-6.5.0.jar
  [get] To: 
<https://ci-builds.apache.org/job/POI/job/POI-DSL-Windows-1.14/ws/build\findbugs\lib\bcel-6.5.0.jar>
  [get] Getting: 
https://repo1.maven.org/maven2/org/slf4j/slf4j-api/1.8.0-beta4/slf4j-api-1.8.0-b

Re: Regression Test Run for upcoming 5.0.0

2020-12-30 Thread Andreas Beeker

HI,

I've mentioned it in our private slack group *) - there's also an ant error, 
which ignores quite a few *$Factory.class-es in packing the lite jar.
I'm currently trying to figure out how I can workaround this.


Another potential approach: ...

This was my first approach class -> xsb, but it was not reliable therefore I've 
spent some time to find out (the few lines) of byte-buddy code.
So those .xsb are the ones we use in our test. if we do b) those should be 
picked up.

Andi

*) this is just a participation reminder for the rest - I'm happy to invite you 
if you tell me your asf slack id ;)

On 30.12.20 20:04, Dominik Stadler wrote:

Hi,

I'd go for b), hopefully not too many are necessary, it seems a simple test
which reads in the document triggers the necesary parts in most of the
cases.

c) would mean anybody out there with such a file would now get
regression-errors unless he switches to the full file.

Another potential approach: I don't know much about how you do all this
agent-stuff nowadays, but is there a way to match the classes to the xsb to
find those missing ones as we seem to cover the classes themselves already
as they are only included when used in tests.

Dominik.

On Wed, Dec 30, 2020 at 7:09 PM Andreas Beeker  wrote:


Hi Dominik,

thank you for running the regression test.


* Most of these are because the "lite" ooxml-schema jar is still missing
some stuff, not sure if the new way of building the lite-jar is the cause
or if we now use more parts in the regression tests

The lite jar used to contain all *.xsb files and now it will only contains
the ones used in the tests, which decreased its size by around 40%.

Should we ... ?
a) rollback the change and include all *.xsbs - the class files might be
still missing
b) provide unit tests for the failing files - we might need a few
roundtrips to fix those cases, i.e. best would be a reduced file list of
those failures
c) use the full schema for the regression tests

Andi


On 30.12.20 17:37, Dominik Stadler wrote:

Hi,

In order to get the release-preparations rolling a bit, I have finished a
first run of the "mass regression test" exercise.

As usual it brings up cases where documents fail now, but did work fine
previously, i.e. regressions that we may have introduced since the

previous

release.

I now process 3,356,984 documents (460k of those are skipped because they
are duplicates), currently there are around 3800 documents which show a
regression:
* Most of these are because the "lite" ooxml-schema jar is still missing
some stuff, not sure if the new way of building the lite-jar is the cause
or if we now use more parts in the regression tests
* some exceptions/NPEs probably related to more support for
drawing/rendering PPT(X) and so some may in fact be simply new "expected"
exceptions for broken documents
* Note: The ones with TIMEOUT or OLDFORMAT are not regressions

5.0.0 vs. 4.1.2:


http://people.apache.org/~centic/poi_regression/reports/index412RC3to500RC1.html

5.0.0 overall errors:


http://people.apache.org/~centic/poi_regression/reportsAll/index412RC3to500RC1.html

I can fairly easily re-run this as soon as we have fixes for some of the
things.

Thanks... Dominik.



-
To unsubscribe, e-mail: dev-unsubscr...@poi.apache.org
For additional commands, e-mail: dev-h...@poi.apache.org





-
To unsubscribe, e-mail: dev-unsubscr...@poi.apache.org
For additional commands, e-mail: dev-h...@poi.apache.org



Jenkins build is back to normal : POI » POI-DSL-Windows-1.8 #84

2020-12-30 Thread Apache Jenkins Server
See 



-
To unsubscribe, e-mail: dev-unsubscr...@poi.apache.org
For additional commands, e-mail: dev-h...@poi.apache.org



Re: Regression Test Run for upcoming 5.0.0

2020-12-30 Thread Dominik Stadler
Hi,

I'd go for b), hopefully not too many are necessary, it seems a simple test
which reads in the document triggers the necesary parts in most of the
cases.

c) would mean anybody out there with such a file would now get
regression-errors unless he switches to the full file.

Another potential approach: I don't know much about how you do all this
agent-stuff nowadays, but is there a way to match the classes to the xsb to
find those missing ones as we seem to cover the classes themselves already
as they are only included when used in tests.

Dominik.

On Wed, Dec 30, 2020 at 7:09 PM Andreas Beeker  wrote:

> Hi Dominik,
>
> thank you for running the regression test.
>
> > * Most of these are because the "lite" ooxml-schema jar is still missing
> > some stuff, not sure if the new way of building the lite-jar is the cause
> > or if we now use more parts in the regression tests
>
> The lite jar used to contain all *.xsb files and now it will only contains
> the ones used in the tests, which decreased its size by around 40%.
>
> Should we ... ?
> a) rollback the change and include all *.xsbs - the class files might be
> still missing
> b) provide unit tests for the failing files - we might need a few
> roundtrips to fix those cases, i.e. best would be a reduced file list of
> those failures
> c) use the full schema for the regression tests
>
> Andi
>
>
> On 30.12.20 17:37, Dominik Stadler wrote:
> > Hi,
> >
> > In order to get the release-preparations rolling a bit, I have finished a
> > first run of the "mass regression test" exercise.
> >
> > As usual it brings up cases where documents fail now, but did work fine
> > previously, i.e. regressions that we may have introduced since the
> previous
> > release.
> >
> > I now process 3,356,984 documents (460k of those are skipped because they
> > are duplicates), currently there are around 3800 documents which show a
> > regression:
> > * Most of these are because the "lite" ooxml-schema jar is still missing
> > some stuff, not sure if the new way of building the lite-jar is the cause
> > or if we now use more parts in the regression tests
> > * some exceptions/NPEs probably related to more support for
> > drawing/rendering PPT(X) and so some may in fact be simply new "expected"
> > exceptions for broken documents
> > * Note: The ones with TIMEOUT or OLDFORMAT are not regressions
> >
> > 5.0.0 vs. 4.1.2:
> >
> http://people.apache.org/~centic/poi_regression/reports/index412RC3to500RC1.html
> >
> > 5.0.0 overall errors:
> >
> http://people.apache.org/~centic/poi_regression/reportsAll/index412RC3to500RC1.html
> >
> > I can fairly easily re-run this as soon as we have fixes for some of the
> > things.
> >
> > Thanks... Dominik.
> >
>
>
> -
> To unsubscribe, e-mail: dev-unsubscr...@poi.apache.org
> For additional commands, e-mail: dev-h...@poi.apache.org
>
>


Build failed in Jenkins: POI » POI-DSL-Windows-1.14 #23

2020-12-30 Thread Apache Jenkins Server
 schema:  and  
Consumers shall
  [javadoc]^
  [javadoc] 
<https://ci-builds.apache.org/job/POI/job/POI-DSL-Windows-1.14/ws/src\ooxml\java\org\apache\poi\openxml4j\opc\internal\unmarshallers\PackagePropertiesUnmarshaller.java>:223:
 error: bad use of '>'
  [javadoc]  * the schema:  and  
Consumers shall
  [javadoc]^
  [javadoc] 
<https://ci-builds.apache.org/job/POI/job/POI-DSL-Windows-1.14/ws/src\ooxml\java\org\apache\poi\openxml4j\opc\internal\unmarshallers\PackagePropertiesUnmarshaller.java>:223:
 error: malformed HTML
  [javadoc]  * the schema:  and  
Consumers shall
  [javadoc]  ^
  [javadoc] 
<https://ci-builds.apache.org/job/POI/job/POI-DSL-Windows-1.14/ws/src\ooxml\java\org\apache\poi\openxml4j\opc\internal\unmarshallers\PackagePropertiesUnmarshaller.java>:223:
 error: bad use of '>'
  [javadoc]  * the schema:  and  
Consumers shall
  [javadoc]   ^
  [javadoc] 
<https://ci-builds.apache.org/job/POI/job/POI-DSL-Windows-1.14/ws/src\ooxml\java\org\apache\poi\openxml4j\opc\internal\unmarshallers\PackagePropertiesUnmarshaller.java>:231:
 error: malformed HTML
  [javadoc]  * the xsi:type attribute, except for a  or
  [javadoc] ^
  [javadoc] 
<https://ci-builds.apache.org/job/POI/job/POI-DSL-Windows-1.14/ws/src\ooxml\java\org\apache\poi\openxml4j\opc\internal\unmarshallers\PackagePropertiesUnmarshaller.java>:231:
 error: bad use of '>'
  [javadoc]  * the xsi:type attribute, except for a  or
  [javadoc] ^
  [javadoc] 
<https://ci-builds.apache.org/job/POI/job/POI-DSL-Windows-1.14/ws/src\ooxml\java\org\apache\poi\openxml4j\opc\internal\unmarshallers\PackagePropertiesUnmarshaller.java>:232:
 error: malformed HTML
  [javadoc]  *  element where the xsi:type attribute 
shall be present
  [javadoc]^
  [javadoc] 
<https://ci-builds.apache.org/job/POI/job/POI-DSL-Windows-1.14/ws/src\ooxml\java\org\apache\poi\openxml4j\opc\internal\unmarshallers\PackagePropertiesUnmarshaller.java>:232:
 error: bad use of '>'
  [javadoc]  *  element where the xsi:type attribute 
shall be present
  [javadoc] ^
  [javadoc] 
<https://ci-builds.apache.org/job/POI/job/POI-DSL-Windows-1.14/ws/src\ooxml\java\org\apache\poi\xslf\usermodel\XSLFSheet.java>:348:
 error: tag not supported in the generated HTML version: tt
  [javadoc]  * @return true if this sheet contained the specified 
element
  [javadoc]^
  [javadoc] 
<https://ci-builds.apache.org/job/POI/job/POI-DSL-Windows-1.14/ws/src\ooxml\java\org\apache\poi\xssf\eventusermodel\XSSFReader.java>:291:
 error: tag not supported in the generated HTML version: tt
  [javadoc]  * Returns true if the iteration has more elements.
  [javadoc]^
  [javadoc] 100 errors
  [javadoc] 100 warnings
  [jar] Building jar: 
<https://ci-builds.apache.org/job/POI/job/POI-DSL-Windows-1.14/ws/build\dist\maven\poi-ooxml\poi-ooxml-5.0.0-SNAPSHOT-javadoc.jar>

assemble:
  [zip] Building zip: 
<https://ci-builds.apache.org/job/POI/job/POI-DSL-Windows-1.14/ws/build\dist\poi-bin-5.0.0-SNAPSHOT-20201230.zip>
  [tar] Building tar: 
<https://ci-builds.apache.org/job/POI/job/POI-DSL-Windows-1.14/ws/build\dist\poi-bin-5.0.0-SNAPSHOT-20201230.tar.gz>
  [zip] Building zip: 
<https://ci-builds.apache.org/job/POI/job/POI-DSL-Windows-1.14/ws/build\dist\poi-src-5.0.0-SNAPSHOT-20201230.zip>
  [tar] Building tar: 
<https://ci-builds.apache.org/job/POI/job/POI-DSL-Windows-1.14/ws/build\dist\poi-src-5.0.0-SNAPSHOT-20201230.tar.gz>
 [echo] Creating Maven POMs

maven-poms:
 [copy] Copying 7 files to 
<https://ci-builds.apache.org/job/POI/job/POI-DSL-Windows-1.14/ws/build\dist\maven>
 [echo] Maven POMs are located in 
<https://ci-builds.apache.org/job/POI/job/POI-DSL-Windows-1.14/ws/build\dist>
 [echo] Use ant dist-nexus to deploy the artifacts in the remote repository
 [echo] Distribution located in 
<https://ci-builds.apache.org/job/POI/job/POI-DSL-Windows-1.14/ws/build\dist>
 [echo] Use "ant dist-checksum" to create sha256/sha512 checksums and GPG 
signatures

findbugs:
[mkdir] Created dir: 
<https://ci-builds.apache.org/job/POI/job/POI-DSL-Windows-1.14/ws/build\findbugs\lib\config>
  [get] Getting: 
https://repo1.maven.org/maven2/com/github/spotbugs/spotbugs/4.2.0/spotbugs-4.2.0.jar
  [get] To: 
<https://ci-builds.apache.org/job/POI/job/POI-DSL-Windows-1.14/ws/build\findbugs\lib\spotbugs.jar>
  [get] Getting: 
https://repo1.maven.org/maven2/com/github/spotbugs/spotbugs-ant/4.2.0/spotbugs-ant-4.2.0.jar
  [get] To: 
<https://ci-builds.apache.org/job/POI/job/POI-DSL-Windows-1.14/ws/build\findbugs\lib\spotbugs

Re: Regression Test Run for upcoming 5.0.0

2020-12-30 Thread Andreas Beeker

Hi Dominik,

thank you for running the regression test.


* Most of these are because the "lite" ooxml-schema jar is still missing
some stuff, not sure if the new way of building the lite-jar is the cause
or if we now use more parts in the regression tests


The lite jar used to contain all *.xsb files and now it will only contains the 
ones used in the tests, which decreased its size by around 40%.

Should we ... ?
a) rollback the change and include all *.xsbs - the class files might be still 
missing
b) provide unit tests for the failing files - we might need a few roundtrips to 
fix those cases, i.e. best would be a reduced file list of those failures
c) use the full schema for the regression tests

Andi


On 30.12.20 17:37, Dominik Stadler wrote:

Hi,

In order to get the release-preparations rolling a bit, I have finished a
first run of the "mass regression test" exercise.

As usual it brings up cases where documents fail now, but did work fine
previously, i.e. regressions that we may have introduced since the previous
release.

I now process 3,356,984 documents (460k of those are skipped because they
are duplicates), currently there are around 3800 documents which show a
regression:
* Most of these are because the "lite" ooxml-schema jar is still missing
some stuff, not sure if the new way of building the lite-jar is the cause
or if we now use more parts in the regression tests
* some exceptions/NPEs probably related to more support for
drawing/rendering PPT(X) and so some may in fact be simply new "expected"
exceptions for broken documents
* Note: The ones with TIMEOUT or OLDFORMAT are not regressions

5.0.0 vs. 4.1.2:
http://people.apache.org/~centic/poi_regression/reports/index412RC3to500RC1.html

5.0.0 overall errors:
http://people.apache.org/~centic/poi_regression/reportsAll/index412RC3to500RC1.html

I can fairly easily re-run this as soon as we have fixes for some of the
things.

Thanks... Dominik.




-
To unsubscribe, e-mail: dev-unsubscr...@poi.apache.org
For additional commands, e-mail: dev-h...@poi.apache.org



[Bug 64980] org.apache.poi.openxml4j.exceptions.PartAlreadyExistsException

2020-12-30 Thread bugzilla
https://bz.apache.org/bugzilla/show_bug.cgi?id=64980

--- Comment #2 from Dominik Stadler  ---
The main [Content_Types.xml] in the .xlsx is not according to the spec in the
broken file, it does not link to the shared-strings xml file as required.

Unfortunately both LibreOffice and Excel are "lenient" for many such cases and
thus makes it actually harder for everyone else ...

-- 
You are receiving this mail because:
You are the assignee for the bug.
-
To unsubscribe, e-mail: dev-unsubscr...@poi.apache.org
For additional commands, e-mail: dev-h...@poi.apache.org



Jenkins build is back to normal : POI » POI-DSL-SonarQube-Gradle #103

2020-12-30 Thread Apache Jenkins Server
See 



-
To unsubscribe, e-mail: dev-unsubscr...@poi.apache.org
For additional commands, e-mail: dev-h...@poi.apache.org



[Bug 65042] Adding pictures to workbook causes memory leak

2020-12-30 Thread bugzilla
https://bz.apache.org/bugzilla/show_bug.cgi?id=65042

Dominik Stadler  changed:

   What|Removed |Added

 Status|NEW |NEEDINFO

--- Comment #2 from Dominik Stadler  ---
Can you provide a small piece of code which reproduces the problem for you?
Ideally as a self-contained unit-test so we can reproduce the problem and take
a closer look?

-- 
You are receiving this mail because:
You are the assignee for the bug.
-
To unsubscribe, e-mail: dev-unsubscr...@poi.apache.org
For additional commands, e-mail: dev-h...@poi.apache.org



[Bug 65042] Adding pictures to workbook causes memory leak

2020-12-30 Thread bugzilla
https://bz.apache.org/bugzilla/show_bug.cgi?id=65042

Dominik Stadler  changed:

   What|Removed |Added

Summary|Writing pircture to |Adding pictures to workbook
   |workbook cause memory leak  |causes memory leak
   |due to picture data is to   |
   |much in memory. |

-- 
You are receiving this mail because:
You are the assignee for the bug.
-
To unsubscribe, e-mail: dev-unsubscr...@poi.apache.org
For additional commands, e-mail: dev-h...@poi.apache.org



[Bug 64959] [PATCH] PackagePart#flush is unused

2020-12-30 Thread bugzilla
https://bz.apache.org/bugzilla/show_bug.cgi?id=64959

Dominik Stadler  changed:

   What|Removed |Added

 Status|NEW |NEEDINFO

-- 
You are receiving this mail because:
You are the assignee for the bug.
-
To unsubscribe, e-mail: dev-unsubscr...@poi.apache.org
For additional commands, e-mail: dev-h...@poi.apache.org



[Bug 64959] [PATCH] PackagePart#flush is unused

2020-12-30 Thread bugzilla
https://bz.apache.org/bugzilla/show_bug.cgi?id=64959

Dominik Stadler  changed:

   What|Removed |Added

Summary|PackagePart#flush is unused |[PATCH] PackagePart#flush
   ||is unused

-- 
You are receiving this mail because:
You are the assignee for the bug.
-
To unsubscribe, e-mail: dev-unsubscr...@poi.apache.org
For additional commands, e-mail: dev-h...@poi.apache.org



[Bug 64950] about doughnutchart

2020-12-30 Thread bugzilla
https://bz.apache.org/bugzilla/show_bug.cgi?id=64950

Dominik Stadler  changed:

   What|Removed |Added

 Status|NEW |NEEDINFO

-- 
You are receiving this mail because:
You are the assignee for the bug.
-
To unsubscribe, e-mail: dev-unsubscr...@poi.apache.org
For additional commands, e-mail: dev-h...@poi.apache.org



[Bug 64980] org.apache.poi.openxml4j.exceptions.PartAlreadyExistsException

2020-12-30 Thread bugzilla
https://bz.apache.org/bugzilla/show_bug.cgi?id=64980

Dominik Stadler  changed:

   What|Removed |Added

 OS||All

-- 
You are receiving this mail because:
You are the assignee for the bug.
-
To unsubscribe, e-mail: dev-unsubscr...@poi.apache.org
For additional commands, e-mail: dev-h...@poi.apache.org



[Bug 64986] Cannot evaluate formulas with extra comma before missing optional parameter

2020-12-30 Thread bugzilla
https://bz.apache.org/bugzilla/show_bug.cgi?id=64986

Dominik Stadler  changed:

   What|Removed |Added

 OS||All

-- 
You are receiving this mail because:
You are the assignee for the bug.
-
To unsubscribe, e-mail: dev-unsubscr...@poi.apache.org
For additional commands, e-mail: dev-h...@poi.apache.org



[Bug 65042] Writing pircture to workbook cause memory leak due to picture data is to much in memory.

2020-12-30 Thread bugzilla
https://bz.apache.org/bugzilla/show_bug.cgi?id=65042

Dominik Stadler  changed:

   What|Removed |Added

   Severity|blocker |major

-- 
You are receiving this mail because:
You are the assignee for the bug.
-
To unsubscribe, e-mail: dev-unsubscr...@poi.apache.org
For additional commands, e-mail: dev-h...@poi.apache.org



[GitHub] [poi] centic9 commented on pull request #211: #65009 Fix HSLFPictureData indices during presentation load

2020-12-30 Thread GitBox


centic9 commented on pull request #211:
URL: https://github.com/apache/poi/pull/211#issuecomment-752691804


   Applied via r1884948 in a slightly different way to use the same approach 
across two similar code-places.



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: dev-unsubscr...@poi.apache.org
For additional commands, e-mail: dev-h...@poi.apache.org



[Bug 65009] When loading a PPT, PictureData indices are 0-based

2020-12-30 Thread bugzilla
https://bz.apache.org/bugzilla/show_bug.cgi?id=65009

Dominik Stadler  changed:

   What|Removed |Added

 Resolution|--- |FIXED
 Status|NEW |RESOLVED

--- Comment #2 from Dominik Stadler  ---
Applied via r1884948 in a slightly different way to use the same approach
across two similar code-places.

-- 
You are receiving this mail because:
You are the assignee for the bug.
-
To unsubscribe, e-mail: dev-unsubscr...@poi.apache.org
For additional commands, e-mail: dev-h...@poi.apache.org



[GitHub] [poi] asfgit closed pull request #211: #65009 Fix HSLFPictureData indices during presentation load

2020-12-30 Thread GitBox


asfgit closed pull request #211:
URL: https://github.com/apache/poi/pull/211


   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: dev-unsubscr...@poi.apache.org
For additional commands, e-mail: dev-h...@poi.apache.org



Regression Test Run for upcoming 5.0.0

2020-12-30 Thread Dominik Stadler
Hi,

In order to get the release-preparations rolling a bit, I have finished a
first run of the "mass regression test" exercise.

As usual it brings up cases where documents fail now, but did work fine
previously, i.e. regressions that we may have introduced since the previous
release.

I now process 3,356,984 documents (460k of those are skipped because they
are duplicates), currently there are around 3800 documents which show a
regression:
* Most of these are because the "lite" ooxml-schema jar is still missing
some stuff, not sure if the new way of building the lite-jar is the cause
or if we now use more parts in the regression tests
* some exceptions/NPEs probably related to more support for
drawing/rendering PPT(X) and so some may in fact be simply new "expected"
exceptions for broken documents
* Note: The ones with TIMEOUT or OLDFORMAT are not regressions

5.0.0 vs. 4.1.2:
http://people.apache.org/~centic/poi_regression/reports/index412RC3to500RC1.html

5.0.0 overall errors:
http://people.apache.org/~centic/poi_regression/reportsAll/index412RC3to500RC1.html

I can fairly easily re-run this as soon as we have fixes for some of the
things.

Thanks... Dominik.