subject:"Re\: Packaging Netbeans 9 on Gentoo"

On Sun, 26 Nov 2017 18:11:45 -0500
"William L. Thomson Jr."  wrote:

> On Sun, 26 Nov 2017 17:18:15 -0500
> "William L. Thomson Jr."  wrote:
> 
> > On Sun, 26 Nov 2017 14:11:18 -0500
> > "William L. Thomson Jr."  wrote:
> >  
> > > There is also a StaticProcessor but seems only used by 1 class for
> > > icons. Also a LayerProcessor, which I assume generates layer info
> > > in manifest.mf. There were not many others. The others are in odd
> > > packages that are further down the dependency chain if not
> > > optional packages. 
> > 
> > Working with more processors, this is like the error I got from
> > StaticResourceProcessor.
> > 
> > This is from ActionProcessor
> > 
> > src/org/netbeans/core/windows/design/DesignView.java:130: error:
> > Cannot find resource org/netbeans/core/windows/design/DesignView.png
> > @ActionRegistration(iconBase =
> > "org/netbeans/core/windows/design/DesignView.png",  
> 
> Turns out I added the folder to classpath incorrectly. When I got that
> right it found the file. But then I got a new error...
> 
> src/org/netbeans/core/windows/actions/ResetWindowsAction.java:60:
> error: Cannot find resource
> org/netbeans/core/windows/actions/Bundle.properties public static
> ActionListener reset() {
>   ^
> 
> Not sure why pointing to reset. Seems the issue is it cannot find the
> Bundles.properties resource. Which only happens when using the
> ActionProcessor. Otherwise it is found. The path that fixes the icon
> for ActionProcessor seems to not help for this, despite the
> Bundle.properties being there.
> 
> Playing with paths now.
> https://github.com/Obsidian-StudiosInc/os-xtoo/blob/master/eclass/java-netbeans.eclass#L126

These annotation processors are a real nightmare. I am not sure why
people insist on using them. They have some very strange issues with
path resolution. I got it to build once. I did not save the path I
used. I went to slim it down and now I cannot get it to build again. I
really cannot believe how stupid this regarding finding files. When I
am passing absolute paths to the classpath.

Seems it has gone on for years like this
https://duckduckgo.com/?q=java+processor+"error%3A+Cannot+find+resource;

This one is crazy, changes with different JDK versions
https://forums.netbeans.org/post-132249.html
https://forums.netbeans.org/post-122635.html

Jersey relies heavily on annotation processing and does not have this
sort of madness to build or run. Really need to revisit this stuff in
Netbeans. There is no reason to cause problems like this for so many.

I have generated Java code using a whole variety of things. I have
never seen anything so problematic on trivial things like paths to
files or resources

Super frustrating Wasting tons of time on trial and error on very
small things. I can package hundreds of things then get stuck on stupid
issues like this. Which makes me think its a horribly engineered
concept that should not be used.

At the moment via absolute paths I am passing the root directory, src
directory and src/org, Its not finding it in any of those absolute
paths... Soon as I drop ActionProcessor. It is found and the Action
stuff just isn't processed. Why processors mess with others paths. Also
makes no sense.

I myself will avoid annotation processors in my own code like the plague

-- 
William L. Thomson Jr.

pgptgxLwD3imq.pgp
Description: OpenPGP digital signature

Re: Packaging Netbeans 9 on Gentoo

On Sun, 26 Nov 2017 17:18:15 -0500
"William L. Thomson Jr."  wrote:

> On Sun, 26 Nov 2017 14:11:18 -0500
> "William L. Thomson Jr."  wrote:
>
> > There is also a StaticProcessor but seems only used by 1 class for
> > icons. Also a LayerProcessor, which I assume generates layer info in
> > manifest.mf. There were not many others. The others are in odd
> > packages that are further down the dependency chain if not optional
> > packages.   
> 
> Working with more processors, this is like the error I got from
> StaticResourceProcessor.
> 
> This is from ActionProcessor
> 
> src/org/netbeans/core/windows/design/DesignView.java:130: error:
> Cannot find resource org/netbeans/core/windows/design/DesignView.png
> @ActionRegistration(iconBase =
> "org/netbeans/core/windows/design/DesignView.png",

Turns out I added the folder to classpath incorrectly. When I got that
right it found the file. But then I got a new error...

src/org/netbeans/core/windows/actions/ResetWindowsAction.java:60:
error: Cannot find resource
org/netbeans/core/windows/actions/Bundle.properties public static
ActionListener reset() {
  ^

Not sure why pointing to reset. Seems the issue is it cannot find the
Bundles.properties resource. Which only happens when using the
ActionProcessor. Otherwise it is found. The path that fixes the icon
for ActionProcessor seems to not help for this, despite the
Bundle.properties being there.

Playing with paths now.
https://github.com/Obsidian-StudiosInc/os-xtoo/blob/master/eclass/java-netbeans.eclass#L126

-- 
William L. Thomson Jr.

pgpRR4HJ9BsDJ.pgp
Description: OpenPGP digital signature

Re: Packaging Netbeans 9 on Gentoo

On Sun, 26 Nov 2017 17:41:20 -0500
Emilian Bold  wrote:

> It's not moot how they are generated. If you copy-paste by hand then
> will get out of sync when the NetBeans sources change.

Why do some sources have them in the first place then? Seems they
should be generated always. I guess needed for some bootstrapping or
something like that. Or default values if generation fails. Just odd
to see some generated, and some in sources. I would think it would be
all one way or another.

> Instead of manually editing .ebuild files you might as well just copy
> the whole static META-INF/ including subfolders.

I am doing that but seems most if not all projects have manifest.mf in
the root folder not in META-INF.
https://github.com/Obsidian-StudiosInc/os-xtoo/blob/master/eclass/java-netbeans.eclass#L63

> The point being that even if you don't use ant you have to get those
> annotation processors right.

Yes I am working on that now.
https://github.com/Obsidian-StudiosInc/os-xtoo/blob/master/eclass/java-netbeans.eclass#L97

-- 
William L. Thomson Jr.

pgp9bcobysGPc.pgp
Description: OpenPGP digital signature

Re: Packaging Netbeans 9 on Gentoo

2017-11-26 Thread Emilian Bold

It's not moot how they are generated. If you copy-paste by hand then will get 
out of sync when the NetBeans sources change.

Instead of manually editing .ebuild files you might as well just copy the whole 
static META-INF/ including subfolders.

The point being that even if you don't use ant you have to get those annotation 
processors right.

--emi

> Original Message 
>Subject: Re: Packaging Netbeans 9 on Gentoo
>Local Time: November 26, 2017 9:14 PM
>UTC Time: November 26, 2017 7:14 PM
>From: wlt...@o-sinc.com
>To: dev@netbeans.incubator.apache.org
>
>On Sun, 26 Nov 2017 14:11:18 -0500
> "William L. Thomson Jr." wlt...@o-sinc.com wrote:
>>>There are many processors, see ServiceProviderProcessor for
>>> @ServiceProvider annotations then we have annotations for actions,
>>> etc.
>>>I grepped for AbstractProcessor usage. I only found a couple. I added
>> the ServiceProccesors to core.startup. It only generated services but
>> not named services despite having that processor. So I just generate
>> the others manually via echo. Using the contents from what was in the
>> ones from 8.2.
>>https://github.com/Obsidian-StudiosInc/os-xtoo/blob/master/dev-java/netbeans-core-startup/netbeans-core-startup-.ebuild#L27
>>
>> Before processor I was creating those files by hand. I see others
>> already have them in src/META-INF. Not sure if those need be
>> re-generated or used as is in sources.
>>https://github.com/Obsidian-StudiosInc/os-xtoo/commit/7df638bb8df6ef4ab06ed2eaab5278a94abb6a38#diff-cb1024e8ec8f26e74fb46039237652b6
>>
>> How they are created seems moot. Not sure contents change based on
>> compile, so that makes it even more moot to be generated vs static in
>> some form.
>>
>> --
>> William L. Thomson Jr.

Re: Packaging Netbeans 9 on Gentoo

On Sun, 26 Nov 2017 14:11:18 -0500
"William L. Thomson Jr."  wrote:
>
> > There are many processors, see ServiceProviderProcessor for
> > @ServiceProvider annotations then we have annotations for actions,
> > etc.  
> 
> I grepped for AbstractProcessor usage. I only found a couple. I added
> the ServiceProccesors to core.startup. It only generated services but
> not named services despite having that processor. So I just generate
> the others manually via echo. Using the contents from what was in the
> ones from 8.2.
> https://github.com/Obsidian-StudiosInc/os-xtoo/blob/master/dev-java/netbeans-core-startup/netbeans-core-startup-.ebuild#L27
> 
> There is also a StaticProcessor but seems only used by 1 class for
> icons. Also a LayerProcessor, which I assume generates layer info in
> manifest.mf. There were not many others. The others are in odd
> packages that are further down the dependency chain if not optional
> packages. 

Working with more processors, this is like the error I got from
StaticResourceProcessor.

This is from ActionProcessor

src/org/netbeans/core/windows/design/DesignView.java:130: error: Cannot
find resource org/netbeans/core/windows/design/DesignView.png
@ActionRegistration(iconBase =
"org/netbeans/core/windows/design/DesignView.png",

It makes no sense as the file DesignView.png is literally in the same
folder as DesignView.java and the next file in order. I tried adding
the folder to the classpath and no luck. I ended up removing usage of
StaticResourceProcessor which was likely not correct but just in
quicksearch. There is likely more ActionRegistrations I rather not
remove and further break things down the road at runtime.

-- 
William L. Thomson Jr.


pgpdcooC813zE.pgp
Description: OpenPGP digital signature

Re: Packaging Netbeans 9 on Gentoo

On Sun, 26 Nov 2017 14:11:18 -0500
"William L. Thomson Jr."  wrote:
>
> 9.0_alpha_rc2-os-xtoo] org.netbeans.api.progress.nb [1.48
> 9.0_alpha_rc2-os-xtoo] org.netbeans.api.progress [1.48
> 9.0_alpha_rc2-os-xtoo] org.netbeans.api.java [1.66
> 9.0_alpha_rc2-os-xtoo] org.netbeans.api.io [1.4
> 9.0_alpha_rc2-os-xtoo] org.netbeans.api.intent [1.3
> 9.0_alpha_rc2-os-xtoo] org.netbeans.api.annotations.common [1.28
> 9.0_alpha_rc2-os-xtoo] SEVERE [global] java.lang.NullPointerException
> at
> java.base/java.io.FilterOutputStream.write(FilterOutputStream.java:103)
> at
> org.netbeans.core.startup.layers.LayerCacheManager$1Updater.flushCaches(LayerCacheManager.java:123)
> at org.netbeans.Stamps$Store.store(Stamps.java:708) [catch] at
> org.netbeans.Stamps$Worker.run(Stamps.java:876)

Forgot to mention, at this point Netbeans Platform seems to be running.
There is a java process. But no Window/UI. But seems it is running till
I hit ctrl-c. So I am pretty close to something. What I have no idea :)

-- 
William L. Thomson Jr.


pgpah509VajDZ.pgp
Description: OpenPGP digital signature

Re: Packaging Netbeans 9 on Gentoo

On Sun, 26 Nov 2017 14:11:18 -0500
"William L. Thomson Jr."  wrote:
>
> 
> > There are many processors, see ServiceProviderProcessor for
> > @ServiceProvider annotations then we have annotations for actions,
> > etc.  
> 
> I grepped for AbstractProcessor usage. I only found a couple. I added
> the ServiceProccesors to core.startup. It only generated services but
> not named services despite having that processor. So I just generate
> the others manually via echo. Using the contents from what was in the
> ones from 8.2.
> https://github.com/Obsidian-StudiosInc/os-xtoo/blob/master/dev-java/netbeans-core-startup/netbeans-core-startup-.ebuild#L27

Before processor I was creating those files by hand. I see others
already have them in src/META-INF. Not sure if those need be
re-generated or used as is in sources.
https://github.com/Obsidian-StudiosInc/os-xtoo/commit/7df638bb8df6ef4ab06ed2eaab5278a94abb6a38#diff-cb1024e8ec8f26e74fb46039237652b6

How they are created seems moot. Not sure contents change based on
compile, so that makes it even more moot to be generated vs static in
some form.

-- 
William L. Thomson Jr.

pgp33498f87XI.pgp
Description: OpenPGP digital signature

Re: Packaging Netbeans 9 on Gentoo

Latest road block, maybe a missing java module not sure.

org.xml.sax.SAXException: java.net.MalformedURLException: unknown
protocol: nbres
at 
org.netbeans.core.startup.layers.ParsingLayerCacheManager.startElement(ParsingLayerCacheManager.java:210)
at 
java.xml/com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.startElement(AbstractSAXParser.java:509)
at 
java.xml/com.sun.org.apache.xerces.internal.impl.dtd.XMLDTDValidator.startElement(XMLDTDValidator.java:746)
at java.xml/com.sun.org.apache.xerc

I have in jar like 8.2 jars that work
META-INF/namedservices/URLStreamHandler/nbresloc/java.net.URLStreamHandler
META-INF/namedservices/URLStreamHandler/nbres/java.net.URLStreamHandler

Seems its not handling the 2nd one though given the exception. Must be
doing something wrong there.

On Sun, 26 Nov 2017 04:59:07 -0500
Emilian Bold  wrote:

> You should compare your output JAR with the NetBeans output JAR and
> see which files you are missing. Most of them will be from annotation
> processors.

That is what I am doing. How I discovered I was missing those files.
Though most seem to have what upstream ones do. Still more to compare.
I have a working 8.2 install and I grabbed a zip of 8.2. I have been
removing jars from the zip to try to break it. I have platform down to
all the same jars I have. So it must be down to contents and manifests.

> There are many processors, see ServiceProviderProcessor for
> @ServiceProvider annotations then we have annotations for actions,
> etc.

I grepped for AbstractProcessor usage. I only found a couple. I added
the ServiceProccesors to core.startup. It only generated services but
not named services despite having that processor. So I just generate
the others manually via echo. Using the contents from what was in the
ones from 8.2.
https://github.com/Obsidian-StudiosInc/os-xtoo/blob/master/dev-java/netbeans-core-startup/netbeans-core-startup-.ebuild#L27

There is also a StaticProcessor but seems only used by 1 class for
icons. Also a LayerProcessor, which I assume generates layer info in
manifest.mf. There were not many others. The others are in odd packages
that are further down the dependency chain if not optional packages.

> We have various 3rd party dependencies in NetBeans references in
> the /external/ folder (eg. libs.asm/external/asm-all-5.0.1.jar). Some
> of those dependencies we use as-is. Some we also *patch*. Your build
> system should take these into account.

I haven't come across that stuff yet. But thanks for the heads up. I
will keep that in mind. Worse case I can see about packaging that,
applying those packages to already packaged stuff via USE flag for
netbeans or other.

I am getting closer though. Having problems with it finding and loading
modules from module directory. For now i just toss them all in library
folder for now. Just to get it running and then I will address other
issues.

Numerous warnings like the following 2 I removed and classpath from
the following startup output

WARNING [org.netbeans.core.modules]: module
org.netbeans.api.annotations.common does not declare
OpenIDE-Module-Public-Packages in its manifest, so all packages are
considered public by default:
http://bits.netbeans.org/dev/javadoc/org-openide-modules/org/openide/modules/doc-files/api.html#how-vers

WARNING [org.netbeans.core.startup.ModuleList]: Note - failed to parse
MultiFileObject@c647c11[Modules/org-openide-explorer.xml] the quick
way, falling back on XMLReader

---
>Log Session: Sunday, November 26, 2017 at 2:04:54 PM Eastern Standard Time
>System Info:
  Product Version = NetBeans Platform 8.2 (Build 9.0_alpha_rc2-os-xtoo)
  Operating System= Linux version 4.13.11-gentoo running on amd64
  Java; VM; Vendor= 9.0.1; Java HotSpot(TM) 64-Bit Server VM 9.0.1+11; 
Oracle Corporation
  Runtime = Java(TM) SE Runtime Environment 9.0.1+11
  Java Home   = /opt/oracle-jdk-bin-9.0.1
  System Locale; Encoding = en_US (nb); UTF-8
  Home Directory  = /home/wlt
  Current Directory   = /home/wlt/.netbeans
  User Directory  = /home/wlt/.netbeans/dev
  Cache Directory = /home/wlt/.cache/netbeans/dev
  Installation= /usr/share/netbeans-9
  Boot & Ext. Classpath   =
  Application Classpath   = 
  Startup Classpath   =
---
org.xml.sax.SAXException: java.net.MalformedURLException: unknown protocol: 
nbres
at 
org.netbeans.core.startup.layers.ParsingLayerCacheManager.startElement(ParsingLayerCacheManager.java:210)
at 
java.xml/com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.startElement(AbstractSAXParser.java:509)
at 
java.xml/com.sun.org.apache.xerces.internal.impl.dtd.XMLDTDValidator.startElement(XMLDTDValidator.java:746)

Re: Packaging Netbeans 9 on Gentoo

2017-11-26 Thread Antonio




El 26/11/17 a las 10:33, William L. Thomson Jr. escribió:



But before digging into that, how are you going to build the patched
external binaries NetBeans requires to run? Have you given a thought
to that?


Which ones do you mean? Worse case I can package those as well.



Some NetBeans modules use external binaries that live in each the 
module's "external" directory. From there they're renamed attending to 
nbproject/project.* rules into some other directories.


Some of those binaries are patched to solve bugs, or fit NetBeans 
requirements, or to provide functionality that is not included in 
NetBeans nor the JDK (spawning system processes, for instance).


Cheers,
Antonio

Re: Packaging Netbeans 9 on Gentoo

2017-11-26 Thread Emilian Bold

You should compare your output JAR with the NetBeans output JAR and see which 
files you are missing. Most of them will be from annotation processors.

There are many processors, see ServiceProviderProcessor for @ServiceProvider 
annotations then we have annotations for actions, etc.

We have various 3rd party dependencies in NetBeans references in the /external/ 
folder (eg. libs.asm/external/asm-all-5.0.1.jar). Some of those dependencies we 
use as-is. Some we also *patch*. Your build system should take these into 
account.

--emi


> Original Message 
>Subject: Re: Packaging Netbeans 9 on Gentoo
>Local Time: November 26, 2017 11:33 AM
>UTC Time: November 26, 2017 9:33 AM
>From: wlt...@o-sinc.com
>To: dev@netbeans.incubator.apache.org
>
>On Sun, 26 Nov 2017 07:33:35 +0100
> Antonio anto...@vieiro.net wrote:
>>That's because you're not running the annotation processors.
>>
>> I am using NbBundleProcessor. Is there another? I can look. The static
>> one used in 1 place for 2 icons I bypassed. It was having problems
>> finding the icons in its own sources.
>>
>> But before digging into that, how are you going to build the patched
>> external binaries NetBeans requires to run? Have you given a thought
>> to that?
>>
>> Which ones do you mean? Worse case I can package those as well.
>>
>> Cheers,
>> Antonio
>>El 26/11/17 a las 02:28, William L. Thomson Jr. escribió:
>>>On Sat, 25 Nov 2017 12:29:30 -0500
>>> "William L. Thomson Jr." wlt...@o-sinc.com wrote:
>>>>Presently stuck at
>>>>java.lang.AssertionError: Has to be NbRepository:
>>>> org.openide.filesystems.Repository@3ab8ef5a
>>>> at org.netbeans.core.startup.Main.start(Main.java:281)
>>>> at
>>>> org.netbeans.core.startup.TopThreadGroup.run(TopThreadGroup.java:98)
>>>> at java.base/java.lang.Thread.run(Thread.java:844)
>>>>Finally made it past that error. I grabbed missing stuff from 8.2.
>>>It turns out I was missing stuff from core.startup. I do not have
>>> any service files for some reason. These files
>>>$ ls META-INF/
>>> MANIFEST.MF namedservices ervices
>>>$ ls services/
>>> org.netbeans.CLIHandler
>>> 'org.netbeans.core.startup.base.LayerFactory$Provider'
>>> org.openide.filesystems.Repository
>>> org.openide.LifecycleManager
>>> org.openide.modules.InstalledFileLocator
>>> org.openide.modules.Places
>>> org.openide.util.NbPreferences$Provider
>>>I am not finding those in the sources. Not sure what generates
>>> those, but seems I do need them. That is causing the main startup
>>> issues. Though I still have some others to resolve.
>>
>
>William L. Thomson Jr.
>

Re: Packaging Netbeans 9 on Gentoo

On Sun, 26 Nov 2017 07:33:35 +0100
Antonio  wrote:

> That's because you're not running the annotation processors.

I am using NbBundleProcessor. Is there another? I can look. The static
one used in 1 place for 2 icons I bypassed. It was having problems
finding the icons in its own sources.

> But before digging into that, how are you going to build the patched 
> external binaries NetBeans requires to run? Have you given a thought
> to that?

Which ones do you mean? Worse case I can package those as well.

> Cheers,
> Antonio
> 
> El 26/11/17 a las 02:28, William L. Thomson Jr. escribió:
> > On Sat, 25 Nov 2017 12:29:30 -0500
> > "William L. Thomson Jr."  wrote:  
> >>
> >> Presently stuck at
> >>
> >> java.lang.AssertionError: Has to be NbRepository:
> >> org.openide.filesystems.Repository@3ab8ef5a
> >>  at org.netbeans.core.startup.Main.start(Main.java:281)
> >>  at
> >> org.netbeans.core.startup.TopThreadGroup.run(TopThreadGroup.java:98)
> >>  at java.base/java.lang.Thread.run(Thread.java:844)  
> > 
> > Finally made it past that error. I grabbed missing stuff from 8.2.
> > 
> >   It turns out I was missing stuff from core.startup. I do not have
> > any service files for some reason. These files
> > 
> > $ ls META-INF/
> > MANIFEST.MF namedservices ervices
> > 
> > $ ls services/
> >   org.netbeans.CLIHandler
> >   'org.netbeans.core.startup.base.LayerFactory$Provider'
> > org.openide.filesystems.Repository
> > org.openide.LifecycleManager
> > org.openide.modules.InstalledFileLocator
> > org.openide.modules.Places
> > org.openide.util.NbPreferences$Provider
> > 
> > I am not finding those in the sources. Not sure what generates
> > those, but seems I do need them. That is causing the main startup
> > issues. Though I still have some others to resolve.
> >   



-- 
William L. Thomson Jr.


pgpsfPpBdAf5d.pgp
Description: OpenPGP digital signature

Re: Packaging Netbeans 9 on Gentoo


That's because you're not running the annotation processors.

But before digging into that, how are you going to build the patched 
external binaries NetBeans requires to run? Have you given a thought to 
that?


Cheers,
Antonio

El 26/11/17 a las 02:28, William L. Thomson Jr. escribió:

On Sat, 25 Nov 2017 12:29:30 -0500
"William L. Thomson Jr."  wrote:


Presently stuck at

java.lang.AssertionError: Has to be NbRepository:
org.openide.filesystems.Repository@3ab8ef5a
 at org.netbeans.core.startup.Main.start(Main.java:281)
 at
org.netbeans.core.startup.TopThreadGroup.run(TopThreadGroup.java:98)
 at java.base/java.lang.Thread.run(Thread.java:844)


Finally made it past that error. I grabbed missing stuff from 8.2.

  It turns out I was missing stuff from core.startup. I do not have any
  service files for some reason. These files

$ ls META-INF/
MANIFEST.MF namedservices ervices

$ ls services/
  org.netbeans.CLIHandler
  'org.netbeans.core.startup.base.LayerFactory$Provider'
org.openide.filesystems.Repository
org.openide.LifecycleManager
org.openide.modules.InstalledFileLocator
org.openide.modules.Places
org.openide.util.NbPreferences$Provider

I am not finding those in the sources. Not sure what generates those,
but seems I do need them. That is causing the main startup issues.
Though I still have some others to resolve.

Re: Packaging Netbeans 9 on Gentoo

On Sat, 25 Nov 2017 12:29:30 -0500
"William L. Thomson Jr."  wrote:
>
> Presently stuck at
> 
> java.lang.AssertionError: Has to be NbRepository:
> org.openide.filesystems.Repository@3ab8ef5a
> at org.netbeans.core.startup.Main.start(Main.java:281)
> at
> org.netbeans.core.startup.TopThreadGroup.run(TopThreadGroup.java:98)
> at java.base/java.lang.Thread.run(Thread.java:844)

Finally made it past that error. I grabbed missing stuff from 8.2.

 It turns out I was missing stuff from core.startup. I do not have any
 service files for some reason. These files

$ ls META-INF/
MANIFEST.MF namedservices ervices

$ ls services/
 org.netbeans.CLIHandler
 'org.netbeans.core.startup.base.LayerFactory$Provider' 
org.openide.filesystems.Repository
org.openide.LifecycleManager
org.openide.modules.InstalledFileLocator
org.openide.modules.Places 
org.openide.util.NbPreferences$Provider

I am not finding those in the sources. Not sure what generates those,
but seems I do need them. That is causing the main startup issues.
Though I still have some others to resolve.

-- 
William L. Thomson Jr.

pgpHJqdXx3JRm.pgp
Description: OpenPGP digital signature

Re: Packaging Netbeans 9 on Gentoo


Upload one or more resulting jars, for we to review.

Our pleasure helping out! :-)

El 25/11/17 a las 22:39, William L. Thomson Jr. escribió:

On Sat, 25 Nov 2017 22:33:17 +0100
Antonio  wrote:


Hi,

Please upload the result somewhere so we can take a look by tomorrow.


Upload what? My repo changes or the actual jars produced? I can push
out changes. I can send link to live jars on my system. Either way.

Thanks for the assistance and feedback. Much appreciated!

Re: Packaging Netbeans 9 on Gentoo

On Sat, 25 Nov 2017 16:48:59 -0500
"William L. Thomson Jr."  wrote:

> I was missing openide.filesystems.compat8
> 
> With that I get new errors, proress!!!

False alarm... That just caused an exception with asm missing. Once I
added that, back to error... g :(

java.lang.AssertionError: Has to be NbRepository:
org.openide.filesystems.Repository@47af979c at
org.netbeans.core.startup.Main.start(Main.java:281) at
org.netbeans.core.startup.TopThreadGroup.run(TopThreadGroup.java:98) at
java.base/java.lang.Thread.run(Thread.java:844)

Guess I will keep packaging and trying stuff out. I may drop the value
I add to manifest.mf and see if that makes a difference or not.

-- 
William L. Thomson Jr.

pgpVon96KDclh.pgp
Description: OpenPGP digital signature

Re: Packaging Netbeans 9 on Gentoo

I was missing openide.filesystems.compat8

With that I get new errors, proress!!!

On Sat, 25 Nov 2017 12:29:30 -0500
"William L. Thomson Jr."  wrote:
>
> Presently stuck at
> 
> java.lang.AssertionError: Has to be NbRepository:
> org.openide.filesystems.Repository@3ab8ef5a
> at org.netbeans.core.startup.Main.start(Main.java:281)
> at
> org.netbeans.core.startup.TopThreadGroup.run(TopThreadGroup.java:98)
> at java.base/java.lang.Thread.run(Thread.java:844)
> 
> Which I came across this but does not resolve that for me.
> https://forums.netbeans.org/topic65009.html



-- 
William L. Thomson Jr.


pgpecNp_MVWF2.pgp
Description: OpenPGP digital signature

Re: Packaging Netbeans 9 on Gentoo

On Sat, 25 Nov 2017 22:24:38 +0100
Antonio  wrote:
> 
> _ALL_ the files. This includes nested directories and their contents. 
> META-INF/services/* is key for NetBeans to run. There may be some
> other files there as well. Keep the structure as is.

I am copying them over as they exist in src/.  Just less *.java files.

> Don't mess with manifest.mf entries contents. Just pass the "-M"
> option to jar and avoid specifying a custom manifest.

I am pretty sure I have to add at minimum 
OpenIDE-Module-Build-Version

Not sure why I added 
OpenIDE-Module-Implementation-Version

That may not be necessary.

-- 
William L. Thomson Jr.


pgpMo8T0k4vSr.pgp
Description: OpenPGP digital signature

Re: Packaging Netbeans 9 on Gentoo


Hi,

Please upload the result somewhere so we can take a look by tomorrow.

Cheers,
Antonio

El 25/11/17 a las 22:29, William L. Thomson Jr. escribió:

Fixed warning, but still fails. Thinking something is missing from
/usr/share/netbeans-9/config/Modules/

Or its not seeing modules in
/usr/share/netbeans-9/modules/

  I put the auto files when they exist in
  /usr/share/netbeans-9/config/ModuleAutoDep/

Not sure but clearly something is missing or off. Jar missing resources
or missing a needed jar.

Re: Packaging Netbeans 9 on Gentoo

Fixed warning, but still fails. Thinking something is missing from
/usr/share/netbeans-9/config/Modules/

Or its not seeing modules in 
/usr/share/netbeans-9/modules/

 I put the auto files when they exist in
 /usr/share/netbeans-9/config/ModuleAutoDep/

Not sure but clearly something is missing or off. Jar missing resources
or missing a needed jar.

-- 
William L. Thomson Jr.


pgpXAHckqpFOB.pgp
Description: OpenPGP digital signature

Re: Packaging Netbeans 9 on Gentoo

El 25/11/17 a las 22:09, William L. Thomson Jr. escribió:

On Sat, 25 Nov 2017 22:03:06 +0100
Antonio wrote:

El 25/11/17 a las 21:46, William L. Thomson Jr. escribió:

Great thanks, but that is not needed as much as other stuff. Though
I may need to know what modules I should link into a default minimal
install. Still working on getting that started. No UI atm. Though I
think I know why. Duplicate entry in manifest maybe causing things
to not start.

NetBeans manifests hold very important information needed at
_runtime_, not just at compile time.

Yes thus far that has been the biggest issue. Runtime resources.
https://github.com/Obsidian-StudiosInc/os-xtoo/blob/master/eclass/java-netbeans.eclass#L61

My main gripe thus far with Netbeans is mixing in sources with
resources. I have to copy that over and remove java files not idea.
https://github.com/Obsidian-StudiosInc/os-xtoo/blob/master/eclass/java-netbeans.eclass#L81

Try to keep all the files under meta-inf/* directories intact, and
include those in the your "jar" tasks (jar has an 'm' option, IIRC,
to specify the manifest to use). If you just "jar" then the
meta-inf/manifest.mf entry will be overwritten and nothing will work.

_ALL_ the files. This includes nested directories and their contents.
META-INF/services/* is key for NetBeans to run. There may be some other
files there as well. Keep the structure as is.

Don't mess with manifest.mf entries contents. Just pass the "-M" option
to jar and avoid specifying a custom manifest.

Cheers,
Antonio

Re: Packaging Netbeans 9 on Gentoo

On Sat, 25 Nov 2017 22:03:06 +0100
Antonio  wrote:

> El 25/11/17 a las 21:46, William L. Thomson Jr. escribió:
> > Great thanks, but that is not needed as much as other stuff. Though
> > I may need to know what modules I should link into a default minimal
> > install. Still working on getting that started. No UI atm. Though I
> > think I know why. Duplicate entry in manifest maybe causing things
> > to not start.  
> 
> NetBeans manifests hold very important information needed at
> _runtime_, not just at compile time.

Yes thus far that has been the biggest issue. Runtime resources.
https://github.com/Obsidian-StudiosInc/os-xtoo/blob/master/eclass/java-netbeans.eclass#L61

My main gripe thus far with Netbeans is mixing in sources with
resources. I have to copy that over and remove java files not idea.
https://github.com/Obsidian-StudiosInc/os-xtoo/blob/master/eclass/java-netbeans.eclass#L81

> Try to keep all the files under meta-inf/* directories intact, and 
> include those in the your "jar" tasks (jar has an 'm' option, IIRC,
> to specify the manifest to use). If you just "jar" then the 
> meta-inf/manifest.mf entry will be overwritten and nothing will work.

I use jar with the mM options, to include and not generate one. It was
due to issues there that prevented initial startup and maybe still
causing the following due to the warning before. I am adding that value
when it does not exist. Or should be. I was adding it regardless
before. Now removing and replacing. Though may need to grep then sed.

The OpenIDE-Module-Implementation-Version is something I add via
https://github.com/Obsidian-StudiosInc/os-xtoo/blob/master/eclass/java-netbeans.eclass#L74

Newer version not yet pushed deletes
OpenIDE-Module-Implementation-Version before adding it back

This the warning, but maybe causing the startup to fail afterward. Or
missing jars. Working on masterfs-linux and nio2. Not sure if they are
needed with masterfs. Since the following exact error seems resolved
with that per
https://forums.netbeans.org/topic65009.html

Nov 25, 2017 3:48:09 PM java.util.jar.Attributes read
WARNING: Duplicate name in Manifest:
OpenIDE-Module-Implementation-Version. Ensure that the manifest does
not have duplicate entries, and that blank lines separate individual
sections in both your manifest and in the META-INF/MANIFEST.MF entry in
the jar file. java.lang.AssertionError: Has to be NbRepository:
org.openide.filesystems.Repository@61d9dfd1 at
org.netbeans.core.startup.Main.start(Main.java:281) at
org.netbeans.core.startup.TopThreadGroup.run(TopThreadGroup.java:98) at
java.base/java.lang.Thread.run(Thread.java:844)

-- 
William L. Thomson Jr.

pgpZzII2tphP9.pgp
Description: OpenPGP digital signature

Re: Packaging Netbeans 9 on Gentoo




El 25/11/17 a las 21:46, William L. Thomson Jr. escribió:

Great thanks, but that is not needed as much as other stuff. Though I
may need to know what modules I should link into a default minimal
install. Still working on getting that started. No UI atm. Though I
think I know why. Duplicate entry in manifest maybe causing things to
not start.


NetBeans manifests hold very important information needed at _runtime_, 
not just at compile time.


Try to keep all the files under meta-inf/* directories intact, and 
include those in the your "jar" tasks (jar has an 'm' option, IIRC, to 
specify the manifest to use). If you just "jar" then the 
meta-inf/manifest.mf entry will be overwritten and nothing will work.


Cheers,
Antonio

Re: Packaging Netbeans 9 on Gentoo

On Sat, 25 Nov 2017 21:13:26 +0100
Antonio  wrote:
> 
> The problem when trying to compile NetBeans modules is handling 
> dependencies properly. You need to compile some modules before some
> others.

Yes but that works itself out. As I build one piece, it needs stuff
from another. I just keep packaging other stuff till I can build that
piece. I also have a tool I use to update/bump the package. Which is
where order matters.
https://github.com/Obsidian-StudiosInc/ebuild-bumper/blob/master/bump_pkgs/netbeans

> Extracting this information from the NetBeans sources may be, by
> itself, a difficult task. Keeping it in sync with the NetBeans repo
> should be done automatically.

I do not bother looking at sources. Sometimes pom.xml etc. I just see
what it needs to actually build by building it. See what imports are
missing during any compile. Rinse and repeat.

> I see. Then I imagine you're extracting NetBeans inter-module 
> dependencies and are translating those to Gentoo package
> dependencies. Otherwise your packages may compile, but the final
> result may fail at runtime.

Yes, Gentoo handles dependency order. That is normal for Gentoo in
general, nothing Java specific there. Why Maven and Gradle conflict
with Gentoo vs help. Ivy + Ant is easier, as you can comment out Ivy
and keep Ant. If going that route.

But then patching, fiddling with build.xml, sed, re-writing. Just
creates more work.

> I've worked a little bit with NetBeans module dependencies 
> (https://github.com/vieiro/nbp-demo) so let me know if you need help 
> generating this information.

Great thanks, but that is not needed as much as other stuff. Though I
may need to know what modules I should link into a default minimal
install. Still working on getting that started. No UI atm. Though I
think I know why. Duplicate entry in manifest maybe causing things to
not start.

> I am not sure you'll end up with a simpler build and packaging
> system, nor with simpler package mainteinance. But I don't know
> Gentoo, so I'm not sure.

I have dealt with packaging stuff on Gentoo for over  a decade, mostly
Java, but not all. In my experience, this is a much easier route with
less overhead for recurring maintenance over the long term.

Packaging in general is pretty thankless and fruitless, but necessary.

> If I were to build a package for Debian or FreeBSD I'll reuse the 
> existing NetBeans build system. Compile NetBeans as per NetBeans
> build system and then package that to a platform specific package.

If I did not have to integrate with a build system that needs to build
from source all the time for the user. Then it would heavily simplify
things. It is MUCH easier to package for binary distributions. Build
once, and do what ever to ensure the result is what you want. That is
not so easy with a build it on demand system for anyone. With their own
preferences. It adds in levels of complexity you do not have on binary
based operating systems.

> FreeBSD's NetBeans port [1], for instance, just checksums a NetBeans 
> binary and then extracts the binaries to a specific system-wide 
> directory, after some file modificatiosns [2].

Gentoo was inspired by BSD, thus portage, related to ports.

There are -bin packages on Gentoo. They are not really preferred. Its a
slippery slope. Once you put in 1 bin, why not 2? Why not then make
the whole OS binary vs from source. Usually from source distros like
FreeBSD and Gentoo do that when it is to difficult to package.

That is where I come in. I make the difficult simple :) 

-- 
William L. Thomson Jr.

pgpTJ1k8_EMCF.pgp
Description: OpenPGP digital signature

Re: Packaging Netbeans 9 on Gentoo


Hi,

Some comments inlined below.

El 25/11/17 a las 20:20, William L. Thomson Jr. escribió:

On Sat, 25 Nov 2017 18:59:47 +0100
Antonio  wrote:


Hi,

I'm afraid I'm confused.

The subject of your email says "Packaging NetBeans 9 on Gentoo" but
then you're not packaging NetBeans 9 on Gentoo, but packaging
NetBeans in "abnormal ways" using the Gentoo packaging system.

Why are you packaging NetBeans in "abnormal ways"?


It is difficult to use normal Java build systems with Gentoo's portage
packaging system. They overlap in many ways, and require lots of
complex code to integrate. Even ant requires a custom Gentoo eclass,
xml re-writters written in some language, atm python. Its cumbersome.


Mmmm... If ant is difficult to integrate ant then integrating NetBeans 
must be indeed very complicated.





What are these  "abnormal ways"?


Basically using custom shell scripts. That get a list of all java
files, pass that to javac. Then a folder of resources that is combined
with classes and passed to jar. Pretty basic, just javac and jar.

Gets a bit trickier when needing to generate Java code but that is not
that hard to do via the simple route.
https://github.com/Obsidian-StudiosInc/os-xtoo/blob/master/eclass/java-pkg-simple.eclass#L110

I make hundreds of packages that way. Presently trying to get rid of
ant entirely. For numerous reasons.



The problem when trying to compile NetBeans modules is handling 
dependencies properly. You need to compile some modules before some others.


Extracting this information from the NetBeans sources may be, by itself, 
a difficult task. Keeping it in sync with the NetBeans repo should be 
done automatically.



Are you trying to package NetBeans modules as Gentoo packages?


Core modules yes, all 570 projects in repo, NO. Stuff that can be
downloaded into a users directory via the modules/plugin manager. I
will not package. I am just looking to package the core IDE and maybe
some common modules, but not all.


I see. Then I imagine you're extracting NetBeans inter-module 
dependencies and are translating those to Gentoo package dependencies. 
Otherwise your packages may compile, but the final result may fail at 
runtime.


I've worked a little bit with NetBeans module dependencies 
(https://github.com/vieiro/nbp-demo) so let me know if you need help 
generating this information.





If so, why? In order to achieve what,  exactly?


To support Java 9. To have Netbeans 9. To have a simpler build and
packaging process on Gentoo. To reduce package maintenance all around.
To provide a level of customization that is presently not available by
default. To be able to manage all of this by myself efficiently :)



I am not sure you'll end up with a simpler build and packaging system, 
nor with simpler package mainteinance. But I don't know Gentoo, so I'm 
not sure.


If I were to build a package for Debian or FreeBSD I'll reuse the 
existing NetBeans build system. Compile NetBeans as per NetBeans build 
system and then package that to a platform specific package.


FreeBSD's NetBeans port [1], for instance, just checksums a NetBeans 
binary and then extracts the binaries to a specific system-wide 
directory, after some file modificatiosns [2].


Cheers,
Antonio


[1] https://svnweb.freebsd.org/ports/head/java/netbeans/
[2] 
https://svnweb.freebsd.org/ports/head/java/netbeans/Makefile?revision=418767=markup

Re: Packaging Netbeans 9 on Gentoo

On Sat, 25 Nov 2017 18:59:47 +0100
Antonio  wrote:

> Hi,
> 
> I'm afraid I'm confused.
> 
> The subject of your email says "Packaging NetBeans 9 on Gentoo" but
> then you're not packaging NetBeans 9 on Gentoo, but packaging
> NetBeans in "abnormal ways" using the Gentoo packaging system.
> 
> Why are you packaging NetBeans in "abnormal ways"? 

It is difficult to use normal Java build systems with Gentoo's portage
packaging system. They overlap in many ways, and require lots of
complex code to integrate. Even ant requires a custom Gentoo eclass,
xml re-writters written in some language, atm python. Its cumbersome.

> What are these  "abnormal ways"?

Basically using custom shell scripts. That get a list of all java
files, pass that to javac. Then a folder of resources that is combined
with classes and passed to jar. Pretty basic, just javac and jar.

Gets a bit trickier when needing to generate Java code but that is not
that hard to do via the simple route.
https://github.com/Obsidian-StudiosInc/os-xtoo/blob/master/eclass/java-pkg-simple.eclass#L110

I make hundreds of packages that way. Presently trying to get rid of
ant entirely. For numerous reasons.

>Are you trying to package NetBeans modules as Gentoo packages?

Core modules yes, all 570 projects in repo, NO. Stuff that can be
downloaded into a users directory via the modules/plugin manager. I
will not package. I am just looking to package the core IDE and maybe
some common modules, but not all.

>If so, why? In order to achieve what,  exactly?

To support Java 9. To have Netbeans 9. To have a simpler build and
packaging process on Gentoo. To reduce package maintenance all around.
To provide a level of customization that is presently not available by
default. To be able to manage all of this by myself efficiently :)

-- 
William L. Thomson Jr.

pgpIdAgwB_8x6.pgp
Description: OpenPGP digital signature

Re: Packaging Netbeans 9 on Gentoo

On Sat, 25 Nov 2017 13:15:51 -0500
Emilian Bold  wrote:

> Antonio, he's not using our ant build system at all. Basically trying
> to build NetBeans using only our sources and the Gentool build
> scripts/-specific tools.
> 
> It's extra work but doable in the end. Might be interesting if it
> works.

It is actually less work. Integrating Netbeans ant build system with
Gentoo's build system is not trivial. It cannot fully integrate with
Gentoo's ant build system. As it re-writes source/target. Which fails
half way through some of Netbeans files. I was reverting to sed in
fixing it to build under 9 but ran into issues I did not using ant
outside of Gentoo's build system.

Like this sed
https://github.com/Obsidian-StudiosInc/os-xtoo/blob/master/dev-java/netbeans-platform/netbeans-platform-8.2-r11.ebuild#L113

Look at any of these. The URLs alone can be a PITA. It becomes
difficult to use system installed libraries. Which maybe newer than
what Netbeans ships. I end up with duplicate stuff in Libraries, old
stuff Netbeans ships with it needs to build or fails. Or new stuff I
added.

https://github.com/gentoo/gentoo/blob/master/dev-java/netbeans-apisupport/netbeans-apisupport-8.2.ebuild
https://github.com/gentoo/gentoo/blob/master/dev-java/netbeans-cnd/netbeans-cnd-8.2.ebuild
https://github.com/gentoo/gentoo/blob/master/dev-java/netbeans-dlight/netbeans-dlight-8.2.ebuild
https://github.com/gentoo/gentoo/blob/master/dev-java/netbeans-enterprise/netbeans-enterprise-8.2-r1.ebuild
https://github.com/gentoo/gentoo/blob/master/dev-java/netbeans-ergonomics/netbeans-ergonomics-8.2.ebuild
https://github.com/gentoo/gentoo/blob/master/dev-java/netbeans-extide/netbeans-extide-8.2.ebuild
https://github.com/gentoo/gentoo/blob/master/dev-java/netbeans-groovy/netbeans-groovy-8.2.ebuild
https://github.com/gentoo/gentoo/blob/master/dev-java/netbeans-harness/netbeans-harness-8.2.ebuild
https://github.com/gentoo/gentoo/blob/master/dev-java/netbeans-ide/netbeans-ide-8.2.ebuild
https://github.com/gentoo/gentoo/blob/master/dev-java/netbeans-java/netbeans-java-8.2.ebuild
https://github.com/gentoo/gentoo/blob/master/dev-java/netbeans-javacard/netbeans-javacard-8.2.ebuild
https://github.com/gentoo/gentoo/blob/master/dev-java/netbeans-javadoc/netbeans-javadoc-8.2.ebuild
https://github.com/gentoo/gentoo/blob/master/dev-java/netbeans-javafx/netbeans-javafx-8.2.ebuild
https://github.com/gentoo/gentoo/blob/master/dev-java/netbeans-mobility/netbeans-mobility-8.2.ebuild
https://github.com/gentoo/gentoo/blob/master/dev-java/netbeans-nb/netbeans-nb-8.2.ebuild
https://github.com/gentoo/gentoo/blob/master/dev-java/netbeans-php/netbeans-php-8.2.ebuild
https://github.com/gentoo/gentoo/blob/master/dev-java/netbeans-platform/netbeans-platform-8.2.ebuild
https://github.com/gentoo/gentoo/blob/master/dev-java/netbeans-profiler/netbeans-profiler-8.2.ebuild
https://github.com/gentoo/gentoo/blob/master/dev-java/netbeans-webcommon/netbeans-webcommon-8.2.ebuild
https://github.com/gentoo/gentoo/blob/master/dev-java/netbeans-websvccommon/netbeans-websvccommon-8.2.ebuild

In a fraction of the time, I have some 50+ netbeans packages, and can
crank out more quickly. Each ebuild is trivial. The eclass even is
smaller than most Netbeans ant ebuilds.

https://github.com/Obsidian-StudiosInc/os-xtoo/blob/master/dev-java/netbeans-core-windows/netbeans-core-windows-.ebuild
https://github.com/Obsidian-StudiosInc/os-xtoo/blob/master/dev-util/netbeans/netbeans-.ebuild
https://github.com/Obsidian-StudiosInc/os-xtoo/blob/master/eclass/java-netbeans.eclass

-- 
William L. Thomson Jr.


pgpejXJLDcpnP.pgp
Description: OpenPGP digital signature

Re: Packaging Netbeans 9 on Gentoo

2017-11-25 Thread Emilian Bold

Antonio, he's not using our ant build system at all. Basically trying to build 
NetBeans using only our sources and the Gentool build scripts/-specific tools.

It's extra work but doable in the end. Might be interesting if it works.

--emi

> Original Message 
>Subject: Re: Packaging Netbeans 9 on Gentoo
>Local Time: November 25, 2017 7:59 PM
>UTC Time: November 25, 2017 5:59 PM
>From: anto...@vieiro.net
>To: dev@netbeans.incubator.apache.org
>
>Hi,
>
> I'm afraid I'm confused.
>
> The subject of your email says "Packaging NetBeans 9 on Gentoo" but then
> you're not packaging NetBeans 9 on Gentoo, but packaging NetBeans in
> "abnormal ways" using the Gentoo packaging system.
>
> Why are you packaging NetBeans in "abnormal ways"? What are these
> "abnormal ways"? Are you trying to package NetBeans modules as Gentoo
> packages? If so, why? In order to achieve what, exactly?
>
> Cheers,
> Antonio
>
> El 25/11/17 a las 18:29, William L. Thomson Jr. escribió:
>>Greetings all,
>>Just starting a thread here since I did on the old mailing list. Just
>> to recap for those who missed it. I am packaging Netbeans in abnormal
>> ways using Gentoo packaging system. I am not using Netbeans ant build
>> system. That was in use on Gentoo but is to cumbersome.
>>This new approach is going well and I am close to an initial something.
>> I had some startup issues due to missing resources and may still.
>>https://github.com/Obsidian-StudiosInc/os-xtoo/tree/master/dev-util/netbeans
>>netbeans- packages are libraries used in the previous meta one
>>https://github.com/Obsidian-StudiosInc/os-xtoo/tree/master/dev-java/
>>Gentoo netbeans eclass, where I do specific stuff, process bundles,
>> copy resources, etc.
>>https://github.com/Obsidian-StudiosInc/os-xtoo/blob/master/eclass/java-netbeans.eclass
>>Presently stuck at
>>java.lang.AssertionError: Has to be NbRepository:
>> org.openide.filesystems.Repository@3ab8ef5a
>> at org.netbeans.core.startup.Main.start(Main.java:281)
>> at
>> org.netbeans.core.startup.TopThreadGroup.run(TopThreadGroup.java:98)
>> at java.base/java.lang.Thread.run(Thread.java:844)
>>Which I came across this but does not resolve that for me.
>>https://forums.netbeans.org/topic65009.html
>>Basically think I am close to something along these lines
>>https://platform.netbeans.org/tutorials/nbm-runtime-container.html
>>I can post my initial from the other list. It was a bit long. Not sure
>> if there is an archive of the old list so I can provide a link for
>> reference. But I covered the basics here :)
>>Thanks in advance!
>

Re: Packaging Netbeans 9 on Gentoo