[jira] [Commented] (SOLR-13392) Unable to start prometheus-exporter in 7x branch
[ https://issues.apache.org/jira/browse/SOLR-13392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16819787#comment-16819787 ] Karl Stoney commented on SOLR-13392: Patch works in 7_7 > Unable to start prometheus-exporter in 7x branch > > > Key: SOLR-13392 > URL: https://issues.apache.org/jira/browse/SOLR-13392 > Project: Solr > Issue Type: Bug > Security Level: Public(Default Security Level. Issues are Public) > Components: metrics >Affects Versions: 7.7.2 >Reporter: Karl Stoney >Assignee: Shalin Shekhar Mangar >Priority: Major > Attachments: SOLR-13392.patch > > > Hi, > prometheus-exporter doesn't start in branch 7x on commit > 7dfe1c093b65f77407c2df4c2a1120a213aef166, it does work on > 26b498d0a9d25626a15e25b0cf97c8339114263a so something has changed between > those two commits causing this. > I am presuming it is > https://github.com/apache/lucene-solr/commit/e1eeafb5dc077976646b06f4cba4d77534963fa9#diff-3f7b27f0f087632739effa2aa508d77eR34 > Exception in thread "main" java.lang.NoClassDefFoundError: > org/apache/lucene/util/IOUtils > at > org.apache.solr.core.SolrResourceLoader.close(SolrResourceLoader.java:881) > at > org.apache.solr.prometheus.exporter.SolrExporter.loadMetricsConfiguration(SolrExporter.java:221) > at > org.apache.solr.prometheus.exporter.SolrExporter.main(SolrExporter.java:205) > Caused by: java.lang.ClassNotFoundException: org.apache.lucene.util.IOUtils > at java.net.URLClassLoader.findClass(URLClassLoader.java:382) > at java.lang.ClassLoader.loadClass(ClassLoader.java:424) > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349) > at java.lang.ClassLoader.loadClass(ClassLoader.java:357) > ... 3 more -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-13392) Unable to start prometheus-exporter in 7x branch
[ https://issues.apache.org/jira/browse/SOLR-13392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16819772#comment-16819772 ] Karl Stoney commented on SOLR-13392: Sounds nasty. I'll monkeypatch my build with your patch for now to work around the issue. Ta > Unable to start prometheus-exporter in 7x branch > > > Key: SOLR-13392 > URL: https://issues.apache.org/jira/browse/SOLR-13392 > Project: Solr > Issue Type: Bug > Security Level: Public(Default Security Level. Issues are Public) > Components: metrics >Affects Versions: 7.7.2 >Reporter: Karl Stoney >Assignee: Shalin Shekhar Mangar >Priority: Major > Attachments: SOLR-13392.patch > > > Hi, > prometheus-exporter doesn't start in branch 7x on commit > 7dfe1c093b65f77407c2df4c2a1120a213aef166, it does work on > 26b498d0a9d25626a15e25b0cf97c8339114263a so something has changed between > those two commits causing this. > I am presuming it is > https://github.com/apache/lucene-solr/commit/e1eeafb5dc077976646b06f4cba4d77534963fa9#diff-3f7b27f0f087632739effa2aa508d77eR34 > Exception in thread "main" java.lang.NoClassDefFoundError: > org/apache/lucene/util/IOUtils > at > org.apache.solr.core.SolrResourceLoader.close(SolrResourceLoader.java:881) > at > org.apache.solr.prometheus.exporter.SolrExporter.loadMetricsConfiguration(SolrExporter.java:221) > at > org.apache.solr.prometheus.exporter.SolrExporter.main(SolrExporter.java:205) > Caused by: java.lang.ClassNotFoundException: org.apache.lucene.util.IOUtils > at java.net.URLClassLoader.findClass(URLClassLoader.java:382) > at java.lang.ClassLoader.loadClass(ClassLoader.java:424) > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349) > at java.lang.ClassLoader.loadClass(ClassLoader.java:357) > ... 3 more -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-13285) ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during replication
[ https://issues.apache.org/jira/browse/SOLR-13285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16817624#comment-16817624 ] Karl Stoney commented on SOLR-13285: Makes sense, thank you :-) > ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during > replication > - > > Key: SOLR-13285 > URL: https://issues.apache.org/jira/browse/SOLR-13285 > Project: Solr > Issue Type: Bug > Security Level: Public(Default Security Level. Issues are Public) > Components: replication (java), SolrCloud, SolrJ >Affects Versions: 7.7, 7.7.1, 8.0 > Environment: centos 7 > solrcloud 7.7.1, 8.1.0 >Reporter: Karl Stoney >Assignee: Noble Paul >Priority: Major > Labels: newbie, replication > Attachments: SOLR-13285.patch, SOLR-13285.patch > > > Since upgrading to 7.7 (also tried 7.7.1, and 8.1.0) from 6.6.4, we're seeing > the following errors in the SolrCloud elected master for a given collection > when updates are written. This was after a full reindex of data (fresh > build). > {code:java} > request: > http://solr-1.search-solr.preprod.k8.atcloud.io:80/solr/at-uk_shard1_replica_n2/update?update.distrib=FROMLEADER=http%3A%2F%2Fsolr-2.search-solr.preprod.k8.atcloud.io%3A80%2Fsolr%2Fat-uk_shard1_replica_n1%2F=javabin=2 > Remote error message: org.apache.solr.common.util.ByteArrayUtf8CharSequence > cannot be cast to java.lang.String > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.sendUpdateStream(ConcurrentUpdateSolrClient.java:385) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:183) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176) > ~[metrics-core-3.2.6.jar:3.2.6] > at > org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > ~[?:1.8.0_191] > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > ~[?:1.8.0_191] > at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191] > {code} > Following this through to the replica, you'll see: > {code:java} > 08:35:22.060 [qtp1540374340-20] ERROR org.apache.solr.servlet.HttpSolrCall - > null:java.lang.ClassCastException: > org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to > java.lang.String > at > org.apache.solr.common.util.JavaBinCodec.readEnumFieldValue(JavaBinCodec.java:813) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:339) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.readSolrInputDocument(JavaBinCodec.java:640) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:337) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.readMapEntry(JavaBinCodec.java:819) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:341) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readOuterMostDocIterator(JavaBinUpdateRequestCodec.java:295) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readIterator(JavaBinUpdateRequestCodec.java:280) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:333) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readNamedList(JavaBinUpdateRequestCodec.java:235) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:298) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.unmarshal(JavaBinCodec.java:191) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec.unmarshal(JavaBinUpdateRequestCodec.java:126) > at > org.apache.solr.handler.loader.JavabinLoader.parseAndLoadDocs(JavabinLoader.java:123) > at >
[jira] [Commented] (SOLR-13285) ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during replication
[ https://issues.apache.org/jira/browse/SOLR-13285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16817619#comment-16817619 ] Karl Stoney commented on SOLR-13285: Thanks [~noble.paul] - does it need to be in 7x too as I'm guessing that forms 7.8.0? > ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during > replication > - > > Key: SOLR-13285 > URL: https://issues.apache.org/jira/browse/SOLR-13285 > Project: Solr > Issue Type: Bug > Security Level: Public(Default Security Level. Issues are Public) > Components: replication (java), SolrCloud, SolrJ >Affects Versions: 7.7, 7.7.1, 7.7.2, 8.0 > Environment: centos 7 > solrcloud 7.7.1, 8.1.0 >Reporter: Karl Stoney >Assignee: Noble Paul >Priority: Major > Labels: newbie, replication > Attachments: SOLR-13285.patch, SOLR-13285.patch > > > Since upgrading to 7.7 (also tried 7.7.1, and 8.1.0) from 6.6.4, we're seeing > the following errors in the SolrCloud elected master for a given collection > when updates are written. This was after a full reindex of data (fresh > build). > {code:java} > request: > http://solr-1.search-solr.preprod.k8.atcloud.io:80/solr/at-uk_shard1_replica_n2/update?update.distrib=FROMLEADER=http%3A%2F%2Fsolr-2.search-solr.preprod.k8.atcloud.io%3A80%2Fsolr%2Fat-uk_shard1_replica_n1%2F=javabin=2 > Remote error message: org.apache.solr.common.util.ByteArrayUtf8CharSequence > cannot be cast to java.lang.String > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.sendUpdateStream(ConcurrentUpdateSolrClient.java:385) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:183) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176) > ~[metrics-core-3.2.6.jar:3.2.6] > at > org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > ~[?:1.8.0_191] > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > ~[?:1.8.0_191] > at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191] > {code} > Following this through to the replica, you'll see: > {code:java} > 08:35:22.060 [qtp1540374340-20] ERROR org.apache.solr.servlet.HttpSolrCall - > null:java.lang.ClassCastException: > org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to > java.lang.String > at > org.apache.solr.common.util.JavaBinCodec.readEnumFieldValue(JavaBinCodec.java:813) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:339) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.readSolrInputDocument(JavaBinCodec.java:640) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:337) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.readMapEntry(JavaBinCodec.java:819) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:341) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readOuterMostDocIterator(JavaBinUpdateRequestCodec.java:295) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readIterator(JavaBinUpdateRequestCodec.java:280) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:333) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readNamedList(JavaBinUpdateRequestCodec.java:235) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:298) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.unmarshal(JavaBinCodec.java:191) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec.unmarshal(JavaBinUpdateRequestCodec.java:126) > at >
[jira] [Commented] (SOLR-13285) ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during replication
[ https://issues.apache.org/jira/browse/SOLR-13285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16816510#comment-16816510 ] Karl Stoney commented on SOLR-13285: Brill, thanks [~gerlowskija] > ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during > replication > - > > Key: SOLR-13285 > URL: https://issues.apache.org/jira/browse/SOLR-13285 > Project: Solr > Issue Type: Bug > Security Level: Public(Default Security Level. Issues are Public) > Components: replication (java), SolrCloud, SolrJ >Affects Versions: 7.7, 7.7.1, 7.7.2, 8.0 > Environment: centos 7 > solrcloud 7.7.1, 8.1.0 >Reporter: Karl Stoney >Assignee: Noble Paul >Priority: Major > Labels: newbie, replication > Attachments: SOLR-13285.patch, SOLR-13285.patch > > > Since upgrading to 7.7 (also tried 7.7.1, and 8.1.0) from 6.6.4, we're seeing > the following errors in the SolrCloud elected master for a given collection > when updates are written. This was after a full reindex of data (fresh > build). > {code:java} > request: > http://solr-1.search-solr.preprod.k8.atcloud.io:80/solr/at-uk_shard1_replica_n2/update?update.distrib=FROMLEADER=http%3A%2F%2Fsolr-2.search-solr.preprod.k8.atcloud.io%3A80%2Fsolr%2Fat-uk_shard1_replica_n1%2F=javabin=2 > Remote error message: org.apache.solr.common.util.ByteArrayUtf8CharSequence > cannot be cast to java.lang.String > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.sendUpdateStream(ConcurrentUpdateSolrClient.java:385) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:183) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176) > ~[metrics-core-3.2.6.jar:3.2.6] > at > org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > ~[?:1.8.0_191] > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > ~[?:1.8.0_191] > at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191] > {code} > Following this through to the replica, you'll see: > {code:java} > 08:35:22.060 [qtp1540374340-20] ERROR org.apache.solr.servlet.HttpSolrCall - > null:java.lang.ClassCastException: > org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to > java.lang.String > at > org.apache.solr.common.util.JavaBinCodec.readEnumFieldValue(JavaBinCodec.java:813) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:339) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.readSolrInputDocument(JavaBinCodec.java:640) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:337) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.readMapEntry(JavaBinCodec.java:819) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:341) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readOuterMostDocIterator(JavaBinUpdateRequestCodec.java:295) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readIterator(JavaBinUpdateRequestCodec.java:280) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:333) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readNamedList(JavaBinUpdateRequestCodec.java:235) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:298) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.unmarshal(JavaBinCodec.java:191) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec.unmarshal(JavaBinUpdateRequestCodec.java:126) > at > org.apache.solr.handler.loader.JavabinLoader.parseAndLoadDocs(JavabinLoader.java:123) > at >
[jira] [Updated] (SOLR-13285) ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during replication
[ https://issues.apache.org/jira/browse/SOLR-13285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karl Stoney updated SOLR-13285: --- Affects Version/s: 7.7.2 > ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during > replication > - > > Key: SOLR-13285 > URL: https://issues.apache.org/jira/browse/SOLR-13285 > Project: Solr > Issue Type: Bug > Security Level: Public(Default Security Level. Issues are Public) > Components: replication (java), SolrCloud, SolrJ >Affects Versions: 7.7, 7.7.1, 7.7.2, 8.0 > Environment: centos 7 > solrcloud 7.7.1, 8.1.0 >Reporter: Karl Stoney >Assignee: Noble Paul >Priority: Major > Labels: newbie, replication > Attachments: SOLR-13285.patch, SOLR-13285.patch > > > Since upgrading to 7.7 (also tried 7.7.1, and 8.1.0) from 6.6.4, we're seeing > the following errors in the SolrCloud elected master for a given collection > when updates are written. This was after a full reindex of data (fresh > build). > {code:java} > request: > http://solr-1.search-solr.preprod.k8.atcloud.io:80/solr/at-uk_shard1_replica_n2/update?update.distrib=FROMLEADER=http%3A%2F%2Fsolr-2.search-solr.preprod.k8.atcloud.io%3A80%2Fsolr%2Fat-uk_shard1_replica_n1%2F=javabin=2 > Remote error message: org.apache.solr.common.util.ByteArrayUtf8CharSequence > cannot be cast to java.lang.String > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.sendUpdateStream(ConcurrentUpdateSolrClient.java:385) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:183) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176) > ~[metrics-core-3.2.6.jar:3.2.6] > at > org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > ~[?:1.8.0_191] > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > ~[?:1.8.0_191] > at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191] > {code} > Following this through to the replica, you'll see: > {code:java} > 08:35:22.060 [qtp1540374340-20] ERROR org.apache.solr.servlet.HttpSolrCall - > null:java.lang.ClassCastException: > org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to > java.lang.String > at > org.apache.solr.common.util.JavaBinCodec.readEnumFieldValue(JavaBinCodec.java:813) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:339) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.readSolrInputDocument(JavaBinCodec.java:640) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:337) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.readMapEntry(JavaBinCodec.java:819) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:341) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readOuterMostDocIterator(JavaBinUpdateRequestCodec.java:295) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readIterator(JavaBinUpdateRequestCodec.java:280) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:333) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readNamedList(JavaBinUpdateRequestCodec.java:235) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:298) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.unmarshal(JavaBinCodec.java:191) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec.unmarshal(JavaBinUpdateRequestCodec.java:126) > at > org.apache.solr.handler.loader.JavabinLoader.parseAndLoadDocs(JavabinLoader.java:123) > at > org.apache.solr.handler.loader.JavabinLoader.load(JavabinLoader.java:70) > at >
[jira] [Commented] (SOLR-13293) org.apache.solr.client.solrj.impl.ConcurrentUpdateHttp2SolrClient - Error consuming and closing http response stream.
[ https://issues.apache.org/jira/browse/SOLR-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16816494#comment-16816494 ] Karl Stoney commented on SOLR-13293: I don't see how they're related, I mean this error is in ConcurrentUpdateHttp2SolrClient, which is what's being used for solrcloud replication right? Not sure how metrics queries from prometheus exporter would cause this? > org.apache.solr.client.solrj.impl.ConcurrentUpdateHttp2SolrClient - Error > consuming and closing http response stream. > - > > Key: SOLR-13293 > URL: https://issues.apache.org/jira/browse/SOLR-13293 > Project: Solr > Issue Type: Bug > Security Level: Public(Default Security Level. Issues are Public) > Components: SolrJ >Affects Versions: 8.0 >Reporter: Karl Stoney >Priority: Minor > > Hi, > Testing out branch_8x, we're randomly seeing the following errors on a simple > 3 node cluster. It doesn't appear to affect replication (the cluster remains > green). > They come in (mass, literally 1000s at a time) bulk. > There we no network issues at the time. > {code:java} > 16:53:01.492 [updateExecutor-4-thread-34-processing-x:at-uk_shard1_replica_n1 > r:core_node3 null n:solr-2.search-solr.preprod.k8.atcloud.io:80_solr c:at-uk > s:shard1] ERROR > org.apache.solr.client.solrj.impl.ConcurrentUpdateHttp2SolrClient - Error > consuming and closing http response stream. > java.nio.channels.AsynchronousCloseException: null > at > org.eclipse.jetty.client.util.InputStreamResponseListener$Input.read(InputStreamResponseListener.java:316) > ~[jetty-client-9.4.14.v20181114.jar:9.4.14.v20181114] > at java.io.InputStream.read(InputStream.java:101) ~[?:1.8.0_191] > at > org.eclipse.jetty.client.util.InputStreamResponseListener$Input.read(InputStreamResponseListener.java:287) > ~[jetty-client-9.4.14.v20181114.jar:9.4.14.v20181114] > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateHttp2SolrClient$Runner.sendUpdateStream(ConcurrentUpdateHttp2SolrClient.java:283) > ~[solr-solrj-8.1.0-SNAPSHOT.jar:8.1.0-SNAPSHOT > b14748e61fd147ea572f6545265b883fa69ed27f - root > - 2019-03-04 16:30:04] > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateHttp2SolrClient$Runner.run(ConcurrentUpdateHttp2SolrClient.java:176) > ~[solr-solrj-8.1.0-SNAPSHOT.jar:8.1.0-SNAPSHOT > b14748e61fd147ea572f6545265b883fa69ed27f - root - 2019-03-04 > 16:30:04] > at > com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176) > ~[metrics-core-3.2.6.jar:3.2.6] > at > org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209) > ~[solr-solrj-8.1.0-SNAPSHOT.jar:8.1.0-SNAPSHOT > b14748e61fd147ea572f6545265b883fa69ed27f - root - 2019-03-04 16:30:04] > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > [?:1.8.0_191] > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > [?:1.8.0_191] > at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191] > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-13293) org.apache.solr.client.solrj.impl.ConcurrentUpdateHttp2SolrClient - Error consuming and closing http response stream.
[ https://issues.apache.org/jira/browse/SOLR-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16816487#comment-16816487 ] Karl Stoney commented on SOLR-13293: [~krisden] that issue is totally unrelated, it's a classpath compilation error on the prometheus exporter contrib - it doesn't even start - and I've narrowed it to a particular commit. This issue came before the prometheus one! > org.apache.solr.client.solrj.impl.ConcurrentUpdateHttp2SolrClient - Error > consuming and closing http response stream. > - > > Key: SOLR-13293 > URL: https://issues.apache.org/jira/browse/SOLR-13293 > Project: Solr > Issue Type: Bug > Security Level: Public(Default Security Level. Issues are Public) > Components: SolrJ >Affects Versions: 8.0 >Reporter: Karl Stoney >Priority: Minor > > Hi, > Testing out branch_8x, we're randomly seeing the following errors on a simple > 3 node cluster. It doesn't appear to affect replication (the cluster remains > green). > They come in (mass, literally 1000s at a time) bulk. > There we no network issues at the time. > {code:java} > 16:53:01.492 [updateExecutor-4-thread-34-processing-x:at-uk_shard1_replica_n1 > r:core_node3 null n:solr-2.search-solr.preprod.k8.atcloud.io:80_solr c:at-uk > s:shard1] ERROR > org.apache.solr.client.solrj.impl.ConcurrentUpdateHttp2SolrClient - Error > consuming and closing http response stream. > java.nio.channels.AsynchronousCloseException: null > at > org.eclipse.jetty.client.util.InputStreamResponseListener$Input.read(InputStreamResponseListener.java:316) > ~[jetty-client-9.4.14.v20181114.jar:9.4.14.v20181114] > at java.io.InputStream.read(InputStream.java:101) ~[?:1.8.0_191] > at > org.eclipse.jetty.client.util.InputStreamResponseListener$Input.read(InputStreamResponseListener.java:287) > ~[jetty-client-9.4.14.v20181114.jar:9.4.14.v20181114] > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateHttp2SolrClient$Runner.sendUpdateStream(ConcurrentUpdateHttp2SolrClient.java:283) > ~[solr-solrj-8.1.0-SNAPSHOT.jar:8.1.0-SNAPSHOT > b14748e61fd147ea572f6545265b883fa69ed27f - root > - 2019-03-04 16:30:04] > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateHttp2SolrClient$Runner.run(ConcurrentUpdateHttp2SolrClient.java:176) > ~[solr-solrj-8.1.0-SNAPSHOT.jar:8.1.0-SNAPSHOT > b14748e61fd147ea572f6545265b883fa69ed27f - root - 2019-03-04 > 16:30:04] > at > com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176) > ~[metrics-core-3.2.6.jar:3.2.6] > at > org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209) > ~[solr-solrj-8.1.0-SNAPSHOT.jar:8.1.0-SNAPSHOT > b14748e61fd147ea572f6545265b883fa69ed27f - root - 2019-03-04 16:30:04] > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > [?:1.8.0_191] > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > [?:1.8.0_191] > at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191] > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-13293) org.apache.solr.client.solrj.impl.ConcurrentUpdateHttp2SolrClient - Error consuming and closing http response stream.
[ https://issues.apache.org/jira/browse/SOLR-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16816353#comment-16816353 ] Karl Stoney commented on SOLR-13293: Anyone have any ideas about this? We're unable to upgrade to 8x as a result. > org.apache.solr.client.solrj.impl.ConcurrentUpdateHttp2SolrClient - Error > consuming and closing http response stream. > - > > Key: SOLR-13293 > URL: https://issues.apache.org/jira/browse/SOLR-13293 > Project: Solr > Issue Type: Bug > Security Level: Public(Default Security Level. Issues are Public) > Components: SolrJ >Affects Versions: 8.0 >Reporter: Karl Stoney >Priority: Minor > > Hi, > Testing out branch_8x, we're randomly seeing the following errors on a simple > 3 node cluster. It doesn't appear to affect replication (the cluster remains > green). > They come in (mass, literally 1000s at a time) bulk. > There we no network issues at the time. > {code:java} > 16:53:01.492 [updateExecutor-4-thread-34-processing-x:at-uk_shard1_replica_n1 > r:core_node3 null n:solr-2.search-solr.preprod.k8.atcloud.io:80_solr c:at-uk > s:shard1] ERROR > org.apache.solr.client.solrj.impl.ConcurrentUpdateHttp2SolrClient - Error > consuming and closing http response stream. > java.nio.channels.AsynchronousCloseException: null > at > org.eclipse.jetty.client.util.InputStreamResponseListener$Input.read(InputStreamResponseListener.java:316) > ~[jetty-client-9.4.14.v20181114.jar:9.4.14.v20181114] > at java.io.InputStream.read(InputStream.java:101) ~[?:1.8.0_191] > at > org.eclipse.jetty.client.util.InputStreamResponseListener$Input.read(InputStreamResponseListener.java:287) > ~[jetty-client-9.4.14.v20181114.jar:9.4.14.v20181114] > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateHttp2SolrClient$Runner.sendUpdateStream(ConcurrentUpdateHttp2SolrClient.java:283) > ~[solr-solrj-8.1.0-SNAPSHOT.jar:8.1.0-SNAPSHOT > b14748e61fd147ea572f6545265b883fa69ed27f - root > - 2019-03-04 16:30:04] > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateHttp2SolrClient$Runner.run(ConcurrentUpdateHttp2SolrClient.java:176) > ~[solr-solrj-8.1.0-SNAPSHOT.jar:8.1.0-SNAPSHOT > b14748e61fd147ea572f6545265b883fa69ed27f - root - 2019-03-04 > 16:30:04] > at > com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176) > ~[metrics-core-3.2.6.jar:3.2.6] > at > org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209) > ~[solr-solrj-8.1.0-SNAPSHOT.jar:8.1.0-SNAPSHOT > b14748e61fd147ea572f6545265b883fa69ed27f - root - 2019-03-04 16:30:04] > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > [?:1.8.0_191] > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > [?:1.8.0_191] > at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191] > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Comment Edited] (SOLR-13285) ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during replication
[ https://issues.apache.org/jira/browse/SOLR-13285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16816348#comment-16816348 ] Karl Stoney edited comment on SOLR-13285 at 4/12/19 3:18 PM: - Is there any plan to back port this to solr `7.7.2`? The fact we're having to build solr 7 from a branch just to monkeypatch this is kinda frustrating as 7x is LTS? I've even provided the patch for 7x above which fixes it, I just need someone to actually apply it. [~noble.paul] [~gerlowskija]? was (Author: kstoney): Is there any plan to back port this to solr `7.7.2`? The fact we're having to build solr 7 from a branch just to monkeypatch this is kinda frustrating as 7x is LTS? [~noble.paul] [~gerlowskija]? > ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during > replication > - > > Key: SOLR-13285 > URL: https://issues.apache.org/jira/browse/SOLR-13285 > Project: Solr > Issue Type: Bug > Security Level: Public(Default Security Level. Issues are Public) > Components: replication (java), SolrCloud, SolrJ >Affects Versions: 7.7, 7.7.1, 8.0 > Environment: centos 7 > solrcloud 7.7.1, 8.1.0 >Reporter: Karl Stoney >Assignee: Noble Paul >Priority: Major > Labels: newbie, replication > Attachments: SOLR-13285.patch, SOLR-13285.patch > > > Since upgrading to 7.7 (also tried 7.7.1, and 8.1.0) from 6.6.4, we're seeing > the following errors in the SolrCloud elected master for a given collection > when updates are written. This was after a full reindex of data (fresh > build). > {code:java} > request: > http://solr-1.search-solr.preprod.k8.atcloud.io:80/solr/at-uk_shard1_replica_n2/update?update.distrib=FROMLEADER=http%3A%2F%2Fsolr-2.search-solr.preprod.k8.atcloud.io%3A80%2Fsolr%2Fat-uk_shard1_replica_n1%2F=javabin=2 > Remote error message: org.apache.solr.common.util.ByteArrayUtf8CharSequence > cannot be cast to java.lang.String > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.sendUpdateStream(ConcurrentUpdateSolrClient.java:385) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:183) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176) > ~[metrics-core-3.2.6.jar:3.2.6] > at > org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > ~[?:1.8.0_191] > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > ~[?:1.8.0_191] > at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191] > {code} > Following this through to the replica, you'll see: > {code:java} > 08:35:22.060 [qtp1540374340-20] ERROR org.apache.solr.servlet.HttpSolrCall - > null:java.lang.ClassCastException: > org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to > java.lang.String > at > org.apache.solr.common.util.JavaBinCodec.readEnumFieldValue(JavaBinCodec.java:813) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:339) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.readSolrInputDocument(JavaBinCodec.java:640) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:337) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.readMapEntry(JavaBinCodec.java:819) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:341) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readOuterMostDocIterator(JavaBinUpdateRequestCodec.java:295) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readIterator(JavaBinUpdateRequestCodec.java:280) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:333) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at >
[jira] [Commented] (SOLR-13392) Unable to start prometheus-exporter in 7x branch
[ https://issues.apache.org/jira/browse/SOLR-13392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16816350#comment-16816350 ] Karl Stoney commented on SOLR-13392: [~ichattopadhyaya] any input? As far as I can tell this will be broken for 7.7.2 when released > Unable to start prometheus-exporter in 7x branch > > > Key: SOLR-13392 > URL: https://issues.apache.org/jira/browse/SOLR-13392 > Project: Solr > Issue Type: Bug > Security Level: Public(Default Security Level. Issues are Public) > Components: metrics >Affects Versions: 7.7.2 >Reporter: Karl Stoney >Priority: Major > > Hi, > prometheus-exporter doesn't start in branch 7x on commit > 7dfe1c093b65f77407c2df4c2a1120a213aef166, it does work on > 26b498d0a9d25626a15e25b0cf97c8339114263a so something has changed between > those two commits causing this. > I am presuming it is > https://github.com/apache/lucene-solr/commit/e1eeafb5dc077976646b06f4cba4d77534963fa9#diff-3f7b27f0f087632739effa2aa508d77eR34 > Exception in thread "main" java.lang.NoClassDefFoundError: > org/apache/lucene/util/IOUtils > at > org.apache.solr.core.SolrResourceLoader.close(SolrResourceLoader.java:881) > at > org.apache.solr.prometheus.exporter.SolrExporter.loadMetricsConfiguration(SolrExporter.java:221) > at > org.apache.solr.prometheus.exporter.SolrExporter.main(SolrExporter.java:205) > Caused by: java.lang.ClassNotFoundException: org.apache.lucene.util.IOUtils > at java.net.URLClassLoader.findClass(URLClassLoader.java:382) > at java.lang.ClassLoader.loadClass(ClassLoader.java:424) > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349) > at java.lang.ClassLoader.loadClass(ClassLoader.java:357) > ... 3 more -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-13285) ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during replication
[ https://issues.apache.org/jira/browse/SOLR-13285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16816348#comment-16816348 ] Karl Stoney commented on SOLR-13285: Is there any plan to back port this to solr `7.7.2`? The fact we're having to build solr 7 from a branch just to monkeypatch this is kinda frustrating as 7x is LTS? [~noble.paul] [~gerlowskija]? > ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during > replication > - > > Key: SOLR-13285 > URL: https://issues.apache.org/jira/browse/SOLR-13285 > Project: Solr > Issue Type: Bug > Security Level: Public(Default Security Level. Issues are Public) > Components: replication (java), SolrCloud, SolrJ >Affects Versions: 7.7, 7.7.1, 8.0 > Environment: centos 7 > solrcloud 7.7.1, 8.1.0 >Reporter: Karl Stoney >Assignee: Noble Paul >Priority: Major > Labels: newbie, replication > Attachments: SOLR-13285.patch, SOLR-13285.patch > > > Since upgrading to 7.7 (also tried 7.7.1, and 8.1.0) from 6.6.4, we're seeing > the following errors in the SolrCloud elected master for a given collection > when updates are written. This was after a full reindex of data (fresh > build). > {code:java} > request: > http://solr-1.search-solr.preprod.k8.atcloud.io:80/solr/at-uk_shard1_replica_n2/update?update.distrib=FROMLEADER=http%3A%2F%2Fsolr-2.search-solr.preprod.k8.atcloud.io%3A80%2Fsolr%2Fat-uk_shard1_replica_n1%2F=javabin=2 > Remote error message: org.apache.solr.common.util.ByteArrayUtf8CharSequence > cannot be cast to java.lang.String > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.sendUpdateStream(ConcurrentUpdateSolrClient.java:385) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:183) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176) > ~[metrics-core-3.2.6.jar:3.2.6] > at > org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > ~[?:1.8.0_191] > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > ~[?:1.8.0_191] > at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191] > {code} > Following this through to the replica, you'll see: > {code:java} > 08:35:22.060 [qtp1540374340-20] ERROR org.apache.solr.servlet.HttpSolrCall - > null:java.lang.ClassCastException: > org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to > java.lang.String > at > org.apache.solr.common.util.JavaBinCodec.readEnumFieldValue(JavaBinCodec.java:813) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:339) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.readSolrInputDocument(JavaBinCodec.java:640) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:337) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.readMapEntry(JavaBinCodec.java:819) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:341) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readOuterMostDocIterator(JavaBinUpdateRequestCodec.java:295) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readIterator(JavaBinUpdateRequestCodec.java:280) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:333) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readNamedList(JavaBinUpdateRequestCodec.java:235) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:298) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.unmarshal(JavaBinCodec.java:191) > at >
[jira] [Comment Edited] (SOLR-13392) Unable to start prometheus-exporter in 7x branch
[ https://issues.apache.org/jira/browse/SOLR-13392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16815451#comment-16815451 ] Karl Stoney edited comment on SOLR-13392 at 4/11/19 4:04 PM: - [~ichattopadhyaya] it is a fresh clone, it's built in a dockerfile, there's not even any cache, let alone straggling files: It's the same build process we used on to build the older commit `26b498d0a9d25626a15e25b0cf97c8339114263a` ``` git clone https://github.com/apache/lucene-solr.git -b $SOLR_BRANCH && \ cd lucene-solr && \ git reset --hard $SOLR_COMMIT && \ ant clean && \ ant ivy-bootstrap && \ ant compile && \ cd solr && \ ant server && \ ant -file build.xml prepare-release-no-sign && \ cp package/solr-*-SNAPSHOT.tgz /usr/local/autotrader/app/solr.tgz && \ rm -rf /usr/local/autotrader/app/lucene-solr && \ mkdir -p /opt/solr && \ tar -C /opt/solr --extract --file /usr/local/autotrader/app/solr.tgz --strip-components=1 && \ rm -Rf /opt/solr/docs/ ``` was (Author: kstoney): [~ichattopadhyaya] it is a fresh clone, it's built in a dockerfile, there's not even any cache, let alone straggling files: It's the same build process we used on to build the older commit `26b498d0a9d25626a15e25b0cf97c8339114263a` ``` git clone https://github.com/apache/lucene-solr.git -b $SOLR_BRANCH && \ cd lucene-solr && \ ant clean && \ ant ivy-bootstrap && \ cd solr && \ git reset --hard $SOLR_COMMIT && \ ant -file build.xml prepare-release-no-sign && \ cp package/solr-*-SNAPSHOT.tgz /usr/local/autotrader/app/solr.tgz && \ rm -rf /usr/local/autotrader/app/lucene-solr && \ mkdir -p /opt/solr && \ tar -C /opt/solr --extract --file /usr/local/autotrader/app/solr.tgz --strip-components=1 && \ rm -Rf /opt/solr/docs/ ``` > Unable to start prometheus-exporter in 7x branch > > > Key: SOLR-13392 > URL: https://issues.apache.org/jira/browse/SOLR-13392 > Project: Solr > Issue Type: Bug > Security Level: Public(Default Security Level. Issues are Public) > Components: metrics >Affects Versions: 7.7.2 >Reporter: Karl Stoney >Priority: Major > > Hi, > prometheus-exporter doesn't start in branch 7x on commit > 7dfe1c093b65f77407c2df4c2a1120a213aef166, it does work on > 26b498d0a9d25626a15e25b0cf97c8339114263a so something has changed between > those two commits causing this. > I am presuming it is > https://github.com/apache/lucene-solr/commit/e1eeafb5dc077976646b06f4cba4d77534963fa9#diff-3f7b27f0f087632739effa2aa508d77eR34 > Exception in thread "main" java.lang.NoClassDefFoundError: > org/apache/lucene/util/IOUtils > at > org.apache.solr.core.SolrResourceLoader.close(SolrResourceLoader.java:881) > at > org.apache.solr.prometheus.exporter.SolrExporter.loadMetricsConfiguration(SolrExporter.java:221) > at > org.apache.solr.prometheus.exporter.SolrExporter.main(SolrExporter.java:205) > Caused by: java.lang.ClassNotFoundException: org.apache.lucene.util.IOUtils > at java.net.URLClassLoader.findClass(URLClassLoader.java:382) > at java.lang.ClassLoader.loadClass(ClassLoader.java:424) > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349) > at java.lang.ClassLoader.loadClass(ClassLoader.java:357) > ... 3 more -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Updated] (SOLR-13392) Unable to start prometheus-exporter in 7x branch
[ https://issues.apache.org/jira/browse/SOLR-13392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karl Stoney updated SOLR-13392: --- Description: Hi, prometheus-exporter doesn't start in branch 7x on commit 7dfe1c093b65f77407c2df4c2a1120a213aef166, it does work on 26b498d0a9d25626a15e25b0cf97c8339114263a so something has changed between those two commits causing this. I am presuming it is https://github.com/apache/lucene-solr/commit/e1eeafb5dc077976646b06f4cba4d77534963fa9#diff-3f7b27f0f087632739effa2aa508d77eR34 Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/lucene/util/IOUtils at org.apache.solr.core.SolrResourceLoader.close(SolrResourceLoader.java:881) at org.apache.solr.prometheus.exporter.SolrExporter.loadMetricsConfiguration(SolrExporter.java:221) at org.apache.solr.prometheus.exporter.SolrExporter.main(SolrExporter.java:205) Caused by: java.lang.ClassNotFoundException: org.apache.lucene.util.IOUtils at java.net.URLClassLoader.findClass(URLClassLoader.java:382) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) ... 3 more was: Hi, prometheus-exporter doesn't start in branch 7x on commit 7dfe1c093b65f77407c2df4c2a1120a213aef166, it does work on 26b498d0a9d25626a15e25b0cf97c8339114263a so something has changed between those two commits causing this. I am presuming it is https://github.com/apache/lucene-solr/commit/e1eeafb5dc077976646b06f4cba4d77534963fa9#diff-3f7b27f0f087632739effa2aa508d77eR34 INFO - 2019-04-10 23:52:30.979; org.apache.solr.core.SolrResourceLoader; solr home defaulted to 'solr/' (could not find system property or JNDI) Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/lucene/util/IOUtils at org.apache.solr.core.SolrResourceLoader.close(SolrResourceLoader.java:881) at org.apache.solr.prometheus.exporter.SolrExporter.loadMetricsConfiguration(SolrExporter.java:221) at org.apache.solr.prometheus.exporter.SolrExporter.main(SolrExporter.java:205) Caused by: java.lang.ClassNotFoundException: org.apache.lucene.util.IOUtils at java.net.URLClassLoader.findClass(URLClassLoader.java:382) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) ... 3 more > Unable to start prometheus-exporter in 7x branch > > > Key: SOLR-13392 > URL: https://issues.apache.org/jira/browse/SOLR-13392 > Project: Solr > Issue Type: Bug > Security Level: Public(Default Security Level. Issues are Public) > Components: metrics >Affects Versions: 7.7.2 >Reporter: Karl Stoney >Priority: Major > > Hi, > prometheus-exporter doesn't start in branch 7x on commit > 7dfe1c093b65f77407c2df4c2a1120a213aef166, it does work on > 26b498d0a9d25626a15e25b0cf97c8339114263a so something has changed between > those two commits causing this. > I am presuming it is > https://github.com/apache/lucene-solr/commit/e1eeafb5dc077976646b06f4cba4d77534963fa9#diff-3f7b27f0f087632739effa2aa508d77eR34 > Exception in thread "main" java.lang.NoClassDefFoundError: > org/apache/lucene/util/IOUtils > at > org.apache.solr.core.SolrResourceLoader.close(SolrResourceLoader.java:881) > at > org.apache.solr.prometheus.exporter.SolrExporter.loadMetricsConfiguration(SolrExporter.java:221) > at > org.apache.solr.prometheus.exporter.SolrExporter.main(SolrExporter.java:205) > Caused by: java.lang.ClassNotFoundException: org.apache.lucene.util.IOUtils > at java.net.URLClassLoader.findClass(URLClassLoader.java:382) > at java.lang.ClassLoader.loadClass(ClassLoader.java:424) > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349) > at java.lang.ClassLoader.loadClass(ClassLoader.java:357) > ... 3 more -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Comment Edited] (SOLR-13392) Unable to start prometheus-exporter in 7x branch
[ https://issues.apache.org/jira/browse/SOLR-13392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16815451#comment-16815451 ] Karl Stoney edited comment on SOLR-13392 at 4/11/19 2:41 PM: - [~ichattopadhyaya] it is a fresh clone, it's built in a dockerfile, there's not even any cache, let alone straggling files: It's the same build process we used on to build the older commit `26b498d0a9d25626a15e25b0cf97c8339114263a` ``` git clone https://github.com/apache/lucene-solr.git -b $SOLR_BRANCH && \ cd lucene-solr && \ ant clean && \ ant ivy-bootstrap && \ cd solr && \ git reset --hard $SOLR_COMMIT && \ ant -file build.xml prepare-release-no-sign && \ cp package/solr-*-SNAPSHOT.tgz /usr/local/autotrader/app/solr.tgz && \ rm -rf /usr/local/autotrader/app/lucene-solr && \ mkdir -p /opt/solr && \ tar -C /opt/solr --extract --file /usr/local/autotrader/app/solr.tgz --strip-components=1 && \ rm -Rf /opt/solr/docs/ ``` was (Author: kstoney): [~ichattopadhyaya] it is a fresh clone, it's built in a dockerfile, there's not even any maven cache, let alone straggling files: It's the same build process we used on to build the older commit `26b498d0a9d25626a15e25b0cf97c8339114263a` ``` git clone https://github.com/apache/lucene-solr.git -b $SOLR_BRANCH && \ cd lucene-solr && \ ant clean && \ ant ivy-bootstrap && \ cd solr && \ git reset --hard $SOLR_COMMIT && \ ant -file build.xml prepare-release-no-sign && \ cp package/solr-*-SNAPSHOT.tgz /usr/local/autotrader/app/solr.tgz && \ rm -rf /usr/local/autotrader/app/lucene-solr && \ mkdir -p /opt/solr && \ tar -C /opt/solr --extract --file /usr/local/autotrader/app/solr.tgz --strip-components=1 && \ rm -Rf /opt/solr/docs/ ``` > Unable to start prometheus-exporter in 7x branch > > > Key: SOLR-13392 > URL: https://issues.apache.org/jira/browse/SOLR-13392 > Project: Solr > Issue Type: Bug > Security Level: Public(Default Security Level. Issues are Public) > Components: metrics >Affects Versions: 7.7.2 >Reporter: Karl Stoney >Priority: Major > > Hi, > prometheus-exporter doesn't start in branch 7x on commit > 7dfe1c093b65f77407c2df4c2a1120a213aef166, it does work on > 26b498d0a9d25626a15e25b0cf97c8339114263a so something has changed between > those two commits causing this. > I am presuming it is > https://github.com/apache/lucene-solr/commit/e1eeafb5dc077976646b06f4cba4d77534963fa9#diff-3f7b27f0f087632739effa2aa508d77eR34 > INFO - 2019-04-10 23:52:30.979; org.apache.solr.core.SolrResourceLoader; > solr home defaulted to 'solr/' (could not find system property or JNDI) > Exception in thread "main" java.lang.NoClassDefFoundError: > org/apache/lucene/util/IOUtils > at > org.apache.solr.core.SolrResourceLoader.close(SolrResourceLoader.java:881) > at > org.apache.solr.prometheus.exporter.SolrExporter.loadMetricsConfiguration(SolrExporter.java:221) > at > org.apache.solr.prometheus.exporter.SolrExporter.main(SolrExporter.java:205) > Caused by: java.lang.ClassNotFoundException: org.apache.lucene.util.IOUtils > at java.net.URLClassLoader.findClass(URLClassLoader.java:382) > at java.lang.ClassLoader.loadClass(ClassLoader.java:424) > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349) > at java.lang.ClassLoader.loadClass(ClassLoader.java:357) > ... 3 more -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-13392) Unable to start prometheus-exporter in 7x branch
[ https://issues.apache.org/jira/browse/SOLR-13392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16815451#comment-16815451 ] Karl Stoney commented on SOLR-13392: [~ichattopadhyaya] it is a fresh clone, it's built in a dockerfile, there's not even any maven cache, let alone straggling files: It's the same build process we used on to build the older commit `26b498d0a9d25626a15e25b0cf97c8339114263a` ``` git clone https://github.com/apache/lucene-solr.git -b $SOLR_BRANCH && \ cd lucene-solr && \ ant clean && \ ant ivy-bootstrap && \ cd solr && \ git reset --hard $SOLR_COMMIT && \ ant -file build.xml prepare-release-no-sign && \ cp package/solr-*-SNAPSHOT.tgz /usr/local/autotrader/app/solr.tgz && \ rm -rf /usr/local/autotrader/app/lucene-solr && \ mkdir -p /opt/solr && \ tar -C /opt/solr --extract --file /usr/local/autotrader/app/solr.tgz --strip-components=1 && \ rm -Rf /opt/solr/docs/ ``` > Unable to start prometheus-exporter in 7x branch > > > Key: SOLR-13392 > URL: https://issues.apache.org/jira/browse/SOLR-13392 > Project: Solr > Issue Type: Bug > Security Level: Public(Default Security Level. Issues are Public) > Components: metrics >Affects Versions: 7.7.2 >Reporter: Karl Stoney >Priority: Major > > Hi, > prometheus-exporter doesn't start in branch 7x on commit > 7dfe1c093b65f77407c2df4c2a1120a213aef166, it does work on > 26b498d0a9d25626a15e25b0cf97c8339114263a so something has changed between > those two commits causing this. > I am presuming it is > https://github.com/apache/lucene-solr/commit/e1eeafb5dc077976646b06f4cba4d77534963fa9#diff-3f7b27f0f087632739effa2aa508d77eR34 > INFO - 2019-04-10 23:52:30.979; org.apache.solr.core.SolrResourceLoader; > solr home defaulted to 'solr/' (could not find system property or JNDI) > Exception in thread "main" java.lang.NoClassDefFoundError: > org/apache/lucene/util/IOUtils > at > org.apache.solr.core.SolrResourceLoader.close(SolrResourceLoader.java:881) > at > org.apache.solr.prometheus.exporter.SolrExporter.loadMetricsConfiguration(SolrExporter.java:221) > at > org.apache.solr.prometheus.exporter.SolrExporter.main(SolrExporter.java:205) > Caused by: java.lang.ClassNotFoundException: org.apache.lucene.util.IOUtils > at java.net.URLClassLoader.findClass(URLClassLoader.java:382) > at java.lang.ClassLoader.loadClass(ClassLoader.java:424) > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349) > at java.lang.ClassLoader.loadClass(ClassLoader.java:357) > ... 3 more -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Reopened] (SOLR-13392) Unable to start prometheus-exporter in 7x branch
[ https://issues.apache.org/jira/browse/SOLR-13392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karl Stoney reopened SOLR-13392: [~ichattopadhyaya] reopening as you asked. > Unable to start prometheus-exporter in 7x branch > > > Key: SOLR-13392 > URL: https://issues.apache.org/jira/browse/SOLR-13392 > Project: Solr > Issue Type: Bug > Security Level: Public(Default Security Level. Issues are Public) > Components: metrics >Affects Versions: 7.7.2 >Reporter: Karl Stoney >Priority: Major > > Hi, > prometheus-exporter doesn't start in branch 7x on commit > 7dfe1c093b65f77407c2df4c2a1120a213aef166, it does work on > 26b498d0a9d25626a15e25b0cf97c8339114263a so something has changed between > those two commits causing this. > I am presuming it is > https://github.com/apache/lucene-solr/commit/e1eeafb5dc077976646b06f4cba4d77534963fa9#diff-3f7b27f0f087632739effa2aa508d77eR34 > INFO - 2019-04-10 23:52:30.979; org.apache.solr.core.SolrResourceLoader; > solr home defaulted to 'solr/' (could not find system property or JNDI) > Exception in thread "main" java.lang.NoClassDefFoundError: > org/apache/lucene/util/IOUtils > at > org.apache.solr.core.SolrResourceLoader.close(SolrResourceLoader.java:881) > at > org.apache.solr.prometheus.exporter.SolrExporter.loadMetricsConfiguration(SolrExporter.java:221) > at > org.apache.solr.prometheus.exporter.SolrExporter.main(SolrExporter.java:205) > Caused by: java.lang.ClassNotFoundException: org.apache.lucene.util.IOUtils > at java.net.URLClassLoader.findClass(URLClassLoader.java:382) > at java.lang.ClassLoader.loadClass(ClassLoader.java:424) > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349) > at java.lang.ClassLoader.loadClass(ClassLoader.java:357) > ... 3 more -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-13290) Prometheus metric exporter AsyncLogger: java.lang.NoClassDefFoundError
[ https://issues.apache.org/jira/browse/SOLR-13290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16814950#comment-16814950 ] Karl Stoney commented on SOLR-13290: Possibly linked to https://issues.apache.org/jira/browse/SOLR-13392, the same commit seems to have broken 7x prometheus-exporter too. > Prometheus metric exporter AsyncLogger: java.lang.NoClassDefFoundError > -- > > Key: SOLR-13290 > URL: https://issues.apache.org/jira/browse/SOLR-13290 > Project: Solr > Issue Type: Bug > Security Level: Public(Default Security Level. Issues are Public) > Components: metrics >Affects Versions: 8.0, 8.1 >Reporter: Karl Stoney >Assignee: Erick Erickson >Priority: Major > > Since this > commit:[https://github.com/apache/lucene-solr/commit/02eb9d34404b8fc7225ee7c5c867e194afae17a0] > The metrics exporter in branch_8x no longer starts > {code:java} > 2019-03-04 16:06:01,070 main ERROR Unable to invoke factory method in class > org.apache.logging.log4j.core.async.AsyncLoggerConfig for element > AsyncLogger: java.lang.NoClassDefFoundError > : com/lmax/disruptor/EventFactory java.lang.reflect.InvocationTargetException > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at > org.apache.logging.log4j.core.config.plugins.util.PluginBuilder.build(PluginBuilder.java:136) > at > org.apache.logging.log4j.core.config.AbstractConfiguration.createPluginObject(AbstractConfiguration.java:964) > at > org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:904) > at > org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:896) > at > org.apache.logging.log4j.core.config.AbstractConfiguration.doConfigure(AbstractConfiguration.java:514) > at > org.apache.logging.log4j.core.config.AbstractConfiguration.initialize(AbstractConfiguration.java:238) > at > org.apache.logging.log4j.core.config.AbstractConfiguration.start(AbstractConfiguration.java:250) > at > org.apache.logging.log4j.core.LoggerContext.setConfiguration(LoggerContext.java:548) > at > org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:620) > at > org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:637) > at org.apache.logging.log4j.core.LoggerContext.start(LoggerContext.java:231) > at > org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:153) > at > org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:45) > at org.apache.logging.log4j.LogManager.getContext(LogManager.java:194) > at > org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:121) > at > org.apache.logging.slf4j.Log4jLoggerFactory.getContext(Log4jLoggerFactory.java:43) > at > org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:46) > at > org.apache.logging.slf4j.Log4jLoggerFactory.getLogger(Log4jLoggerFactory.java:29) > at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:358) > at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:383) > at > org.apache.solr.prometheus.exporter.SolrExporter.(SolrExporter.java:48) > Caused by: java.lang.NoClassDefFoundError: com/lmax/disruptor/EventFactory > at > org.apache.logging.log4j.core.config.AbstractConfiguration.getAsyncLoggerConfigDelegate(AbstractConfiguration.java:203) > at > org.apache.logging.log4j.core.async.AsyncLoggerConfig.(AsyncLoggerConfig.java:91) > at > org.apache.logging.log4j.core.async.AsyncLoggerConfig.createLogger(AsyncLoggerConfig.java:273) > ... 25 more > Caused by: java.lang.ClassNotFoundException: com.lmax.disruptor.EventFactory > at java.net.URLClassLoader.findClass(URLClassLoader.java:382) > at java.lang.ClassLoader.loadClass(ClassLoader.java:424) > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349) > at java.lang.ClassLoader.loadClass(ClassLoader.java:357) > ... 28 more{code} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Updated] (SOLR-13392) Unable to start prometheus-exporter in 7x branch
[ https://issues.apache.org/jira/browse/SOLR-13392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karl Stoney updated SOLR-13392: --- Description: Hi, prometheus-exporter doesn't start in branch 7x on commit 7dfe1c093b65f77407c2df4c2a1120a213aef166, it does work on 26b498d0a9d25626a15e25b0cf97c8339114263a so something has changed between those two commits causing this. I am presuming it is https://github.com/apache/lucene-solr/commit/e1eeafb5dc077976646b06f4cba4d77534963fa9#diff-3f7b27f0f087632739effa2aa508d77eR34 INFO - 2019-04-10 23:52:30.979; org.apache.solr.core.SolrResourceLoader; solr home defaulted to 'solr/' (could not find system property or JNDI) Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/lucene/util/IOUtils at org.apache.solr.core.SolrResourceLoader.close(SolrResourceLoader.java:881) at org.apache.solr.prometheus.exporter.SolrExporter.loadMetricsConfiguration(SolrExporter.java:221) at org.apache.solr.prometheus.exporter.SolrExporter.main(SolrExporter.java:205) Caused by: java.lang.ClassNotFoundException: org.apache.lucene.util.IOUtils at java.net.URLClassLoader.findClass(URLClassLoader.java:382) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) ... 3 more was: Hi, prometheus-exporter doesn't start in branch 7x on commit 7dfe1c093b65f77407c2df4c2a1120a213aef166, it does work on 26b498d0a9d25626a15e25b0cf97c8339114263a so something has changed between those two commits causing this: INFO - 2019-04-10 23:52:30.979; org.apache.solr.core.SolrResourceLoader; solr home defaulted to 'solr/' (could not find system property or JNDI) Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/lucene/util/IOUtils at org.apache.solr.core.SolrResourceLoader.close(SolrResourceLoader.java:881) at org.apache.solr.prometheus.exporter.SolrExporter.loadMetricsConfiguration(SolrExporter.java:221) at org.apache.solr.prometheus.exporter.SolrExporter.main(SolrExporter.java:205) Caused by: java.lang.ClassNotFoundException: org.apache.lucene.util.IOUtils at java.net.URLClassLoader.findClass(URLClassLoader.java:382) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) ... 3 more > Unable to start prometheus-exporter in 7x branch > > > Key: SOLR-13392 > URL: https://issues.apache.org/jira/browse/SOLR-13392 > Project: Solr > Issue Type: Bug > Security Level: Public(Default Security Level. Issues are Public) > Components: metrics >Affects Versions: 7.7.2 >Reporter: Karl Stoney >Priority: Major > > Hi, > prometheus-exporter doesn't start in branch 7x on commit > 7dfe1c093b65f77407c2df4c2a1120a213aef166, it does work on > 26b498d0a9d25626a15e25b0cf97c8339114263a so something has changed between > those two commits causing this. > I am presuming it is > https://github.com/apache/lucene-solr/commit/e1eeafb5dc077976646b06f4cba4d77534963fa9#diff-3f7b27f0f087632739effa2aa508d77eR34 > INFO - 2019-04-10 23:52:30.979; org.apache.solr.core.SolrResourceLoader; > solr home defaulted to 'solr/' (could not find system property or JNDI) > Exception in thread "main" java.lang.NoClassDefFoundError: > org/apache/lucene/util/IOUtils > at > org.apache.solr.core.SolrResourceLoader.close(SolrResourceLoader.java:881) > at > org.apache.solr.prometheus.exporter.SolrExporter.loadMetricsConfiguration(SolrExporter.java:221) > at > org.apache.solr.prometheus.exporter.SolrExporter.main(SolrExporter.java:205) > Caused by: java.lang.ClassNotFoundException: org.apache.lucene.util.IOUtils > at java.net.URLClassLoader.findClass(URLClassLoader.java:382) > at java.lang.ClassLoader.loadClass(ClassLoader.java:424) > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349) > at java.lang.ClassLoader.loadClass(ClassLoader.java:357) > ... 3 more -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Created] (SOLR-13392) Unable to start prometheus-exporter in 7x branch
Karl Stoney created SOLR-13392: -- Summary: Unable to start prometheus-exporter in 7x branch Key: SOLR-13392 URL: https://issues.apache.org/jira/browse/SOLR-13392 Project: Solr Issue Type: Bug Security Level: Public (Default Security Level. Issues are Public) Components: metrics Affects Versions: 7.7.2 Reporter: Karl Stoney Hi, prometheus-exporter doesn't start in branch 7x on commit 7dfe1c093b65f77407c2df4c2a1120a213aef166, it does work on 26b498d0a9d25626a15e25b0cf97c8339114263a so something has changed between those two commits causing this: INFO - 2019-04-10 23:52:30.979; org.apache.solr.core.SolrResourceLoader; solr home defaulted to 'solr/' (could not find system property or JNDI) Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/lucene/util/IOUtils at org.apache.solr.core.SolrResourceLoader.close(SolrResourceLoader.java:881) at org.apache.solr.prometheus.exporter.SolrExporter.loadMetricsConfiguration(SolrExporter.java:221) at org.apache.solr.prometheus.exporter.SolrExporter.main(SolrExporter.java:205) Caused by: java.lang.ClassNotFoundException: org.apache.lucene.util.IOUtils at java.net.URLClassLoader.findClass(URLClassLoader.java:382) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) ... 3 more -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-13285) ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during replication
[ https://issues.apache.org/jira/browse/SOLR-13285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789380#comment-16789380 ] Karl Stoney commented on SOLR-13285: [~thomas.woeckinger] I would hope they will, in the interim however if you see my comment above I've attached a patch that you can build the 7.x branch with and do `git apply -v --index` > ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during > replication > - > > Key: SOLR-13285 > URL: https://issues.apache.org/jira/browse/SOLR-13285 > Project: Solr > Issue Type: Bug > Security Level: Public(Default Security Level. Issues are Public) > Components: replication (java), SolrCloud, SolrJ >Affects Versions: 7.7, 8.0, 7.7.1 > Environment: centos 7 > solrcloud 7.7.1, 8.1.0 >Reporter: Karl Stoney >Assignee: Noble Paul >Priority: Major > Labels: newbie, replication > Attachments: SOLR-13285.patch, SOLR-13285.patch > > > Since upgrading to 7.7 (also tried 7.7.1, and 8.1.0) from 6.6.4, we're seeing > the following errors in the SolrCloud elected master for a given collection > when updates are written. This was after a full reindex of data (fresh > build). > {code:java} > request: > http://solr-1.search-solr.preprod.k8.atcloud.io:80/solr/at-uk_shard1_replica_n2/update?update.distrib=FROMLEADER=http%3A%2F%2Fsolr-2.search-solr.preprod.k8.atcloud.io%3A80%2Fsolr%2Fat-uk_shard1_replica_n1%2F=javabin=2 > Remote error message: org.apache.solr.common.util.ByteArrayUtf8CharSequence > cannot be cast to java.lang.String > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.sendUpdateStream(ConcurrentUpdateSolrClient.java:385) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:183) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176) > ~[metrics-core-3.2.6.jar:3.2.6] > at > org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > ~[?:1.8.0_191] > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > ~[?:1.8.0_191] > at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191] > {code} > Following this through to the replica, you'll see: > {code:java} > 08:35:22.060 [qtp1540374340-20] ERROR org.apache.solr.servlet.HttpSolrCall - > null:java.lang.ClassCastException: > org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to > java.lang.String > at > org.apache.solr.common.util.JavaBinCodec.readEnumFieldValue(JavaBinCodec.java:813) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:339) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.readSolrInputDocument(JavaBinCodec.java:640) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:337) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.readMapEntry(JavaBinCodec.java:819) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:341) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readOuterMostDocIterator(JavaBinUpdateRequestCodec.java:295) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readIterator(JavaBinUpdateRequestCodec.java:280) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:333) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readNamedList(JavaBinUpdateRequestCodec.java:235) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:298) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.unmarshal(JavaBinCodec.java:191) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec.unmarshal(JavaBinUpdateRequestCodec.java:126) >
[jira] [Commented] (SOLR-13285) ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during replication
[ https://issues.apache.org/jira/browse/SOLR-13285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16783683#comment-16783683 ] Karl Stoney commented on SOLR-13285: [^SOLR-13285.patch] For what it's worth here is a patch for the 7x branch > ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during > replication > - > > Key: SOLR-13285 > URL: https://issues.apache.org/jira/browse/SOLR-13285 > Project: Solr > Issue Type: Bug > Security Level: Public(Default Security Level. Issues are Public) > Components: replication (java), SolrCloud, SolrJ >Affects Versions: 7.7, 7.7.1, 8.1 > Environment: centos 7 > solrcloud 7.7.1, 8.1.0 >Reporter: Karl Stoney >Assignee: Noble Paul >Priority: Major > Labels: newbie, replication > Attachments: SOLR-13285.patch, SOLR-13285.patch > > > Since upgrading to 7.7 (also tried 7.7.1, and 8.1.0) from 6.6.4, we're seeing > the following errors in the SolrCloud elected master for a given collection > when updates are written. This was after a full reindex of data (fresh > build). > {code:java} > request: > http://solr-1.search-solr.preprod.k8.atcloud.io:80/solr/at-uk_shard1_replica_n2/update?update.distrib=FROMLEADER=http%3A%2F%2Fsolr-2.search-solr.preprod.k8.atcloud.io%3A80%2Fsolr%2Fat-uk_shard1_replica_n1%2F=javabin=2 > Remote error message: org.apache.solr.common.util.ByteArrayUtf8CharSequence > cannot be cast to java.lang.String > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.sendUpdateStream(ConcurrentUpdateSolrClient.java:385) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:183) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176) > ~[metrics-core-3.2.6.jar:3.2.6] > at > org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > ~[?:1.8.0_191] > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > ~[?:1.8.0_191] > at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191] > {code} > Following this through to the replica, you'll see: > {code:java} > 08:35:22.060 [qtp1540374340-20] ERROR org.apache.solr.servlet.HttpSolrCall - > null:java.lang.ClassCastException: > org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to > java.lang.String > at > org.apache.solr.common.util.JavaBinCodec.readEnumFieldValue(JavaBinCodec.java:813) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:339) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.readSolrInputDocument(JavaBinCodec.java:640) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:337) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.readMapEntry(JavaBinCodec.java:819) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:341) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readOuterMostDocIterator(JavaBinUpdateRequestCodec.java:295) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readIterator(JavaBinUpdateRequestCodec.java:280) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:333) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readNamedList(JavaBinUpdateRequestCodec.java:235) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:298) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.unmarshal(JavaBinCodec.java:191) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec.unmarshal(JavaBinUpdateRequestCodec.java:126) > at > org.apache.solr.handler.loader.JavabinLoader.parseAndLoadDocs(JavabinLoader.java:123) > at >
[jira] [Updated] (SOLR-13285) ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during replication
[ https://issues.apache.org/jira/browse/SOLR-13285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karl Stoney updated SOLR-13285: --- Attachment: SOLR-13285.patch > ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during > replication > - > > Key: SOLR-13285 > URL: https://issues.apache.org/jira/browse/SOLR-13285 > Project: Solr > Issue Type: Bug > Security Level: Public(Default Security Level. Issues are Public) > Components: replication (java), SolrCloud, SolrJ >Affects Versions: 7.7, 7.7.1, 8.1 > Environment: centos 7 > solrcloud 7.7.1, 8.1.0 >Reporter: Karl Stoney >Assignee: Noble Paul >Priority: Major > Labels: newbie, replication > Attachments: SOLR-13285.patch, SOLR-13285.patch > > > Since upgrading to 7.7 (also tried 7.7.1, and 8.1.0) from 6.6.4, we're seeing > the following errors in the SolrCloud elected master for a given collection > when updates are written. This was after a full reindex of data (fresh > build). > {code:java} > request: > http://solr-1.search-solr.preprod.k8.atcloud.io:80/solr/at-uk_shard1_replica_n2/update?update.distrib=FROMLEADER=http%3A%2F%2Fsolr-2.search-solr.preprod.k8.atcloud.io%3A80%2Fsolr%2Fat-uk_shard1_replica_n1%2F=javabin=2 > Remote error message: org.apache.solr.common.util.ByteArrayUtf8CharSequence > cannot be cast to java.lang.String > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.sendUpdateStream(ConcurrentUpdateSolrClient.java:385) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:183) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176) > ~[metrics-core-3.2.6.jar:3.2.6] > at > org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > ~[?:1.8.0_191] > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > ~[?:1.8.0_191] > at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191] > {code} > Following this through to the replica, you'll see: > {code:java} > 08:35:22.060 [qtp1540374340-20] ERROR org.apache.solr.servlet.HttpSolrCall - > null:java.lang.ClassCastException: > org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to > java.lang.String > at > org.apache.solr.common.util.JavaBinCodec.readEnumFieldValue(JavaBinCodec.java:813) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:339) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.readSolrInputDocument(JavaBinCodec.java:640) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:337) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.readMapEntry(JavaBinCodec.java:819) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:341) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readOuterMostDocIterator(JavaBinUpdateRequestCodec.java:295) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readIterator(JavaBinUpdateRequestCodec.java:280) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:333) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readNamedList(JavaBinUpdateRequestCodec.java:235) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:298) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.unmarshal(JavaBinCodec.java:191) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec.unmarshal(JavaBinUpdateRequestCodec.java:126) > at > org.apache.solr.handler.loader.JavabinLoader.parseAndLoadDocs(JavabinLoader.java:123) > at > org.apache.solr.handler.loader.JavabinLoader.load(JavabinLoader.java:70) > at >
[jira] [Updated] (SOLR-13293) org.apache.solr.client.solrj.impl.ConcurrentUpdateHttp2SolrClient - Error consuming and closing http response stream.
[ https://issues.apache.org/jira/browse/SOLR-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karl Stoney updated SOLR-13293: --- Description: Hi, Testing out branch_8x, we're randomly seeing the following errors on a simple 3 node cluster. It doesn't appear to affect replication (the cluster remains green). They come in (mass, literally 1000s at a time) bulk. There we no network issues at the time. {code:java} 16:53:01.492 [updateExecutor-4-thread-34-processing-x:at-uk_shard1_replica_n1 r:core_node3 null n:solr-2.search-solr.preprod.k8.atcloud.io:80_solr c:at-uk s:shard1] ERROR org.apache.solr.client.solrj.impl.ConcurrentUpdateHttp2SolrClient - Error consuming and closing http response stream. java.nio.channels.AsynchronousCloseException: null at org.eclipse.jetty.client.util.InputStreamResponseListener$Input.read(InputStreamResponseListener.java:316) ~[jetty-client-9.4.14.v20181114.jar:9.4.14.v20181114] at java.io.InputStream.read(InputStream.java:101) ~[?:1.8.0_191] at org.eclipse.jetty.client.util.InputStreamResponseListener$Input.read(InputStreamResponseListener.java:287) ~[jetty-client-9.4.14.v20181114.jar:9.4.14.v20181114] at org.apache.solr.client.solrj.impl.ConcurrentUpdateHttp2SolrClient$Runner.sendUpdateStream(ConcurrentUpdateHttp2SolrClient.java:283) ~[solr-solrj-8.1.0-SNAPSHOT.jar:8.1.0-SNAPSHOT b14748e61fd147ea572f6545265b883fa69ed27f - root - 2019-03-04 16:30:04] at org.apache.solr.client.solrj.impl.ConcurrentUpdateHttp2SolrClient$Runner.run(ConcurrentUpdateHttp2SolrClient.java:176) ~[solr-solrj-8.1.0-SNAPSHOT.jar:8.1.0-SNAPSHOT b14748e61fd147ea572f6545265b883fa69ed27f - root - 2019-03-04 16:30:04] at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176) ~[metrics-core-3.2.6.jar:3.2.6] at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209) ~[solr-solrj-8.1.0-SNAPSHOT.jar:8.1.0-SNAPSHOT b14748e61fd147ea572f6545265b883fa69ed27f - root - 2019-03-04 16:30:04] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_191] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_191] at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191] {code} was: Hi, Testing out branch_8x, we're randomly seeing the following errors on a simple 3 node cluster. They come in (mass, literally 1000s at a time) bulk. There we no network issues at the time. {code:java} 16:53:01.492 [updateExecutor-4-thread-34-processing-x:at-uk_shard1_replica_n1 r:core_node3 null n:solr-2.search-solr.preprod.k8.atcloud.io:80_solr c:at-uk s:shard1] ERROR org.apache.solr.client.solrj.impl.ConcurrentUpdateHttp2SolrClient - Error consuming and closing http response stream. java.nio.channels.AsynchronousCloseException: null at org.eclipse.jetty.client.util.InputStreamResponseListener$Input.read(InputStreamResponseListener.java:316) ~[jetty-client-9.4.14.v20181114.jar:9.4.14.v20181114] at java.io.InputStream.read(InputStream.java:101) ~[?:1.8.0_191] at org.eclipse.jetty.client.util.InputStreamResponseListener$Input.read(InputStreamResponseListener.java:287) ~[jetty-client-9.4.14.v20181114.jar:9.4.14.v20181114] at org.apache.solr.client.solrj.impl.ConcurrentUpdateHttp2SolrClient$Runner.sendUpdateStream(ConcurrentUpdateHttp2SolrClient.java:283) ~[solr-solrj-8.1.0-SNAPSHOT.jar:8.1.0-SNAPSHOT b14748e61fd147ea572f6545265b883fa69ed27f - root - 2019-03-04 16:30:04] at org.apache.solr.client.solrj.impl.ConcurrentUpdateHttp2SolrClient$Runner.run(ConcurrentUpdateHttp2SolrClient.java:176) ~[solr-solrj-8.1.0-SNAPSHOT.jar:8.1.0-SNAPSHOT b14748e61fd147ea572f6545265b883fa69ed27f - root - 2019-03-04 16:30:04] at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176) ~[metrics-core-3.2.6.jar:3.2.6] at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209) ~[solr-solrj-8.1.0-SNAPSHOT.jar:8.1.0-SNAPSHOT b14748e61fd147ea572f6545265b883fa69ed27f - root - 2019-03-04 16:30:04] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_191] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_191] at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191] {code} > org.apache.solr.client.solrj.impl.ConcurrentUpdateHttp2SolrClient - Error > consuming and closing http response stream. > - > > Key: SOLR-13293 > URL: https://issues.apache.org/jira/browse/SOLR-13293 >
[jira] [Created] (SOLR-13293) org.apache.solr.client.solrj.impl.ConcurrentUpdateHttp2SolrClient - Error consuming and closing http response stream.
Karl Stoney created SOLR-13293: -- Summary: org.apache.solr.client.solrj.impl.ConcurrentUpdateHttp2SolrClient - Error consuming and closing http response stream. Key: SOLR-13293 URL: https://issues.apache.org/jira/browse/SOLR-13293 Project: Solr Issue Type: Bug Security Level: Public (Default Security Level. Issues are Public) Components: SolrJ Affects Versions: 8x Reporter: Karl Stoney Hi, Testing out branch_8x, we're randomly seeing the following errors on a simple 3 node cluster. They come in (mass, literally 1000s at a time) bulk. There we no network issues at the time. {code:java} 16:53:01.492 [updateExecutor-4-thread-34-processing-x:at-uk_shard1_replica_n1 r:core_node3 null n:solr-2.search-solr.preprod.k8.atcloud.io:80_solr c:at-uk s:shard1] ERROR org.apache.solr.client.solrj.impl.ConcurrentUpdateHttp2SolrClient - Error consuming and closing http response stream. java.nio.channels.AsynchronousCloseException: null at org.eclipse.jetty.client.util.InputStreamResponseListener$Input.read(InputStreamResponseListener.java:316) ~[jetty-client-9.4.14.v20181114.jar:9.4.14.v20181114] at java.io.InputStream.read(InputStream.java:101) ~[?:1.8.0_191] at org.eclipse.jetty.client.util.InputStreamResponseListener$Input.read(InputStreamResponseListener.java:287) ~[jetty-client-9.4.14.v20181114.jar:9.4.14.v20181114] at org.apache.solr.client.solrj.impl.ConcurrentUpdateHttp2SolrClient$Runner.sendUpdateStream(ConcurrentUpdateHttp2SolrClient.java:283) ~[solr-solrj-8.1.0-SNAPSHOT.jar:8.1.0-SNAPSHOT b14748e61fd147ea572f6545265b883fa69ed27f - root - 2019-03-04 16:30:04] at org.apache.solr.client.solrj.impl.ConcurrentUpdateHttp2SolrClient$Runner.run(ConcurrentUpdateHttp2SolrClient.java:176) ~[solr-solrj-8.1.0-SNAPSHOT.jar:8.1.0-SNAPSHOT b14748e61fd147ea572f6545265b883fa69ed27f - root - 2019-03-04 16:30:04] at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176) ~[metrics-core-3.2.6.jar:3.2.6] at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209) ~[solr-solrj-8.1.0-SNAPSHOT.jar:8.1.0-SNAPSHOT b14748e61fd147ea572f6545265b883fa69ed27f - root - 2019-03-04 16:30:04] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_191] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_191] at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191] {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Created] (SOLR-13290) Prometheus metric exporter AsyncLogger: java.lang.NoClassDefFoundError
Karl Stoney created SOLR-13290: -- Summary: Prometheus metric exporter AsyncLogger: java.lang.NoClassDefFoundError Key: SOLR-13290 URL: https://issues.apache.org/jira/browse/SOLR-13290 Project: Solr Issue Type: Bug Security Level: Public (Default Security Level. Issues are Public) Components: metrics Affects Versions: 8.x Reporter: Karl Stoney Since this commit:[https://github.com/apache/lucene-solr/commit/02eb9d34404b8fc7225ee7c5c867e194afae17a0] The metrics exporter in branch_8x no longer starts {code:java} 2019-03-04 16:06:01,070 main ERROR Unable to invoke factory method in class org.apache.logging.log4j.core.async.AsyncLoggerConfig for element AsyncLogger: java.lang.NoClassDefFoundError : com/lmax/disruptor/EventFactory java.lang.reflect.InvocationTargetException at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.logging.log4j.core.config.plugins.util.PluginBuilder.build(PluginBuilder.java:136) at org.apache.logging.log4j.core.config.AbstractConfiguration.createPluginObject(AbstractConfiguration.java:964) at org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:904) at org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:896) at org.apache.logging.log4j.core.config.AbstractConfiguration.doConfigure(AbstractConfiguration.java:514) at org.apache.logging.log4j.core.config.AbstractConfiguration.initialize(AbstractConfiguration.java:238) at org.apache.logging.log4j.core.config.AbstractConfiguration.start(AbstractConfiguration.java:250) at org.apache.logging.log4j.core.LoggerContext.setConfiguration(LoggerContext.java:548) at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:620) at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:637) at org.apache.logging.log4j.core.LoggerContext.start(LoggerContext.java:231) at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:153) at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:45) at org.apache.logging.log4j.LogManager.getContext(LogManager.java:194) at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:121) at org.apache.logging.slf4j.Log4jLoggerFactory.getContext(Log4jLoggerFactory.java:43) at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:46) at org.apache.logging.slf4j.Log4jLoggerFactory.getLogger(Log4jLoggerFactory.java:29) at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:358) at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:383) at org.apache.solr.prometheus.exporter.SolrExporter.(SolrExporter.java:48) Caused by: java.lang.NoClassDefFoundError: com/lmax/disruptor/EventFactory at org.apache.logging.log4j.core.config.AbstractConfiguration.getAsyncLoggerConfigDelegate(AbstractConfiguration.java:203) at org.apache.logging.log4j.core.async.AsyncLoggerConfig.(AsyncLoggerConfig.java:91) at org.apache.logging.log4j.core.async.AsyncLoggerConfig.createLogger(AsyncLoggerConfig.java:273) ... 25 more Caused by: java.lang.ClassNotFoundException: com.lmax.disruptor.EventFactory at java.net.URLClassLoader.findClass(URLClassLoader.java:382) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) ... 28 more{code} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-13285) ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during replication
[ https://issues.apache.org/jira/browse/SOLR-13285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16783191#comment-16783191 ] Karl Stoney commented on SOLR-13285: Thanks [~noble.paul] - is there any intention to back port this fix to 7x?  > ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during > replication > - > > Key: SOLR-13285 > URL: https://issues.apache.org/jira/browse/SOLR-13285 > Project: Solr > Issue Type: Bug > Security Level: Public(Default Security Level. Issues are Public) > Components: replication (java), SolrCloud, SolrJ >Affects Versions: 7.7, 7.7.1, 8.1 > Environment: centos 7 > solrcloud 7.7.1, 8.1.0 >Reporter: Karl Stoney >Assignee: Noble Paul >Priority: Major > Labels: newbie, replication > Attachments: SOLR-13285.patch > > > Since upgrading to 7.7 (also tried 7.7.1, and 8.1.0) from 6.6.4, we're seeing > the following errors in the SolrCloud elected master for a given collection > when updates are written. This was after a full reindex of data (fresh > build). > {code:java} > request: > http://solr-1.search-solr.preprod.k8.atcloud.io:80/solr/at-uk_shard1_replica_n2/update?update.distrib=FROMLEADER=http%3A%2F%2Fsolr-2.search-solr.preprod.k8.atcloud.io%3A80%2Fsolr%2Fat-uk_shard1_replica_n1%2F=javabin=2 > Remote error message: org.apache.solr.common.util.ByteArrayUtf8CharSequence > cannot be cast to java.lang.String > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.sendUpdateStream(ConcurrentUpdateSolrClient.java:385) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:183) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176) > ~[metrics-core-3.2.6.jar:3.2.6] > at > org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > ~[?:1.8.0_191] > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > ~[?:1.8.0_191] > at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191] > {code} > Following this through to the replica, you'll see: > {code:java} > 08:35:22.060 [qtp1540374340-20] ERROR org.apache.solr.servlet.HttpSolrCall - > null:java.lang.ClassCastException: > org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to > java.lang.String > at > org.apache.solr.common.util.JavaBinCodec.readEnumFieldValue(JavaBinCodec.java:813) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:339) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.readSolrInputDocument(JavaBinCodec.java:640) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:337) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.readMapEntry(JavaBinCodec.java:819) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:341) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readOuterMostDocIterator(JavaBinUpdateRequestCodec.java:295) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readIterator(JavaBinUpdateRequestCodec.java:280) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:333) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readNamedList(JavaBinUpdateRequestCodec.java:235) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:298) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.unmarshal(JavaBinCodec.java:191) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec.unmarshal(JavaBinUpdateRequestCodec.java:126) > at > org.apache.solr.handler.loader.JavabinLoader.parseAndLoadDocs(JavabinLoader.java:123) > at >
[jira] [Comment Edited] (SOLR-13285) ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during replication
[ https://issues.apache.org/jira/browse/SOLR-13285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782800#comment-16782800 ] Karl Stoney edited comment on SOLR-13285 at 3/3/19 6:11 PM: OK i can confirm the patch works on branch_8x @ commit 677a97edc7ba07a35f644792c98fa5ebf5667bb5 - thanks! What's the process for getting it merged in and part of the nightly builds so i'm not maintaining my fork? was (Author: kstoney): OK i can confirm the patch works on branch_8x @ commit 677a97edc7ba07a35f644792c98fa5ebf5667bb5 - thanks! > ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during > replication > - > > Key: SOLR-13285 > URL: https://issues.apache.org/jira/browse/SOLR-13285 > Project: Solr > Issue Type: Bug > Security Level: Public(Default Security Level. Issues are Public) > Components: replication (java), SolrCloud, SolrJ >Affects Versions: 7.7, 7.7.1, 8.1 > Environment: centos 7 > solrcloud 7.7.1, 8.1.0 >Reporter: Karl Stoney >Assignee: Noble Paul >Priority: Major > Labels: newbie, replication > Attachments: SOLR-13285.patch > > > Since upgrading to 7.7 (also tried 7.7.1, and 8.1.0) from 6.6.4, we're seeing > the following errors in the SolrCloud elected master for a given collection > when updates are written. This was after a full reindex of data (fresh > build). > {code:java} > request: > http://solr-1.search-solr.preprod.k8.atcloud.io:80/solr/at-uk_shard1_replica_n2/update?update.distrib=FROMLEADER=http%3A%2F%2Fsolr-2.search-solr.preprod.k8.atcloud.io%3A80%2Fsolr%2Fat-uk_shard1_replica_n1%2F=javabin=2 > Remote error message: org.apache.solr.common.util.ByteArrayUtf8CharSequence > cannot be cast to java.lang.String > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.sendUpdateStream(ConcurrentUpdateSolrClient.java:385) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:183) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176) > ~[metrics-core-3.2.6.jar:3.2.6] > at > org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > ~[?:1.8.0_191] > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > ~[?:1.8.0_191] > at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191] > {code} > Following this through to the replica, you'll see: > {code:java} > 08:35:22.060 [qtp1540374340-20] ERROR org.apache.solr.servlet.HttpSolrCall - > null:java.lang.ClassCastException: > org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to > java.lang.String > at > org.apache.solr.common.util.JavaBinCodec.readEnumFieldValue(JavaBinCodec.java:813) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:339) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.readSolrInputDocument(JavaBinCodec.java:640) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:337) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.readMapEntry(JavaBinCodec.java:819) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:341) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readOuterMostDocIterator(JavaBinUpdateRequestCodec.java:295) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readIterator(JavaBinUpdateRequestCodec.java:280) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:333) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readNamedList(JavaBinUpdateRequestCodec.java:235) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:298) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at >
[jira] [Commented] (SOLR-13285) ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during replication
[ https://issues.apache.org/jira/browse/SOLR-13285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782800#comment-16782800 ] Karl Stoney commented on SOLR-13285: OK i can confirm the patch works on branch_8x @ commit 677a97edc7ba07a35f644792c98fa5ebf5667bb5 - thanks! > ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during > replication > - > > Key: SOLR-13285 > URL: https://issues.apache.org/jira/browse/SOLR-13285 > Project: Solr > Issue Type: Bug > Security Level: Public(Default Security Level. Issues are Public) > Components: replication (java), SolrCloud, SolrJ >Affects Versions: 7.7, 7.7.1, 8.1 > Environment: centos 7 > solrcloud 7.7.1, 8.1.0 >Reporter: Karl Stoney >Assignee: Noble Paul >Priority: Major > Labels: newbie, replication > Attachments: SOLR-13285.patch > > > Since upgrading to 7.7 (also tried 7.7.1, and 8.1.0) from 6.6.4, we're seeing > the following errors in the SolrCloud elected master for a given collection > when updates are written. This was after a full reindex of data (fresh > build). > {code:java} > request: > http://solr-1.search-solr.preprod.k8.atcloud.io:80/solr/at-uk_shard1_replica_n2/update?update.distrib=FROMLEADER=http%3A%2F%2Fsolr-2.search-solr.preprod.k8.atcloud.io%3A80%2Fsolr%2Fat-uk_shard1_replica_n1%2F=javabin=2 > Remote error message: org.apache.solr.common.util.ByteArrayUtf8CharSequence > cannot be cast to java.lang.String > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.sendUpdateStream(ConcurrentUpdateSolrClient.java:385) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:183) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176) > ~[metrics-core-3.2.6.jar:3.2.6] > at > org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > ~[?:1.8.0_191] > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > ~[?:1.8.0_191] > at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191] > {code} > Following this through to the replica, you'll see: > {code:java} > 08:35:22.060 [qtp1540374340-20] ERROR org.apache.solr.servlet.HttpSolrCall - > null:java.lang.ClassCastException: > org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to > java.lang.String > at > org.apache.solr.common.util.JavaBinCodec.readEnumFieldValue(JavaBinCodec.java:813) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:339) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.readSolrInputDocument(JavaBinCodec.java:640) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:337) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.readMapEntry(JavaBinCodec.java:819) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:341) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readOuterMostDocIterator(JavaBinUpdateRequestCodec.java:295) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readIterator(JavaBinUpdateRequestCodec.java:280) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:333) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readNamedList(JavaBinUpdateRequestCodec.java:235) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:298) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.unmarshal(JavaBinCodec.java:191) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec.unmarshal(JavaBinUpdateRequestCodec.java:126) > at > org.apache.solr.handler.loader.JavabinLoader.parseAndLoadDocs(JavabinLoader.java:123) >
[jira] [Commented] (SOLR-13285) ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during replication
[ https://issues.apache.org/jira/browse/SOLR-13285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782668#comment-16782668 ] Karl Stoney commented on SOLR-13285: I've built from the branch_8x branch applying your patch and rolled that out to our test environments, will report back any issues. The patch wasn't compatible with the branch_7x > ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during > replication > - > > Key: SOLR-13285 > URL: https://issues.apache.org/jira/browse/SOLR-13285 > Project: Solr > Issue Type: Bug > Security Level: Public(Default Security Level. Issues are Public) > Components: replication (java), SolrCloud, SolrJ >Affects Versions: 7.7, 7.7.1, 8.1 > Environment: centos 7 > solrcloud 7.7.1, 8.1.0 >Reporter: Karl Stoney >Assignee: Noble Paul >Priority: Major > Labels: newbie, replication > Attachments: SOLR-13285.patch > > > Since upgrading to 7.7 (also tried 7.7.1, and 8.1.0) from 6.6.4, we're seeing > the following errors in the SolrCloud elected master for a given collection > when updates are written. This was after a full reindex of data (fresh > build). > {code:java} > request: > http://solr-1.search-solr.preprod.k8.atcloud.io:80/solr/at-uk_shard1_replica_n2/update?update.distrib=FROMLEADER=http%3A%2F%2Fsolr-2.search-solr.preprod.k8.atcloud.io%3A80%2Fsolr%2Fat-uk_shard1_replica_n1%2F=javabin=2 > Remote error message: org.apache.solr.common.util.ByteArrayUtf8CharSequence > cannot be cast to java.lang.String > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.sendUpdateStream(ConcurrentUpdateSolrClient.java:385) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:183) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176) > ~[metrics-core-3.2.6.jar:3.2.6] > at > org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > ~[?:1.8.0_191] > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > ~[?:1.8.0_191] > at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191] > {code} > Following this through to the replica, you'll see: > {code:java} > 08:35:22.060 [qtp1540374340-20] ERROR org.apache.solr.servlet.HttpSolrCall - > null:java.lang.ClassCastException: > org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to > java.lang.String > at > org.apache.solr.common.util.JavaBinCodec.readEnumFieldValue(JavaBinCodec.java:813) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:339) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.readSolrInputDocument(JavaBinCodec.java:640) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:337) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.readMapEntry(JavaBinCodec.java:819) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:341) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readOuterMostDocIterator(JavaBinUpdateRequestCodec.java:295) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readIterator(JavaBinUpdateRequestCodec.java:280) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:333) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readNamedList(JavaBinUpdateRequestCodec.java:235) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:298) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.unmarshal(JavaBinCodec.java:191) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec.unmarshal(JavaBinUpdateRequestCodec.java:126) > at >
[jira] [Updated] (SOLR-13285) ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during replication
[ https://issues.apache.org/jira/browse/SOLR-13285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karl Stoney updated SOLR-13285: --- Priority: Major (was: Minor) > ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during > replication > - > > Key: SOLR-13285 > URL: https://issues.apache.org/jira/browse/SOLR-13285 > Project: Solr > Issue Type: Bug > Security Level: Public(Default Security Level. Issues are Public) > Components: replication (java), SolrCloud, SolrJ >Affects Versions: 7.7, 7.7.1, 8.1 > Environment: centos 7 > solrcloud 7.7.1, 8.1.0 >Reporter: Karl Stoney >Assignee: Noble Paul >Priority: Major > Labels: newbie, replication > Attachments: SOLR-13285.patch > > > Since upgrading to 7.7 (also tried 7.7.1, and 8.1.0) from 6.6.4, we're seeing > the following errors in the SolrCloud elected master for a given collection > when updates are written. This was after a full reindex of data (fresh > build). > {code:java} > request: > http://solr-1.search-solr.preprod.k8.atcloud.io:80/solr/at-uk_shard1_replica_n2/update?update.distrib=FROMLEADER=http%3A%2F%2Fsolr-2.search-solr.preprod.k8.atcloud.io%3A80%2Fsolr%2Fat-uk_shard1_replica_n1%2F=javabin=2 > Remote error message: org.apache.solr.common.util.ByteArrayUtf8CharSequence > cannot be cast to java.lang.String > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.sendUpdateStream(ConcurrentUpdateSolrClient.java:385) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:183) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176) > ~[metrics-core-3.2.6.jar:3.2.6] > at > org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > ~[?:1.8.0_191] > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > ~[?:1.8.0_191] > at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191] > {code} > Following this through to the replica, you'll see: > {code:java} > 08:35:22.060 [qtp1540374340-20] ERROR org.apache.solr.servlet.HttpSolrCall - > null:java.lang.ClassCastException: > org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to > java.lang.String > at > org.apache.solr.common.util.JavaBinCodec.readEnumFieldValue(JavaBinCodec.java:813) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:339) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.readSolrInputDocument(JavaBinCodec.java:640) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:337) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.readMapEntry(JavaBinCodec.java:819) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:341) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readOuterMostDocIterator(JavaBinUpdateRequestCodec.java:295) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readIterator(JavaBinUpdateRequestCodec.java:280) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:333) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readNamedList(JavaBinUpdateRequestCodec.java:235) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:298) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.unmarshal(JavaBinCodec.java:191) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec.unmarshal(JavaBinUpdateRequestCodec.java:126) > at > org.apache.solr.handler.loader.JavabinLoader.parseAndLoadDocs(JavabinLoader.java:123) > at > org.apache.solr.handler.loader.JavabinLoader.load(JavabinLoader.java:70) > at >
[jira] [Commented] (SOLR-13285) ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during replication
[ https://issues.apache.org/jira/browse/SOLR-13285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782372#comment-16782372 ] Karl Stoney commented on SOLR-13285: Hi guys, I was wrong, the issue persists in 8.1.0: ``` 01:37:14.171 [qtp568221876-3618] ERROR org.apache.solr.handler.RequestHandlerBase - java.lang.ClassCastException: org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to java.lang.String at org.apache.solr.common.util.JavaBinCodec.readEnumFieldValue(JavaBinCodec.java:821) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:339) at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) at org.apache.solr.common.util.JavaBinCodec.readSolrInputDocument(JavaBinCodec.java:640) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:337) ``` > ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during > replication > - > > Key: SOLR-13285 > URL: https://issues.apache.org/jira/browse/SOLR-13285 > Project: Solr > Issue Type: Bug > Security Level: Public(Default Security Level. Issues are Public) > Components: replication (java), SolrCloud, SolrJ >Affects Versions: 7.7, 7.7.1, 8.1 > Environment: centos 7 > solrcloud 7.7.1, 8.1.0 >Reporter: Karl Stoney >Assignee: Noble Paul >Priority: Minor > Labels: newbie, replication > Attachments: SOLR-13285.patch > > > Since upgrading to 7.7 (also tried 7.7.1, and 8.1.0) from 6.6.4, we're seeing > the following errors in the SolrCloud elected master for a given collection > when updates are written. This was after a full reindex of data (fresh > build). > {code:java} > request: > http://solr-1.search-solr.preprod.k8.atcloud.io:80/solr/at-uk_shard1_replica_n2/update?update.distrib=FROMLEADER=http%3A%2F%2Fsolr-2.search-solr.preprod.k8.atcloud.io%3A80%2Fsolr%2Fat-uk_shard1_replica_n1%2F=javabin=2 > Remote error message: org.apache.solr.common.util.ByteArrayUtf8CharSequence > cannot be cast to java.lang.String > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.sendUpdateStream(ConcurrentUpdateSolrClient.java:385) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:183) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176) > ~[metrics-core-3.2.6.jar:3.2.6] > at > org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > ~[?:1.8.0_191] > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > ~[?:1.8.0_191] > at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191] > {code} > Following this through to the replica, you'll see: > {code:java} > 08:35:22.060 [qtp1540374340-20] ERROR org.apache.solr.servlet.HttpSolrCall - > null:java.lang.ClassCastException: > org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to > java.lang.String > at > org.apache.solr.common.util.JavaBinCodec.readEnumFieldValue(JavaBinCodec.java:813) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:339) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.readSolrInputDocument(JavaBinCodec.java:640) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:337) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.readMapEntry(JavaBinCodec.java:819) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:341) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readOuterMostDocIterator(JavaBinUpdateRequestCodec.java:295) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readIterator(JavaBinUpdateRequestCodec.java:280) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:333) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) >
[jira] [Comment Edited] (SOLR-13285) ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during replication
[ https://issues.apache.org/jira/browse/SOLR-13285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782372#comment-16782372 ] Karl Stoney edited comment on SOLR-13285 at 3/2/19 1:18 PM: Hi guys, Unfortunately the issue does still persist in 8.1.0: {code:java} 01:37:14.171 [qtp568221876-3618] ERROR org.apache.solr.handler.RequestHandlerBase - java.lang.ClassCastException: org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to java.lang.String at org.apache.solr.common.util.JavaBinCodec.readEnumFieldValue(JavaBinCodec.java:821) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:339) at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) at org.apache.solr.common.util.JavaBinCodec.readSolrInputDocument(JavaBinCodec.java:640) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:337) {code} When this happens, the replicas seem to enter a recovering state for a short period, and then come back, so it's really quite disruptive! Our replicas have gone into a recovering state 77 times in the last 14 hours. I'm more than happy trying out a nightly in our environment if you can resolve this? was (Author: kstoney): Hi guys, I was wrong, the issue persists in 8.1.0: {code:java} 01:37:14.171 [qtp568221876-3618] ERROR org.apache.solr.handler.RequestHandlerBase - java.lang.ClassCastException: org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to java.lang.String at org.apache.solr.common.util.JavaBinCodec.readEnumFieldValue(JavaBinCodec.java:821) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:339) at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) at org.apache.solr.common.util.JavaBinCodec.readSolrInputDocument(JavaBinCodec.java:640) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:337) {code} When this happens, the replicas seem to enter a recovering state for a short period, and then come back, so it's really quite disruptive! Our replicas have gone into a recovering state 77 times in the last 14 hours. I'm more than happy trying out a nightly in our environment if you can resolve this? > ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during > replication > - > > Key: SOLR-13285 > URL: https://issues.apache.org/jira/browse/SOLR-13285 > Project: Solr > Issue Type: Bug > Security Level: Public(Default Security Level. Issues are Public) > Components: replication (java), SolrCloud, SolrJ >Affects Versions: 7.7, 7.7.1, 8.1 > Environment: centos 7 > solrcloud 7.7.1, 8.1.0 >Reporter: Karl Stoney >Assignee: Noble Paul >Priority: Minor > Labels: newbie, replication > Attachments: SOLR-13285.patch > > > Since upgrading to 7.7 (also tried 7.7.1, and 8.1.0) from 6.6.4, we're seeing > the following errors in the SolrCloud elected master for a given collection > when updates are written. This was after a full reindex of data (fresh > build). > {code:java} > request: > http://solr-1.search-solr.preprod.k8.atcloud.io:80/solr/at-uk_shard1_replica_n2/update?update.distrib=FROMLEADER=http%3A%2F%2Fsolr-2.search-solr.preprod.k8.atcloud.io%3A80%2Fsolr%2Fat-uk_shard1_replica_n1%2F=javabin=2 > Remote error message: org.apache.solr.common.util.ByteArrayUtf8CharSequence > cannot be cast to java.lang.String > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.sendUpdateStream(ConcurrentUpdateSolrClient.java:385) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:183) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176) > ~[metrics-core-3.2.6.jar:3.2.6] > at > org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > ~[?:1.8.0_191] > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > ~[?:1.8.0_191] > at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191] > {code} > Following this through to the replica, you'll see: > {code:java} > 08:35:22.060
[jira] [Comment Edited] (SOLR-13285) ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during replication
[ https://issues.apache.org/jira/browse/SOLR-13285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782372#comment-16782372 ] Karl Stoney edited comment on SOLR-13285 at 3/2/19 1:17 PM: Hi guys, I was wrong, the issue persists in 8.1.0: {code:java} 01:37:14.171 [qtp568221876-3618] ERROR org.apache.solr.handler.RequestHandlerBase - java.lang.ClassCastException: org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to java.lang.String at org.apache.solr.common.util.JavaBinCodec.readEnumFieldValue(JavaBinCodec.java:821) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:339) at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) at org.apache.solr.common.util.JavaBinCodec.readSolrInputDocument(JavaBinCodec.java:640) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:337) {code} When this happens, the replicas seem to enter a recovering state for a short period, and then come back, so it's really quite disruptive! Our replicas have gone into a recovering state 77 times in the last 14 hours. I'm more than happy trying out a nightly in our environment if you can resolve this? was (Author: kstoney): Hi guys, I was wrong, the issue persists in 8.1.0: {code:java} 01:37:14.171 [qtp568221876-3618] ERROR org.apache.solr.handler.RequestHandlerBase - java.lang.ClassCastException: org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to java.lang.String at org.apache.solr.common.util.JavaBinCodec.readEnumFieldValue(JavaBinCodec.java:821) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:339) at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) at org.apache.solr.common.util.JavaBinCodec.readSolrInputDocument(JavaBinCodec.java:640) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:337) {code} When this happens, the replicas seem to enter a recovering state for a short period, and then come back, so it's really quite disruptive! I'm more than happy trying out a nightly in our environment if you can resolve this? > ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during > replication > - > > Key: SOLR-13285 > URL: https://issues.apache.org/jira/browse/SOLR-13285 > Project: Solr > Issue Type: Bug > Security Level: Public(Default Security Level. Issues are Public) > Components: replication (java), SolrCloud, SolrJ >Affects Versions: 7.7, 7.7.1, 8.1 > Environment: centos 7 > solrcloud 7.7.1, 8.1.0 >Reporter: Karl Stoney >Assignee: Noble Paul >Priority: Minor > Labels: newbie, replication > Attachments: SOLR-13285.patch > > > Since upgrading to 7.7 (also tried 7.7.1, and 8.1.0) from 6.6.4, we're seeing > the following errors in the SolrCloud elected master for a given collection > when updates are written. This was after a full reindex of data (fresh > build). > {code:java} > request: > http://solr-1.search-solr.preprod.k8.atcloud.io:80/solr/at-uk_shard1_replica_n2/update?update.distrib=FROMLEADER=http%3A%2F%2Fsolr-2.search-solr.preprod.k8.atcloud.io%3A80%2Fsolr%2Fat-uk_shard1_replica_n1%2F=javabin=2 > Remote error message: org.apache.solr.common.util.ByteArrayUtf8CharSequence > cannot be cast to java.lang.String > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.sendUpdateStream(ConcurrentUpdateSolrClient.java:385) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:183) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176) > ~[metrics-core-3.2.6.jar:3.2.6] > at > org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > ~[?:1.8.0_191] > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > ~[?:1.8.0_191] > at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191] > {code} > Following this through to the replica, you'll see: > {code:java} > 08:35:22.060 [qtp1540374340-20] ERROR org.apache.solr.servlet.HttpSolrCall - >
[jira] [Comment Edited] (SOLR-13285) ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during replication
[ https://issues.apache.org/jira/browse/SOLR-13285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782372#comment-16782372 ] Karl Stoney edited comment on SOLR-13285 at 3/2/19 1:15 PM: Hi guys, I was wrong, the issue persists in 8.1.0: {code:java} 01:37:14.171 [qtp568221876-3618] ERROR org.apache.solr.handler.RequestHandlerBase - java.lang.ClassCastException: org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to java.lang.String at org.apache.solr.common.util.JavaBinCodec.readEnumFieldValue(JavaBinCodec.java:821) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:339) at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) at org.apache.solr.common.util.JavaBinCodec.readSolrInputDocument(JavaBinCodec.java:640) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:337) {code} When this happens, the replicas seem to enter a recovering state for a short period, and then come back, so it's really quite disruptive! I'm more than happy trying out a nightly in our environment if you can resolve this? was (Author: kstoney): Hi guys, I was wrong, the issue persists in 8.1.0: ``` 01:37:14.171 [qtp568221876-3618] ERROR org.apache.solr.handler.RequestHandlerBase - java.lang.ClassCastException: org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to java.lang.String at org.apache.solr.common.util.JavaBinCodec.readEnumFieldValue(JavaBinCodec.java:821) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:339) at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) at org.apache.solr.common.util.JavaBinCodec.readSolrInputDocument(JavaBinCodec.java:640) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:337) ``` When this happens, the replicas seem to enter a recovering state for a short period, and then come back, so it's really quite disruptive! I'm more than happy trying out a nightly in our environment if you can resolve this? > ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during > replication > - > > Key: SOLR-13285 > URL: https://issues.apache.org/jira/browse/SOLR-13285 > Project: Solr > Issue Type: Bug > Security Level: Public(Default Security Level. Issues are Public) > Components: replication (java), SolrCloud, SolrJ >Affects Versions: 7.7, 7.7.1, 8.1 > Environment: centos 7 > solrcloud 7.7.1, 8.1.0 >Reporter: Karl Stoney >Assignee: Noble Paul >Priority: Minor > Labels: newbie, replication > Attachments: SOLR-13285.patch > > > Since upgrading to 7.7 (also tried 7.7.1, and 8.1.0) from 6.6.4, we're seeing > the following errors in the SolrCloud elected master for a given collection > when updates are written. This was after a full reindex of data (fresh > build). > {code:java} > request: > http://solr-1.search-solr.preprod.k8.atcloud.io:80/solr/at-uk_shard1_replica_n2/update?update.distrib=FROMLEADER=http%3A%2F%2Fsolr-2.search-solr.preprod.k8.atcloud.io%3A80%2Fsolr%2Fat-uk_shard1_replica_n1%2F=javabin=2 > Remote error message: org.apache.solr.common.util.ByteArrayUtf8CharSequence > cannot be cast to java.lang.String > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.sendUpdateStream(ConcurrentUpdateSolrClient.java:385) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:183) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176) > ~[metrics-core-3.2.6.jar:3.2.6] > at > org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > ~[?:1.8.0_191] > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > ~[?:1.8.0_191] > at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191] > {code} > Following this through to the replica, you'll see: > {code:java} > 08:35:22.060 [qtp1540374340-20] ERROR org.apache.solr.servlet.HttpSolrCall - > null:java.lang.ClassCastException: > org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to >
[jira] [Comment Edited] (SOLR-13285) ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during replication
[ https://issues.apache.org/jira/browse/SOLR-13285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782372#comment-16782372 ] Karl Stoney edited comment on SOLR-13285 at 3/2/19 1:15 PM: Hi guys, I was wrong, the issue persists in 8.1.0: ``` 01:37:14.171 [qtp568221876-3618] ERROR org.apache.solr.handler.RequestHandlerBase - java.lang.ClassCastException: org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to java.lang.String at org.apache.solr.common.util.JavaBinCodec.readEnumFieldValue(JavaBinCodec.java:821) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:339) at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) at org.apache.solr.common.util.JavaBinCodec.readSolrInputDocument(JavaBinCodec.java:640) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:337) ``` When this happens, the replicas seem to enter a recovering state for a short period, and then come back, so it's really quite disruptive! I'm more than happy trying out a nightly in our environment if you can resolve this? was (Author: kstoney): Hi guys, I was wrong, the issue persists in 8.1.0: ``` 01:37:14.171 [qtp568221876-3618] ERROR org.apache.solr.handler.RequestHandlerBase - java.lang.ClassCastException: org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to java.lang.String at org.apache.solr.common.util.JavaBinCodec.readEnumFieldValue(JavaBinCodec.java:821) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:339) at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) at org.apache.solr.common.util.JavaBinCodec.readSolrInputDocument(JavaBinCodec.java:640) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:337) ``` > ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during > replication > - > > Key: SOLR-13285 > URL: https://issues.apache.org/jira/browse/SOLR-13285 > Project: Solr > Issue Type: Bug > Security Level: Public(Default Security Level. Issues are Public) > Components: replication (java), SolrCloud, SolrJ >Affects Versions: 7.7, 7.7.1, 8.1 > Environment: centos 7 > solrcloud 7.7.1, 8.1.0 >Reporter: Karl Stoney >Assignee: Noble Paul >Priority: Minor > Labels: newbie, replication > Attachments: SOLR-13285.patch > > > Since upgrading to 7.7 (also tried 7.7.1, and 8.1.0) from 6.6.4, we're seeing > the following errors in the SolrCloud elected master for a given collection > when updates are written. This was after a full reindex of data (fresh > build). > {code:java} > request: > http://solr-1.search-solr.preprod.k8.atcloud.io:80/solr/at-uk_shard1_replica_n2/update?update.distrib=FROMLEADER=http%3A%2F%2Fsolr-2.search-solr.preprod.k8.atcloud.io%3A80%2Fsolr%2Fat-uk_shard1_replica_n1%2F=javabin=2 > Remote error message: org.apache.solr.common.util.ByteArrayUtf8CharSequence > cannot be cast to java.lang.String > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.sendUpdateStream(ConcurrentUpdateSolrClient.java:385) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:183) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176) > ~[metrics-core-3.2.6.jar:3.2.6] > at > org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > ~[?:1.8.0_191] > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > ~[?:1.8.0_191] > at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191] > {code} > Following this through to the replica, you'll see: > {code:java} > 08:35:22.060 [qtp1540374340-20] ERROR org.apache.solr.servlet.HttpSolrCall - > null:java.lang.ClassCastException: > org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to > java.lang.String > at > org.apache.solr.common.util.JavaBinCodec.readEnumFieldValue(JavaBinCodec.java:813) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:339) > at
[jira] [Commented] (SOLR-13285) ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during replication
[ https://issues.apache.org/jira/browse/SOLR-13285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781976#comment-16781976 ] Karl Stoney commented on SOLR-13285: Hello! The 8.x build I used was: https://builds.apache.org/job/Solr-Artifacts-8.x/lastBuild/artifact/solr/package/solr-8.1.0-35.tgz and it comes up at 8.1 in the GUI. Let me know if there is anything else you need. Karl > ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during > replication > - > > Key: SOLR-13285 > URL: https://issues.apache.org/jira/browse/SOLR-13285 > Project: Solr > Issue Type: Bug > Security Level: Public(Default Security Level. Issues are Public) > Components: replication (java), SolrCloud, SolrJ >Affects Versions: 7.7, 7.7.1, 8.1 > Environment: centos 7 > solrcloud 7.7.1, 8.1.0 >Reporter: Karl Stoney >Priority: Minor > Labels: newbie, replication > > Since upgrading to 7.7 (also tried 7.7.1, and 8.1.0) from 6.6.4, we're seeing > the following errors in the SolrCloud elected master for a given collection > when updates are written. This was after a full reindex of data (fresh > build). > {code:java} > request: > http://solr-1.search-solr.preprod.k8.atcloud.io:80/solr/at-uk_shard1_replica_n2/update?update.distrib=FROMLEADER=http%3A%2F%2Fsolr-2.search-solr.preprod.k8.atcloud.io%3A80%2Fsolr%2Fat-uk_shard1_replica_n1%2F=javabin=2 > Remote error message: org.apache.solr.common.util.ByteArrayUtf8CharSequence > cannot be cast to java.lang.String > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.sendUpdateStream(ConcurrentUpdateSolrClient.java:385) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:183) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176) > ~[metrics-core-3.2.6.jar:3.2.6] > at > org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > ~[?:1.8.0_191] > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > ~[?:1.8.0_191] > at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191] > {code} > Following this through to the replica, you'll see: > {code:java} > 08:35:22.060 [qtp1540374340-20] ERROR org.apache.solr.servlet.HttpSolrCall - > null:java.lang.ClassCastException: > org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to > java.lang.String > at > org.apache.solr.common.util.JavaBinCodec.readEnumFieldValue(JavaBinCodec.java:813) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:339) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.readSolrInputDocument(JavaBinCodec.java:640) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:337) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.readMapEntry(JavaBinCodec.java:819) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:341) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readOuterMostDocIterator(JavaBinUpdateRequestCodec.java:295) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readIterator(JavaBinUpdateRequestCodec.java:280) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:333) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readNamedList(JavaBinUpdateRequestCodec.java:235) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:298) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.unmarshal(JavaBinCodec.java:191) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec.unmarshal(JavaBinUpdateRequestCodec.java:126) > at >
[jira] [Updated] (SOLR-13285) ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during replication
[ https://issues.apache.org/jira/browse/SOLR-13285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karl Stoney updated SOLR-13285: --- Description: Since upgrading to 7.6 (also tried 7.7, and 8.1), we're seeing the following errors in the SolrCloud elected master for a given collection: {code:java} request: http://solr-1.search-solr.preprod.k8.atcloud.io:80/solr/at-uk_shard1_replica_n2/update?update.distrib=FROMLEADER=http%3A%2F%2Fsolr-2.search-solr.preprod.k8.atcloud.io%3A80%2Fsolr%2Fat-uk_shard1_replica_n1%2F=javabin=2 Remote error message: org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to java.lang.String at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.sendUpdateStream(ConcurrentUpdateSolrClient.java:385) ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - ishan - 2019-02-23 02:39:09] at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:183) ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - ishan - 2019-02-23 02:39:09] at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176) ~[metrics-core-3.2.6.jar:3.2.6] at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209) ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - ishan - 2019-02-23 02:39:09] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_191] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_191] at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191] {code} I noticed there some similar issues raised in 7x (https://issues.apache.org/jira/browse/SOLR-13255), so I don't know if this is the same sort of thing? {code:java} 08:35:22.060 [qtp1540374340-20] ERROR org.apache.solr.servlet.HttpSolrCall - null:java.lang.ClassCastException: org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to java.lang.String at org.apache.solr.common.util.JavaBinCodec.readEnumFieldValue(JavaBinCodec.java:813) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:339) at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) at org.apache.solr.common.util.JavaBinCodec.readSolrInputDocument(JavaBinCodec.java:640) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:337) at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) at org.apache.solr.common.util.JavaBinCodec.readMapEntry(JavaBinCodec.java:819) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:341) at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readOuterMostDocIterator(JavaBinUpdateRequestCodec.java:295) at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readIterator(JavaBinUpdateRequestCodec.java:280) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:333) at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readNamedList(JavaBinUpdateRequestCodec.java:235) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:298) at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) at org.apache.solr.common.util.JavaBinCodec.unmarshal(JavaBinCodec.java:191) at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec.unmarshal(JavaBinUpdateRequestCodec.java:126) at org.apache.solr.handler.loader.JavabinLoader.parseAndLoadDocs(JavabinLoader.java:123) at org.apache.solr.handler.loader.JavabinLoader.load(JavabinLoader.java:70) at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97) at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199) at org.apache.solr.core.SolrCore.execute(SolrCore.java:2551) at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:710) at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:516) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:395) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:341) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1602) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146)
[jira] [Updated] (SOLR-13285) ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during replication
[ https://issues.apache.org/jira/browse/SOLR-13285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karl Stoney updated SOLR-13285: --- Description: Since upgrading to 7.7 (also tried 7.7.1, and 8.1.0) from 6.6.4, we're seeing the following errors in the SolrCloud elected master for a given collection when updates are written. This was after a full reindex of data (fresh build). {code:java} request: http://solr-1.search-solr.preprod.k8.atcloud.io:80/solr/at-uk_shard1_replica_n2/update?update.distrib=FROMLEADER=http%3A%2F%2Fsolr-2.search-solr.preprod.k8.atcloud.io%3A80%2Fsolr%2Fat-uk_shard1_replica_n1%2F=javabin=2 Remote error message: org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to java.lang.String at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.sendUpdateStream(ConcurrentUpdateSolrClient.java:385) ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - ishan - 2019-02-23 02:39:09] at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:183) ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - ishan - 2019-02-23 02:39:09] at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176) ~[metrics-core-3.2.6.jar:3.2.6] at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209) ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - ishan - 2019-02-23 02:39:09] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_191] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_191] at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191] {code} Following this through to the replica, you'll see: {code:java} 08:35:22.060 [qtp1540374340-20] ERROR org.apache.solr.servlet.HttpSolrCall - null:java.lang.ClassCastException: org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to java.lang.String at org.apache.solr.common.util.JavaBinCodec.readEnumFieldValue(JavaBinCodec.java:813) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:339) at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) at org.apache.solr.common.util.JavaBinCodec.readSolrInputDocument(JavaBinCodec.java:640) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:337) at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) at org.apache.solr.common.util.JavaBinCodec.readMapEntry(JavaBinCodec.java:819) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:341) at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readOuterMostDocIterator(JavaBinUpdateRequestCodec.java:295) at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readIterator(JavaBinUpdateRequestCodec.java:280) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:333) at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readNamedList(JavaBinUpdateRequestCodec.java:235) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:298) at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) at org.apache.solr.common.util.JavaBinCodec.unmarshal(JavaBinCodec.java:191) at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec.unmarshal(JavaBinUpdateRequestCodec.java:126) at org.apache.solr.handler.loader.JavabinLoader.parseAndLoadDocs(JavabinLoader.java:123) at org.apache.solr.handler.loader.JavabinLoader.load(JavabinLoader.java:70) at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97) at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199) at org.apache.solr.core.SolrCore.execute(SolrCore.java:2551) at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:710) at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:516) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:395) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:341) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1602) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at
[jira] [Updated] (SOLR-13285) ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during replication
[ https://issues.apache.org/jira/browse/SOLR-13285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karl Stoney updated SOLR-13285: --- Description: Since upgrading to 7.7 (also tried 7.7.1, and 8.1.0) from 6.6.4, we're seeing the following errors in the SolrCloud elected master for a given collection when updates are written. This was after a full reindex of data (fresh build). {code:java} request: http://solr-1.search-solr.preprod.k8.atcloud.io:80/solr/at-uk_shard1_replica_n2/update?update.distrib=FROMLEADER=http%3A%2F%2Fsolr-2.search-solr.preprod.k8.atcloud.io%3A80%2Fsolr%2Fat-uk_shard1_replica_n1%2F=javabin=2 Remote error message: org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to java.lang.String at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.sendUpdateStream(ConcurrentUpdateSolrClient.java:385) ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - ishan - 2019-02-23 02:39:09] at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:183) ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - ishan - 2019-02-23 02:39:09] at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176) ~[metrics-core-3.2.6.jar:3.2.6] at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209) ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - ishan - 2019-02-23 02:39:09] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_191] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_191] at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191] {code} I noticed there some similar issues raised in 7x (https://issues.apache.org/jira/browse/SOLR-13255), so I don't know if this is the same sort of thing? {code:java} 08:35:22.060 [qtp1540374340-20] ERROR org.apache.solr.servlet.HttpSolrCall - null:java.lang.ClassCastException: org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to java.lang.String at org.apache.solr.common.util.JavaBinCodec.readEnumFieldValue(JavaBinCodec.java:813) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:339) at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) at org.apache.solr.common.util.JavaBinCodec.readSolrInputDocument(JavaBinCodec.java:640) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:337) at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) at org.apache.solr.common.util.JavaBinCodec.readMapEntry(JavaBinCodec.java:819) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:341) at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readOuterMostDocIterator(JavaBinUpdateRequestCodec.java:295) at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readIterator(JavaBinUpdateRequestCodec.java:280) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:333) at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readNamedList(JavaBinUpdateRequestCodec.java:235) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:298) at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) at org.apache.solr.common.util.JavaBinCodec.unmarshal(JavaBinCodec.java:191) at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec.unmarshal(JavaBinUpdateRequestCodec.java:126) at org.apache.solr.handler.loader.JavabinLoader.parseAndLoadDocs(JavabinLoader.java:123) at org.apache.solr.handler.loader.JavabinLoader.load(JavabinLoader.java:70) at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97) at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199) at org.apache.solr.core.SolrCore.execute(SolrCore.java:2551) at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:710) at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:516) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:395) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:341) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1602) at
[jira] [Updated] (SOLR-13285) ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during replication
[ https://issues.apache.org/jira/browse/SOLR-13285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karl Stoney updated SOLR-13285: --- Description: Since upgrading to 7.7 (also tried 7.7.1, and 8.1.0), we're seeing the following errors in the SolrCloud elected master for a given collection when updates are written. {code:java} request: http://solr-1.search-solr.preprod.k8.atcloud.io:80/solr/at-uk_shard1_replica_n2/update?update.distrib=FROMLEADER=http%3A%2F%2Fsolr-2.search-solr.preprod.k8.atcloud.io%3A80%2Fsolr%2Fat-uk_shard1_replica_n1%2F=javabin=2 Remote error message: org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to java.lang.String at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.sendUpdateStream(ConcurrentUpdateSolrClient.java:385) ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - ishan - 2019-02-23 02:39:09] at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:183) ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - ishan - 2019-02-23 02:39:09] at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176) ~[metrics-core-3.2.6.jar:3.2.6] at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209) ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - ishan - 2019-02-23 02:39:09] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_191] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_191] at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191] {code} I noticed there some similar issues raised in 7x (https://issues.apache.org/jira/browse/SOLR-13255), so I don't know if this is the same sort of thing? {code:java} 08:35:22.060 [qtp1540374340-20] ERROR org.apache.solr.servlet.HttpSolrCall - null:java.lang.ClassCastException: org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to java.lang.String at org.apache.solr.common.util.JavaBinCodec.readEnumFieldValue(JavaBinCodec.java:813) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:339) at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) at org.apache.solr.common.util.JavaBinCodec.readSolrInputDocument(JavaBinCodec.java:640) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:337) at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) at org.apache.solr.common.util.JavaBinCodec.readMapEntry(JavaBinCodec.java:819) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:341) at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readOuterMostDocIterator(JavaBinUpdateRequestCodec.java:295) at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readIterator(JavaBinUpdateRequestCodec.java:280) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:333) at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readNamedList(JavaBinUpdateRequestCodec.java:235) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:298) at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) at org.apache.solr.common.util.JavaBinCodec.unmarshal(JavaBinCodec.java:191) at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec.unmarshal(JavaBinUpdateRequestCodec.java:126) at org.apache.solr.handler.loader.JavabinLoader.parseAndLoadDocs(JavabinLoader.java:123) at org.apache.solr.handler.loader.JavabinLoader.load(JavabinLoader.java:70) at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97) at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199) at org.apache.solr.core.SolrCore.execute(SolrCore.java:2551) at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:710) at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:516) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:395) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:341) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1602) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540) at
[jira] [Commented] (SOLR-13285) ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during replication
[ https://issues.apache.org/jira/browse/SOLR-13285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781956#comment-16781956 ] Karl Stoney commented on SOLR-13285: A recent development to this is that we did a rolling upgrade from 7.7.1 to 8.1.0, and the issues still presented. I decided to totally reindex the data on 8.1.0 and we haven't seen the error since, so it's something to do with the data was being index on 7.x. I'll continue to run load over the weekend and see what manifests. > ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during > replication > - > > Key: SOLR-13285 > URL: https://issues.apache.org/jira/browse/SOLR-13285 > Project: Solr > Issue Type: Bug > Security Level: Public(Default Security Level. Issues are Public) > Components: replication (java), SolrCloud, SolrJ >Affects Versions: 7.7, 7.7.1, 8.1 > Environment: centos 7 > solrcloud 7.7.1, 8.1.0 >Reporter: Karl Stoney >Priority: Minor > Labels: newbie, replication > > Since upgrading to 7.7 (also tried 7.7.1, and 8.1.0), we're seeing the > following errors in the SolrCloud elected master for a given collection when > updates are written. > {code:java} > request: > http://solr-1.search-solr.preprod.k8.atcloud.io:80/solr/at-uk_shard1_replica_n2/update?update.distrib=FROMLEADER=http%3A%2F%2Fsolr-2.search-solr.preprod.k8.atcloud.io%3A80%2Fsolr%2Fat-uk_shard1_replica_n1%2F=javabin=2 > Remote error message: org.apache.solr.common.util.ByteArrayUtf8CharSequence > cannot be cast to java.lang.String > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.sendUpdateStream(ConcurrentUpdateSolrClient.java:385) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:183) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176) > ~[metrics-core-3.2.6.jar:3.2.6] > at > org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209) > ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - > ishan - 2019-02-23 02:39:09] > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > ~[?:1.8.0_191] > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > ~[?:1.8.0_191] > at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191] > {code} > I noticed there some similar issues raised in 7x > (https://issues.apache.org/jira/browse/SOLR-13255), so I don't know if this > is the same sort of thing? > {code:java} > 08:35:22.060 [qtp1540374340-20] ERROR org.apache.solr.servlet.HttpSolrCall - > null:java.lang.ClassCastException: > org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to > java.lang.String > at > org.apache.solr.common.util.JavaBinCodec.readEnumFieldValue(JavaBinCodec.java:813) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:339) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.readSolrInputDocument(JavaBinCodec.java:640) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:337) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.readMapEntry(JavaBinCodec.java:819) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:341) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readOuterMostDocIterator(JavaBinUpdateRequestCodec.java:295) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readIterator(JavaBinUpdateRequestCodec.java:280) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:333) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readNamedList(JavaBinUpdateRequestCodec.java:235) > at > org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:298) > at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) > at > org.apache.solr.common.util.JavaBinCodec.unmarshal(JavaBinCodec.java:191) > at >
[jira] [Updated] (SOLR-13285) ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during replication
[ https://issues.apache.org/jira/browse/SOLR-13285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karl Stoney updated SOLR-13285: --- Description: Since upgrading to 7.6 (also tried 7.7, and 8.1), we're seeing the following errors in the SolrCloud elected master for a given collection when updates are written. {code:java} request: http://solr-1.search-solr.preprod.k8.atcloud.io:80/solr/at-uk_shard1_replica_n2/update?update.distrib=FROMLEADER=http%3A%2F%2Fsolr-2.search-solr.preprod.k8.atcloud.io%3A80%2Fsolr%2Fat-uk_shard1_replica_n1%2F=javabin=2 Remote error message: org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to java.lang.String at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.sendUpdateStream(ConcurrentUpdateSolrClient.java:385) ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - ishan - 2019-02-23 02:39:09] at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:183) ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - ishan - 2019-02-23 02:39:09] at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176) ~[metrics-core-3.2.6.jar:3.2.6] at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209) ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - ishan - 2019-02-23 02:39:09] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_191] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_191] at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191] {code} I noticed there some similar issues raised in 7x (https://issues.apache.org/jira/browse/SOLR-13255), so I don't know if this is the same sort of thing? {code:java} 08:35:22.060 [qtp1540374340-20] ERROR org.apache.solr.servlet.HttpSolrCall - null:java.lang.ClassCastException: org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to java.lang.String at org.apache.solr.common.util.JavaBinCodec.readEnumFieldValue(JavaBinCodec.java:813) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:339) at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) at org.apache.solr.common.util.JavaBinCodec.readSolrInputDocument(JavaBinCodec.java:640) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:337) at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) at org.apache.solr.common.util.JavaBinCodec.readMapEntry(JavaBinCodec.java:819) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:341) at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readOuterMostDocIterator(JavaBinUpdateRequestCodec.java:295) at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readIterator(JavaBinUpdateRequestCodec.java:280) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:333) at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readNamedList(JavaBinUpdateRequestCodec.java:235) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:298) at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) at org.apache.solr.common.util.JavaBinCodec.unmarshal(JavaBinCodec.java:191) at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec.unmarshal(JavaBinUpdateRequestCodec.java:126) at org.apache.solr.handler.loader.JavabinLoader.parseAndLoadDocs(JavabinLoader.java:123) at org.apache.solr.handler.loader.JavabinLoader.load(JavabinLoader.java:70) at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97) at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199) at org.apache.solr.core.SolrCore.execute(SolrCore.java:2551) at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:710) at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:516) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:395) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:341) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1602) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540) at
[jira] [Updated] (SOLR-13285) ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during replication
[ https://issues.apache.org/jira/browse/SOLR-13285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karl Stoney updated SOLR-13285: --- Description: Since upgrading to 7.6 (also tried 7.7, and 8.1), we're seeing the following errors in the SolrCloud elected master for a given collection: request: http://solr-1.search-solr.preprod.k8.atcloud.io:80/solr/at-uk_shard1_replica_n2/update?update.distrib=FROMLEADER=http%3A%2F%2Fsolr-2.search-solr.preprod.k8.atcloud.io%3A80%2Fsolr%2Fat-uk_shard1_replica_n1%2F=javabin=2 Remote error message: org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to java.lang.String at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.sendUpdateStream(ConcurrentUpdateSolrClient.java:385) ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - ishan - 2019-02-23 02:39:09] at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:183) ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - ishan - 2019-02-23 02:39:09] at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176) ~[metrics-core-3.2.6.jar:3.2.6] at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209) ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - ishan - 2019-02-23 02:39:09] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_191] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_191] at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191] I noticed there some similar issues raised in 7x (https://issues.apache.org/jira/browse/SOLR-13255), so I don't know if this is the same sort of thing? 08:35:22.060 [qtp1540374340-20] ERROR org.apache.solr.servlet.HttpSolrCall - null:java.lang.ClassCastException: org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to java.lang.String at org.apache.solr.common.util.JavaBinCodec.readEnumFieldValue(JavaBinCodec.java:813) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:339) at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) at org.apache.solr.common.util.JavaBinCodec.readSolrInputDocument(JavaBinCodec.java:640) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:337) at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) at org.apache.solr.common.util.JavaBinCodec.readMapEntry(JavaBinCodec.java:819) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:341) at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readOuterMostDocIterator(JavaBinUpdateRequestCodec.java:295) at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readIterator(JavaBinUpdateRequestCodec.java:280) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:333) at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readNamedList(JavaBinUpdateRequestCodec.java:235) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:298) at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) at org.apache.solr.common.util.JavaBinCodec.unmarshal(JavaBinCodec.java:191) at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec.unmarshal(JavaBinUpdateRequestCodec.java:126) at org.apache.solr.handler.loader.JavabinLoader.parseAndLoadDocs(JavabinLoader.java:123) at org.apache.solr.handler.loader.JavabinLoader.load(JavabinLoader.java:70) at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97) at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199) at org.apache.solr.core.SolrCore.execute(SolrCore.java:2551) at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:710) at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:516) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:395) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:341) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1602) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at
[jira] [Updated] (SOLR-13285) ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during replication
[ https://issues.apache.org/jira/browse/SOLR-13285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karl Stoney updated SOLR-13285: --- Description: Since upgrading to 7.6 (also tried 7.7, and 8.1), we're seeing the following errors in the SolrCloud elected master for a given collection: {{request: [http://solr-1.search-solr.preprod.k8.atcloud.io:80/solr/at-uk_shard1_replica_n2/update?update.distrib=FROMLEADER=http%3A%2F%2Fsolr-2.search-solr.preprod.k8.atcloud.io%3A80%2Fsolr%2Fat-uk_shard1_replica_n1%2F=javabin=2|http://solr-1.search-solr.preprod.k8.atcloud.io/solr/at-uk_shard1_replica_n2/update?update.distrib=FROMLEADER=http%3A%2F%2Fsolr-2.search-solr.preprod.k8.atcloud.io%3A80%2Fsolr%2Fat-uk_shard1_replica_n1%2F=javabin=2]}} {{ Remote error message: org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to java.lang.String}} {{ at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.sendUpdateStream(ConcurrentUpdateSolrClient.java:385) ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - ishan - 2019-02-23 02:39:09]}} {{ at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:183) ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - ishan - 2019-02-23 02:39:09]}} {{ at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176) ~[metrics-core-3.2.6.jar:3.2.6]}} {{ at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209) ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - ishan - 2019-02-23 02:39:09]}} {{ at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_191]}} {{ at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_191]}} {{ at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191]}} I noticed there some similar issues raised in 7x (https://issues.apache.org/jira/browse/SOLR-13255), so I don't know if this is the same sort of thing? {{08:35:22.060 [qtp1540374340-20] ERROR org.apache.solr.servlet.HttpSolrCall - null:java.lang.ClassCastException: org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to java.lang.String}} {{ at org.apache.solr.common.util.JavaBinCodec.readEnumFieldValue(JavaBinCodec.java:813)}} {{ at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:339)}} {{ at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278)}} {{ at org.apache.solr.common.util.JavaBinCodec.readSolrInputDocument(JavaBinCodec.java:640)}} {{ at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:337)}} {{ at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278)}} {{ at org.apache.solr.common.util.JavaBinCodec.readMapEntry(JavaBinCodec.java:819)}} {{ at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:341)}} {{ at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278)}} {{ at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readOuterMostDocIterator(JavaBinUpdateRequestCodec.java:295)}} {{ at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readIterator(JavaBinUpdateRequestCodec.java:280)}} {{ at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:333)}} {{ at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278)}} {{ at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readNamedList(JavaBinUpdateRequestCodec.java:235)}} {{ at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:298)}} {{ at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278)}} {{ at org.apache.solr.common.util.JavaBinCodec.unmarshal(JavaBinCodec.java:191)}} {{ at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec.unmarshal(JavaBinUpdateRequestCodec.java:126)}} {{ at org.apache.solr.handler.loader.JavabinLoader.parseAndLoadDocs(JavabinLoader.java:123)}} {{ at org.apache.solr.handler.loader.JavabinLoader.load(JavabinLoader.java:70)}} {{ at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97)}} {{ at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)}} {{ at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)}} {{ at org.apache.solr.core.SolrCore.execute(SolrCore.java:2551)}} {{ at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:710)}} {{ at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:516)}} {{ at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:395)}} {{ at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:341)}} {{ at
[jira] [Updated] (SOLR-13285) ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during replication
[ https://issues.apache.org/jira/browse/SOLR-13285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karl Stoney updated SOLR-13285: --- Description: {{Since upgrading to 7.6 (also tried 7.7, and 8.1), we're seeing the following errors in the SolrCloud elected master for a given collection:}} {{request: [http://solr-1.search-solr.preprod.k8.atcloud.io:80/solr/at-uk_shard1_replica_n2/update?update.distrib=FROMLEADER=http%3A%2F%2Fsolr-2.search-solr.preprod.k8.atcloud.io%3A80%2Fsolr%2Fat-uk_shard1_replica_n1%2F=javabin=2|http://solr-1.search-solr.preprod.k8.atcloud.io/solr/at-uk_shard1_replica_n2/update?update.distrib=FROMLEADER=http%3A%2F%2Fsolr-2.search-solr.preprod.k8.atcloud.io%3A80%2Fsolr%2Fat-uk_shard1_replica_n1%2F=javabin=2]}} {{ Remote error message: org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to java.lang.String}} {{ at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.sendUpdateStream(ConcurrentUpdateSolrClient.java:385) ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - ishan - 2019-02-23 02:39:09]}} {{ at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:183) ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - ishan - 2019-02-23 02:39:09]}} {{ at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176) ~[metrics-core-3.2.6.jar:3.2.6]}} {{ at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209) ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - ishan - 2019-02-23 02:39:09]}} {{ at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_191]}} {{ at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_191]}} {{ at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191]}} {{If you follow this through to the replica you'll see:}} {{08:35:22.060 [qtp1540374340-20] ERROR org.apache.solr.servlet.HttpSolrCall - null:java.lang.ClassCastException: org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to java.lang.String}} {{ at org.apache.solr.common.util.JavaBinCodec.readEnumFieldValue(JavaBinCodec.java:813)}} {{ at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:339)}} {{ at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278)}} {{ at org.apache.solr.common.util.JavaBinCodec.readSolrInputDocument(JavaBinCodec.java:640)}} {{ at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:337)}} {{ at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278)}} {{ at org.apache.solr.common.util.JavaBinCodec.readMapEntry(JavaBinCodec.java:819)}} {{ at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:341)}} {{ at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278)}} {{ at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readOuterMostDocIterator(JavaBinUpdateRequestCodec.java:295)}} {{ at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readIterator(JavaBinUpdateRequestCodec.java:280)}} {{ at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:333)}} {{ at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278)}} {{ at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readNamedList(JavaBinUpdateRequestCodec.java:235)}} {{ at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:298)}} {{ at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278)}} {{ at org.apache.solr.common.util.JavaBinCodec.unmarshal(JavaBinCodec.java:191)}} {{ at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec.unmarshal(JavaBinUpdateRequestCodec.java:126)}} {{ at org.apache.solr.handler.loader.JavabinLoader.parseAndLoadDocs(JavabinLoader.java:123)}} {{ at org.apache.solr.handler.loader.JavabinLoader.load(JavabinLoader.java:70)}} {{ at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97)}} {{ at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)}} {{ at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)}} {{ at org.apache.solr.core.SolrCore.execute(SolrCore.java:2551)}} {{ at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:710)}} {{ at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:516)}} {{ at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:395)}} {{ at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:341)}} {{ at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1602)}} {{ at
[jira] [Created] (SOLR-13285) ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during replication
Karl Stoney created SOLR-13285: -- Summary: ByteArrayUtf8CharSequence cannot be cast to java.lang.String exception during replication Key: SOLR-13285 URL: https://issues.apache.org/jira/browse/SOLR-13285 Project: Solr Issue Type: Bug Security Level: Public (Default Security Level. Issues are Public) Components: replication (java), SolrCloud, SolrJ Affects Versions: 7.7, 7.6, 8.1 Environment: centos 7 solrcloud 7.7.1, 8.1.0 Reporter: Karl Stoney Since upgrading to 7.6 (also tried 7.7, and 8.1), we're seeing the following errors in the SolrCloud elected master for a given collection: ``` request: http://solr-1.search-solr.preprod.k8.atcloud.io:80/solr/at-uk_shard1_replica_n2/update?update.distrib=FROMLEADER=http%3A%2F%2Fsolr-2.search-solr.preprod.k8.atcloud.io%3A80%2Fsolr%2Fat-uk_shard1_replica_n1%2F=javabin=2 Remote error message: org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to java.lang.String at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.sendUpdateStream(ConcurrentUpdateSolrClient.java:385) ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - ishan - 2019-02-23 02:39:09] at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:183) ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - ishan - 2019-02-23 02:39:09] at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176) ~[metrics-core-3.2.6.jar:3.2.6] at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209) ~[solr-solrj-7.7.1.jar:7.7.1 5bf96d32f88eb8a2f5e775339885cd6ba84a3b58 - ishan - 2019-02-23 02:39:09] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_191] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_191] at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191] ``` If you follow this through to the replica you'll see: ``` 08:35:22.060 [qtp1540374340-20] ERROR org.apache.solr.servlet.HttpSolrCall - null:java.lang.ClassCastException: org.apache.solr.common.util.ByteArrayUtf8CharSequence cannot be cast to java.lang.String at org.apache.solr.common.util.JavaBinCodec.readEnumFieldValue(JavaBinCodec.java:813) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:339) at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) at org.apache.solr.common.util.JavaBinCodec.readSolrInputDocument(JavaBinCodec.java:640) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:337) at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) at org.apache.solr.common.util.JavaBinCodec.readMapEntry(JavaBinCodec.java:819) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:341) at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readOuterMostDocIterator(JavaBinUpdateRequestCodec.java:295) at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readIterator(JavaBinUpdateRequestCodec.java:280) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:333) at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readNamedList(JavaBinUpdateRequestCodec.java:235) at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:298) at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:278) at org.apache.solr.common.util.JavaBinCodec.unmarshal(JavaBinCodec.java:191) at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec.unmarshal(JavaBinUpdateRequestCodec.java:126) at org.apache.solr.handler.loader.JavabinLoader.parseAndLoadDocs(JavabinLoader.java:123) at org.apache.solr.handler.loader.JavabinLoader.load(JavabinLoader.java:70) at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97) at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199) at org.apache.solr.core.SolrCore.execute(SolrCore.java:2551) at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:710) at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:516) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:395) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:341)