The problem goes away with concat strategy.
assemblyMergeStrategy in assembly := {
case PathList("META-INF", xs @ _*) => MergeStrategy.discard
case "reference.conf => MergeStrategy.concat
case x => MergeStrategy.first
}
Thanks for the help!
On Thursday, May 18, 2017 at 3:03:54 PM UTC+2, Konrad Malawski wrote:
>
> Hi there,
>
> > case x => MergeStrategy.first
>
> is wrong. Configuration must be concated - so all reference.conf and
> application.conf must be concated together.
>
> --
> Konrad `ktoso` Malawski
> Akka <http://akka.io> @ Lightbend <http://lightbend.com>
>
> On 18 May 2017 at 14:53:55, [email protected] <javascript:> (
> [email protected] <javascript:>) wrote:
>
> I am trying to incorporate akka http to spark. when submitting job with
> command
>
> spark-submit --class example.MyHttp
> /path/to/target/scala-2.11/my-assembly-0.1.jar
>
> it throws exceptions "Could not resolve substitution to a value:
> ${akka.stream.blocking-io-dispatcher}"
>
> Exception in thread "main"
> com.typesafe.config.ConfigException$UnresolvedSubstitution: reference.conf
> @
> jar:file:/path/to/project/target/scala-2.11/my-assembly-0.1.jar!/reference.conf:
>
> 42: Could not resolve substitution to a value:
> ${akka.stream.blocking-io-dispatcher}
> at
> com.typesafe.config.impl.ConfigReference.resolveSubstitutions(ConfigReference.java:108)
> at
> com.typesafe.config.impl.ResolveContext.realResolve(ResolveContext.java:179)
> at
> com.typesafe.config.impl.ResolveContext.resolve(ResolveContext.java:142)
> at
> com.typesafe.config.impl.SimpleConfigObject$ResolveModifier.modifyChildMayThrow(SimpleConfigObject.java:379)
> at
> com.typesafe.config.impl.SimpleConfigObject.modifyMayThrow(SimpleConfigObject.java:312)
> at
> com.typesafe.config.impl.SimpleConfigObject.resolveSubstitutions(SimpleConfigObject.java:398)
> at
> com.typesafe.config.impl.ResolveContext.realResolve(ResolveContext.java:179)
> at
> com.typesafe.config.impl.ResolveContext.resolve(ResolveContext.java:142)
> at
> com.typesafe.config.impl.SimpleConfigObject$ResolveModifier.modifyChildMayThrow(SimpleConfigObject.java:379)
> at
> com.typesafe.config.impl.SimpleConfigObject.modifyMayThrow(SimpleConfigObject.java:312)
>
> After googling a bit, it seems to be the problem when merging multiple
> reference.conf files. But I don't find a solution for this problem.
>
> My sbt looks below
>
> scalaVersion := "2.11.8"
>
> libraryDependencies ++= Seq(
> "com.typesafe.akka" %% "akka-http" % "10.0.6",
> "com.typesafe.akka" %% "akka-http-xml" % "10.0.6",
> "org.apache.spark" %% "spark-streaming" % "2.1.0" % "provided",
> "com.typesafe" % "config" % "1.3.1",
> "org.scalatest" %% "scalatest" % "2.2.6" % "test"
> )
>
> assemblyMergeStrategy in assembly := {
> case PathList("META-INF", xs @ _*) => MergeStrategy.discard
> case x => MergeStrategy.first
> }
>
> How can I fix it? I appreciate any suggestions. Thanks
> --
> >>>>>>>>>> Read the docs: http://akka.io/docs/
> >>>>>>>>>> Check the FAQ:
> http://doc.akka.io/docs/akka/current/additional/faq.html
> >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user
> ---
> You received this message because you are subscribed to the Google Groups
> "Akka User List" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to [email protected] <javascript:>.
> To post to this group, send email to [email protected]
> <javascript:>.
> Visit this group at https://groups.google.com/group/akka-user.
> For more options, visit https://groups.google.com/d/optout.
>
>
--
>>>>>>>>>> Read the docs: http://akka.io/docs/
>>>>>>>>>> Check the FAQ:
>>>>>>>>>> http://doc.akka.io/docs/akka/current/additional/faq.html
>>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user
---
You received this message because you are subscribed to the Google Groups "Akka
User List" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To post to this group, send email to [email protected].
Visit this group at https://groups.google.com/group/akka-user.
For more options, visit https://groups.google.com/d/optout.
