Re: Reading configuration file in Spark Scala throws error

2019-08-03 Thread Chris Teoh
This seems to work-

val printEntry = new
java.util.function.Consumer[java.util.Map.Entry[String,com.typesafe.config.ConfigValue]]
{

override def accept(a:
java.util.Map.Entry[String,com.typesafe.config.ConfigValue]): Unit = {

  println(a.getKey)

}

  }



conf.entrySet.iterator.forEachRemaining (printEntry)



// returns

scala> conf.entrySet.iterator.forEachRemaining (printEntry)

dbUsername

dbPassword

bootstrapServers

dbDatabase


I hope that helps.

On Sun, 4 Aug 2019 at 05:29, Mich Talebzadeh 
wrote:

> Hi,
>
> I have a config file application.conf that I am trying to read.
>
> The skeleton code is as follows:
>
> ```
> import com.typesafe.config.ConfigFactory
> import scala.collection.JavaConverters
>   def main(args: Array[String]): Unit = {
> val globalConfig = ConfigFactory.load()  // pass in filename (without
> extension) to load additional config file in src/main/resources or CLASSPATH
> val conf   = globalConfig.getConfig("database")  // extract out
> top level key from top level namespace
> conf.entrySet().iterator().forEachRemaining { entry =>
>   val key:String = entry.getKey
>   val value:  Any= entry.getValue.unwrapped()  // access via entry
>   val value2: Any= conf.getAnyRef(key) // access via hash
> lookup from config
>   println( s"$key : $value | $value2" )  // string
> interpolation
> }
>   }
> ```
>
> But I am getting the following error
>
> ```
> [info] Compiling 1 Scala source to
> /data6/hduser/scala/testconf/target/scala-2.11/classes...
> [error]
> /data6/hduser/scala/testconf/src/main/scala/myPackage/testconf.scala:10:
> missing parameter type
> [error] conf.entrySet().iterator().forEachRemaining { entry =>
> [error]   ^
> [error] one error found
> [error] (compile:compileIncremental) Compilation failed
> ```
> The application.conf has the following layout
>
> database = {
>   dbDatabase = "trading"
>   dbPassword = "mongodb"
>   dbUsername = "trading_user_RW"
>   bootstrapServers = "rhes75:9092"
> }
>
> I appreciate any hint
>
> Thanks,
>
> Dr Mich Talebzadeh
>
>
>
> LinkedIn * 
> https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
> *
>
>
>
> http://talebzadehmich.wordpress.com
>
>
> *Disclaimer:* Use it at your own risk. Any and all responsibility for any
> loss, damage or destruction of data or any other property which may arise
> from relying on this email's technical content is explicitly disclaimed.
> The author will in no case be liable for any monetary damages arising from
> such loss, damage or destruction.
>
>
>


-- 
Chris


Reading configuration file in Spark Scala throws error

2019-08-03 Thread Mich Talebzadeh
Hi,

I have a config file application.conf that I am trying to read.

The skeleton code is as follows:

```
import com.typesafe.config.ConfigFactory
import scala.collection.JavaConverters
  def main(args: Array[String]): Unit = {
val globalConfig = ConfigFactory.load()  // pass in filename (without
extension) to load additional config file in src/main/resources or CLASSPATH
val conf   = globalConfig.getConfig("database")  // extract out top
level key from top level namespace
conf.entrySet().iterator().forEachRemaining { entry =>
  val key:String = entry.getKey
  val value:  Any= entry.getValue.unwrapped()  // access via entry
  val value2: Any= conf.getAnyRef(key) // access via hash
lookup from config
  println( s"$key : $value | $value2" )  // string
interpolation
}
  }
```

But I am getting the following error

```
[info] Compiling 1 Scala source to
/data6/hduser/scala/testconf/target/scala-2.11/classes...
[error]
/data6/hduser/scala/testconf/src/main/scala/myPackage/testconf.scala:10:
missing parameter type
[error] conf.entrySet().iterator().forEachRemaining { entry =>
[error]   ^
[error] one error found
[error] (compile:compileIncremental) Compilation failed
```
The application.conf has the following layout

database = {
  dbDatabase = "trading"
  dbPassword = "mongodb"
  dbUsername = "trading_user_RW"
  bootstrapServers = "rhes75:9092"
}

I appreciate any hint

Thanks,

Dr Mich Talebzadeh



LinkedIn * 
https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
*



http://talebzadehmich.wordpress.com


*Disclaimer:* Use it at your own risk. Any and all responsibility for any
loss, damage or destruction of data or any other property which may arise
from relying on this email's technical content is explicitly disclaimed.
The author will in no case be liable for any monetary damages arising from
such loss, damage or destruction.