Re: Silencing messages from Ivy when calling spark-submit

2018-03-12 Thread Nicholas Chammas
Looks like the only way to change the Ivy log setting, given how we're using it in Spark, is via code . This makes me think: People often have trouble

Re: Silencing messages from Ivy when calling spark-submit

2018-03-06 Thread Bryan Cutler
Cool, hopefully it will work. I don't know what setting that would be though, but it seems like it might be somewhere under here http://ant.apache.org/ivy/history/latest-milestone/settings/outputters.html. It's pretty difficult to sort through the docs, and I often found myself looking at the

Re: Silencing messages from Ivy when calling spark-submit

2018-03-05 Thread Nicholas Chammas
Oh, I didn't know about that. I think that will do the trick. Would you happen to know what setting I need? I'm looking here , but it's a bit overwhelming. I'm basically looking for a way to set the overall Ivy log level to WARN or

Re: Silencing messages from Ivy when calling spark-submit

2018-03-05 Thread Bryan Cutler
Hi Nick, Not sure about changing the default to warnings only because I think some might find the resolution output useful, but you can specify your own ivy settings file with "spark.jars.ivySettings" to point to your ivysettings.xml file. Would that work for you to configure it there? Bryan

Silencing messages from Ivy when calling spark-submit

2018-03-05 Thread Nicholas Chammas
I couldn’t get an answer anywhere else, so I thought I’d ask here. Is there a way to silence the messages that come from Ivy when you call spark-submit with --packages? (For the record, I asked this question on Stack Overflow .) Would it be a good