Re: RDD to DataFrame question with JsValue in the mix

2016-07-01 Thread Dood
On 7/1/2016 6:42 AM, Akhil Das wrote: case class Holder(str: String, js:JsValue) Hello, Thanks! I tried that before posting the question to the list but I keep getting an error such as this even after the map() operation to convert (String,JsValue) -> Holder and then toDF(). I am simply

RDD to DataFrame question with JsValue in the mix

2016-06-30 Thread Dood
Hello, I have an RDD[(String,JsValue)] that I want to convert into a DataFrame and then run SQL on. What is the easiest way to get the JSON (in form of JsValue) "understood" by the process? Thanks! - To unsubscribe e-mail:

Re: Silly Question on my part...

2016-05-17 Thread Dood
On 5/16/2016 12:12 PM, Michael Segel wrote: For one use case.. we were considering using the thrift server as a way to allow multiple clients access shared RDDs. Within the Thrift Context, we create an RDD and expose it as a hive table. The question is… where does the RDD exist. On the

Re: Structured Streaming in Spark 2.0 and DStreams

2016-05-16 Thread Dood
On 5/16/2016 9:53 AM, Yuval Itzchakov wrote: AFAIK, the underlying data represented under the DataSet[T] abstraction will be formatted in Tachyon under the hood, but as with RDD's if needed they will be spilled to local disk on the worker of needed. There is another option in case of

Re: Apache Spark Slack

2016-05-16 Thread Dood
On 5/16/2016 9:52 AM, Xinh Huynh wrote: I just went to IRC. It looks like the correct channel is #apache-spark. So, is this an "official" chat room for Spark? Ah yes, my apologies, it is #apache-spark indeed. Not sure if there is an official channel on IRC for spark :-)

Re: Apache Spark Slack

2016-05-16 Thread Dood
On 5/16/2016 9:30 AM, Paweł Szulc wrote: Just realized that people have to be invited to this thing. You see, that's why Gitter is just simpler. I will try to figure it out ASAP You don't need invitations to IRC and it has been around for decades. You can just go to webchat.freenode.net

Re: Apache Spark Slack

2016-05-16 Thread Dood
On 5/16/2016 6:40 AM, Paweł Szulc wrote: I've just created this https://apache-spark.slack.com for ad-hoc communications within the comunity. Everybody's welcome! Why not just IRC? Slack is yet another place to create an account etc. - IRC is much easier. What does Slack give you that's so

Re: Tracking / estimating job progress

2016-05-13 Thread Dood
On 5/13/2016 10:39 AM, Anthony May wrote: It looks like it might only be available via REST, http://spark.apache.org/docs/latest/monitoring.html#rest-api Nice, thanks! On Fri, 13 May 2016 at 11:24 Dood@ODDO <oddodao...@gmail.com <mailto:oddodao...@gmail.com>> wrote: On

Re: Tracking / estimating job progress

2016-05-13 Thread Dood
hih...@gmail.com <mailto:yuzhih...@gmail.com>> wrote: Have you looked at core/src/main/scala/org/apache/spark/ui/jobs/JobProgressListener.scala ? Cheers On Fri, May 13, 2016 at 10:05 AM, Dood@ODDO <oddodao...@gmail.com <mailto:oddodao...@gmail.com>> w

Tracking / estimating job progress

2016-05-13 Thread Dood
I provide a RESTful API interface from scalatra for launching Spark jobs - part of the functionality is tracking these jobs. What API is available to track the progress of a particular spark application? How about estimating where in the total job progress the job is? Thanks!

Re: Confused - returning RDDs from functions

2016-05-13 Thread Dood
RDD, I get an empty Map(). If I copy/paste this code into the caller, I get the properly filled in Map. I am fairly new to Spark and Scala so excuse any inefficiencies - my priority was to be able to solve the problem in an obvious and correct way and worry about making it p

Confused - returning RDDs from functions

2016-05-12 Thread Dood
Hello all, I have been programming for years but this has me baffled. I have an RDD[(String,Int)] that I return from a function after extensive manipulation of an initial RDD of a different type. When I return this RDD and initiate the .collectAsMap() on it from the caller, I get an empty

Re: [jira] [Commented] (IGNITE-2693) withKeepBinary and non-binary marshallers

2016-05-11 Thread Dood
Anyone willing to help me a bit to finish this ticket for 1.6? :-) Thanks! On 4/12/2016 6:03 AM, Vladimir Ozerov (JIRA) wrote: [ https://issues.apache.org/jira/browse/IGNITE-2693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15237114#comment-15237114 ] Vladimir

Re: IGNITE-2693: question about setting BinaryMarshaller on a cache

2016-03-09 Thread Dood
On 3/9/2016 7:46 PM, Alexey Goncharuk wrote: Note that withKeepBinary() is just a way to tell a cache not to deserialize values when doing a get or running an entry processor. The concept of binary object does not belong solely to caches - you can get an instance of IgniteBinary interface from

Re: IGNITE-2693: question about setting BinaryMarshaller on a cache

2016-03-09 Thread Dood
On 3/9/2016 6:43 PM, Alexey Goncharuk wrote: Hi, The current version of test is not very clean and it works only because withKeepBinary() is a noop. The correct version would be to use plain cache for non-binary-object entry processor and use withKeepBinary for binary-object entry processor.

IGNITE-2693: question about setting BinaryMarshaller on a cache

2016-03-09 Thread Dood
Hello all, I am working on IGNITE-2693 with Vlad Ozerov's help. I am somewhat of a Java newbie so please be gentle ;-) I am curious about something - after reading the Javadocs and Binary Marshaller docs on Ignite's documentation websites, I think that the documentation is not very friendly

IGNITE-2693 - could someone take a look and help me with a quick review

2016-03-03 Thread Dood
Hello, This is my second Ignite ticket and if I understand correctly, it is a simple fix - I submitted a patch recently, it is only a few lines. Can someone take a look and see if I am on the right track or did I completely misunderstand it... :-) Thanks!

Re: Switching back to review-then-commit process

2016-03-03 Thread Dood
+1 - sounds very reasonable and practical. On 3/3/2016 5:54 AM, Denis Magda wrote: Igniters, I would propose to switch back to review-then-commit process. This process has to be followed by both contributors and committers. There is a reason for this I have in mind. Ignite is a complex

Re: Apache Arrow and Apache Ignite

2016-02-26 Thread Dood
On 2/25/2016 11:06 AM, Konstantin Boudnik wrote: On Wed, Feb 24, 2016 at 02:02PM, Dood@ODDO wrote: On 2/24/2016 1:31 PM, Konstantin Boudnik wrote: On Sat, Feb 20, 2016 at 02:13PM, Dood@ODDO wrote: That's the million dollar question - I think we should approach the Arrow people and get

Re: Apache Arrow and Apache Ignite

2016-02-24 Thread Dood
On 2/24/2016 1:31 PM, Konstantin Boudnik wrote: On Sat, Feb 20, 2016 at 02:13PM, Dood@ODDO wrote: That's the million dollar question - I think we should approach the Arrow people and get a conversation going. We want to be ahead of the curve, not behind it - Arrow seems to be making quite

Re: Binary mode for Data Structures

2016-02-24 Thread Dood
IGNITE-1144 has been fixed so at least that obstacle is out of the way :-) On 2/24/2016 9:10 AM, Denis Magda wrote: The community has already faced with the issue that the binary mode is not supported for data structures. https://issues.apache.org/jira/browse/IGNITE-2339 I've linked this

Re: IGNITE-1144

2016-02-23 Thread Dood
On 2/23/2016 7:05 PM, Valentin Kulichenko wrote: I added couple more tests and merged your changes into master. Thanks for the contribution! Thanks! What other ticket do you think I could/should tackle?

Re: IGNITE-1144

2016-02-22 Thread Dood
Val, All the test passed on TC - you can look at the PR at any time. Thanks! On 2/22/2016 8:13 PM, Valentin Kulichenko wrote: Hi, Thanks for the pull request! I will take a look as soon as possible. -Val On Mon, Feb 22, 2016 at 9:14 AM, Dood@ODDO <oddodao...@gmail.com> wrote: Hel

IGNITE-1144

2016-02-22 Thread Dood
Hello all, I was wondering if anyone can take a look at the PR I submitted for IGNITE-1144 [1]. It compiles and I think the code is good but the tests I submitted are failing - specifically, one test: I am using assertThrows() to make sure that an exception is thrown if affinityRun() is

Re: Apache Arrow and Apache Ignite

2016-02-20 Thread Dood
That's the million dollar question - I think we should approach the Arrow people and get a conversation going. We want to be ahead of the curve, not behind it - Arrow seems to be making quite a stir, not to mention that it was fast-tracked to mature project status apparently solely based on

Async and sync ops in IgniteQueue and IgniteSet implementations

2016-02-12 Thread Dood
Hello all, This may be a very dumb question (and feel free to "reprimand" me ;-) but I will ask it anyways. I am working on https://issues.apache.org/jira/browse/IGNITE-1144 and one of the comments on the submitted code was that I marked both methods I am implemented as

Re: Async and sync ops in IgniteQueue and IgniteSet implementations

2016-02-12 Thread Dood
for new affinityRun and affinityCall methods that you're adding, but I'm not sure about others. Does anyone has thoughts on this? -Val On Fri, Feb 12, 2016 at 11:07 AM, Dood@ODDO <oddodao...@gmail.com> wrote: Hello all, This may be a very dumb question (and feel free to "reprimand&qu

Compiling Ignite against different JDKs

2016-02-11 Thread Dood
Hello all, I am working on a ticket that is not very difficult, if you are good with Idea, Java, Maven etc. I have been a developer in various languages but new to Java ;). I had JDK8 installed and I introduced some changes to the code base that cause it to not compile (apparently) against

Re: affinityRun() and affinityCall() (JIRA ticket)

2016-01-29 Thread Dood
mpl have a reference to GridCacheContext which represents the underlying cache for the data structure. GridCacheContext.name() will give you the correct cache name that you can use when calling affinityRun method. -Val On Wed, Jan 27, 2016 at 9:13 AM, Dood@ODDO <oddodao...@gmail.com> wro

affinityRun() and affinityCall() (JIRA ticket)

2016-01-27 Thread Dood
Hello, I am playing with https://issues.apache.org/jira/browse/IGNITE-1144 as introduction to hacking on Ignite. I am not a Java developer by day but have experience writing code in various languages. This is my first in-depth exposure to Ignite internals (have lightly used it as a user in a

Re: Using Ignite

2016-01-18 Thread Dood
Kafka may suit your needs as a "queue" with producer/consumer and persistence capabilities also. On 1/18/2016 9:52 AM, Murthy Kakarlamudi wrote: Hi, We have a scenario where in we have a c++ application that pumps out data ticks multiple times in a second. These data ticks needs to be

[Muscle] coolkey or pkcs variant with acrobat reader?

2014-01-30 Thread Howy Dood
I wanted to be able to sign PDFs instead of having to use windows to do so. I use coolkey with firefox and chrome in Linux, but I installed the 686 version for acrobat reader in Fedora 20. I tried to follow the instructions here, albeit a little different:

[Muscle] connection reset/no data returned errors in browser with pcsclite/coolkey

2013-10-03 Thread Howdy Dood
Hello, I have Fedora 19 on two machines. I use libcoolkey to use a Common Access Card's certificates to access my webmail at http://www.foo.bar.gov However, since upgrading to F19 on machine two, although I am prompted for pin, etc, and certs show, and I can choose the right cert, I get: The

Re: [Muscle] connection reset/no data returned errors in browser with pcsclite/coolkey

2013-10-03 Thread Howdy Dood
Considering it works fine on my laptop, I doubt that has anything to do with anything. On Thu, Oct 3, 2013 at 11:00 AM, Michael Bender michaelben...@me.comwrote: The government is shut down, what do you expect :-) ⛵ On Oct 3, 2013, at 8:51 AM, Howdy Dood h0wdyd3...@gmail.com wrote

Re: [Muscle] connection reset/no data returned errors in browser with pcsclite/coolkey

2013-10-03 Thread Howdy Dood
). On Thu, Oct 3, 2013 at 12:16 PM, Douglas E. Engert deeng...@anl.gov wrote: On 10/3/2013 10:51 AM, Howdy Dood wrote: Hello, I have Fedora 19 on two machines. I use libcoolkey to use a Common Access Card's certificates to access my webmail at http://www.foo.bar.gov However, since

Re: [Muscle] connection reset/no data returned errors in browser with pcsclite/coolkey

2013-10-03 Thread Howdy Dood
reader in May and had been using it without incident. On Thu, Oct 3, 2013 at 2:21 PM, Howdy Dood h0wdyd3...@gmail.com wrote: Douglas, Thanks for your help. It uses the card in that it prompts for pin, then prompts for which cert to use. On sites that use Digital signature certificate

Re: [Muscle] connection reset/no data returned errors in browser with pcsclite/coolkey

2013-10-03 Thread Howdy Dood
I'm sorry, I forgot that when I plugged in scr331 to my working laptop, I had no issues. So, the scr3500 and the scr331 work on laptop the scr3500 works on desktop, but scr331 only works with certain certificates. On Thu, Oct 3, 2013 at 7:26 PM, Howdy Dood h0wdyd3...@gmail.com wrote: OK, I

Re: [Muscle] connection reset/no data returned errors in browser with pcsclite/coolkey

2013-10-03 Thread Howdy Dood
I have no idea what's going on. I went and got an old scr311 out of storage and it works fine with my problem computer now. At any rate, thanks for the help! On Thu, Oct 3, 2013 at 7:46 PM, Bruno Jesus 00cp...@gmail.com wrote: On Thu, Oct 3, 2013 at 9:41 PM, Howdy Dood h0wdyd3...@gmail.com

[Pound Mailing List] Too many redirects

2013-06-19 Thread Martijn de Dood
Thanks for all the answers. Removing the space between ^ and http stops the loop but it also doesn't rewrite anymore.It also occurs when doing in PHP a location / redirect 301. RewriteLocation:This was the solution.When setting rewritelocation to 0 the redirects are working. Tnx!

RE: [Pound Mailing List] Too many redirects

2013-06-19 Thread Martijn de Dood
Sorry.Did not hit reply but started a new message. Thanks for all the answers. Removing the space between ^ and http stops the loop but it also doesn't rewrite anymore.It also occurs when doing in PHP a location / redirect 301. RewriteLocation:This was the solution.When setting rewritelocation to

RE: [Pound Mailing List] Too many redirects

2013-06-19 Thread Martijn de Dood
Sorry.Did not hit reply but started a new message. From: mded...@hotmail.com To: pound@apsis.ch Date: Wed, 19 Jun 2013 12:33:14 +0200 Subject: [Pound Mailing List] Too many redirects Thanks for all the answers. Removing the space between ^ and http stops the loop but it also doesn't rewrite

Re: [SlimDevices: Touch] can you set duration of alarms?

2012-08-21 Thread dood
dood wrote: Indeed, I hadn't thought of that. Now if by setting another alarm, the first one is cancelled, then theoretically to turn off I could set an alarm with a beep at the time that I want the SB turned off. Will give it a try. ok I set 3 alarms 2 minutes apart - radio station 1

[SlimDevices: Touch] can you set duration of alarms?

2012-08-20 Thread dood
I use the alarms to turn on the SBT as my alarm clock every morning. I set it to turn on a radio station rather than alarm sound. Is there any way to get it to turn itself off say after 2 hours? Perhaps integrate the sleep function? Wishful thinking: can I get it to change stations at

Re: [SlimDevices: Touch] can you set duration of alarms?

2012-08-20 Thread dood
aubuti wrote: Not sure about the answer to the first question, but to change stations at a predetermined time you could set another alarm, with the different station as the alarm. Indeed, I hadn't thought of that. Now if by setting another alarm, the first one is cancelled, then

[SlimDevices: Touch] squeezecommander vs squeezebox app

2012-08-11 Thread dood
I've downloaded squeeze commander as an alternative to the Logitech android app, after reading how much better it is. I've found that it is not very intuitive. For example I can't figure out how to change the player. In the settings it shows that it sees 2 players. On the Logitech app you simply

Re: [SlimDevices: Touch] BBC live does not work through DAC

2012-08-09 Thread dood
changed settings in LMS for live stream to WMA and all fine now. Thanks. dood's Profile: http://forums.slimdevices.com/member.php?userid=56698 View this thread: http://forums.slimdevices.com/showthread.php?t=95994

Re: [SlimDevices: Touch] can't see playlists in squeezebox touch

2012-08-09 Thread dood
dood wrote: i am also experiencing difficulties seeing playlists on my SBT. I have all my music on a QNAP NAS which stays on 24/7. I have done test playlists on itunes on my laptop, and exported the xml and M3U playlists to the playlist folder in multimedia on the NAS, but these do not show

Re: [SlimDevices: Touch] can't see playlists in squeezebox touch

2012-08-07 Thread dood
i am also experiencing difficulties seeing playlists on my SBT. I have all my music on a QNAP NAS which stays on 24/7. I have done test playlists on itunes on my laptop, and exported the xml and M3U playlists to the playlist folder in multimedia on the NAS, but these do not show up on the SBT.

[SlimDevices: Touch] BBC live does not work through DAC

2012-08-07 Thread dood
I can access internet radio on my SBT as expected. When I go to BBC iplayer, it plays the recorded programs on the various channels but does not play the live broadcast. After assessing variables I discovered that this only happens when the SBT is connected to my external DAC (an old Wadia12).

Re: [SlimDevices: Touch] BBC live does not work through DAC

2012-08-07 Thread dood
Mnyb wrote: What sampling frequencies does it accept ? the wadia 12 . Radio is very often 48kHz but in some cases also 32kHz . It can also be a word length problem for the old DAC keep the squeezebox volume at 100% and try again If I remember correctly it is 44.1 and 48. I'll check when

Re: [SlimDevices: Touch] SBT not seeing server

2012-07-21 Thread dood
toby10 wrote: Yes, using USB on Touch means you have disconnected from LMS server on your NAS. Looks like LMS Twonky are trying to access the same ports. Try disabling Twonky for a few days to see if LMS works fine then. So far so good, LMS and twonkymedia both streaming. However, I have

[SlimDevices: Touch] SBT not seeing server

2012-07-19 Thread dood
I have had my SBT for a few weeks now. Unfortunately it only functions intermittently. I have a QNAP NAS which store my music files. I have installed LMS on it. I have a wifi network at home and the SBT connects to it and there's no problem getting internet radio. I have succeeded in accessing

Re: [SlimDevices: Touch] SBT not seeing server

2012-07-19 Thread dood
ok just went into advanced settings on the SBT. Network test is fine, wireless connection 100%. Registered with mysqueezebox.com BUT.. not connected to LMS dood's Profile:

Re: [SlimDevices: Touch] SBT not seeing server

2012-07-19 Thread dood
update I went into the QNAP admin page. Disabled LMS ans re-enabled it. Went to SBT, switched libraries and it saw my NAS and music. So the question is why is it losing connection to the NAS? Another question: How do I create music playlists on my computer that can be accessed by the SBT from

Re: [SlimDevices: Touch] SBT not seeing server

2012-07-19 Thread dood
toby10 wrote: If this is happening when you power up the NAS then it is likely that the NAS is too slow on it's bootup and not fully booted when LMS starts. You can add a program on your NAS to delay LMS startup. If the Touch is connected to LMS on the NAS then you navigate away from LMS

[R] using var from bash in R script

2012-01-04 Thread dood
Dear R users, This probably a really noob question, but I'm stuck. I'd like to pass some variables from bash to R as strings. I can successfully pass variables using commandArgs(), the problem is that I end up with an array. So, for example: Args - commandArgs(TRUE) Args [1] one two three

Re: [R] using var from bash in R script

2012-01-04 Thread dood
Marc Schwartz-3 wrote See ?as.formula and ?paste Something along the lines of the following should work: Args - c(one, two, three) Args [1] one two three paste(Args[1], ~, Args[2]) [1] one ~ two as.formula(paste(Args[1], ~, Args[2])) one ~ two Then use:

[R] separate mfrow region with line

2011-08-27 Thread dood
Dear R users, I have six plots in one figure, created with par(mfrow=c(2,3)). I would like to add two lines to the figure outside the plotting regions, separating the figure into 3 columns. Is this possible? Thanks -- View this message in context:

[nonamanis] SEPI

2009-11-18 Thread Dood
kok akhir2 ini sepi yachh ? apa yahoo group gw yg error ?

Re: Kernel and Dual booting

2008-08-11 Thread DooD
To prevent opkg from upgrading the kernel try: opkg flag hold kernel-2.6.24 opkg flag hold kernel-image-2.6.24 Altho i think you only need to block the kernel-image-2.6.24 After getting a neo1973 kernel and a bad kernel that wouldnt boot from opkg, i do all my kernel upgrades with the

Re: full-keyboard for Om 2008.08?

2008-08-10 Thread DooD
magically disappear . . Dirk Bergstrom-2 wrote: DooD wrote: The files you need to edit are under /usr/lib/enlightenment/modules/illume/keyboards I believe there is a Full-QWERTY.kbd in there, just backup the Default.kbd and replace it with the Full-QWERTY.kbd mv Default.kbd

Re: full-keyboard for Om 2008.08?

2008-08-09 Thread DooD
The files you need to edit are under /usr/lib/enlightenment/modules/illume/keyboards I believe there is a Full-QWERTY.kbd in there, just backup the Default.kbd and replace it with the Full-QWERTY.kbd mv Default.kbd Defaultbackup.kbd mv Full-QWERTY.kbd Default.kbd /etc/init.d/xserver-nodm

Re: ASU - startup broken by upgrade?

2008-07-31 Thread DooD
I found that installing the newest e-wm and illume packages http://downloads.openmoko.org/openmoko-repository/ASU/armv4t/e-wm_0.16.999.042+cvs200807270730-r11_armv4t.ipk http://downloads.openmoko.org/openmoko-repository/ASU/armv4t/illume_0.0+svnr170-r7_armv4t.ipk caused this problem. when i

Re: ASU, exposure doesn't work

2008-07-31 Thread DooD
Finally found how to get this one to work... the problem is with python-ecore package the newest one doesnt even seem to run camp wifi for me anymore. The version you want to install is from http://buildhost.automated.it/OM2007.2/packages/armv4t/python-ecore_0.2.1+cvs20080702-r1_armv4t.ipk

Re: Flash ASU

2008-07-29 Thread DooD
Most of these instructions i have pulled off the wiki or from other e-mails, Do not hold me responsible if you brick your Freerunner while following them. Here is what has worked for me so far First you want to get the newest ASU rootfs from http://buildhost.openmoko.org/daily/freerunner/ The

Using Proxy Server

2004-07-27 Thread Matt Dood
With the IE control the application will pull your proxy settings from your default internet connection profile...how do I get the Mozilla plugin the proxy info? I'm currently only running Firefox and not a full install of Mozilla...could this be an issue?

[PHP] arrays

2001-12-20 Thread php dood
I'm trying to figure out how to parse an xml document, and convert it into html... i know how to parse in simple xml stuff for example easyeasy/easy is pretty easy to parse in, and i know how to code that, but when you start adding flags that i'm going to need variables for, example easy does=1