[jira] [Created] (FLINK-5410) Running out of memory on Yarn

2017-01-05 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-5410: -- Summary: Running out of memory on Yarn Key: FLINK-5410 URL: https://issues.apache.org/jira/browse/FLINK-5410 Project: Flink Issue Type: Bug Components

Lack of review on PRs

2015-12-05 Thread Sachin Goel
for bearing with me. :) Cheers! Sachin -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685

Re: Connection reset by peer

2015-11-15 Thread Sachin Goel
a exception handler at the end of pipeline. https://github.com/apache/flink/pull/1338 -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Sun, Nov 15, 2015 at 5:48 PM, Ufuk Celebi <u...@apache.org> wrote: > This Exception was not thrown by the data exchange

[jira] [Created] (FLINK-2989) Job Cancel button doesn't work on Yarn

2015-11-09 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2989: -- Summary: Job Cancel button doesn't work on Yarn Key: FLINK-2989 URL: https://issues.apache.org/jira/browse/FLINK-2989 Project: Flink Issue Type: Bug

Re: Web interface to submit jobs

2015-11-09 Thread Sachin Goel
@Max: Added all three things and opened a PR yesterday. :) -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Mon, Nov 9, 2015 at 3:10 PM, Maximilian Michels <m...@apache.org> wrote: > Hi Sachin, > > Thank you for your work. From the screenshots it looks like

Re: Web interface to submit jobs

2015-11-08 Thread Sachin Goel
required parameters, and their types etc. is somewhat frustrating in JavaScript. Everything has to be rechecked at the Server again anyways. I opened a PR just now: https://github.com/apache/flink/pull/1338. Let me know what you guys think. :) Cheers! Sachin -- Sachin Goel Computer Science, IIT

Re: Web interface to submit jobs

2015-11-06 Thread Sachin Goel
y class. I think this is reasonable because we do not need anything related to yarn here. Web monitor already has the gateway to job manager. Any comments or review is welcome. :) I'll likely be able to finish up by the end of this week. Cheers! Sachin -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457

Re: Web interface to submit jobs

2015-11-05 Thread Sachin Goel
The current authentication mechanism is via htaccess, in the webclient. The dashboard however isn't secured at all. -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Thu, Nov 5, 2015 at 2:33 PM, Aljoscha Krettek <aljos...@apache.org> wrote: > The reason why we didn’t wan

Re: Web interface to submit jobs

2015-11-05 Thread Sachin Goel
Hi Stephan I agree. However, as and when we secure the Dashboard, everything should get secured in one go. Or is a secure dashboard not much desired? [By secure, I mean some form of authentication for accessing.] -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Thu, Nov 5, 2015

Re: Web interface to submit jobs

2015-11-05 Thread Sachin Goel
of program's entry class. Will that be a major issue, that one thread is performing this work [although the server is capable to handling several requests in parallel]? -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Thu, Nov 5, 2015 at 4:28 PM, Maximilian Michels <m...@apache.

Re: Web interface to submit jobs

2015-11-05 Thread Sachin Goel
I plan to implement all features of the existing web client. :) I think multiple programs will be best displayed as a list in the Entry Class column. -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Thu, Nov 5, 2015 at 5:36 PM, Matthias J. Sax <mj...@apache.org> wrote: &

Re: Web interface to submit jobs

2015-11-05 Thread Sachin Goel
Okay. I think that does it. I've already designed the basic interface, although the major part for uploading jars and actually running the job are left. :') Here are some screenshots: [image: Inline image 2][image: Inline image 1][image: Inline image 3] -- Sachin Goel Computer Science, IIT Delhi

Re: Web interface to submit jobs

2015-11-05 Thread Sachin Goel
Ah. Sharing the links then: https://drive.google.com/file/d/0B0Xlv1qTgpjDT0ZCd0pSU3VYMUU/view?usp=sharing https://drive.google.com/file/d/0B0Xlv1qTgpjDeG51azRRc0FJYjQ/view?usp=sharing https://drive.google.com/file/d/0B0Xlv1qTgpjDSHZXQ0h5S0FBS3c/view?usp=sharing -- Sachin Goel Computer Science

[jira] [Created] (FLINK-2982) CLI info option throws ClassCastException for streaming jobs

2015-11-05 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2982: -- Summary: CLI info option throws ClassCastException for streaming jobs Key: FLINK-2982 URL: https://issues.apache.org/jira/browse/FLINK-2982 Project: Flink

[jira] [Created] (FLINK-2978) Integrate web submission interface into the new dashboard

2015-11-05 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2978: -- Summary: Integrate web submission interface into the new dashboard Key: FLINK-2978 URL: https://issues.apache.org/jira/browse/FLINK-2978 Project: Flink Issue

Re: [VOTE] Release Apache Flink 0.10.0 (release-0.10.0-rc2)

2015-10-28 Thread Sachin Goel
before the release :) > > On 28 October 2015 at 13:06, Sachin Goel <sachingoel0...@gmail.com> wrote: > > > Those are hard coded values. > > What exactly should be there, I'm not sure either. > > On Oct 28, 2015 5:25 PM, "Vasiliki Kalavri" <vasilikika

Re: [VOTE] Release Apache Flink 0.10.0 (release-0.10.0-rc2)

2015-10-28 Thread Sachin Goel
-counts is being used. Looking into it now. -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Wed, Oct 28, 2015 at 7:26 PM, Vasiliki Kalavri <vasilikikala...@gmail.com > wrote: > The numbers I see in the overview are different. > > See > > https://dr

Re: [VOTE] Release Apache Flink 0.10.0 (release-0.10.0-rc2)

2015-10-28 Thread Sachin Goel
I think the squares on top of the job page are showing the status of vertices, not tasks. The squares on overview pages however show the number of tasks. Should we make it vertices or tasks everywhere, for consistency? -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Wed, Oct 28

Re: [VOTE] Release Apache Flink 0.10.0 (release-0.10.0-rc0)

2015-10-22 Thread Sachin Goel
Not sure if it's a blocker, but the yarn detached mode is faulty for interactive programs with eager execution calls. The most basic starting point for yarn, i.e. *bin/flink run -m yarn-cluster -yd -n <> examples/Wordcount.jar* fails in a bad way. -- Sachin Goel Computer Science, IIT D

Re: [VOTE] Release Apache Flink 0.10.0 (release-0.10.0-rc0)

2015-10-22 Thread Sachin Goel
n doesn't > >> > work with detached programs is that the client submits the first Flink > >> job > >> > (call to execute/count/collect/print) to the cluster and then returns an > >> > empty ExecutionResult. This leads to error if the user program tries to &

Re: Apache flink with Elastic Search

2015-10-13 Thread Sachin Goel
Hi Santosh There is an Elastic search connector under streaming connectors. Can you check if that satisfies your needs? Aljoscha will be able to provide more details in case you need them. Cheers! Sachin -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Tue, Oct 13, 2015 at 6:38

[jira] [Created] (FLINK-2850) Limit the types of jobs which can run in detached mode

2015-10-13 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2850: -- Summary: Limit the types of jobs which can run in detached mode Key: FLINK-2850 URL: https://issues.apache.org/jira/browse/FLINK-2850 Project: Flink Issue Type

[jira] [Created] (FLINK-2849) AggregatingAlignedProcessingTimeWindowOperatorTest failure

2015-10-13 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2849: -- Summary: AggregatingAlignedProcessingTimeWindowOperatorTest failure Key: FLINK-2849 URL: https://issues.apache.org/jira/browse/FLINK-2849 Project: Flink Issue

Flaky ScalaShellLocalStartupITCase

2015-10-13 Thread Sachin Goel
. Just recently, observed a loss of the task manager. https://travis-ci.org/apache/flink/jobs/85108827 Has someone else observed any such issues? It seems a simple enough test to display such flaky behavior. Cheers! Sachin -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685

Re: Flaky ScalaShellLocalStartupITCase

2015-10-13 Thread Sachin Goel
tests could cause confusion for contributors. > > Thanks, > > > - Henry > > On Tue, Oct 13, 2015 at 7:14 AM, Sachin Goel <sachingoel0...@gmail.com> > wrote: > > Hi all > > Over the past few days, I've observed multiple failures of this test > case. >

[jira] [Created] (FLINK-2791) ParallelMergeITCase failure

2015-09-30 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2791: -- Summary: ParallelMergeITCase failure Key: FLINK-2791 URL: https://issues.apache.org/jira/browse/FLINK-2791 Project: Flink Issue Type: Bug Components

[jira] [Created] (FLINK-2710) SocketTextStreamFunctionTest failure

2015-09-19 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2710: -- Summary: SocketTextStreamFunctionTest failure Key: FLINK-2710 URL: https://issues.apache.org/jira/browse/FLINK-2710 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-2711) TaskManagerTest failure

2015-09-19 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2711: -- Summary: TaskManagerTest failure Key: FLINK-2711 URL: https://issues.apache.org/jira/browse/FLINK-2711 Project: Flink Issue Type: Bug Reporter

[jira] [Created] (FLINK-2700) YarnSessionFIFOITCase.testJavaApi failure

2015-09-18 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2700: -- Summary: YarnSessionFIFOITCase.testJavaApi failure Key: FLINK-2700 URL: https://issues.apache.org/jira/browse/FLINK-2700 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-2648) CombineTaskTest.testCancelCombineTaskSorting

2015-09-09 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2648: -- Summary: CombineTaskTest.testCancelCombineTaskSorting Key: FLINK-2648 URL: https://issues.apache.org/jira/browse/FLINK-2648 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-2627) Make Scala Data Set utils easier to access

2015-09-07 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2627: -- Summary: Make Scala Data Set utils easier to access Key: FLINK-2627 URL: https://issues.apache.org/jira/browse/FLINK-2627 Project: Flink Issue Type: Bug

Re: Scala Utils

2015-09-07 Thread Sachin Goel
Olrite. I will file a JIRA for this. Cheers! Sachin -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Sat, Sep 5, 2015 at 10:14 PM, Aljoscha Krettek <aljos...@apache.org> wrote: > I think the utils are a perfect case of for this pattern so I would suggest >

Scala Utils

2015-09-05 Thread Sachin Goel
importing utils like import org.apache.flink.api.scala.utils._ Since this will likely break existing code, I'm seeking opinion whether this should be done or not. If yes, I will file a JIRA and submit a patch. Regards Sachin -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685

[jira] [Created] (FLINK-2618) ExternalSortITCase failure

2015-09-03 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2618: -- Summary: ExternalSortITCase failure Key: FLINK-2618 URL: https://issues.apache.org/jira/browse/FLINK-2618 Project: Flink Issue Type: Bug Reporter

[jira] [Created] (FLINK-2615) Multiple restarts of Local Cluster for a single program

2015-09-03 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2615: -- Summary: Multiple restarts of Local Cluster for a single program Key: FLINK-2615 URL: https://issues.apache.org/jira/browse/FLINK-2615 Project: Flink Issue Type

Re: Driver Test Base issue

2015-08-24 Thread Sachin Goel
them since I've triggered quite a few builds since my email. ​Cheers! Sachin​ -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Mon, Aug 24, 2015 at 3:38 PM, Maximilian Michels m...@apache.org wrote: Hi Sachin, Thanks for reporting. Which of the test cases failed in the MapTaskTest

Re: Graph.fromDataSet function calls: flink-gelly

2015-08-22 Thread Sachin Goel
on every call. However, in general, this wouldn't be the case. I'll push a patch along with the fix I'm working on. Cheers! Sachin -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Sat, Aug 22, 2015 at 11:21 PM, Vasiliki Kalavri vasilikikala...@gmail.com wrote: Hi Sachin, I

Graph.fromDataSet function calls: flink-gelly

2015-08-21 Thread Sachin Goel
allows sharing of job results across Execution Environments, and these two lines are the only thing which cause trouble with that. :') Thanks in advance Cheers! Sachin -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685

Driver Test Base issue

2015-08-18 Thread Sachin Goel
) Regards Sachin -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685

Re: Code style guideline for Scala

2015-08-16 Thread Sachin Goel
and continuation etc. can be hard to get exactly right [At least that was my experience]. All in all, big plus one to this. -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Sun, Aug 16, 2015 at 7:36 PM, Stephan Ewen se...@apache.org wrote: Hi! I very much support that. A bit stricter rules

Re: [NOTICE] Reporting and fixing minor issues

2015-08-16 Thread Sachin Goel
, but the main README links to http://flink.apache.org/how-to-contribute.html. We should perhaps merge the cwiki page content here. Regards Sachin -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Sun, Aug 16, 2015 at 9:21 PM, Stephan Ewen se...@apache.org wrote: Hi all! Henry raised

[jira] [Created] (FLINK-2528) MatchTaskTest failure

2015-08-15 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2528: -- Summary: MatchTaskTest failure Key: FLINK-2528 URL: https://issues.apache.org/jira/browse/FLINK-2528 Project: Flink Issue Type: Bug Reporter: Sachin

Re: Multiple control flows in a program

2015-08-12 Thread Sachin Goel
Since the random splits need to be done on any data set a user provides, I think making a persistent source would be the best solution then. -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Wed, Aug 12, 2015 at 1:37 PM, Till Rohrmann till.rohrm...@gmail.com wrote: One branch

Multiple control flows in a program

2015-08-11 Thread Sachin Goel
exclusive, we need to generate the exact same sequence of random numbers, but also to ensure that the elements arrive in a filter job in exactly the same order. How do I achieve this? Here's the code I've written: https://github.com/apache/flink/pull/921/files Regards Sachin -- Sachin Goel Computer

Re: Parameter Server for Flink

2015-08-10 Thread Sachin Goel
it turned on or not, however. Cheers! Sachin -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Mon, Aug 10, 2015 at 11:12 PM, Stephan Ewen se...@apache.org wrote: Very interesting addition, Sachin! I cc-ed Nam-Luc Tran, who recently opened a pull request with a draft for SSP

[jira] [Created] (FLINK-2505) HDFSTest failure: VM crash

2015-08-10 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2505: -- Summary: HDFSTest failure: VM crash Key: FLINK-2505 URL: https://issues.apache.org/jira/browse/FLINK-2505 Project: Flink Issue Type: Bug Reporter

[jira] [Created] (FLINK-2498) GroupReduceITCase failure

2015-08-07 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2498: -- Summary: GroupReduceITCase failure Key: FLINK-2498 URL: https://issues.apache.org/jira/browse/FLINK-2498 Project: Flink Issue Type: Bug Reporter

[jira] [Created] (FLINK-2496) Expose Task Manager configuration to Runtime Context

2015-08-07 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2496: -- Summary: Expose Task Manager configuration to Runtime Context Key: FLINK-2496 URL: https://issues.apache.org/jira/browse/FLINK-2496 Project: Flink Issue Type

Parameter Server for Flink

2015-08-07 Thread Sachin Goel
think? Cheers! Sachin PS. Sorry about the long email on a weekend. -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685

Re: FYI: Blog Post on Flink's Streaming Performance and Fault Tolerance

2015-08-05 Thread Sachin Goel
This makes me want to dig into the streaming API. About time perhaps. :') Cheers! Sachin -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Aug 6, 2015 2:39 AM, Theodore Vasiloudis theodoros.vasilou...@gmail.com wrote: Great post Stephan! A small note: the code for Google

[jira] [Created] (FLINK-2468) StreamCheckpointingITCase failure

2015-08-03 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2468: -- Summary: StreamCheckpointingITCase failure Key: FLINK-2468 URL: https://issues.apache.org/jira/browse/FLINK-2468 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-2466) Travis build failure

2015-08-03 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2466: -- Summary: Travis build failure Key: FLINK-2466 URL: https://issues.apache.org/jira/browse/FLINK-2466 Project: Flink Issue Type: Bug Reporter: Sachin

[jira] [Created] (FLINK-2458) Distributed Cache doesn't work with iterations.

2015-08-01 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2458: -- Summary: Distributed Cache doesn't work with iterations. Key: FLINK-2458 URL: https://issues.apache.org/jira/browse/FLINK-2458 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-2459) Failure on recently added Client side logging test

2015-08-01 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2459: -- Summary: Failure on recently added Client side logging test Key: FLINK-2459 URL: https://issues.apache.org/jira/browse/FLINK-2459 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-2433) Jekyll on windows for building local documentation

2015-07-29 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2433: -- Summary: Jekyll on windows for building local documentation Key: FLINK-2433 URL: https://issues.apache.org/jira/browse/FLINK-2433 Project: Flink Issue Type

[jira] [Created] (FLINK-2417) Travis build failure on flink-tachyon

2015-07-28 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2417: -- Summary: Travis build failure on flink-tachyon Key: FLINK-2417 URL: https://issues.apache.org/jira/browse/FLINK-2417 Project: Flink Issue Type: Bug

Re: Travis build failure

2015-07-28 Thread Sachin Goel
Yes. I've never encountered this type of build failure. -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Jul 28, 2015 1:41 PM, Till Rohrmann trohrm...@apache.org wrote: This might be a Travis hick-up. Was it the first time this happened? Cheers, Till On Mon, Jul 27, 2015

Re: Travis build failure

2015-07-28 Thread Sachin Goel
Should I open a JIRA for this? -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Tue, Jul 28, 2015 at 2:16 PM, Stephan Ewen se...@apache.org wrote: I have seen that issue before. Since Flink only tests using Tachyon via the Hadoop connector, this is either a bug in the Hadoop

Travis build failure

2015-07-27 Thread Sachin Goel
goodbye. VM crash or System.exit called? Here's the log file: https://s3.amazonaws.com/archive.travis-ci.org/jobs/72878976/log.txt. The failed build passes on travis on my PR's build. -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685

Re: New Flink Runtime Monitor Dashboard

2015-07-24 Thread Sachin Goel
According to GitHub, 26.1% code is now in JavaScript. :| -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Thu, Jul 23, 2015 at 3:12 AM, Matthias J. Sax mj...@informatik.hu-berlin.de wrote: Haha! On 07/22/2015 07:02 PM, Kostas Tzoumas wrote: Finally, Flink is a JavaScript

Re: Communicating between nodes at runtime

2015-07-20 Thread Sachin Goel
which is *only *evaluated at runtime. Cheers! Sachin -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Mon, Jul 20, 2015 at 3:34 PM, Stephan Ewen se...@apache.org wrote: You are probably looking for a parameter server tool. How about setting up one of these memory grids to use

[jira] [Created] (FLINK-2379) Add methods to evaluate field wise statistics over DataSet of vectors.

2015-07-19 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2379: -- Summary: Add methods to evaluate field wise statistics over DataSet of vectors. Key: FLINK-2379 URL: https://issues.apache.org/jira/browse/FLINK-2379 Project: Flink

Communicating between nodes at runtime

2015-07-17 Thread Sachin Goel
in the RuntimeContext, broadcast(key,value) and receive(key). If such a thing doesn't exist now, how should I approach implementing it? Cheers! Sachin -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685

Re: Failing tests on Windows

2015-07-17 Thread Sachin Goel
explicitly filed for these. If you wish, file JIRAs for these too, in case these still persist. Further, since the build stops at flink-runtime, I can't be sure if any further tests wouldn't fail. I can try verify commands again 0nce there are fixes for these. Cheers! Sachin -- Sachin Goel

Re: [ml] Convergence Criterias

2015-07-06 Thread Sachin Goel
is that this is a hard problem to generalize properly, given the dependence on the specific algorithm, model, and data. Regards, Theodore On Wed, Jul 1, 2015 at 9:23 PM, Sachin Goel sachingoel0...@gmail.com wrote: Hi all I'm trying to work out a general convergence framework for Machine

Re: Documentation not reachable

2015-06-29 Thread Sachin Goel
I've been experiencing the same problem. Regards Sachin Goel On Mon, Jun 29, 2015 at 3:09 PM, Felix Neutatz neut...@googlemail.com wrote: Hi, when I want to access the documentation on the website I get the following error: http://ci.apache.org/projects/flink/flink-docs-release-0.9

Re: Testing Apache Flink 0.9.0-rc1

2015-06-10 Thread Sachin Goel
I have run mvn clean verify five times now and every time I'm getting these failed tests: BlobUtilsTest.before:45 null BlobUtilsTest.before:45 null BlobServerDeleteTest.testDeleteFails:291 null BlobLibraryCacheManagerTest.testRegisterAndDownload:196 Could not remove write permissions from

Re: Testing Apache Flink 0.9.0-rc1

2015-06-09 Thread Sachin Goel
On my local machine, several flink runtime tests are failing on mvn clean verify. Here is the log output: http://pastebin.com/raw.php?i=VWbx2ppf -- ​ Sachin​ On Tue, Jun 9, 2015 at 4:04 PM, Aljoscha Krettek aljos...@apache.org wrote: I also saw the same error on my third mvn clean verify run.

Re: Testing Apache Flink 0.9.0-rc1

2015-06-09 Thread Sachin Goel
with maximum 8 threads. Regards Sachin Goel On Tue, Jun 9, 2015 at 5:34 PM, Ufuk Celebi u...@apache.org wrote: On 09 Jun 2015, at 13:58, Sachin Goel sachingoel0...@gmail.com wrote: On my local machine, several flink runtime tests are failing on mvn clean verify. Here is the log output: http

[jira] [Created] (FLINK-2187) KMeans clustering is not present in release-0.9-rc1

2015-06-08 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2187: -- Summary: KMeans clustering is not present in release-0.9-rc1 Key: FLINK-2187 URL: https://issues.apache.org/jira/browse/FLINK-2187 Project: Flink Issue Type

Re: Problem with ML pipeline

2015-06-08 Thread Sachin Goel
Yes. I agree too. It makes no sense for the learning algorithm to have extra payload. Only relevant data makes sense. Further, adding ID to the predict operation type definition seems a legitimate choice. +1 from my side. Regards Sachin Goel On Mon, Jun 8, 2015 at 4:06 PM, Theodore Vasiloudis

Re: Problem with ML pipeline

2015-06-08 Thread Sachin Goel
approach this. Regards Sachin Goel On Mon, Jun 8, 2015 at 4:26 PM, Felix Neutatz neut...@googlemail.com wrote: I am in favor of efficiency. Therefore I would be prefer to introduce new methods, in order to save memory and network traffic. This would also solve the problem of how to come up

Re: Problem with ML pipeline

2015-06-08 Thread Sachin Goel
]) : DataSet[LabeledVector] = { predict(ParameterMap,input) } } } Regards Sachin Goel On Mon, Jun 8, 2015 at 4:11 PM, Till Rohrmann till.rohrm...@gmail.com wrote: My gut feeling is also that a `Transformer` would be a good place to implement feature selection. Then you

Re: Problem with ML pipeline

2015-06-07 Thread Sachin Goel
A more general approach would be to take as input which indices of the vector to consider as features. After that, the vector can be returned as such and user can do what they wish with the non-feature values. This wouldn't need extending the predict operation, instead this can be specified in

Travis build issue

2015-06-05 Thread Sachin Goel
Travis build is failing on SimpleRecoveryITCase. Randomly again, I think. Also, the KafkaITCase. Are these also known issues? Regards Sachin Goel

GSoC work

2015-06-03 Thread Sachin Goel
://issues.apache.org/jira/browse/FLINK-2131. Cheers! Sachin Goel

Travis build failing

2015-06-02 Thread Sachin Goel
before the test was finished. Return value = 0 at org.junit.Assert.fail(Assert.java:88) at org.apache.flink.yarn.YarnTestBase.runWithArgs(YarnTestBase.java:453) at org.apache.flink.yarn.YARNSessionFIFOITCase.perJobYarnCluster(YARNSessionFIFOITCase.java:407) Regards Sachin Goel

Writing test suites

2015-06-02 Thread Sachin Goel
Hi What's the convention with using an ITSuite in the name instead of just Suite? Regards Sachin Goel