PRE-CREATION
trunk/crawler/src/main/java/org/apache/oodt/cas/crawl/config/ProductCrawlerBean.java
1590893
trunk/crawler/src/main/resources/cmd-line-options.xml 1590893
Diff: https://reviews.apache.org/r/21615/diff/
Testing
---
Thanks,
brian Foster
. year, month,
+ * day, hour, minute, and second).
+ *
+ * @author bfos...@apache.org (Brian Foster)
+ */
+public class DateTimeExpandMetExtractor extends
AbstractFilemgrMetExtractor {
+
+ private static final String FULL_DATE_TIME_KEY
is I would love to hear about it. I am also not an expert on Java Threads, so I could have missed something in the code, but it seems like the Thread is started and never terminated. Thanks for reading,Cameron On Thu, Nov 21, 2013 at 1:43 PM, Brian Foster holeno...@me.com wrote: Hey
Hey Jordan,Try not specifying the runInfo element for your daemons in RemoteSpecs.xml file. It should just run once through for those sites. I believe the pushpull shuts down automatically when all deamons have terminated, so after you run one pass it should just terminate. It's been a while since
hey michael,
System.getenv() didn't exist in jdk 1.4 when the code was initially written and
System.getenv(String) was deprecated in jdk 1.4... i believe it was rewritten
and undeprecated in jdk 1.5 and System.getenv() was added... so ya it probably
should be using System.getenv()... a patch
/WorkflowInstance.java
1399095
Diff: https://reviews.apache.org/r/7944/diff/
Testing
---
Thanks,
brian Foster
hey chris,
so i'm going through this WorkflowProcessor stuff and finishing it up... I'm
trying to make it so that WorkflowProcessor is used by all Workflow Engines...
WorkflowInstance holds the state, times, etc.. for a Workflow, and then a
WorkflowProcessor is response for analyzing that
hey chris,
I think i work this out... i'm gonna create a RunnableInstance class... this
will then hold the state, start/end times, type (TASK or CONDITION), and the
class to run (WorkflowTaskInstance or WorkflowConditionInstance).
-brian
On Nov 7, 2012, at 3:05 PM, Brian Foster wrote:
hey
hey chris,
i got the initial changes to Workflow, WorkflowInstance, and WorkflowProcessor
in... https://reviews.apache.org/r/7944/ ... let me know what you think... lol
-brian
On Nov 7, 2012, at 6:16 PM, Brian Foster wrote:
hey chris,
I think i work this out... i'm gonna create
;
/**
- * {@link CmdLineOption} for specifying {@link CmdLineAction}.
*+ * {@link CmdLineOption} for specifying {@link
org.apache.oodt.cas.cli.action.CmdLineAction}.*
*
* @author bfoster (Brian Foster)
*/
Index:
src/main/java/org/apache/oodt/cas/cli/option/validator
! Cheers, Chris On Aug 6, 2012, at 11:15 AM, Brian Foster wrote:yunhee, let actually make the property name: org.apache.oodt.cas.protocol.jsch.sftp.port what you think chris? -brian On Aug 06, 2012, at 10:52 AM, Brian Foster holeno...@mac.com wrote: hey yunhee, like chris said i
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/6357/#review9844
---
On Aug. 3, 2012, 10:47 p.m., brian Foster wrote
check it in
today
- brian Foster
On Aug. 7, 2012, 3:36 a.m., Sheryl John wrote:
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/6416
hey yunhee and chris,we DON'T want to turn that off!... you need to connect to the site either using command-line sftp or something similar so you can accept adding the sftp site to your known hosts file... sftp protocol is working correctly-brianOn Aug 06, 2012, at 01:28 AM, YunHee Kang
hey yunhee,like chris said i would use the java properties he defined and modify the following class to set port to it by default to it:https://svn.apache.org/repos/asf/oodt/trunk/protocol/sftp/src/main/java/org/apache/oodt/cas/protocol/sftp/JschSftpProtocolFactory.javayour change would probably
yunhee,let actually make the property name:org.apache.oodt.cas.protocol.jsch.sftp.portwhat you think chris?-brianOn Aug 06, 2012, at 10:52 AM, Brian Foster holeno...@mac.com wrote:hey yunhee,like chris said i would use the java properties he defined and modify the following class to set port
oops... fixing...-brianOn Aug 06, 2012, at 12:30 PM, Apache Jenkins Server jenk...@builds.apache.org wrote:See https://builds.apache.org/job/oodt-trunk/581/changes
/GenericWorkflowObjectFactory.java
1369233
Diff: https://reviews.apache.org/r/6357/diff/
Testing
---
Thanks,
brian Foster
/java/org/apache/oodt/cas/workflow/system/XmlRpcWorkflowManager.java
1369233
trunk/workflow/src/main/java/org/apache/oodt/cas/workflow/util/GenericWorkflowObjectFactory.java
1369233
Diff: https://reviews.apache.org/r/6357/diff/
Testing
---
Thanks,
brian Foster
/workflow/src/main/java/org/apache/oodt/cas/workflow/util/GenericWorkflowObjectFactory.java
1369233
Diff: https://reviews.apache.org/r/6357/diff/
Testing
---
Thanks,
brian Foster
Hey YunHee,
Okay, found another bug... lol... you're on a roll dude!
I've attached the fix to issue:
https://issues.apache.org/jira/browse/OODT-481
Just patch the fix into the trunk pushpull and download with communication to
filemgr should work now.
-brian
On Aug 1, 2012, at 8:28 AM,
hey YunHee,
I've submitted the patch, so you can instead of having to patch the code you
can just resync your pushpull code and rebuild it and swap the jar out in your
deployment
-brian
On Aug 1, 2012, at 8:28 AM, YunHee Kang wrote:
Hi Chris and Brian,
I am reading source codes for
until Sun Jul 29 22:12:00 KST 2012
Please let me know how to fix this problem.
Thanks,
Yunhee
2012/7/28 Brian Foster holeno...@me.com:
Hey YunHee,
Doesn't look like the patch took this time, but don't worry about that now,
i have put the fixes into the trunk... if you just check
());
// }
Will you let me know if the method get() in the
CommonsNetFtpProtocol.java was called when pushpull was run ?
Thanks,
Yunhee
2012/7/27 Brian Foster holeno...@mac.com:
Hey YunHee,
Okay the latest patch attached to the issue now (the on with todays date)
works as far as pushpull
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/6166/#review9525
---
On July 27, 2012, 12:15 a.m., brian Foster wrote
ar -- !--protocolFactory class="org.apache.oodt.cas.protocol.ftp.CommonsNetFtpClientFactory"/-- protocolFactory class="org.apache.oodt.cas.protocol.ftp.CommonsNetFtpProtocolFactory"/ /protocol Thanks, Yunhee 2012/7/26 Brian Foster holeno...@mac.com: hey Yunhee, i just realized that your probably not on the
Haha... Wow... Just put a ! in the if statement below... Lol... and I'll file a
bug and fix it tomorrow... It's throwing an exception on success... oops... Lol
-Brian
On Jul 26, 2012, at 5:38 PM, Brian Foster holeno...@mac.com wrote:
Hey YunHee,
Okay the latest patch attached to the issue
/retrievalsystem/RetrievalSetup.java
1365306
Diff: https://reviews.apache.org/r/6166/diff/
Testing
---
Ran test provided by YunHee
Thanks,
brian Foster
provided by YunHee
Thanks,
brian Foster
) at java.lang.Thread.run(Thread.java:662) Please let me know what java programs I check frist. Thanks, Yunhee 2012/7/25 Brian Foster holeno...@mac.com: YunHee, There is a NullPointerException being thrown... on line 118 of org.apache.oodt.cas.pushpull.retrievalsystem.RetrievalSetup.java change
YunHee,There is a NullPointerException being thrown... on line 118 of org.apache.oodt.cas.pushpull.retrievalsystem.RetrievalSetup.javachange it from:
LOG.log(Level.SEVERE,
"Failed to finish downloading per property files "
+
side note: Don't use 0.4 CAS-PGE... use the latest from trunk... there were changes that never made it into the trunk in time for 0.4 release.-brianOn Jul 11, 2012, at 07:16 AM, "Mattmann, Chris A (388J)" chris.a.mattm...@jpl.nasa.gov wrote:[dropping private@ and user@ CC's] Hi Mike, In general,
0.4 CAS-PGE uses AutoDetectProductCrawler now... in the PgeConfig XML file you now just specify directories where you want your crawler to crawl and you configure ingest with the crawler... same as you would for a pushpull staging area... check out this
---
Thanks,
brian Foster
://reviews.apache.org/r/5382/diff/
Testing
---
Wrote unit-tests
Thanks,
brian Foster
+1On Jun 22, 2012, at 06:58 AM, "Mattmann, Chris A (388J)" chris.a.mattm...@jpl.nasa.gov wrote:Hey Ricky, I just read your page: https://cwiki.apache.org/confluence/display/OODT/MetExtractors+for+Crawler Super awesome! My +1 the ProdTypePatternMetExtractor sounds super useful. Cheers, Chris
hey guys,running this:curl http://www.apache.org/dist/oodt/radix-0.4.tgz radix-0.4.tgzgives me a file with content:!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN"htmlheadtitle404 Not Found/title/headbodyh1Not Found/h1pThe requested URL /dist/oodt/radix-0.4.tgz was not found on this
Ever since review board when down the other day, since it's come back up it is working with JIRA anymore... who should i bug?-brian
/oodt/cas/pge/config/TestXmlFilePgeConfigBuilder.java
PRE-CREATION
trunk/pge/src/test/org/apache/oodt/cas/pge/util/TestXmlHelper.java
PRE-CREATION
Diff: https://reviews.apache.org/r/5382/diff/
Testing
---
Wrote unit-tests
Thanks,
brian Foster
k!Cheers, ChrisOn May 16, 2012, at 11:32 PM, Brian Foster wrote:google+ hangout 4 those out of state!On May 16, 2012, at 11:54 AM, "Mattmann, Chris A (388J)" chris.a.mattm...@jpl.nasa.gov wrote:Hey Paul,This sounds like a great idea and I'm in (of course!)
+1On May 15, 2012, at 05:21 PM, "Ramirez, Paul M (388J)" paul.m.rami...@jpl.nasa.gov wrote:Hi All, Anyone interested in doing a meetup/hackathon at the beginning of June. The goal would be to get some updates to our code base but really focused on getting 0.4 out the door. If there is enough
On 2012-05-02 19:20:13, brian Foster wrote:
./trunk/workflow/src/test/org/apache/oodt/cas/workflow/engine/TestTaskQuerier.java,
line 79
https://reviews.apache.org/r/4961/diff/1/?file=105932#file105932line79
When Success/done is passed in, the processor created is incorrect
On 2012-05-02 19:20:13, brian Foster wrote:
./trunk/workflow/src/test/org/apache/oodt/cas/workflow/engine/TestTaskQuerier.java,
line 79
https://reviews.apache.org/r/4961/diff/1/?file=105932#file105932line79
When Success/done is passed in, the processor created is incorrect
/
---
(Updated 2012-05-02 05:08:45)
Review request for oodt, brian Foster, Ricky Nguyen, Paul Ramirez, Sheryl
John, and Thomas Bennett.
Summary
---
Task Querier thread for OODT-310. See javadocs on:
https://builds.apache.org/job/oodt-trunk/javadoc
hey guys,in the wengine branched CAS-PGE, it supported staging the CAS-PGE's XML config file to tmp directory so it could be parsed and then processed and then the staged config file was copied CAS-PGE's working directory (had to be copied later since the working directory information is in the
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/4746/
---
(Updated 2012-04-30 21:23:30.299369)
Review request for oodt, Chris Mattmann,
hey guys,There are several cool new features in Java 7... such as, and you JPLer will probably like this one, file change notifications --The WatchService API lets you receive notification events upon changes to the subject (directory or file)... also Maven 3 has been out for a while and i would
Hey Rishi,
Do what Chris said AND add a CmdLineAction to cmd-line-action.xml to run you
crawler (should just be a copy/paste and change some names)
-Brian
On Apr 25, 2012, at 10:12 PM, Mattmann, Chris A (388J)
chris.a.mattm...@jpl.nasa.gov wrote:
Hey Rishi,
I think you need to change
Nevermind... Looks like you are using 0.3 instead of the trunk... what I added
applies to trunk crawler
-Brian
On Apr 25, 2012, at 4:36 PM, Verma, Rishi (388J) rishi.ve...@jpl.nasa.gov
wrote:
Hi all,
I wrote a custom cas-crawler ProductCrawler, but I'm having some difficulty
registering
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/4665/
---
Review request for oodt, Chris Mattmann, Ricky Nguyen, Paul Ramirez, and Thomas
---
On 2012-04-03 21:56:17, brian Foster wrote:
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/4628
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/4628/
---
(Updated 2012-04-06 02:16:10.469275)
Review request for oodt, Chris Mattmann,
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/4628/
---
Review request for oodt, Chris Mattmann, Ricky Nguyen, Paul Ramirez, and Thomas
Mattmann, brian Foster, Paul Ramirez, and
Sheryl John.
Summary
---
Get product references before calling retrieveProduct().
1) call setProductReferences method
2) remove d.retrieveProduct() outside the if else statement.
Fix unit tests testRetrieveFilesById() and testRetrieveFilesByName
hey guys,I'm proposing deletion instead of deprecation of CAS-PGE product file renaming and met file writing... this will be replaced by the CAS-Crawler AutoDetectProductCrawler which now has support for both these things... CAS-Crawler has evolved along-side CAS-PGE and has been integrated with
On 2012-03-26 21:06:00, brian Foster wrote:
trunk/filemgr/src/main/java/org/apache/oodt/cas/filemgr/structs/query/QueryResultComparator.java,
line 48
https://reviews.apache.org/r/4458/diff/2/?file=95128#file95128line48
i don't think this case is ever true... this checks
, brian Foster, Paul Ramirez, Sheryl
John, and Thomas Bennett.
Summary
---
putting nulls last
This addresses bug OODT-429.
https://issues.apache.org/jira/browse/OODT-429
Diffs
-
trunk/filemgr/src/main/java/org/apache/oodt/cas/filemgr/structs/query
hey ryan,The example pushpull RemoteSpecs.xml file requires setting some environment variables:CAS_PP_RESOURCES = should be set to absolute path to your pushpull etc directoryCAS_PP_TEMP_PROPS = temporary directory for examples which download pushpull config filesYou might be able to get a few of
, visit:
https://reviews.apache.org/r/4451/
---
(Updated 2012-03-22 23:47:07)
Review request for oodt, Chris Mattmann, brian Foster, Paul Ramirez, Sheryl
John, and Thomas Bennett.
Summary
---
Cleaned up metadata
reach
this IF statement... The IF statement it is contained in will be false
- brian
On 2012-03-22 06:09:52, brian Foster wrote:
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/
---
On 2012-03-22 06:09:52, brian Foster wrote:
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/
00:10:25)
Review request for oodt, Chris Mattmann, brian Foster, Paul Ramirez, Sheryl
John, and Thomas Bennett.
Summary
---
putting nulls last
This addresses bug OODT-429.
https://issues.apache.org/jira/browse/OODT-429
Diffs
-
trunk/filemgr/src/main
, brian Foster, Paul Ramirez, Sheryl
John, and Thomas Bennett.
Summary
---
Cleaned up metadata to string methods of QueryResult. If metadata was empty,
it was trying to delete a trailing comma that doesn't exist.
This addresses bug OODT-427.
https://issues.apache.org/jira
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/4454/
---
(Updated 2012-03-26 20:55:22.461160)
Review request for oodt, Chris Mattmann,
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/4454/#review6347
---
On 2012-03-22 21:27:55, brian Foster wrote
:
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/4458/
---
(Updated 2012-03-23 21:19:16)
Review request for oodt, Chris Mattmann, brian Foster, Paul Ramirez, Sheryl
John, and Thomas
/r//#review6349
---
On 2012-03-25 01:55:32, brian Foster wrote:
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r//
---
(Updated 2012-03-27 00:47:30.189828)
Review request for oodt, Chris Mattmann,
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r//
---
(Updated 2012-03-25 01:55:32.563950)
Review request for oodt, Chris Mattmann,
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r//
---
Review request for oodt, Chris Mattmann, Ricky Nguyen, Paul Ramirez, and Thomas
hey thomas,i know what the problem is... working on the fix right now... i'll create an issue describing the problem and post the fix so you can patch it in as soon as i have something.-brianOn Mar 22, 2012, at 07:07 AM, Thomas Bennett lmzxq@gmail.com wrote:Sorry forgot to mention that I'm
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/4410/
---
Review request for oodt, Chris Mattmann, Ricky Nguyen, Paul Ramirez, and Thomas
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/4412/
---
Review request for oodt, Chris Mattmann, Ricky Nguyen, Paul Ramirez, and Thomas
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/4397/
---
Review request for oodt.
Summary
---
Will write out
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/4399/
---
Review request for oodt, Chris Mattmann, Ricky Nguyen, Paul Ramirez, and Thomas
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/4398/
---
(Updated 2012-03-18 21:25:45.978379)
Review request for oodt, Chris Mattmann,
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/4399/
---
(Updated 2012-03-18 21:26:02.155994)
Review request for oodt, Chris Mattmann,
/
---
(Updated 2012-03-19 22:33:53)
Review request for oodt, Chris Mattmann, brian Foster, Paul Ramirez, Sheryl
John, and Thomas Bennett.
Summary
---
* updated super POM to use java.net maven repo
* added globus repo to FTP module
* removed
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/4393/
---
(Updated 2012-03-17 20:19:38.958054)
Review request for oodt, Chris Mattmann,
On 2012-03-15 00:35:26, brian Foster wrote:
Why can't DataSourceCatalog be extended and just modified per hypersonic
needs?... what are the differences exactly between DataSource and Hyersonic
versions of the Catalogs?
Chris Mattmann wrote:
Hey Brian, great question. The reality
generated e-mail. To reply, visit:
https://reviews.apache.org/r/4374/
---
(Updated 2012-03-16 03:18:23)
Review request for oodt, Chris Mattmann, brian Foster, Paul Ramirez, Sheryl
John, and Thomas Bennett.
Summary
---
filemgr
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/4375/
---
(Updated 2012-03-16 08:25:17.505045)
Review request for oodt, Chris Mattmann,
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/4375/#review6035
---
On 2012-03-16 08:25:17, brian Foster wrote:
---
This is an automatically generated e-mail
)
- brian
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/4375/#review6035
---
On 2012-03-16 08:25:17, brian Foster wrote
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/4393/
---
Review request for oodt, Chris Mattmann, Ricky Nguyen, Paul Ramirez, and Thomas
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/4359/
---
(Updated 2012-03-15 08:08:37.402954)
Review request for oodt, Chris Mattmann,
no prob!... lots more to come too... don't think i'm even half done with cas-pge yet... lol-brianOn Mar 15, 2012, at 06:24 PM, "Mattmann, Chris A (388J)" chris.a.mattm...@jpl.nasa.gov wrote:You are my hero! Thanks for the wengine help bud! Cheers, Chris On Mar 15, 2012, at 4:34 PM,
then committing it.
- brian
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/4269/#review5819
---
On 2012-03-10 01:32:07, brian Foster wrote
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/4303/
---
Review request for oodt, Chris Mattmann and Paul Ramirez.
Summary
---
Will
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/4195/
---
(Updated 2012-03-09 07:55:23.448447)
Review request for oodt, Chris Mattmann
.
will do!
- brian
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/4196/#review5642
---
On 2012-03-06 08:20:36, brian Foster wrote
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/4196/
---
(Updated 2012-03-09 08:17:12.801020)
Review request for oodt, Chris Mattmann
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/4195/
---
Review request for oodt, Chris Mattmann and Paul Ramirez.
Summary
---
$
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/4196/
---
Review request for oodt, Chris Mattmann and Paul Ramirez.
Summary
---
This
hey Luca,
Ya pushpull can download full directories... do you have a distruct XML file
for downloading individual files?... paste it into a message on this thread and
let me know which directory you would like to download and i can do the mods or
help you through making the mods to the
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/4088/#review5436
---
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/4069/
---
Review request for oodt, Chris Mattmann and Paul Ramirez.
Summary
---
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/4071/
---
(Updated 2012-02-27 23:07:29.730154)
Review request for oodt, Chris Mattmann
or double quotes.
Sean
On 2/23/12 11:47 AM, Brian Foster
holeno...@me.commailto:holeno...@me.com wrote:
Hey Sean,
Maybe try using single quotes instead of double... i.e. ... -query
'SELECT * FROM *'... your shell is prob expanding your *'s
-Brian
Hardman, Sean H (388J
since i wrote the sql part of
query_tool... lol... I'd recommend making a test run through all the commands
for filemgr-client before trusting $@
-Brian
On Feb 25, 2012, at 1:15 AM, Brian Foster holeno...@me.com wrote:
Hey Sean,
Ya I'd expect query_tool to work in this case and filemgr-client
1 - 100 of 125 matches
Mail list logo