Re: [MSNoise] One more clarification

2016-10-13 Thread Lukas Preiswerk
Ashton,

> I think the part that is throwing me off a bit is the "Daily NCFs were then
> obtained by stacking 30-min NCFs".
> This sound like to be, they took their individual 30 min NCFs and stacked
> them, so that each day is represented by the stacked summation of 48
> independent NCFs.

Agreed. If you set corr_duration to 1800 and leave analysis_duration
in the standard 86400, this is exactly what you get in the 1-Day
stacks.

> I assumed that meant that both corr_duration and analysis duration were set
> to 3600, but maybe not.

As I mentioned, if you set analysis_duration to 3600,
then you only use 1 hour of data each day and leave the rest
untouched… Try it for yourself with the keep_all option enabled and by
looking at the data in the h5 files.

Lukas




2016-10-12 18:08 GMT+02:00 Flinders, Ashton :
> Thanks Lukas!
>
> I think the part that is throwing me off a bit is the "Daily NCFs were then
> obtained by stacking 30-min NCFs".
>
> This sound like to be, they took their individual 30 min NCFs and stacked
> them, so that each day is represented by the stacked summation of 48
> independent NCFs.
>
> I assumed that meant that both corr_duration and analysis duration were set
> to 3600, but maybe not.
>
> I'll probably just send an email out to them to see what parameters they
> used.
>
>
> On Tue, Oct 11, 2016 at 11:35 PM, Lukas Preiswerk <
> preisw...@vaw.baug.ethz.ch> wrote:
>
>> Hi Ashton,
>>
>> I can partly answer 1) and 3). First, corr_duration would be 30*60 in
>> their paper (corr_duration is in seconds). As far as I understand,
>> analysis_duration should almost always be 86400. Setting the
>> analysis_duration
>> smaller could be used to prevent loading a full day of data for
>> specific cases, like super high frequency data (8kHz or more). The
>> remaining processing still works on days and not multiples of
>> analysis_duration. For examplem if you set analysis_duration to 3600,
>> then you only use 1 hour of data each day…
>>
>> Hope that helps!
>>
>> Lukas
>>
>>
>> 2016-10-11 18:57 GMT+02:00 Flinders, Ashton :
>> > Hi all, I was just reading through Taka'aki and Forents new paper using
>> > MSNoise, and was hoping just for a wee bit more clarification on the
>> > MSnoise processing scheme (wasnt quite clear in the docs).
>> >
>> >
>> > The paper says;
>> > "We first removed the instrument response from 1-day-long waveform to
>> > obtain ground motion in displacement. Daily displacement data were
>> > bandpassed between 0.08 and 2.0 Hz, down-sampled into 10  Hz, and split
>> > into 30-min-long data. Those 30-min-long data were spectral whitened in a
>> > frequency range of 0.1–0.9  Hz and then one-bit normalized. With those
>> > one-bit normalized data, the NCFs were computed for all possible
>> > combinations of components. Daily NCFs were then obtained by stacking
>> > 30-min NCFs."
>> >
>> >
>> > Q1) So just in terms of implementation in msnoise admin, the 30-min-long
>> > duration would be controlled by "analysis_duration" correct?
>> >
>> > Q2) If you remove the instrument response, is it always removed from a 1
>> > day chunk, or is it removed from a chunk equal in size to
>> > "analysis_duration"? (the docs say 1 day, but I wasnt sure if this was
>> just
>> > referencing the default "analysis_duration" time).
>> >
>> > Q3) This probably isnt the intended usage, but if you used
>> > "analysis_duration" longer than a day, would you expect things to behave?
>> >
>> > Thanks as always!
>> >
>> > -ashton
>> >
>> >
>> > p.s. paper;
>> > http://earth-planets-space.springeropen.com/articles/10.
>> 1186/s40623-016-0538-6
>> >
>> > --
>> > Ashton F. Flinders, Ph.D
>> > U.S. Geological Survey
>> > 345 Middlefield Road
>> > Menlo Park, CA 94025
>> > (650) 329-5050
>> > ___
>> > MSNoise mailing list
>> > MSNoise@mailman-as.oma.be
>> > http://mailman-as.oma.be/mailman/listinfo/msnoise
>> ___
>> MSNoise mailing list
>> MSNoise@mailman-as.oma.be
>> http://mailman-as.oma.be/mailman/listinfo/msnoise
>>
>
>
>
> --
> Ashton F. Flinders, Ph.D
> U.S. Geological Survey
> 345 Middlefield Road
> Menlo Park, CA 94025
> (650) 329-5050
> ___
> MSNoise mailing list
> MSNoise@mailman-as.oma.be
> http://mailman-as.oma.be/mailman/listinfo/msnoise
___
MSNoise mailing list
MSNoise@mailman-as.oma.be
http://mailman-as.oma.be/mailman/listinfo/msnoise


Re: [MSNoise] Tutorial

2016-10-13 Thread Aurélien Mordret
Hi There,

There is actually a test dataset in MSNoise. Just run 'msnoise test' in an
empty folder.

But yes, Julie, You have to populate the database first, right after the
'msnoise install' run.

Cheers,

Aurelien


Le jeu. 13 oct. 2016 à 05:43, VICIC BLAZ [PHD0900016] <
blaz.vi...@phd.units.it> a écrit :

> A tut with small dataset would be useful indeed...Anyway, I think your
> problem is, that you did not populate the station table.
>
>
> http://msnoise.org/doc/workflow.html#module-msnoise.s002populate_station_table
>
>
> afaik you will have to do it manualy, since there is a bug in 1.4 version
> from the web interface.
>
>
> blaz
>
> 
> From: msnoise-boun...@mailman-as.oma.be 
> on behalf of Julie Albaric 
> Sent: Thursday, October 13, 2016 10:49:28 AM
> To: msnoise@mailman-as.oma.be
> Subject: [MSNoise] Tutorial
>
> Hi !
>
> I would like to use MSNoise and was wondering if you had, in addition to
> the documentation on your website, a tutorial with a small dataset.
> Actually, I’ve installed MSNoise on my Mac with SQLite, see the web
> interface but as soon as I try to create a station list I get an error
> message :
> builtins.TypeError
>
> TypeError: __init__() missing 8 required positional arguments: 'net',
> 'sta', 'X', 'Y', 'altitude', 'coordinates', 'instrument', and 'used'
>
>
> I’m not very familiar with Python so I don’t know if it’s because I’ve
> missed something in the way I use MSNoise (parameters to change/ files to
> be present in the project folder…) or if it comes from the installation
> itself.
>
> Thanks,
>
> Julie
>
> --
> Julie Albaric
> UMR 6249 Chrono-environnement
> Université de Franche-Comté
> 16 route de Gray
> 25030 Besançon, France
> Tel. +33 3 81 66 63 69 <03%2081%2066%2063%2069>
>
> ___
> MSNoise mailing list
> MSNoise@mailman-as.oma.be
> http://mailman-as.oma.be/mailman/listinfo/msnoise
> ___
> MSNoise mailing list
> MSNoise@mailman-as.oma.be
> http://mailman-as.oma.be/mailman/listinfo/msnoise
>
___
MSNoise mailing list
MSNoise@mailman-as.oma.be
http://mailman-as.oma.be/mailman/listinfo/msnoise


Re: [MSNoise] Tutorial

2016-10-13 Thread VICIC BLAZ [PHD0900016]
A tut with small dataset would be useful indeed...Anyway, I think your problem 
is, that you did not populate the station table.

http://msnoise.org/doc/workflow.html#module-msnoise.s002populate_station_table


afaik you will have to do it manualy, since there is a bug in 1.4 version from 
the web interface.


blaz


From: msnoise-boun...@mailman-as.oma.be  on 
behalf of Julie Albaric 
Sent: Thursday, October 13, 2016 10:49:28 AM
To: msnoise@mailman-as.oma.be
Subject: [MSNoise] Tutorial

Hi !

I would like to use MSNoise and was wondering if you had, in addition to the 
documentation on your website, a tutorial with a small dataset.
Actually, I’ve installed MSNoise on my Mac with SQLite, see the web interface 
but as soon as I try to create a station list I get an error message :
builtins.TypeError

TypeError: __init__() missing 8 required positional arguments: 'net', 'sta', 
'X', 'Y', 'altitude', 'coordinates', 'instrument', and 'used'


I’m not very familiar with Python so I don’t know if it’s because I’ve missed 
something in the way I use MSNoise (parameters to change/ files to be present 
in the project folder…) or if it comes from the installation itself.

Thanks,

Julie

--
Julie Albaric
UMR 6249 Chrono-environnement
Université de Franche-Comté
16 route de Gray
25030 Besançon, France
Tel. +33 3 81 66 63 69

___
MSNoise mailing list
MSNoise@mailman-as.oma.be
http://mailman-as.oma.be/mailman/listinfo/msnoise
___
MSNoise mailing list
MSNoise@mailman-as.oma.be
http://mailman-as.oma.be/mailman/listinfo/msnoise


[MSNoise] Tutorial

2016-10-13 Thread Julie Albaric
Hi !

I would like to use MSNoise and was wondering if you had, in addition to the 
documentation on your website, a tutorial with a small dataset.
Actually, I’ve installed MSNoise on my Mac with SQLite, see the web interface 
but as soon as I try to create a station list I get an error message : 
builtins.TypeError

TypeError: __init__() missing 8 required positional arguments: 'net', 'sta', 
'X', 'Y', 'altitude', 'coordinates', 'instrument', and 'used'


I’m not very familiar with Python so I don’t know if it’s because I’ve missed 
something in the way I use MSNoise (parameters to change/ files to be present 
in the project folder…) or if it comes from the installation itself.

Thanks,

Julie

--
Julie Albaric
UMR 6249 Chrono-environnement
Université de Franche-Comté
16 route de Gray
25030 Besançon, France
Tel. +33 3 81 66 63 69

___
MSNoise mailing list
MSNoise@mailman-as.oma.be
http://mailman-as.oma.be/mailman/listinfo/msnoise