RE: Speeding up a Powershell script

2016-10-24 Thread Dave Crozier 
+1

And Free - a double bonus!

-Original Message-
From: ProFox [mailto:profox-boun...@leafe.com] On Behalf Of Richard Kaye
Sent: 21 October 2016 22:06
To: profox@leafe.com
Subject: RE: Speeding up a Powershell script

+1 to RegexBuddy. 

--

rk
-Original Message-
From: ProfoxTech [mailto:profoxtech-boun...@leafe.com] On Behalf Of Darren
Sent: Friday, October 21, 2016 4:43 PM
To: profoxt...@leafe.com
Subject: RE: Speeding up a Powershell script

My view ... RegExp syntax is fairly limited in scope and relatively easy to 
learn. Powershell is a whole other beast.

I have used a fantastic tool to work with and develop RegExp for a few years 
now and the small investment has paid over time and again ..

https://www.regexbuddy.com/  recommend it highly !!


[excessive quoting removed by server]

___
Post Messages to: ProFox@leafe.com
Subscription Maintenance: http://mail.leafe.com/mailman/listinfo/profox
OT-free version of this list: http://mail.leafe.com/mailman/listinfo/profoxtech
Searchable Archive: http://leafe.com/archives/search/profox
This message: 
http://leafe.com/archives/byMID/profox/18725b8cd2d5d247873a2baf401d4ab2a434d...@ex2010-a-fpl.fpl.LOCAL
** All postings, unless explicitly stated otherwise, are the opinions of the 
author, and do not constitute legal or medical advice. This statement is added 
to the messages for those lawyers who are too stupid to see the obvious.

RE: Speeding up a Powershell script

2016-10-21 Thread Richard Kaye 
+1 to RegexBuddy. 

--

rk
-Original Message-
From: ProfoxTech [mailto:profoxtech-boun...@leafe.com] On Behalf Of Darren
Sent: Friday, October 21, 2016 4:43 PM
To: profoxt...@leafe.com
Subject: RE: Speeding up a Powershell script

My view ... RegExp syntax is fairly limited in scope and relatively easy to
learn. Powershell is a whole other beast.

I have used a fantastic tool to work with and develop RegExp for a few years
now and the small investment has paid over time and again ..

https://www.regexbuddy.com/  recommend it highly !!


___
Post Messages to: ProFox@leafe.com
Subscription Maintenance: http://mail.leafe.com/mailman/listinfo/profox
OT-free version of this list: http://mail.leafe.com/mailman/listinfo/profoxtech
Searchable Archive: http://leafe.com/archives/search/profox
This message: 
http://leafe.com/archives/byMID/profox/bn4pr10mb0913e82add84ee592ae2bffbd2...@bn4pr10mb0913.namprd10.prod.outlook.com
** All postings, unless explicitly stated otherwise, are the opinions of the 
author, and do not constitute legal or medical advice. This statement is added 
to the messages for those lawyers who are too stupid to see the obvious.

RE: Speeding up a Powershell script

2016-10-21 Thread Darren 
My view ... RegExp syntax is fairly limited in scope and relatively easy to
learn. Powershell is a whole other beast.

I have used a fantastic tool to work with and develop RegExp for a few years
now and the small investment has paid over time and again ..

https://www.regexbuddy.com/  recommend it highly !!




-Original Message-
From: ProfoxTech [mailto:profoxtech-boun...@leafe.com] On Behalf Of Edward
Leafe
Sent: Saturday, 22 October 2016 7:36 AM
To: profoxt...@leafe.com
Subject: Re: Speeding up a Powershell script

On Oct 21, 2016, at 1:53 PM, Gene Wirchenko <ge...@telus.net> wrote:
> 
>> +1.  It's like the UberNerds who want to obfuscate just for the "fun" of
it to be UberNerds.  I felt similar about RegExp.
> 
> Regexes can be great, but I resist the temptation to make long
regexes.  That gets in write-only code all too fast.  Instead, I might use a
couple of shorter ones with a bit of glue code.

Complex? Just add comments!

http://www.diveintopython.net/regular_expressions/verbose.html


-- Ed Leafe






[excessive quoting removed by server]

___
Post Messages to: ProFox@leafe.com
Subscription Maintenance: http://mail.leafe.com/mailman/listinfo/profox
OT-free version of this list: http://mail.leafe.com/mailman/listinfo/profoxtech
Searchable Archive: http://leafe.com/archives/search/profox
This message: 
http://leafe.com/archives/byMID/profox/006401d22bdb$b7e005f0$27a011d0$@ozemail.com.au
** All postings, unless explicitly stated otherwise, are the opinions of the 
author, and do not constitute legal or medical advice. This statement is added 
to the messages for those lawyers who are too stupid to see the obvious.

Re: Speeding up a Powershell script

2016-10-21 Thread Edward Leafe 
On Oct 21, 2016, at 1:53 PM, Gene Wirchenko  wrote:
> 
>> +1.  It's like the UberNerds who want to obfuscate just for the "fun" of it 
>> to be UberNerds.  I felt similar about RegExp.
> 
> Regexes can be great, but I resist the temptation to make long regexes.  
> That gets in write-only code all too fast.  Instead, I might use a couple of 
> shorter ones with a bit of glue code.

Complex? Just add comments!

http://www.diveintopython.net/regular_expressions/verbose.html


-- Ed Leafe






___
Post Messages to: ProFox@leafe.com
Subscription Maintenance: http://mail.leafe.com/mailman/listinfo/profox
OT-free version of this list: http://mail.leafe.com/mailman/listinfo/profoxtech
Searchable Archive: http://leafe.com/archives/search/profox
This message: 
http://leafe.com/archives/byMID/profox/ff755d67-397c-40cd-9cb9-bbc7d0942...@leafe.com
** All postings, unless explicitly stated otherwise, are the opinions of the 
author, and do not constitute legal or medical advice. This statement is added 
to the messages for those lawyers who are too stupid to see the obvious.

Re: Speeding up a Powershell script

2016-10-21 Thread Gene Wirchenko 

At 05:01 2016-10-21, mbsoftwaresoluti...@mbsoftwaresolutions.com wrote:

On 2016-10-19 09:43, Malcolm Greene wrote:

A great use case for getting your feet wet with Python.
BTW: Powershell syntax wants me to gouge my eyes out. Anyone else feel
the same way?


 I guess I just do not have your enthusiasm.   I just look 
away.  Yes, I think it is ugly.


+1.  It's like the UberNerds who want to obfuscate just for the 
"fun" of it to be UberNerds.  I felt similar about RegExp.


 Regexes can be great, but I resist the temptation to make long 
regexes.  That gets in write-only code all too fast.  Instead, I 
might use a couple of shorter ones with a bit of glue code.


Sincerely,

Gene Wirchenko


___
Post Messages to: ProFox@leafe.com
Subscription Maintenance: http://mail.leafe.com/mailman/listinfo/profox
OT-free version of this list: http://mail.leafe.com/mailman/listinfo/profoxtech
Searchable Archive: http://leafe.com/archives/search/profox
This message: 
http://leafe.com/archives/byMID/profox/97ed57a7b6a6b1e0dd1517ec38929ae7@mtlp87
** All postings, unless explicitly stated otherwise, are the opinions of the 
author, and do not constitute legal or medical advice. This statement is added 
to the messages for those lawyers who are too stupid to see the obvious.

Re: Speeding up a Powershell script

2016-10-21 Thread Stephen Russell 
Powershell is "obectized" batch files.  Your nerd status is reduced when
you diss objects like that.

https://gallery.technet.microsoft.com/scriptcenter/Remove-Windows-Store-Apps-a00ef4a4

because powershell is very cool.  I have 25-30 scripts that I run monthly
for a variety of odd reasons.  Sharepoint information, reporting and
possibly control as well as similar things in SQL Server.

On Fri, Oct 21, 2016 at 7:01 AM, <
mbsoftwaresoluti...@mbsoftwaresolutions.com> wrote:

> On 2016-10-19 09:43, Malcolm Greene wrote:
>
>> A great use case for getting your feet wet with Python.
>>
>> BTW: Powershell syntax wants me to gouge my eyes out. Anyone else feel
>> the same way?
>>
>> Malcolm
>>
>
>
> +1.  It's like the UberNerds who want to obfuscate just for the "fun" of
> it to be UberNerds.  I felt similar about RegExp.
>
[excessive quoting removed by server]

___
Post Messages to: ProFox@leafe.com
Subscription Maintenance: http://mail.leafe.com/mailman/listinfo/profox
OT-free version of this list: http://mail.leafe.com/mailman/listinfo/profoxtech
Searchable Archive: http://leafe.com/archives/search/profox
This message: 
http://leafe.com/archives/byMID/profox/cajidmyjtg_n1lsq1hdrumvutz0tlarwvuowkvindjy3mfq+...@mail.gmail.com
** All postings, unless explicitly stated otherwise, are the opinions of the 
author, and do not constitute legal or medical advice. This statement is added 
to the messages for those lawyers who are too stupid to see the obvious.

Re: Speeding up a Powershell script

2016-10-21 Thread mbsoftwaresolutions 

On 2016-10-19 09:43, Malcolm Greene wrote:

A great use case for getting your feet wet with Python.

BTW: Powershell syntax wants me to gouge my eyes out. Anyone else feel
the same way?

Malcolm



+1.  It's like the UberNerds who want to obfuscate just for the "fun" of 
it to be UberNerds.  I felt similar about RegExp.


___
Post Messages to: ProFox@leafe.com
Subscription Maintenance: http://mail.leafe.com/mailman/listinfo/profox
OT-free version of this list: http://mail.leafe.com/mailman/listinfo/profoxtech
Searchable Archive: http://leafe.com/archives/search/profox
This message: 
http://leafe.com/archives/byMID/profox/68a2202b9b72c4b2430ebeb4c6362...@mbsoftwaresolutions.com
** All postings, unless explicitly stated otherwise, are the opinions of the 
author, and do not constitute legal or medical advice. This statement is added 
to the messages for those lawyers who are too stupid to see the obvious.

Re: Speeding up a Powershell script

2016-10-21 Thread Man-wai Chang 
On Thu, Oct 20, 2016 at 10:50 PM, Dave Crozier  wrote:
> I hope you didn't take the comment as disrespectful as It wasn't meant to be 
> in any way at all ;-)

Of course not. It's easier to do it in Visual Foxpro!

> I must admit that Powershell is a little like Regular Expressions in that 
> once you use it on a regular basis it seems simple but if you only visit it 
> once in a blue moon then the learning or re-learning curve is huge!
> Hope you found a solution anyway.

Iterating the $AllFiles is the fastest way out I believe. Well, let
see whether I could copy some codes from others... :)

-- 
 .~. Might, Courage, Vision. SINCERITY!
/ v \ 64-bit Ubuntu 9.10 (Linux kernel 2.6.39.3)
/( _ )\ http://sites.google.com/site/changmw
^ ^ May the Force and farces be with you!

___
Post Messages to: ProFox@leafe.com
Subscription Maintenance: http://mail.leafe.com/mailman/listinfo/profox
OT-free version of this list: http://mail.leafe.com/mailman/listinfo/profoxtech
Searchable Archive: http://leafe.com/archives/search/profox
This message: 
http://leafe.com/archives/byMID/profox/CAGv=MJCmrPvH8UJQUsGdvyfribjJiP91qOc5=ahtjvttzhc...@mail.gmail.com
** All postings, unless explicitly stated otherwise, are the opinions of the 
author, and do not constitute legal or medical advice. This statement is added 
to the messages for those lawyers who are too stupid to see the obvious.

Re: Speeding up a Powershell script

2016-10-20 Thread mbsoftwaresolutions 

On 2016-10-19 10:31, Peter Cushing wrote:

On 19/10/2016 14:51, Dave Crozier wrote:

Or:

for i in $(find . -type f | perl -ne 'print $1 if m/\.([^.\/]+)$/' | 
sort -u); do echo "$i"": ""$(du -hac **/*."$i" | tail -n1 | awk 
'{print $1;}')"; done | sort -h -k 2 -r


Assuming you have extglob enabled:
   shopt -s extglob


Feck me Dave, what was tha



LOL!

___
Post Messages to: ProFox@leafe.com
Subscription Maintenance: http://mail.leafe.com/mailman/listinfo/profox
OT-free version of this list: http://mail.leafe.com/mailman/listinfo/profoxtech
Searchable Archive: http://leafe.com/archives/search/profox
This message: 
http://leafe.com/archives/byMID/profox/7ebd8f6d4b6a488fb57f867dfde05...@mbsoftwaresolutions.com
** All postings, unless explicitly stated otherwise, are the opinions of the 
author, and do not constitute legal or medical advice. This statement is added 
to the messages for those lawyers who are too stupid to see the obvious.

Re: Speeding up a Powershell script

2016-10-20 Thread Ted Roche 
Well, I suppose if I wanted a console program, I could have used
FP-DOS, though SYS(2000) and FSIZE() instead of ADIR().

But I have a SQL-queryable cursor and can use the report writer or
textmerge to produce output in the format desired.

On Thu, Oct 20, 2016 at 9:35 AM, Man-wai Chang  wrote:
> I actually wrote and compiled a console C program to do it using VS 2013 Pro. 
> :)
>

-- 
Ted Roche
Ted Roche & Associates, LLC
http://www.tedroche.com

___
Post Messages to: ProFox@leafe.com
Subscription Maintenance: http://mail.leafe.com/mailman/listinfo/profox
OT-free version of this list: http://mail.leafe.com/mailman/listinfo/profoxtech
Searchable Archive: http://leafe.com/archives/search/profox
This message: 
http://leafe.com/archives/byMID/profox/CACW6n4uyS=7nx+gmgnlpbkwcuwahd3hw0owxtq616nvkamm...@mail.gmail.com
** All postings, unless explicitly stated otherwise, are the opinions of the 
author, and do not constitute legal or medical advice. This statement is added 
to the messages for those lawyers who are too stupid to see the obvious.

Re: Speeding up a Powershell script

2016-10-20 Thread Stephen Russell 
It is .NET for the command line.  You ask specific commandlets to get data
for you and then iterate through it.  In this case you are making a new
container object to hold the "new look" as I vaguely remember.

Currently in my own SharePoint hell of an upgrade that duped all list
contents in 2013 test.  This kills a friging day removing the dupes..

On Thu, Oct 20, 2016 at 8:29 AM, Man-wai Chang  wrote:

> It's native query language is definitely not 100% basic ANSI SQL ...
>
> On Wed, Oct 19, 2016 at 9:43 PM, Malcolm Greene 
> wrote:
> > A great use case for getting your feet wet with Python.
> >
> > BTW: Powershell syntax wants me to gouge my eyes out. Anyone else feel
> > the same way?
>
> --
>  .~. Might, Courage, Vision. SINCERITY!
> / v \ 64-bit Ubuntu 9.10 (Linux kernel 2.6.39.3)
> /( _ )\ http://sites.google.com/site/changmw
> ^ ^ May the Force and farces be with you!
>
[excessive quoting removed by server]

___
Post Messages to: ProFox@leafe.com
Subscription Maintenance: http://mail.leafe.com/mailman/listinfo/profox
OT-free version of this list: http://mail.leafe.com/mailman/listinfo/profoxtech
Searchable Archive: http://leafe.com/archives/search/profox
This message: 
http://leafe.com/archives/byMID/profox/cajidmyl74oxr2vpldecujbh8t3dxgvnnez9ny1cy3t0e9bx...@mail.gmail.com
** All postings, unless explicitly stated otherwise, are the opinions of the 
author, and do not constitute legal or medical advice. This statement is added 
to the messages for those lawyers who are too stupid to see the obvious.

RE: Speeding up a Powershell script

2016-10-20 Thread Dave Crozier 
Man-Wai,
I hope you didn't take the comment as disrespectful as It wasn't meant to be in 
any way at all ;-)

I must admit that Powershell is a little like Regular Expressions in that once 
you use it on a regular basis it seems simple but if you only visit it once in 
a blue moon then the learning or re-learning curve is huge!

Hope you found a solution anyway.

Dave

-Original Message-
From: ProFox [mailto:profox-boun...@leafe.com] On Behalf Of Man-wai Chang
Sent: 20 October 2016 14:35
To: ProFox Email List <profox@leafe.com>
Subject: Re: Speeding up a Powershell script

I actually wrote and compiled a console C program to do it using VS 2013 Pro. :)

https://sites.google.com/site/changmw/scripting/dire/dire-20161020.zip?attredirects=0=1

On Thu, Oct 20, 2016 at 4:13 AM, Ted Roche <tedro...@gmail.com> wrote:
> 30 lines in VFP. As a bonus, you end up with a cursor of data, and an 
> on-topic thread!

--
 .~. Might, Courage, Vision. SINCERITY!
/ v \ 64-bit Ubuntu 9.10 (Linux kernel 2.6.39.3) /( _ )\ 
http://sites.google.com/site/changmw
^ ^ May the Force and farces be with you!

[excessive quoting removed by server]

___
Post Messages to: ProFox@leafe.com
Subscription Maintenance: http://mail.leafe.com/mailman/listinfo/profox
OT-free version of this list: http://mail.leafe.com/mailman/listinfo/profoxtech
Searchable Archive: http://leafe.com/archives/search/profox
This message: 
http://leafe.com/archives/byMID/profox/18725b8cd2d5d247873a2baf401d4ab2a434a...@ex2010-a-fpl.fpl.LOCAL
** All postings, unless explicitly stated otherwise, are the opinions of the 
author, and do not constitute legal or medical advice. This statement is added 
to the messages for those lawyers who are too stupid to see the obvious.

Re: Speeding up a Powershell script

2016-10-20 Thread Man-wai Chang 
I actually wrote and compiled a console C program to do it using VS 2013 Pro. :)

https://sites.google.com/site/changmw/scripting/dire/dire-20161020.zip?attredirects=0=1

On Thu, Oct 20, 2016 at 4:13 AM, Ted Roche  wrote:
> 30 lines in VFP. As a bonus, you end up with a cursor of data, and an
> on-topic thread!

-- 
 .~. Might, Courage, Vision. SINCERITY!
/ v \ 64-bit Ubuntu 9.10 (Linux kernel 2.6.39.3)
/( _ )\ http://sites.google.com/site/changmw
^ ^ May the Force and farces be with you!

___
Post Messages to: ProFox@leafe.com
Subscription Maintenance: http://mail.leafe.com/mailman/listinfo/profox
OT-free version of this list: http://mail.leafe.com/mailman/listinfo/profoxtech
Searchable Archive: http://leafe.com/archives/search/profox
This message: 
http://leafe.com/archives/byMID/profox/CAGv=mjczvti6ump-+jwvd7aucjdemnmzobaujsbjmu5jcof...@mail.gmail.com
** All postings, unless explicitly stated otherwise, are the opinions of the 
author, and do not constitute legal or medical advice. This statement is added 
to the messages for those lawyers who are too stupid to see the obvious.

Re: Speeding up a Powershell script

2016-10-20 Thread Man-wai Chang 
Powershell does not have awk and find. Are you using portable Ubuntu
in Windows 10?

On Wed, Oct 19, 2016 at 9:49 PM, Dave Crozier  wrote:
> Linux:
>
> find . -type f -printf "%f %s\n" |
>   awk '{
>   PARTSCOUNT=split( $1, FILEPARTS, "." );
>   EXTENSION=PARTSCOUNT == 1 ? "NULL" : FILEPARTS[PARTSCOUNT];
>   FILETYPE_MAP[EXTENSION]+=$2
> }
>END {
>  for( FILETYPE in FILETYPE_MAP ) {
>print FILETYPE_MAP[FILETYPE], FILETYPE;
>   }
>}' | sort -n

> > {
> >Write-Host "Counting ... $Ext = " -NoNewline
>  >   $Files = $AllFiles | Where { $_.Extension -eq $Ext.Extension }
>   >  $FilesSum = ($Files | Measure-Object Length -Sum).Sum
>   >  Write-Host $FilesSum

-- 
 .~. Might, Courage, Vision. SINCERITY!
/ v \ 64-bit Ubuntu 9.10 (Linux kernel 2.6.39.3)
/( _ )\ http://sites.google.com/site/changmw
^ ^ May the Force and farces be with you!

___
Post Messages to: ProFox@leafe.com
Subscription Maintenance: http://mail.leafe.com/mailman/listinfo/profox
OT-free version of this list: http://mail.leafe.com/mailman/listinfo/profoxtech
Searchable Archive: http://leafe.com/archives/search/profox
This message: 
http://leafe.com/archives/byMID/profox/CAGv=MJCoQFjNG9MjT62QzijMvFP16Bm0P1tKByuk=3kjeea...@mail.gmail.com
** All postings, unless explicitly stated otherwise, are the opinions of the 
author, and do not constitute legal or medical advice. This statement is added 
to the messages for those lawyers who are too stupid to see the obvious.

Re: Speeding up a Powershell script

2016-10-20 Thread Man-wai Chang 
For the record:

I speak Cantonese and it is quite different from both Mandarin
(Taiwan) and Putonghua (Beijing)!
And  the PLA army speaks Putonghua. :)

On Wed, Oct 19, 2016 at 9:45 PM, Dave Crozier  wrote:
> For a moment I thought the script was written in Mandarin!
> Totally unintelligible unless you deal with it all day long.

-- 
 .~. Might, Courage, Vision. SINCERITY!
/ v \ 64-bit Ubuntu 9.10 (Linux kernel 2.6.39.3)
/( _ )\ http://sites.google.com/site/changmw
^ ^ May the Force and farces be with you!

___
Post Messages to: ProFox@leafe.com
Subscription Maintenance: http://mail.leafe.com/mailman/listinfo/profox
OT-free version of this list: http://mail.leafe.com/mailman/listinfo/profoxtech
Searchable Archive: http://leafe.com/archives/search/profox
This message: 
http://leafe.com/archives/byMID/profox/CAGv=mjaiel9_yt7yovganxkgzwv7rzz7vzqquhqqwwecfmx...@mail.gmail.com
** All postings, unless explicitly stated otherwise, are the opinions of the 
author, and do not constitute legal or medical advice. This statement is added 
to the messages for those lawyers who are too stupid to see the obvious.

Re: Speeding up a Powershell script

2016-10-20 Thread Man-wai Chang 
It's native query language is definitely not 100% basic ANSI SQL ...

On Wed, Oct 19, 2016 at 9:43 PM, Malcolm Greene  wrote:
> A great use case for getting your feet wet with Python.
>
> BTW: Powershell syntax wants me to gouge my eyes out. Anyone else feel
> the same way?

-- 
 .~. Might, Courage, Vision. SINCERITY!
/ v \ 64-bit Ubuntu 9.10 (Linux kernel 2.6.39.3)
/( _ )\ http://sites.google.com/site/changmw
^ ^ May the Force and farces be with you!

___
Post Messages to: ProFox@leafe.com
Subscription Maintenance: http://mail.leafe.com/mailman/listinfo/profox
OT-free version of this list: http://mail.leafe.com/mailman/listinfo/profoxtech
Searchable Archive: http://leafe.com/archives/search/profox
This message: 
http://leafe.com/archives/byMID/profox/CAGv=MJB5_3pVPT2T-FZdXTu-igbe4p=0wyby6zil9g9zmxw...@mail.gmail.com
** All postings, unless explicitly stated otherwise, are the opinions of the 
author, and do not constitute legal or medical advice. This statement is added 
to the messages for those lawyers who are too stupid to see the obvious.

Re: Speeding up a Powershell script

2016-10-19 Thread Ted Roche 
30 lines in VFP. As a bonus, you end up with a cursor of data, and an
on-topic thread!

CREATE CURSOR curFiles (filesPK int NOT NULL autoinc, extension c(12),
totalsize I)
INDEX on extension TAG extension
lnResult = recurse()
WAIT WINDOW NOWAIT "Completed counting " + TRANSFORM(lnResult) + "
directory entries"
BROWSE

FUNCTION Recurse (tcPath)
IF EMPTY(tcPath)
  tcPath = ".\"
ENDIF
LOCAL laDir[1], i, lnCount, lnResult
STORE 0 TO lnResult
lnCount=ADIR(laDir, tcPath+'*','D')
FOR i = 1 TO lnCount
  IF 'D' $ laDir[i,5]  && drill into subdirectories
IF  LEFT(laDir[i,1],1) #'.'
  lnResult = lnResult + Recurse(tcPath+ADDBS(laDir[i,1]))
ENDIF
LOOP
  ENDIF
  * WAIT WINDOW NOWAIT tcPath+laDir[i,1]
  * ? tcPath+laDir[i,1]
  AddToFile(JUSTEXT(laDir[i,1]), laDir[i,2])
NEXT
RETURN lnCount + lnResult

FUNCTION AddToFile(tcExtension, tiFileSize)
  LOCATE FOR extension=tcExtension
  IF FOUND()
replace totalsize WITH totalsize + tiFileSize NEXT 1 IN curFiles
  ELSE
INSERT INTO curfiles (extension, totalsize) VALUES (tcExtension, tiFileSize)
  ENDIF
RETURN

On Wed, Oct 19, 2016 at 10:31 AM, Peter Cushing
 wrote:
> On 19/10/2016 14:51, Dave Crozier wrote:
>>
>> Or:
>>
>> for i in $(find . -type f | perl -ne 'print $1 if m/\.([^.\/]+)$/' | sort
>> -u); do echo "$i"": ""$(du -hac **/*."$i" | tail -n1 | awk '{print $1;}')";
>> done | sort -h -k 2 -r
>>
>> Assuming you have extglob enabled:
>>shopt -s extglob
>>
> Feck me Dave, what was that you were saying about Mandarin/unintelligible
> ;-)
>
> Peter
>
>
> This communication is intended for the person or organisation to whom it is
> addressed. The contents are confidential and may be protected in law.
> Unauthorised use, copying or disclosure of any of it may be unlawful. If you
> have received this message in error, please notify us immediately by
> telephone or email.
> www.whisperingsmith.com
>
> Whispering Smith Ltd Head Office:61 Great Ducie Street, Manchester M3 1RR.
> Tel:0161 831 3700 Fax:0161 831 3715
> London Office:17-19 Foley Street, London W1W 6DW Tel:0207 299 7960
>
>
[excessive quoting removed by server]

___
Post Messages to: ProFox@leafe.com
Subscription Maintenance: http://mail.leafe.com/mailman/listinfo/profox
OT-free version of this list: http://mail.leafe.com/mailman/listinfo/profoxtech
Searchable Archive: http://leafe.com/archives/search/profox
This message: 
http://leafe.com/archives/byMID/profox/cacw6n4uwhqkrnzdqeenm0c5ta_auc-_phfpqiv1pg001ng-...@mail.gmail.com
** All postings, unless explicitly stated otherwise, are the opinions of the 
author, and do not constitute legal or medical advice. This statement is added 
to the messages for those lawyers who are too stupid to see the obvious.

Re: Speeding up a Powershell script

2016-10-19 Thread Peter Cushing 

On 19/10/2016 14:51, Dave Crozier wrote:

Or:

for i in $(find . -type f | perl -ne 'print $1 if m/\.([^.\/]+)$/' | sort -u); do echo "$i"": 
""$(du -hac **/*."$i" | tail -n1 | awk '{print $1;}')"; done | sort -h -k 2 -r

Assuming you have extglob enabled:
   shopt -s extglob

Feck me Dave, what was that you were saying about 
Mandarin/unintelligible ;-)


Peter


This communication is intended for the person or organisation to whom it is addressed. The contents are confidential and may be protected in law. Unauthorised use, copying or disclosure of any of it may be unlawful. If you have received this message in error, please notify us immediately by telephone or email. 


www.whisperingsmith.com

Whispering Smith Ltd Head Office:61 Great Ducie Street, Manchester M3 1RR. 
Tel:0161 831 3700 
Fax:0161 831 3715 


London Office:17-19 Foley Street, London W1W 6DW Tel:0207 299 7960


___
Post Messages to: ProFox@leafe.com
Subscription Maintenance: http://mail.leafe.com/mailman/listinfo/profox
OT-free version of this list: http://mail.leafe.com/mailman/listinfo/profoxtech
Searchable Archive: http://leafe.com/archives/search/profox
This message: 
http://leafe.com/archives/byMID/profox/0aa9a30b-36de-14bc-055c-98c2bd1ea...@whisperingsmith.com
** All postings, unless explicitly stated otherwise, are the opinions of the 
author, and do not constitute legal or medical advice. This statement is added 
to the messages for those lawyers who are too stupid to see the obvious.

RE: Speeding up a Powershell script

2016-10-19 Thread Dave Crozier 
Or:

for i in $(find . -type f | perl -ne 'print $1 if m/\.([^.\/]+)$/' | sort -u); 
do echo "$i"": ""$(du -hac **/*."$i" | tail -n1 | awk '{print $1;}')"; done | 
sort -h -k 2 -r

Assuming you have extglob enabled:
  shopt -s extglob

-Original Message-
From: ProFox [mailto:profox-boun...@leafe.com] On Behalf Of Dave Crozier
Sent: 19 October 2016 14:50
To: ProFox Email List <profox@leafe.com>
Subject: RE: Speeding up a Powershell script

Linux:

find . -type f -printf "%f %s\n" |
  awk '{
  PARTSCOUNT=split( $1, FILEPARTS, "." );
  EXTENSION=PARTSCOUNT == 1 ? "NULL" : FILEPARTS[PARTSCOUNT];
  FILETYPE_MAP[EXTENSION]+=$2
}
   END {
 for( FILETYPE in FILETYPE_MAP ) {
   print FILETYPE_MAP[FILETYPE], FILETYPE;
  }
   }' | sort -n

Dave

-Original Message-
From: ProFox [mailto:profox-boun...@leafe.com] On Behalf Of Man-wai Chang
Sent: 18 October 2016 06:45
To: ProFox Email List <profox@leafe.com>
Subject: Speeding up a Powershell script

The following Powershell script aims to count and calculate file sizes of each 
unique file extension in the current folder recursively.

How would you speed up this script for a folder with over 17 entries?

The problem is the following two statements being repeated for each unique file 
extension, causing a re-parse of $AllFiles which contains over 17 entries.

  $Files = $AllFiles | Where { $_.Extension -eq $Ext.Extension }
  $FilesSum = ($Files | Measure-Object Length -Sum).Sum

*** BEGIN ***
Write-Host "Reading directory ... $Path"
$AllFiles = Get-ChildItem $Path -Include * -Recurse -OutBuffer 2048| Where { 
$_.PSisContainer -eq $false } Write-Host "Number of Files = 
$(@($AllFiles).Count)"
$AllSum = ($AllFiles | Measure-Object Length -Sum).Sum If ($AllFiles.Length) {
Write-Host "Counting unique file extensions = " -NoNewLine
$Extensions = $AllFiles | Select Extension -Unique | Sort Extension
Write-Host ($Extensions).Count

foreach ($x in $Extensions){
Write-Host $x.Extension
}
exit
ForEach ($Ext in $Extensions)
{
Write-Host "Counting ... $Ext = " -NoNewline
$Files = $AllFiles | Where { $_.Extension -eq $Ext.Extension }
$FilesSum = ($Files | Measure-Object Length -Sum).Sum
Write-Host $FilesSum
$Percent = "{0:N0}" -f (($FilesSum / $AllSum) * 100)
$Body += "
$($Ext.Extension)$(@($Files).Count)$('{0:N2}MB' -f ($FilesSum / 
1mb))"
}
$HTML = $HeaderHTML + $Body + $FooterHTML
Write-Host "Writing file $OutputPath\FilesByExtension.html"
$HTML | Out-File $OutputPath\FilesByExtension.html
Write-Host "Done!"
}
Else
{
Write-Host "`nNo files found in $Path"
}
*** END ***

--
 .~. Might, Courage, Vision. SINCERITY!
/ v \ 64-bit Ubuntu 9.10 (Linux kernel 2.6.39.3) /( _ )\ 
http://sites.google.com/site/changmw
^ ^ May the Force and farces be with you!

[excessive quoting removed by server]

___
Post Messages to: ProFox@leafe.com
Subscription Maintenance: http://mail.leafe.com/mailman/listinfo/profox
OT-free version of this list: http://mail.leafe.com/mailman/listinfo/profoxtech
Searchable Archive: http://leafe.com/archives/search/profox
This message: 
http://leafe.com/archives/byMID/profox/18725b8cd2d5d247873a2baf401d4ab2a4349...@ex2010-a-fpl.fpl.LOCAL
** All postings, unless explicitly stated otherwise, are the opinions of the 
author, and do not constitute legal or medical advice. This statement is added 
to the messages for those lawyers who are too stupid to see the obvious.

RE: Speeding up a Powershell script

2016-10-19 Thread Dave Crozier 
Linux:

find . -type f -printf "%f %s\n" |
  awk '{
  PARTSCOUNT=split( $1, FILEPARTS, "." );
  EXTENSION=PARTSCOUNT == 1 ? "NULL" : FILEPARTS[PARTSCOUNT];
  FILETYPE_MAP[EXTENSION]+=$2
}
   END {
 for( FILETYPE in FILETYPE_MAP ) {
   print FILETYPE_MAP[FILETYPE], FILETYPE;
  }
   }' | sort -n

Dave

-Original Message-
From: ProFox [mailto:profox-boun...@leafe.com] On Behalf Of Man-wai Chang
Sent: 18 October 2016 06:45
To: ProFox Email List 
Subject: Speeding up a Powershell script

The following Powershell script aims to count and calculate file sizes of each 
unique file extension in the current folder recursively.

How would you speed up this script for a folder with over 17 entries?

The problem is the following two statements being repeated for each unique file 
extension, causing a re-parse of $AllFiles which contains over 17 entries.

  $Files = $AllFiles | Where { $_.Extension -eq $Ext.Extension }
  $FilesSum = ($Files | Measure-Object Length -Sum).Sum

*** BEGIN ***
Write-Host "Reading directory ... $Path"
$AllFiles = Get-ChildItem $Path -Include * -Recurse -OutBuffer 2048| Where { 
$_.PSisContainer -eq $false } Write-Host "Number of Files = 
$(@($AllFiles).Count)"
$AllSum = ($AllFiles | Measure-Object Length -Sum).Sum If ($AllFiles.Length) {
Write-Host "Counting unique file extensions = " -NoNewLine
$Extensions = $AllFiles | Select Extension -Unique | Sort Extension
Write-Host ($Extensions).Count

foreach ($x in $Extensions){
Write-Host $x.Extension
}
exit
ForEach ($Ext in $Extensions)
{
Write-Host "Counting ... $Ext = " -NoNewline
$Files = $AllFiles | Where { $_.Extension -eq $Ext.Extension }
$FilesSum = ($Files | Measure-Object Length -Sum).Sum
Write-Host $FilesSum
$Percent = "{0:N0}" -f (($FilesSum / $AllSum) * 100)
$Body += "
$($Ext.Extension)$(@($Files).Count)$('{0:N2}MB' -f ($FilesSum / 
1mb))"
}
$HTML = $HeaderHTML + $Body + $FooterHTML
Write-Host "Writing file $OutputPath\FilesByExtension.html"
$HTML | Out-File $OutputPath\FilesByExtension.html
Write-Host "Done!"
}
Else
{
Write-Host "`nNo files found in $Path"
}
*** END ***

--
 .~. Might, Courage, Vision. SINCERITY!
/ v \ 64-bit Ubuntu 9.10 (Linux kernel 2.6.39.3) /( _ )\ 
http://sites.google.com/site/changmw
^ ^ May the Force and farces be with you!

[excessive quoting removed by server]

___
Post Messages to: ProFox@leafe.com
Subscription Maintenance: http://mail.leafe.com/mailman/listinfo/profox
OT-free version of this list: http://mail.leafe.com/mailman/listinfo/profoxtech
Searchable Archive: http://leafe.com/archives/search/profox
This message: 
http://leafe.com/archives/byMID/profox/18725b8cd2d5d247873a2baf401d4ab2a4349...@ex2010-a-fpl.fpl.LOCAL
** All postings, unless explicitly stated otherwise, are the opinions of the 
author, and do not constitute legal or medical advice. This statement is added 
to the messages for those lawyers who are too stupid to see the obvious.

RE: Speeding up a Powershell script

2016-10-19 Thread Dave Crozier 
+1...
For a moment I thought the script was written in Mandarin!

Totally unintelligible unless you deal with it all day long.

+1 for Python ... 15 lines max I reckon (I am only a beginner) and 40 Lines in 
VFP

Dave

-Original Message-
From: ProFox [mailto:profox-boun...@leafe.com] On Behalf Of Malcolm Greene
Sent: 19 October 2016 14:43
To: profox@leafe.com
Subject: Re: Speeding up a Powershell script

A great use case for getting your feet wet with Python.

BTW: Powershell syntax wants me to gouge my eyes out. Anyone else feel the same 
way?

Malcolm

[excessive quoting removed by server]

___
Post Messages to: ProFox@leafe.com
Subscription Maintenance: http://mail.leafe.com/mailman/listinfo/profox
OT-free version of this list: http://mail.leafe.com/mailman/listinfo/profoxtech
Searchable Archive: http://leafe.com/archives/search/profox
This message: 
http://leafe.com/archives/byMID/profox/18725b8cd2d5d247873a2baf401d4ab2a4349...@ex2010-a-fpl.fpl.LOCAL
** All postings, unless explicitly stated otherwise, are the opinions of the 
author, and do not constitute legal or medical advice. This statement is added 
to the messages for those lawyers who are too stupid to see the obvious.

Re: Speeding up a Powershell script

2016-10-19 Thread Alan Bourke 
> BTW: Powershell syntax wants me to gouge my eyes out. Anyone else feel
> the same way?

Yeah, I've never liked it. Super powerful but far too wordy. 

-- 
  Alan Bourke
  alanpbourke (at) fastmail (dot) fm

___
Post Messages to: ProFox@leafe.com
Subscription Maintenance: http://mail.leafe.com/mailman/listinfo/profox
OT-free version of this list: http://mail.leafe.com/mailman/listinfo/profoxtech
Searchable Archive: http://leafe.com/archives/search/profox
This message: 
http://leafe.com/archives/byMID/profox/1476884750.4120131.760853305.01d86...@webmail.messagingengine.com
** All postings, unless explicitly stated otherwise, are the opinions of the 
author, and do not constitute legal or medical advice. This statement is added 
to the messages for those lawyers who are too stupid to see the obvious.

Re: Speeding up a Powershell script

2016-10-19 Thread Malcolm Greene 
A great use case for getting your feet wet with Python.

BTW: Powershell syntax wants me to gouge my eyes out. Anyone else feel
the same way?

Malcolm

___
Post Messages to: ProFox@leafe.com
Subscription Maintenance: http://mail.leafe.com/mailman/listinfo/profox
OT-free version of this list: http://mail.leafe.com/mailman/listinfo/profoxtech
Searchable Archive: http://leafe.com/archives/search/profox
This message: 
http://leafe.com/archives/byMID/profox/1476884601.713475.760846129.02497...@webmail.messagingengine.com
** All postings, unless explicitly stated otherwise, are the opinions of the 
author, and do not constitute legal or medical advice. This statement is added 
to the messages for those lawyers who are too stupid to see the obvious.

Re: Speeding up a Powershell script

2016-10-19 Thread Man-wai Chang 
Last resort! :)

On Tue, Oct 18, 2016 at 6:28 PM, Dave Crozier  wrote:
> Do it in native VFP ...

-- 
 .~. Might, Courage, Vision. SINCERITY!
/ v \ 64-bit Ubuntu 9.10 (Linux kernel 2.6.39.3)
/( _ )\ http://sites.google.com/site/changmw
^ ^ May the Force and farces be with you!

___
Post Messages to: ProFox@leafe.com
Subscription Maintenance: http://mail.leafe.com/mailman/listinfo/profox
OT-free version of this list: http://mail.leafe.com/mailman/listinfo/profoxtech
Searchable Archive: http://leafe.com/archives/search/profox
This message: 
http://leafe.com/archives/byMID/profox/CAGv=mjdby1qgvkwuo0idxc_xmg4yaeqti2copkbqrsdhrjl...@mail.gmail.com
** All postings, unless explicitly stated otherwise, are the opinions of the 
author, and do not constitute legal or medical advice. This statement is added 
to the messages for those lawyers who are too stupid to see the obvious.

Re: Speeding up a Powershell script

2016-10-18 Thread Ted Roche 
On Tue, Oct 18, 2016 at 6:28 AM, Dave Crozier  wrote:
> Do it in native VFP ...
>
> Dave
>

+1!

___
Post Messages to: ProFox@leafe.com
Subscription Maintenance: http://mail.leafe.com/mailman/listinfo/profox
OT-free version of this list: http://mail.leafe.com/mailman/listinfo/profoxtech
Searchable Archive: http://leafe.com/archives/search/profox
This message: 
http://leafe.com/archives/byMID/profox/cacw6n4tdem_qtz7nbiuj5gyxq5kfjb1vtpnkb-y5mgcw2bp...@mail.gmail.com
** All postings, unless explicitly stated otherwise, are the opinions of the 
author, and do not constitute legal or medical advice. This statement is added 
to the messages for those lawyers who are too stupid to see the obvious.

RE: Speeding up a Powershell script

2016-10-18 Thread Dave Crozier 
Do it in native VFP ...

Dave

-Original Message-
From: ProFox [mailto:profox-boun...@leafe.com] On Behalf Of Man-wai Chang
Sent: 18 October 2016 06:45
To: ProFox Email List 
Subject: Speeding up a Powershell script

The following Powershell script aims to count and calculate file sizes of each 
unique file extension in the current folder recursively.

How would you speed up this script for a folder with over 17 entries?

The problem is the following two statements being repeated for each unique file 
extension, causing a re-parse of $AllFiles which contains over 17 entries.

  $Files = $AllFiles | Where { $_.Extension -eq $Ext.Extension }
  $FilesSum = ($Files | Measure-Object Length -Sum).Sum

*** BEGIN ***
Write-Host "Reading directory ... $Path"
$AllFiles = Get-ChildItem $Path -Include * -Recurse -OutBuffer 2048| Where { 
$_.PSisContainer -eq $false } Write-Host "Number of Files = 
$(@($AllFiles).Count)"
$AllSum = ($AllFiles | Measure-Object Length -Sum).Sum If ($AllFiles.Length) {
Write-Host "Counting unique file extensions = " -NoNewLine
$Extensions = $AllFiles | Select Extension -Unique | Sort Extension
Write-Host ($Extensions).Count

foreach ($x in $Extensions){
Write-Host $x.Extension
}
exit
ForEach ($Ext in $Extensions)
{
Write-Host "Counting ... $Ext = " -NoNewline
$Files = $AllFiles | Where { $_.Extension -eq $Ext.Extension }
$FilesSum = ($Files | Measure-Object Length -Sum).Sum
Write-Host $FilesSum
$Percent = "{0:N0}" -f (($FilesSum / $AllSum) * 100)
$Body += "
$($Ext.Extension)$(@($Files).Count)$('{0:N2}MB' -f ($FilesSum / 
1mb))"
}
$HTML = $HeaderHTML + $Body + $FooterHTML
Write-Host "Writing file $OutputPath\FilesByExtension.html"
$HTML | Out-File $OutputPath\FilesByExtension.html
Write-Host "Done!"
}
Else
{
Write-Host "`nNo files found in $Path"
}
*** END ***

--
 .~. Might, Courage, Vision. SINCERITY!
/ v \ 64-bit Ubuntu 9.10 (Linux kernel 2.6.39.3) /( _ )\ 
http://sites.google.com/site/changmw
^ ^ May the Force and farces be with you!

[excessive quoting removed by server]

___
Post Messages to: ProFox@leafe.com
Subscription Maintenance: http://mail.leafe.com/mailman/listinfo/profox
OT-free version of this list: http://mail.leafe.com/mailman/listinfo/profoxtech
Searchable Archive: http://leafe.com/archives/search/profox
This message: 
http://leafe.com/archives/byMID/profox/18725b8cd2d5d247873a2baf401d4ab2a4346...@ex2010-a-fpl.fpl.LOCAL
** All postings, unless explicitly stated otherwise, are the opinions of the 
author, and do not constitute legal or medical advice. This statement is added 
to the messages for those lawyers who are too stupid to see the obvious.