Re: [smartos-discuss] Re: build failure related to python version

[Youzhong Yang]

Now it works. Thanks!

On Fri, Sep 30, 2016 at 4:39 PM, Robert Mustacchi  wrote:

> On 9/30/16 13:05 , Youzhong Yang wrote:
> > Sorry, the 'head' output is after I manually modified hdrchk script. Its
> > first line was referring to /usr/bin/python2.6.
>
> There were various bugs and issues with the merge from upstream,
> including some breakage there. These should all be fixed in the commit
> that was just pushed.
>
> There will be future updates now that this has landed to get build zones
> and python updated, but those haven't come yet.
>
> Robert
>
> > On Fri, Sep 30, 2016 at 4:01 PM, Youzhong Yang 
> wrote:
> >
> >> I am trying to build SmartOS today, pulling illumos-joyent from
> github.com,
> >> here is what I encountered:
> >>
> >> nightly.log:
> >> sh: line 1: /root/smartos-live/projects/illumos/usr/src/tools/proto/
> >> root_i386-nd/opt/onbld/bin/hdrchk: not found
> >> *** Error code 127
> >>
> >> # head -1 /root/smartos-live/projects/illumos/usr/src/tools/proto/
> >> root_i386-nd/opt/onbld/bin/hdrchk
> >> #!/opt/local/bin/python2.6
> >>
> >> It seems the two OS-5688 commits didn't fix the issue.
> >>
> >> Thanks,
> >>
> >> --Youzhong
> >>
> >>
> >
> >
> 
> 



---
smartos-discuss
Archives: https://www.listbox.com/member/archive/184463/=now
RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00
Modify Your Subscription: 
https://www.listbox.com/member/?member_id=25769125_secret=25769125-7688e9fb
Powered by Listbox: http://www.listbox.com

Re: [smartos-discuss] Standardized Benchmarks and various overheads.

[Ian Collins]

On 10/ 1/16 12:43 PM, Matthew Parsons wrote:

(Sorry for the delay in replying.)

Please note I didn't ask "what matches my workload" or "please 
architect my setup for me" :P Mainly I just wanted something for a 
couple basic sanity checks that hardware is performing in the general 
ballpark of what it should, that there weren't any pathological issues 
w/ the drivers under SmartOS. Secondarily would be something that can 
run under native, LX, and KVM to compare relative overheads, and to 
compare against the same hardware running, say Ubuntu Server or 
CentOS. If it were something that there was a public database to 
compare against, that would be a bonus.


I stand by my initial reply :)

There really are too many variables to offer a generic solution. One 
obvious example is comparing lx-brand zone with KVM on a pool without 
decent log devices.  Disk benchmarks will be shite in the KVM, but if 
the same setup had a log, things would be much closer (zones would still 
win!).


If I want a quick and dirty comparison, I use bonnie++ (or CrystalMark 
on a Windows KVM) and building gcc.  The latter is a surprisingly good 
test; it will stress various aspects of your machine and has shown up 
numerous performance issues over the years.  The single character write 
numbers from bonnie++ are pretty meaningless on ZFS.


FWIW, the main production workload that I will care about is a 
not-well threaded java server app, so single-threaded performance, 
coupled with a large-ish MySQL DB with frequent, random I/O both read 
and write.


bonnie++ and building gcc (both can be single or multi-threaded) should 
give you some decent comparisons.


--
Ian.



---
smartos-discuss
Archives: https://www.listbox.com/member/archive/184463/=now
RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00
Modify Your Subscription: 
https://www.listbox.com/member/?member_id=25769125_secret=25769125-7688e9fb
Powered by Listbox: http://www.listbox.com

Re: [smartos-discuss] Standardized Benchmarks and various overheads.

[Matthew Parsons]

(Sorry for the delay in replying.)

Please note I didn't ask "what matches my workload" or "please architect my
setup for me" :P Mainly I just wanted something for a couple basic sanity
checks that hardware is performing in the general ballpark of what it
should, that there weren't any pathological issues w/ the drivers under
SmartOS. Secondarily would be something that can run under native, LX, and
KVM to compare relative overheads, and to compare against the same hardware
running, say Ubuntu Server or CentOS. If it were something that there was a
public database to compare against, that would be a bonus.

FWIW, the main production workload that I will care about is a not-well
threaded java server app, so single-threaded performance, coupled with a
large-ish MySQL DB with frequent, random I/O both read and write.

I went down the rabbit-hole of attempting to to use the Phoronix Test Suite
since it "supports" Solaris and BSD, has some pre-defined Java and Database
test setups, and can compare to publicly recorded reports. However chasing
down the dependencies and chasing down the various "this test failed"
errors was taking up too much time. Looks like I'll stick w/ Bonnie++ and
IOZone via PkgSrc.  (Which means I'll have to start over w/ CentOS)

On Mon, Sep 26, 2016 at 5:45 PM, Ian Collins  wrote:

> On 27/09/16 12:57 pm, Matthew Parsons wrote:
>
>> Is there a suite/script/configs for benchmarks that have emerged as
>> standardized in the smartos community? I'm most interested in disk I/O, and
>> would like to compare native linux hardware RAID vs MD RAID, and Native
>> zone hardware RAID vs. ZFS (without and with SLOG).
>>
>> This is a classic "it depends" question.  The only reliable benchmark is
> one close to your actual workload.  You should be building your ZFS pool to
> match.
>
> In my case, my of my systems are in build farms, so I use database
> benchmarks along with building a representative project (or gcc).
>
> Ideally (time permitting) would want to test comparing native, LX zone,
>> and KVM. Anyone have ballpark figures of the performance overhead those
>> respective types, ideally of the various subsystems? (Disk, CPU, network,
>> memory)
>>
>> Again, it depends what you are doing.  LX is much kinder on the hardware
> and will have better I/O, but there are corners where KVM will still be
> faster.
> 
> Ian.
> 



---
smartos-discuss
Archives: https://www.listbox.com/member/archive/184463/=now
RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00
Modify Your Subscription: 
https://www.listbox.com/member/?member_id=25769125_secret=25769125-7688e9fb
Powered by Listbox: http://www.listbox.com

Re: [smartos-discuss] Re: build failure related to python version

[Robert Mustacchi]

On 9/30/16 13:05 , Youzhong Yang wrote:
> Sorry, the 'head' output is after I manually modified hdrchk script. Its
> first line was referring to /usr/bin/python2.6.

There were various bugs and issues with the merge from upstream,
including some breakage there. These should all be fixed in the commit
that was just pushed.

There will be future updates now that this has landed to get build zones
and python updated, but those haven't come yet.

Robert

> On Fri, Sep 30, 2016 at 4:01 PM, Youzhong Yang  wrote:
> 
>> I am trying to build SmartOS today, pulling illumos-joyent from github.com,
>> here is what I encountered:
>>
>> nightly.log:
>> sh: line 1: /root/smartos-live/projects/illumos/usr/src/tools/proto/
>> root_i386-nd/opt/onbld/bin/hdrchk: not found
>> *** Error code 127
>>
>> # head -1 /root/smartos-live/projects/illumos/usr/src/tools/proto/
>> root_i386-nd/opt/onbld/bin/hdrchk
>> #!/opt/local/bin/python2.6
>>
>> It seems the two OS-5688 commits didn't fix the issue.
>>
>> Thanks,
>>
>> --Youzhong
>>
>>
> 
> 


---
smartos-discuss
Archives: https://www.listbox.com/member/archive/184463/=now
RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00
Modify Your Subscription: 
https://www.listbox.com/member/?member_id=25769125_secret=25769125-7688e9fb
Powered by Listbox: http://www.listbox.com

[smartos-discuss] Re: build failure related to python version

[Youzhong Yang]

Sorry, the 'head' output is after I manually modified hdrchk script. Its
first line was referring to /usr/bin/python2.6.

And here is the list of files still referring to /usr/bin/python2.6:

# grep '#!/usr/bin/python2.6'
/root/smartos-live/projects/illumos/usr/src/tools/scripts/*
/root/smartos-live/projects/illumos/usr/src/tools/scripts/cddlchk:#!/usr/bin/python2.6
/root/smartos-live/projects/illumos/usr/src/tools/scripts/copyrightchk:#!/usr/bin/python2.6
/root/smartos-live/projects/illumos/usr/src/tools/scripts/git-pbchk:#!/usr/bin/python2.6
/root/smartos-live/projects/illumos/usr/src/tools/scripts/hg-active:#!/usr/bin/python2.6
/root/smartos-live/projects/illumos/usr/src/tools/scripts/mapfilechk:#!/usr/bin/python2.6
/root/smartos-live/projects/illumos/usr/src/tools/scripts/validate_pkg:#!/usr/bin/python2.6
/root/smartos-live/projects/illumos/usr/src/tools/scripts/wsdiff:#!/usr/bin/python2.6


On Fri, Sep 30, 2016 at 4:01 PM, Youzhong Yang  wrote:

> I am trying to build SmartOS today, pulling illumos-joyent from github.com,
> here is what I encountered:
>
> nightly.log:
> sh: line 1: /root/smartos-live/projects/illumos/usr/src/tools/proto/
> root_i386-nd/opt/onbld/bin/hdrchk: not found
> *** Error code 127
>
> # head -1 /root/smartos-live/projects/illumos/usr/src/tools/proto/
> root_i386-nd/opt/onbld/bin/hdrchk
> #!/opt/local/bin/python2.6
>
> It seems the two OS-5688 commits didn't fix the issue.
>
> Thanks,
>
> --Youzhong
>
>



---
smartos-discuss
Archives: https://www.listbox.com/member/archive/184463/=now
RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00
Modify Your Subscription: 
https://www.listbox.com/member/?member_id=25769125_secret=25769125-7688e9fb
Powered by Listbox: http://www.listbox.com

Re: [smartos-discuss] build failure related to python version

[Patrick Mooney]

Additional fixes are inbound, pending testing and review.  I would expect
them to land within a few hours.

On 30 September 2016 at 15:01, Youzhong Yang  wrote:

> I am trying to build SmartOS today, pulling illumos-joyent from github.com,
> here is what I encountered:
>
> nightly.log:
> sh: line 1: /root/smartos-live/projects/illumos/usr/src/tools/proto/
> root_i386-nd/opt/onbld/bin/hdrchk: not found
> *** Error code 127
>
> # head -1 /root/smartos-live/projects/illumos/usr/src/tools/proto/
> root_i386-nd/opt/onbld/bin/hdrchk
> #!/opt/local/bin/python2.6
>
> It seems the two OS-5688 commits didn't fix the issue.
>
> Thanks,
>
> --Youzhong
>
> *smartos-discuss* | Archives
> 
>  |
> Modify
> 
> Your Subscription 
>



---
smartos-discuss
Archives: https://www.listbox.com/member/archive/184463/=now
RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00
Modify Your Subscription: 
https://www.listbox.com/member/?member_id=25769125_secret=25769125-7688e9fb
Powered by Listbox: http://www.listbox.com

[smartos-discuss] build failure related to python version

[Youzhong Yang]

I am trying to build SmartOS today, pulling illumos-joyent from github.com,
here is what I encountered:

nightly.log:
sh: line 1:
/root/smartos-live/projects/illumos/usr/src/tools/proto/root_i386-nd/opt/onbld/bin/hdrchk:
not found
*** Error code 127

# head -1
/root/smartos-live/projects/illumos/usr/src/tools/proto/root_i386-nd/opt/onbld/bin/hdrchk
#!/opt/local/bin/python2.6

It seems the two OS-5688 commits didn't fix the issue.

Thanks,

--Youzhong



---
smartos-discuss
Archives: https://www.listbox.com/member/archive/184463/=now
RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00
Modify Your Subscription: 
https://www.listbox.com/member/?member_id=25769125_secret=25769125-7688e9fb
Powered by Listbox: http://www.listbox.com