Re: [CentOS-es] asunto con DRBD

2017-12-01 Thread Ricky Gutierrez 
El día 21 de noviembre de 2017, 11:31, Erick Ocrospoma
 escribió:
> Muestranos tu config
>

Hola , disculpa hasta hoy veo tu mensaje , estoy usando las versiones
que estan en elrepo.org :

kmod-drbd90-9.0.9-1.el7_4.elrepo.x86_64
drbd90-utils-9.1.0-1.el7.elrepo.x86_64

cat /etc/drbd.d/mail-01.res
resource mail-01 {
on mail-01.domainmi.com {
device /dev/drbd0;
disk /dev/sdb1;
address 172.16.249.168:7789;
meta-disk internal;
}

on mail-02.domainmi.com {
device /dev/drbd0;
disk /dev/sdb1;
address 172.16.249.169:7789;
meta-disk internal;
}
}

algo curioso es que cuando cree el meta data no veía que sincronizaba
, te muestro la salida de cat /proc/drbd :
version: 9.0.9-1 (api:2/proto:86-112)
GIT-hash: f7b979e7af01813e031aac579140237640c94569 build by
mockbuild@, 2017-09-14 17:45:45
Transports (api:16):

y ya había definido el primary server , ahora cuando quiero darle
formato a drbd en diferentes sistemas de archivo me muestra esto:

mkfs.xfs /dev/drbd0
mkfs.xfs: cannot open /dev/drbd0: Read-only file system

gracias por todo aporte.

-- 
rickygm

http://gnuforever.homelinux.com
___
CentOS-es mailing list
CentOS-es@centos.org
https://lists.centos.org/mailman/listinfo/centos-es

Re: [CentOS] time foo

2017-12-01 Thread John R Pierce 

On 12/1/2017 11:32 AM, hw wrote:
So this would mean that the database (running on a different server) 
takes
almost two times as much as foo --- which I would consider kinda 
excruciatingly
long because it´s merely inserting rows into two different tables 
after they were

prepared by foo and then processes some queries to convert the data.

The queries after importing may take like 3 or 5 minutes.  About 4.5 
million rows
are being imported. 


so you're missing about 25 minutes, and maybe 5 minutes is spent post 
processing, so thats 20 minutes spent in the data insertion?


inserting one row at a time?  or in batches?    remeber a database 
server is going to do commits after each transaction, which forces the 
data to be flushed to disk.   4.5 million seperate row transactions, 
yeah, I could see that taking some time, plus add that many network 
round trips, etcetc.   if the db server just has a single SATA disk, 
you're doing 9 million committed writes combined to the two tables?    
20 minutes for 9 million inserts, thats 7500 per second.



--
john r pierce, recycling bits in santa cruz

___
CentOS mailing list
CentOS@centos.org
https://lists.centos.org/mailman/listinfo/centos

Re: [CentOS] C7 and docker storage

2017-12-01 Thread Andrew Holway 
I believe use of any kind of storage in conjunction with docker is
generally discouraged. Docker is a quite neat way of packaging up apps and
deploying them but if you care about your data I would store it somewhere
independent of docker.

Ta,

Andrew

On 29 November 2017 at 22:23,  wrote:

> Was working on docker on a server, and on startup, I see
> Nov 29 10:58:27  dockerd-current:
> time="2017-11-29T10:58:27.612849959-05:00" level=warning msg="devmapper:
> Usage of loopback devices is strongly discouraged for production use.
> Please use `--storage-opt dm.thinpooldev` or use `man docker` to refer to
> dm.thinpooldev section."
> Nov 29 10:58:27  dockerd-current:
> time="2017-11-29T10:58:27.655600686-05:00" level=warning msg="devmapper:
> Base device already exists and has filesystem xfs on it. User specified
> filesystem  will be ignored."
>
> The latter would explain the message my user's job gave him when it tried
> to umount /
>
> A bit of googling, and I see something called overlayFS can be used... but
> I know nothing about that, or how dangerous it is.  Anyone got a pointed
> to something more than the minimal how to configure docker to use it?
>
> mark
>
> ___
> CentOS mailing list
> CentOS@centos.org
> https://lists.centos.org/mailman/listinfo/centos
>
___
CentOS mailing list
CentOS@centos.org
https://lists.centos.org/mailman/listinfo/centos

Re: [CentOS] time foo

2017-12-01 Thread Mark Haney 

On 12/01/2017 02:32 PM, hw wrote:



Hm.  Foo is a program that imports data into a database from two CVS files,
using a connection for each file and forking to import both files at once.

So this would mean that the database (running on a different server) takes
almost two times as much as foo --- which I would consider kinda 
excruciatingly
long because it´s merely inserting rows into two different tables after 
they were

prepared by foo and then processes some queries to convert the data.

The queries after importing may take like 3 or 5 minutes.  About 4.5 
million rows

are being imported.

Would you consider about 20 minutes for importing as long?


There are far too many variables you've not mentioned to determine if 
that's good or bad (or very bad).  Is the connection a local connection 
(ie the import is done on the DB server) or a network connection?


What size are the CSV (CVS is a typo, correct?) files?  4.5M rows tells 
us nothing about how much data each row has.  It could be 4.5M rows of 
one INT field or 4.5M rows of a hundred fields.


I'm a bit confused by the last two sentences.  Based on how I read this:

1. Foo is prepping (creating?) the tables
2. Processes queries to convert the data (to CSV?)
3. Runs more queries on those tables.

Or it could be:

1. Foo preps the tables
2. Foo imports the CSV files
3. Foo does post-processing of the tables.

It's not really clear the actual process, but I'll go on the assumption 
that Foo is creating the tables with the correct fields, data types, 
keys and hopefully indices. Then dumps the CSV files into the tables. 
Then does post-processing.  (I've written similar scripts, so this is 
the most logical process to me.)


If we assume network bandwidth is fine, that still leaves far too many 
server variables to know if 20m is about right or not.  Amount of data 
to import, TYPE of data, database AND server configuration, CPU, RAM, 
etc and DB config for tunable paramters like buffer pool, read/write I/O 
threads, etc.


IIRC, you posted some questions about tuning a DB server a while back, 
would this be data going into that server, perhaps?


I'd like to offer a helpful suggestion when asking for list help.  It's 
better to provide TOO MUCH information, than too little.  There's a big 
difference between 'my printer won't print' and 'my printer won't print 
because it's not feeding paper properly'.



--
Mark Haney
Network Engineer at NeoNova
919-460-3330 option 1
mark.ha...@neonova.net
www.neonova.net
___
CentOS mailing list
CentOS@centos.org
https://lists.centos.org/mailman/listinfo/centos

Re: [CentOS] time foo

2017-12-01 Thread Stephen John Smoogen 
On 1 December 2017 at 14:32, hw  wrote:
> Gordon Messmer wrote:
>>
>> On 12/01/2017 08:49 AM, hw wrote:
>>>
>>> # time foo
>>> real43m39.841s
>>> user15m31.109s
>>> sys 0m44.136s
>>>
>>>
>>> Almost 30 minutes have disappeared, but it actually took about that long,
>>> so what happened?
>>
>>
>>
>> I may misunderstand your question, but
>>
>> "time" is provided by the bash shell.  It may be provided by a command if
>> you are using a different shell.  When the command following the "time"
>> keyword completes, bash will print the amount of elapsed time (the amount of
>> time that passed between the command's start and its exit), the amount of
>> time the command was using the CPU and not in a sleep state, and the amount
>> of time the kernel was using the CPU to service requests from the command.
>>
>> So your "foo" application was in a sleep state for around 30 minutes of
>> the 44 minutes that passed between when you started it and when it finished.
>
>
> Hm.  Foo is a program that imports data into a database from two CVS files,
> using a connection for each file and forking to import both files at once.
>
> So this would mean that the database (running on a different server) takes
> almost two times as much as foo --- which I would consider kinda
> excruciatingly
> long because it´s merely inserting rows into two different tables after they
> were
> prepared by foo and then processes some queries to convert the data.
>
> The queries after importing may take like 3 or 5 minutes.  About 4.5 million
> rows
> are being imported.
>
> Would you consider about 20 minutes for importing as long?

That depends on a lot of things.. from drive speed to drive layout to
database to network congestion to... without that information the
question is not answerable.


>
> ___
> CentOS mailing list
> CentOS@centos.org
> https://lists.centos.org/mailman/listinfo/centos



-- 
Stephen J Smoogen.
___
CentOS mailing list
CentOS@centos.org
https://lists.centos.org/mailman/listinfo/centos

Re: [CentOS] time foo

2017-12-01 Thread hw 

Gordon Messmer wrote:

On 12/01/2017 08:49 AM, hw wrote:

# time foo
real43m39.841s
user15m31.109s
sys 0m44.136s


Almost 30 minutes have disappeared, but it actually took about that long,
so what happened?



I may misunderstand your question, but

"time" is provided by the bash shell.  It may be provided by a command if you are using a 
different shell.  When the command following the "time" keyword completes, bash will 
print the amount of elapsed time (the amount of time that passed between the command's start and 
its exit), the amount of time the command was using the CPU and not in a sleep state, and the 
amount of time the kernel was using the CPU to service requests from the command.

So your "foo" application was in a sleep state for around 30 minutes of the 44 
minutes that passed between when you started it and when it finished.


Hm.  Foo is a program that imports data into a database from two CVS files,
using a connection for each file and forking to import both files at once.

So this would mean that the database (running on a different server) takes
almost two times as much as foo --- which I would consider kinda excruciatingly
long because it´s merely inserting rows into two different tables after they 
were
prepared by foo and then processes some queries to convert the data.

The queries after importing may take like 3 or 5 minutes.  About 4.5 million 
rows
are being imported.

Would you consider about 20 minutes for importing as long?

___
CentOS mailing list
CentOS@centos.org
https://lists.centos.org/mailman/listinfo/centos

Re: [CentOS] time foo

2017-12-01 Thread Gordon Messmer 

On 12/01/2017 08:49 AM, hw wrote:

# time foo
real    43m39.841s
user    15m31.109s
sys 0m44.136s


Almost 30 minutes have disappeared, but it actually took about that long,
so what happened? 



I may misunderstand your question, but

"time" is provided by the bash shell.  It may be provided by a command 
if you are using a different shell.  When the command following the 
"time" keyword completes, bash will print the amount of elapsed time 
(the amount of time that passed between the command's start and its 
exit), the amount of time the command was using the CPU and not in a 
sleep state, and the amount of time the kernel was using the CPU to 
service requests from the command.


So your "foo" application was in a sleep state for around 30 minutes of 
the 44 minutes that passed between when you started it and when it finished.


___
CentOS mailing list
CentOS@centos.org
https://lists.centos.org/mailman/listinfo/centos

Re: [CentOS] time foo

2017-12-01 Thread Stephen John Smoogen 
On 1 December 2017 at 11:49, hw  wrote:
>
> Hi,
>
> isn´t this weird:
>
>
> # time foo
> real43m39.841s
> user15m31.109s
> sys 0m44.136s
>

This is counting the CPU time that a process used. If something is not
in 'CPU' but waiting on input etc it might not get counted in user or
sys. There is also the fact that the builtin bash time command you
used calculates things differently from the /usr/bin/time command.

From the /usr/bin/time man page
Note: some shells (e.g., bash(1)) have a  built-in  time  command  that
   provides less functionality than the command described here.  To access
   the real command, you may need to specify its pathname (something  like
   /usr/bin/time).

From the bash man page
   When the shell is in posix mode, time may be followed by a newline.  In
   this case, the shell displays the total user and system  time  consumed
   by  the shell and its children.  The TIMEFORMAT variable may be used to
   specify the format of the time information.

The built in time is actually meant to be used with measuring pipeline
information but can be used by itself


>
> Almost 30 minutes have disappeared, but it actually took about that long,
> so what happened?
> ___
> CentOS mailing list
> CentOS@centos.org
> https://lists.centos.org/mailman/listinfo/centos



-- 
Stephen J Smoogen.
___
CentOS mailing list
CentOS@centos.org
https://lists.centos.org/mailman/listinfo/centos

[CentOS] time foo

2017-12-01 Thread hw 


Hi,

isn´t this weird:


# time foo
real43m39.841s
user15m31.109s
sys 0m44.136s


Almost 30 minutes have disappeared, but it actually took about that long,
so what happened?
___
CentOS mailing list
CentOS@centos.org
https://lists.centos.org/mailman/listinfo/centos

Re: [CentOS] Good linux software RAID primer advise

2017-12-01 Thread Miguel Medalha 
>> Could someone recommend good Linux software RAID primer. It would >> be good 
>> if it has good coverage of monitoring and dealing with failures.

https://raid.wiki.kernel.org/index.php/Linux_Raid
___
CentOS mailing list
CentOS@centos.org
https://lists.centos.org/mailman/listinfo/centos

Re: [CentOS] C7 and docker storage (folllowing myself up)

2017-12-01 Thread m . roth 
m.r...@5-cent.us wrote:
> Gianluca Cecchi  wrote:
>> Date: Thu, 30 Nov 2017 09:55:58 +0100
>> On Wed, Nov 29, 2017 at 10:23 PM,  wrote:
>>
>>> The latter would explain the message my user's job gave him when it
>>> tried to umount /
>>>
>>> A bit of googling, and I see something called overlayFS can be used...
>>> but I know nothing about that, or how dangerous it is.  Anyone got a
>>> pointed to something more than the minimal how to configure docker
>>> to use it?
>>>
>> You could follow CentOS Atomic SIG
>> https://wiki.centos.org/SpecialInterestGroup/Atomic
>> http://www.projectatomic.io/download/
>>
>> and/or read here and adapt in case for your storage needs:
>> http://www.projectatomic.io/docs/docker-storage-recommendation/
>>
>> See also here for overlayfs addiction in CentOS Atomic Host in September
>> this year
>> https://seven.centos.org/2017/09/new-centos-atomic-host-with-overlayfs-storage/
>>
> Interesting, but it doesn't help me: I can't rebuild the server, it's in
> use, and I yum installed docker from the std. repos. What I see from the
> links tells me how to switch storage, not how to manually configure
> overlay2 storage, and whether I can do as I said, and point it to an
> NFS-mounted location.
>
I just found some RH documentation for C 7 on overlayfs, and I see it says
that NFS is only usable for the the docker graphs So, I just found, on
the two systems I'm working with it on, an unused drive. Does anyone know
if it is the case that I *cannot* use the partition, but need to make an
LVM on it, for docker to use it?

  mark

___
CentOS mailing list
CentOS@centos.org
https://lists.centos.org/mailman/listinfo/centos

Re: [CentOS] C7 and docker storage

2017-12-01 Thread m . roth 
Gianluca Cecchi  wrote:
> Date: Thu, 30 Nov 2017 09:55:58 +0100
> On Wed, Nov 29, 2017 at 10:23 PM,  wrote:
>
>> The latter would explain the message my user's job gave him when it tried
>> to umount /
>>
>> A bit of googling, and I see something called overlayFS can be used... but
>> I know nothing about that, or how dangerous it is.  Anyone got a pointed
>> to something more than the minimal how to configure docker to use it?
>>
> You could follow CentOS Atomic SIG
> https://wiki.centos.org/SpecialInterestGroup/Atomic
> http://www.projectatomic.io/download/
>
> and/or read here and adapt in case for your storage needs:
> http://www.projectatomic.io/docs/docker-storage-recommendation/
>
> See also here for overlayfs addiction in CentOS Atomic Host in September
> this year
> https://seven.centos.org/2017/09/new-centos-atomic-host-with-overlayfs-storage/
>
Interesting, but it doesn't help me: I can't rebuild the server, it's in
use, and I yum installed docker from the std. repos. What I see from the
links tells me how to switch storage, not how to manually configure
overlay2 storage, and whether I can do as I said, and point it to an
NFS-mounted location.

 mark

___
CentOS mailing list
CentOS@centos.org
https://lists.centos.org/mailman/listinfo/centos

Re: [CentOS-es] Adinistración grafica de proxy

2017-12-01 Thread Roberto Bermúdez 
Muchas gracias José, webmin también se puede instalar en centos, pero aun
así como que no es tan amigable con usuarios promedios, hay firewalls
gráficos basados en centos listos para instalarse, pero en este caso no o
puedo instalar porque en el servidor tengo otros aplicativos ya instalados,
estaba buscando algún administrador de firewall y squid así de amigables,
agradezco de todos modos a todos por darme de su atención así como el
tiempo que se tomaron para responderdeme

Saludos cordiales
Roberto

El dic. 1, 2017 8:59 AM, "José Roberto Alas" 
escribió:

> El 30 de noviembre de 2017, 09:57, Roberto Bermúdez
>  escribió:
> > Muchas gracias a todos por sus comentarios, pero en realidad lo que busco
> > es una solución gráfica para que usuarios sin experiencia en Linux puedan
> > manejar firewall y squid para control de tráfico y sea sencillo de
> > enseñarles, si conocen de algo así se los agradeceré mucho
>
> Seria algo parecido a YaST de openSUSE y SuSE
>
> Solo se me ocurre a través de Webmin.
>
>
>
> --
> Saludos,
> cheperobert
> ___
> CentOS-es mailing list
> CentOS-es@centos.org
> https://lists.centos.org/mailman/listinfo/centos-es
>
___
CentOS-es mailing list
CentOS-es@centos.org
https://lists.centos.org/mailman/listinfo/centos-es

Re: [CentOS-es] Adinistración grafica de proxy

2017-12-01 Thread José Roberto Alas 
El 30 de noviembre de 2017, 09:57, Roberto Bermúdez
 escribió:
> Muchas gracias a todos por sus comentarios, pero en realidad lo que busco
> es una solución gráfica para que usuarios sin experiencia en Linux puedan
> manejar firewall y squid para control de tráfico y sea sencillo de
> enseñarles, si conocen de algo así se los agradeceré mucho

Seria algo parecido a YaST de openSUSE y SuSE

Solo se me ocurre a través de Webmin.



-- 
Saludos,
cheperobert
___
CentOS-es mailing list
CentOS-es@centos.org
https://lists.centos.org/mailman/listinfo/centos-es

[CentOS] Partition advice

2017-12-01 Thread Kenneth Porter 
I'm setting up a new mail server (dovecot + sendmail + SpamAssassin + 
ClamAV + MIMEDefang) to replace an aging CentOS 6 box. The new box is a 
low-end PowerEdge with an SSD, 3 4TB red drives on a PERC RAID controller 
which I'll probably set up RAID5, and possibly mirrored internal SD cards 
as a boot device. I'm debating how to partition it and am soliciting advice.


My initial instinct is to put /boot and the OS on the SSD and the home 
directories with their mail store on the RAID array. I might put a rescue 
partition on the internal SD drive (which is normally intended for a VM 
host). Does anyone see anything wrong with that? Should I do something 
different? Anything I should avoid putting on the SSD, such as swap, /tmp, 
and /var/tmp?


I've been running Red Hat as a small office server since 5.2 back in the 
90's. I'm trying to create a system that's easy to fix when it breaks. I 
find that's the real power of Linux over any other OS: It's easy to fix 
when it breaks.


Oh, and backup will be to an external USB drive using BackupPC, with the 
drive regularly swapped off-site, plus an off-site rsync mirror.

___
CentOS mailing list
CentOS@centos.org
https://lists.centos.org/mailman/listinfo/centos

Re: [CentOS] Good linux software RAID primer advise

2017-12-01 Thread Frans Reitsma 
The red hat family of linux is my advise. Most practical is a Centos 7.4 
version, since its support many application software packages. Skype, libre 
Office, Firefox, thunderbird.

Good luck with the configuration !

Best.

Sent from my Windows 10 phone

From: Valeri Galtsev
Sent: 01 December 2017 06:19
To: centos@centos.org
Subject: [CentOS] Good linux software RAID primer advise

Dear Experts,

Could someone recommend good Linux software RAID primer. It would be good
if it has good coverage of monitoring and dealing with failures.

I inherited a couple of boxes with big bunch of software RAIDs each, and I
even may have some problems, but I don't want to bother anybody with
specifics unless I really hit brick wall, not just my own ignorance.

Thanks in advance for all your answers!

Valeri


Valeri Galtsev
Sr System Administrator
Department of Astronomy and Astrophysics
Kavli Institute for Cosmological Physics
University of Chicago
Phone: 773-702-4247

___
CentOS mailing list
CentOS@centos.org
https://lists.centos.org/mailman/listinfo/centos

___
CentOS mailing list
CentOS@centos.org
https://lists.centos.org/mailman/listinfo/centos