[Maria-discuss] The future of Dynamic Columns

2015-01-27 Thread Tom Worster
I've been excited about the potential uses of Maria's Dynamic Columns (MDC) since I first read about the them. Now I am starting a new application development and want to use MDC. It's a server-side PHP webapp using the Yii 2.0 MVC framework. These days, for typical webapp pages, I seldom write SQ

Re: [Maria-discuss] The future of Dynamic Columns

2015-01-28 Thread Tom Worster
om/tom--/dynamic-ar . I share it for the README which documents motivation, which may be of interest here. The implementation is very early, rough and wrong. Tom On 1/27/15, 5:18 PM, "Oleksandr Byelkin" wrote: >Hi! > >On 27.01.15 16:39, Tom Worster wrote: >[skip]

Re: [Maria-discuss] The future of Dynamic Columns

2015-01-28 Thread Tom Worster
Hi Sergei, Your reply complements Oleksandr's and is welcome. Your remarks about tepid user response to Dynamic Columns makes me want to reiterate the comments about better marketing my reply to Oleksandr. But you make even more clear that the flip side is very important. Users need to show their

Re: [Maria-discuss] The future of Dynamic Columns

2015-01-28 Thread Tom Worster
t it put in. Tom From: Peter Laursen Date: Wednesday, January 28, 2015 at 4:25 PM To: Roberto Spadim Cc: Tom Worster , maria-discuss email list Subject: Re: [Maria-discuss] The future of Dynamic Columns @Roberto. A comment to "i think it's a nice human readable format for array

Re: [Maria-discuss] The future of Dynamic Columns

2015-01-28 Thread Tom Worster
On 1/28/15, 5:41 PM, "Oleksandr Byelkin" wrote: >Hi, Tom! > >On 28.01.15 23:01, Tom Worster wrote: >> While functions for getting and setting via json might be useful, I >> think they are peripheral to the core datatype problem here. >> >> The interf

Re: [Maria-discuss] The future of Dynamic Columns

2015-01-29 Thread Tom Worster
, January 28, 2015 at 8:20 PM To: Oleksandr Byelkin Cc: Tom Worster , maria-discuss email list Subject: Re: [Maria-discuss] The future of Dynamic Columns Just wanted to add, any application that wants to store forms data without having to create a new table every time you create a new form could

Re: [Maria-discuss] The future of Dynamic Columns

2015-01-29 Thread Tom Worster
settings and is used in basic > science research as well. (see >http://en.wikipedia.org/wiki/Entity%E2%80%93attribute%E2%80%93value_model) > > For those that need it, > dynamic columns is powerful and makes life much easier. > Unfortunately, often those that need dynamic columns do

Re: [Maria-discuss] The future of Dynamic Columns

2015-01-29 Thread Tom Worster
Hi Oleksandr, I'm going to stop bitching about Maria now. My needs are in fact met by the current dyncol functions: - It's not so hard to write methods that generate CREATE_COLUMN() expressions from a general data structure. - COLUMN_JSON() is just fine for all my reading purposes. I see no need

Re: [Maria-discuss] The future of Dynamic Columns

2015-01-29 Thread Tom Worster
I have one final technical question. It is for my understanding and does not reflect a problem I have as a user. The manual says: > The answer is: SQL is a statically-typed language. The SQL interpreter needs to know the datatypes of all expressions before the query is run (for example, when one

Re: [Maria-discuss] The future of Dynamic Columns

2015-01-29 Thread Tom Worster
I'm going to respond to your previous two emails with a generality: It is sometimes better to optimize the software development process than the software's data processing. If this were not true, I would not be using this ORM at all and nobody should. But the converse is also clear: sometimes the

[Maria-discuss] JSON and binary strings

2015-01-30 Thread Tom Worster
BINARY is one of the datatypes you can use with dynamic columns. If you try saving binary string and then retrieve it with COLUMN_JSON() then you get an invalid JSON document back. All the JSON decoders I tested reject such documents. It doesn't make sense to me that COLUMN_JSON() would return a d

Re: [Maria-discuss] JSON and binary strings

2015-01-31 Thread Tom Worster
I could have been more direct. What should be the expected behavior in the following? SELECT COLUMN_JSON(COLUMN_CREATE('name', UNHEX('C1C2C3C4C5C6'))); From: Tom Worster Date: Friday, January 30, 2015 at 9:05 PM To: maria-discuss email list Subject: [Maria-discuss] JSO

Re: [Maria-discuss] JSON and binary strings

2015-01-31 Thread Tom Worster
o return a value in a format that cannot express that value. Tom From: Peter Laursen Date: Saturday, January 31, 2015 at 3:39 PM To: Tom Worster Cc: maria-discuss email list Subject: Re: [Maria-discuss] JSON and binary strings I get the result (what I think is expected) from the query "

Re: [Maria-discuss] JSON and binary strings

2015-01-31 Thread Tom Worster
non-JSON. Tom From: Roberto Spadim Date: Saturday, January 31, 2015 at 3:48 PM To: Peter Laursen Cc: Tom Worster , maria-discuss email list Subject: Re: [Maria-discuss] JSON and binary strings one "problem" about JSON, it only accept Unicode, be carefull when using latin1 + u

Re: [Maria-discuss] JSON and binary strings

2015-01-31 Thread Tom Worster
quotation marks except for the characters that must be escaped: quotation mark, reverse solidus, and the control characters (U+ through U+001F). From: Roberto Spadim Date: Saturday, January 31, 2015 at 3:56 PM To: Tom Worster Cc: Peter Laursen , maria-discuss email list Subject: Re

Re: [Maria-discuss] JSON and binary strings

2015-01-31 Thread Tom Worster
Actually, the characters were probably converted into valid utf8 when you pasted them into the JSLint web form. From: Roberto Spadim Date: Saturday, January 31, 2015 at 3:56 PM To: Tom Worster Cc: Peter Laursen , maria-discuss email list Subject: Re: [Maria-discuss] JSON and binary

[Maria-discuss] Restated: JSON cannot represent binary data

2015-01-31 Thread Tom Worster
I think we're getting lost in the detail. Beyond dispute are two facts: 1. BINARY is a valid datatype in dynamic columns. 2. JSON cannot represent binary data. It follows that: COLUMN_JSON() cannot (correctly) represent all dynamic column values. So I ask the question is: What *sh

Re: [Maria-discuss] Restated: JSON cannot represent binary data

2015-02-01 Thread Tom Worster
ARY) expressions. I could live with that. Tom On 2/1/15, 3:45 PM, "Sergei Golubchik" wrote: >Hi, Tom! > >On Jan 31, Tom Worster wrote: >> I think we're getting lost in the detail. Beyond dispute are two facts: >> >>1. BINARY is a valid datatype i

Re: [Maria-discuss] Restated: JSON cannot represent binary data

2015-02-03 Thread Tom Worster
Hi Sergei, On 2/3/15, 7:13 AM, "Sergei Golubchik" wrote: >> A dynamic column cannot be NULL, so using a JSON null (a different kind >>of >> null) to express "dynamic column exists but cannot be represented as >> requested" should work. The ORM would then have the names and positions >>in >> the

Re: [Maria-discuss] Restated: JSON cannot represent binary data

2015-02-03 Thread Tom Worster
On 2/3/15, 10:24 AM, "Justin Swanhart" wrote: >NULL and missing are two different concepts. Null means unknown, not >missing. The data structure should have an ability to store NULL to be >compatible with RDBMS semantics. While a dynamic column is similar to a >NoSQL document store it is not o

Re: [Maria-discuss] Restated: JSON cannot represent binary data

2015-02-05 Thread Tom Worster
document ::= int32 e_list "\x00" > > Just wonderful! > > > From: Justin Swanhart > Date: Tuesday, February 3, 2015 at 7:31 PM > To: Roberto Spadim > Cc: Federico Razzoli , Tom Worster , > maria-discuss email list > Subject: Re: [Maria-discuss] Res

Re: [Maria-discuss] R: Re: R: Re: R: Re: Switch from rsync to xtrabackup

2015-02-18 Thread Tom Worster
it would be nice to have this info summarized in a KB article From: "absolutely_f...@libero.it" Reply-To: "absolutely_f...@libero.it" Date: Wednesday, February 18, 2015 at 12:27 PM To: Cc: maria-discuss email list Subject: [Maria-discuss] R: Re: R: Re: R: Re: Switch from rsync to xtrabac

[Maria-discuss] Giving up on dynamic columns

2015-03-01 Thread Tom Worster
I discovered this showstopper on Friday while working with real data in development of a new app. I managed to narrow it down today and filed the bug report. https://mariadb.atlassian.net/browse/MDEV-7650 Looks like Maria saves an illegally formatted dyncol string if a dynamic column is longer th

Re: [Maria-discuss] Giving up on dynamic columns

2015-03-01 Thread Tom Worster
who is truncating columns? On 3/1/15, 3:27 PM, "Sergei Golubchik" wrote: >Hi, Tom! > >On Mar 01, Tom Worster wrote: >> I discovered this showstopper on Friday while working with real data in >> development of a new app. I managed to narrow it down toda

Re: [Maria-discuss] Giving up on dynamic columns

2015-03-01 Thread Tom Worster
so it turns out the problem is my incompetence. i thought blob allowed long values. i've been using mysql since 3.something and i still don't know much about its abundance of types. i retract my comments and crawl back into my hole. ___ Mailing list:

[Maria-discuss] Dynamic Columns ORM

2015-05-22 Thread Tom Worster
In January I was asking about Dynamic Columns because I had started working on an ORM extension for it. It is now tagged 0.1.0 in Github. There probably aren't many here using Yii Framework but at least this shows that some of us like and use Maria's Dynamic Columns. Thank you, Maria. I already go

Re: [Maria-discuss] Dynamic Columns ORM

2015-05-23 Thread Tom Worster
Daniel Black Date: Saturday, May 23, 2015 at 1:27 AM To: Tom Worster , maria-discuss email list Subject: Re: [Maria-discuss] Dynamic Columns ORM They are generally good for blob like information that is generally retrieved in a query with some structure around name->value pairs. You

[Maria-discuss] Upgrading mariadb-galera-server

2015-06-19 Thread Tom Worster
Can I upgrade a production cluster from 10.0.15 to 10.0.19 while the cluster remains in service, upgrading one node at a time? ___ Mailing list: https://launchpad.net/~maria-discuss Post to : maria-discuss@lists.launchpad.net Unsubscribe : https://l

Re: [Maria-discuss] Upgrading mariadb-galera-server

2015-06-19 Thread Tom Worster
suggests that it's up to me to choose IST. But isn't it the case that the server choses IST or SST, depending on whether galera.cache has enough writesets for an IST? From: Guillaume Lefranc Date: Friday, June 19, 2015 at 1:22 PM To: Tom Worster Cc: maria-discuss email list Subject:

Re: [Maria-discuss] Upgrading mariadb-galera-server

2015-06-19 Thread Tom Worster
Thanks Geoff, I never would have though of this without your mentioning it. Unless I think there might be defects in my tables, do you think there's a need to run mysql_upgrade for 10.0.15 -> .19? Tom From: Geoff Montee Date: Friday, June 19, 2015 at 1:22 PM To: Tom Worster Cc

[Maria-discuss] More love for Dynamic Columns - support in Sequel Pro

2015-06-24 Thread Tom Worster
Just a little bundle plugin to view the values in a dyncol blob but very handy all the same. If you use dyncols, which I do. https://github.com/tom--/sequel-pro-maria-dynamic-column In other dyncol news, we've improved the ORM extension that I mentioned in a

[Maria-discuss] MySQL 5.7 JSON

2015-09-03 Thread Tom Worster
Are MySQL 5.7 JSON features likely to end up in MariaDB anytime? If so, would it be 10.2? Tom ___ Mailing list: https://launchpad.net/~maria-discuss Post to : mari

Re: [Maria-discuss] Moving from Launchpad lists to something else... ?

2015-10-16 Thread Tom Worster
On 10/15/15, 5:03 AM, "Maria-discuss on behalf of Colin Charles" wrote: >> On 15 Oct 2015, at 05:35, Jean Weisbuch wrote: >> >> To be able to give the best answer we must first know what is >>motivating the move from LP. > >So the reason we were thinking of ditching launchpad for mailing lists:

Re: [Maria-discuss] MariaDB 10.1.8 Stable (GA) now available

2015-10-18 Thread Tom Worster
Congratulations! and thank you! to all involved. 🎃 Tom On 10/17/15, 8:53 AM, "Maria-discuss on behalf of Daniel Bartholomew" wrote: >The MariaDB project is pleased to announce the immediate availability >of MariaDB 10.1.8. This is the first Stable (GA) release in the >MariaDB 10.1 series. See

Re: [Maria-discuss] Most reliable SST (or IST ?) method for MariaDB Cluster

2015-12-05 Thread Tom Worster
Hi Guillaume, What variable(s) should we monitor to estimate the rate at which gcache is written? or to otherwise estimate how far back a given gcache.size goes in history? Tom From: Maria-discuss on behalf of Guillaume Lefranc Date: Saturday, December 5, 2015 at 10:23 AM To: Bertrand Capl

Re: [Maria-discuss] Most reliable SST (or IST ?) method for MariaDB Cluster

2015-12-05 Thread Tom Worster
Hi Guillaume, Yes, it helps. Thanks! I can log these every hour (say) and plot the curve over a week to get an idea of rate and its variability. Tom From: Guillaume Lefranc Date: Saturday, December 5, 2015 at 12:57 PM To: Tom Worster , Bertrand Caplet , maria-discuss email list Subject

[Maria-discuss] Weighted Quorum for Three Nodes

2015-12-27 Thread Tom Worster
In the Galera docs I read > When configuring quorum weights for three nodes, use the following pattern: > node1: pc.weight = 2 > node2: pc.weight = 1 > node3: pc.weight = 0 > Under this pattern

Re: [Maria-discuss] Performace issue with insert

2016-01-27 Thread Tom Worster
Hi wh, If a table has any indexes then inset time increases with the number of records in the table. Even with only one index, the difference between inserting when the table is nearly empty and when it has many millions of records can be dramatic. If you have some understanding of how convention

Re: [Maria-discuss] Collations, trailing spaces and unique indexes

2016-03-19 Thread Tom Worster
This conversation made me curious. Which code points does a PADSPACE collation treat as trailing spaces? Would the imagined utf8_*_nopad_* collations treat all of these code points as significant? Tom On 3/11/16, 6:20 AM, "Maria-discuss on behalf of Alexander Barkov" wrote: >Hello Binarus, K

Re: [Maria-discuss] Designated donor.

2016-07-07 Thread Tom Worster
On 7/7/16, 2:11 AM, "Maria-discuss on behalf of Daniel Black" wrote: >Don't get the donor name wrong or you'll be chasing phantom network >error messages. > >https://github.com/codership/galera/pull/109 i couldn't make wsrep-sst-donor work with either the ip addresses from the gcomm:// wsrep_clu

Re: [Maria-discuss] Designated donor.

2016-07-08 Thread Tom Worster
yes On 7/7/16, 9:20 PM, "Daniel Black" wrote: >It needs to match >https://mariadb.com/kb/en/mariadb/galera-cluster-system-variables/#wsrep_n >ode_name >of the donor. > >On 08/07/16 10:59, Tom Worster wrote: >> On 7/7/16, 2:11 AM, "Maria-discuss on behalf

Re: [Maria-discuss] (no subject)

2016-09-24 Thread Tom Worster
On 9/23/16, 10:11 AM, "Maria-discuss on behalf of l vic" wrote: >Is there is a good way to remove a node from a galera cluster besides >just killing it? Yes. I use normal shutdown of the mysql server. `mysqladmin shutdown` is one way. On Ubuntu `service mysql stop` is another. The Galera node

Re: [Maria-discuss] MariaDB Server 10.3 notes

2016-10-12 Thread Tom Worster
On 10/11/16, 12:58 PM, "Maria-discuss on behalf of Colin Charles" wrote: >* With MyRocks coming, ... what an unfortunate name for a database. tom ___ Mailing list: https://launchpad.net/~maria-discuss Post to : maria-discuss@lists.launchpad.net

[Maria-discuss] New backup procedure plan

2019-05-10 Thread Tom Worster
Hi, 3 MariaDB servers are running Galera on three bare-metal machines adjacent to each other in a data center rack. Two of them handle traffic from a web app while the third machine has other duties including backups. A recent upgrade in the web app completely changed its schema. Previously t

[Maria-discuss] Migrating a Galera cluster to new hardware and major Maria version

2019-11-05 Thread Tom Worster
I've three servers with Debian 9, Maria 10.1 and running a Galera cluster. We're upgrading the hardware by getting three new servers. They will have Debian 10 and Maria 10.3. What are my options for accomplishing this with minimal service downtime? One option I can think of Using a mysqldu

Re: [Maria-discuss] Migrating a Galera cluster to new hardware and major Maria version

2019-11-05 Thread Tom Worster
quicker and I found much better to MySQLDump unless it's presently only a small database. Will also carry over your GTID etc for sync. I have some notes on my blog on my switchovers Cheers Peter On Wed, 6 Nov 2019 at 00:55, Tom Worster wrote: I've three servers with Debian 9, Maria