Hi!

Here is booking.com's wish list!

Regards,
Monty


--- Begin Message ---
These are the notes from the flipchart, transcribed. I have not yet made a Wiki 
page from that.

I hope the list of attendees is correct and I did not leave anybody out - I 
forgot to make a list.

Please check these notes, and send me back any annotations. I will turn all of 
this into a wiki page, and send copies to Monty/SkySQL as well.

Kris



Bert Lindner <[email protected]>
Eric Herman <[email protected]>
Herald van der Breggen <[email protected]>
Kristian Köhntopp <[email protected]>
Elizabeth Mattijsen <[email protected]>
Luciano Rocha <[email protected]>
Michael Diliberto <[email protected]>
Nicolai Plum <[email protected]>
"Ruud H.G. van Tol" <[email protected]>
Yves Orton <[email protected]>

Guy Nir <[email protected]>
Deborah Wade <[email protected]>
Simon J Mudd <[email protected]>
Glenn Nadeau <[email protected]>

Ivan Zoratti <[email protected]>
Maria Luisa Raviol <[email protected]>
Olivier Beutels <[email protected]>
"Michael \"Monty\" Widenius" <[email protected]>


Scalability Team Session

- DROP TABLE is slow -- Kris, Ruud

- Run an instance of MySQL with Profiling on, with real life traffic, forward 
profiling data to MySQL. Also oprofile the box. -- Monty

- Replication Scaling: Number of fsync calls in SQL_THREAD
  - Group Commit and Parallel Apply -- Monty

- Nested Transactions -- Yves
  - If anybody has a definition of Nested Transactions that is viable, I'd be 
glad to hear that. What happens in 'begin; begin; ...; commit; ... rollback;'? 
-- Kris

- Replication Synchronisation: GUID, MASTER_POS_WAIT() across 3 or more hops -- 
Kris

- Large new table in Replication causes lag -- Yves

- Online compressible MyISAM/Aria -- Liz

- GET_LOCK() improvements: Aquire sequentially more than one -- Yves

- Hash Join! -- Yves
  - Way ahead of you -- Monty

- More execution plan info (Waits, I/O) -- Yves
  - Performance_Schema -- Monty

- Better Explain -- Yves
  - WL Item exists -- Monty
  - What is the # of that? -- Kris

- Better Statistics for Queries -- Monty
  - Log query skeletons -- Monty
    - Yes, please. Remember we have tables with time-tailed names (_YYYYMMDD), 
variable length WHERE ... IN (...) lists, and variable length extended insert 
statements. -- Yves

- Unquoted numbers cause weird query plans -- Ruud
  - Yes, they have to, thanks to numeric casting -- Monty
    - Can we make such casts cause an error optionally, that would make that 
SQL easier to find in Development. -- Kris

- UTF-8 currently stalled at booking because of MEMORY tables being fixed 
length in query plans with 'using temporary'. -- Kris, Eric
  - variable length memory tables existed with limits, need sponsorship. -- 
Monty

- Some large join take ages to execute. Probably due to tmp tables to disk. -- 
Liz

- Using memcache as a backend. -- Liz
  - done. -- Monty

- What did that update change? (Adminlogging) -- Yves, Ruud
- Multiple record update syntax (av) -- Yves, Ruud
  - Spec these two out. -- Monty
  - insert/delete, update/select, delete/select previous values. -- Yves, Ruud

- Trailing controls w/ RBR + Statement log or Audit plugin in 5.5 -- Kris

- Federation vs. Table Copy? -- Eric
- Other ways to coalesce data from multiple masters. Multiple disjunct source 
replication slave. -- Eric, Nicolai

- In replication, create new tables and populate them through a second 
connection to speed things up. -- Ruud
- Also for ALTER TABLE? -- Ruud
  - Spec it. -- Monty

- ALTER TABLE progress report. -- Yves
  - done. -- Monty

- IN-SQL-CLONE-PROCEDURE. Setting up a slave from within the slaves command 
line client
- move tables physically from master to slave at disk speed, no index creation 
needed?
    -- Nicolai

- FLUSH TABLES WITH READ LOCK AND NO CHECKPOINT/ Stable snapshot. -- SimonM, 
Kris

- Monitoring. -- Aaron
  - Monyog. -- Kris, Ivan
  - Zabbix -- Aaron, Kris

- FAST ALTER TABLE, online ALTER TABLE, versioned rows in schema. -- Herald, 
Kris
  - Online table change, fast drop columns discussion. -- Monty, Kris


DBA Team Session



- Large joins in DW -- Debs
- Large tables joined in DW -- Debs
  - Hash Join, Join optimizations in 5.3/5.5 -- Monty

- Optimizer Issues: Histograms, Hash Join, Subqueries
  - Partly done. -- Monty

- Try out engines for fast inserts: Infobright, InfiniDB, ... -- SkySQL to 
Booking

- Online ALTER TABLE 
  - Facebook Hack (-- SkySQL) vs. Proper Solution. -- Kris

- Setting up a profiler host for Monty. -- DBA

- Move IBD files physically. -- DBA
  - possible with XtraDB at target, xtrabackup. -- Kris

- SELECT INTO OUTFILE LOCAL/LOAD DATA INFILE LOCAL
  - Security/Firewall issues due to direction of connect. -- Kris
  - mysqldumper parallel load -- Max, SimonM

- proper tablespace management -- SimonM
  - state benefits, spec it. -- Monty to SimonM

- Configuration changes require server restart (especially: Replication, 
InnoDB) -- DBA

- faster I_S, need to work with 1E6 tables. -- SimonM

- Grants, Roles -- Debs, SimonM
  - Spec it! -- Monty

- Views are being reparsed for every access, never cached. -- Monty, Kris, Ruud

- RBR conflict resolution SP -- Kris

- "fan-in": Multiple Masters, FederatedX: "unsharding should be easy" -- SimonM

- transaction-p: "Am I in a transaction"-Predicate as a status variable -- 
Kris, Monty

- Compressed Binlog? At Event level? -- SimonM

- Async Binlog Shipping: Run a SP or Shell cmd on binlog rotation. -- Kris

- Async query API, so that we can write a map-reducer at client level. -- Kris
  - To be done soon, funding from elsewhere. -- Monty

- functional indexes, indexes global to partitions. -- Kris

- Config in tables, not in files, e.g. master.info, relay,info -- DBA
  - part of 5.6 -- Monty

Internal at DBA/Booking:

- Build a snapshot management script for hourly snapshots. -- Kris
- Check out how rsync fails for cloning, fast cloning. -- Kris
- LB DB connections with F5 -- Glenn, Guy, Kris
  - Do you have partners that do this? What are there experiences? -- to SkySQL


--- End Message ---
_______________________________________________
Mailing list: https://launchpad.net/~maria-developers
Post to     : [email protected]
Unsubscribe : https://launchpad.net/~maria-developers
More help   : https://help.launchpad.net/ListHelp

Reply via email to