Effective MySQL

Understanding Tokutek Fractal Tree Indexes

ronald — Thu, 16 May 2013 14:40:45 +0000

Thanks to Tim Callaghan for speaking Tuesday night at the Effective MySQL New York meetup on Fractal Tree Indexes : Theory and Practice (MySQL and MongoDB). There was a good turnout and a full room to learn how the TokuDB storage engine from Tokutek is changing how to handle big data in MySQL.

Also interesting is how the same technology has been applied for use in MongoDB including giving MongoDB transactions; a big change for NoSQL.

New MySQL 5.6 Replication Features

ronald — Fri, 15 Mar 2013 00:00:11 +0000

Download PDF Presentation

There is a long list of new replication features in the latest MySQL 5.6 release including:

Binary log group commit
Multi-threaded slaves
Crash-save slaves
Global Transaction Identifier (GTID)
Replication checksums
Optimized row-based replication
Time-delayed replication
Remote binary log backup
UUID

This presentation from the MySQL Tech Tour events in New York and Boston provides an overview and syntax examples of many of these features. The Effective MySQL: Replication Techniques in Depth also discusses many of these features in detail. Chapter 3 is available for FREE download.

MySQL 5.6 features for NoSQL, Big Data and the Cloud

ronald — Thu, 14 Mar 2013 23:57:34 +0000

Download PDF Presentation

At the recent MySQL Tech Tour Events in New York and Boston I gave a presentation on MySQL integration with NoSQL,Big Data and the Cloud.

This covered discussion on topics including:

Memcached API for InnoDB
InnoDB Online Alter
InnoDB Full Text Search (FTS)
Partitioning inprovements for import/export
SSD Optimisations
Replication Improvements
And much more …

Secrets of mysqlnd Presentation

ronald — Wed, 27 Feb 2013 14:49:19 +0000

Download PDF Presentation

At the recent New York PHP Group in New York, I gave a presentation on “Secrets of mysqlnd”. While there are no real “secrets” of the new MySQL Native Driver for PHP, available in PHP 5.3, and the default for PHP 5.4+ replacing libmysqlclient, there are new features of the driver many are unaware of. If you have ever had to fight the gods with compiling a particular version of PHP with the right libmysqlclient dependency, the good news is that legacy requirement is no longer necessary.

Some of the topics discussed in detail included support for read/write splitting and load balancing with existing applications, and the implications for consistency with MySQL replication. Mysqlnd can also provide failover capabilities, and when combined with using MySQL cluster, Tungsten Replicator and HA manages including MMM and MHA, a more smoother application management of failover in the future may be possible with applicable design.

Mysqlnd also provides a number of other plugin extensions which shows the potential of this new driver for the future. There is still a lot of work to be done, particularly with getting distros and package management to support all capabilities for ease of installation and management.

Our Effective MySQL Books

ronald — Fri, 08 Feb 2013 18:07:23 +0000

At Effective MySQL we provide resources for the DBA, Developer and Architect to best use MySQL. This includes currently three books in our series, available in print, PDF and Kindle formats.


Buy Now	Buy Now	Buy Now

Lessons learned managing large AWS Environments

ronald — Mon, 04 Feb 2013 15:57:32 +0000

Download PDF Presentation

At the recent AWS Meetup group in New York, I gave a presentation on “Lessons learned managing large AWS Environments”.

This included my experiences in managing and optimizing AWS costs, CLI automation for web scale (my work at GitHub), knowing about and improving security, what is important monitoring and dealing with failure.

Managing 500+ MySQL servers in the AWS cloud

ronald — Fri, 04 Jan 2013 20:08:16 +0000

Download PDF Presentation

This presentation discusses the lessons learned about the issues of managing a large number of MySQL instances, Including experiences from multiple clients including supporting one billion+ requests statements per day (and 50+ billion SQL statements), and smaller users of LAMP stack, Microsoft stack and RDS configurations. Topics include:

Monitoring and instrumentation are essential to manage cost
Cost saving techniques
How to automate installations, upgrades and deployments
Traffic minimization techniques
Creating HA with regions and zones
Real-time traffic stats (aggregated every 5 seconds)
AWS specific optimizations with EBS
Considerations and limitations with RDS

Presenter: Ronald Bradford
Schedule:

Cloud Expo West – November 2012- Santa Clara, CA. Session Outline.
MySQL Connect – September 2012 – San Francisco, CA. Session Outline.

Replication Techniques in depth

ronald — Fri, 15 Jun 2012 15:47:20 +0000

The third book of the Effective MySQL series provides the reader with the tools, knowledge and tips for managing a scalable MySQL Replication environment.

Chapters

The Five Minute DBA
Diagnosing Common Replication Problems
Improving Standard Replication Features
Understanding Multi-Master Replication
MySQL Replication Tools
Extending Replication for Practical Needs
MySQL Configuration Options
Monitoring Replication

Order Now

This title is available in print, PDF and Kindle formats from these retailers.

Other Titles

See other titles in our series including:

MySQL Disasters, and how to avoid yours

ronald — Tue, 05 Jun 2012 13:51:41 +0000

Download PDF Presentation

Organizations are always making improvements for scalability, however disaster preparedness is the poor cousin. This presentation will show you how to easily avoid the most common MySQL disaster situations.
Backup and recovery is critical for business continuity, many websites run the risk of data loss or corruption because existing procedures (if any) are generally flawed. Discussion includes:

The essential backup options
Why Binary logging for point in time recovery is important
How replication changes things
Recovery complexities

Presenter: Ronald Bradford
Schedule:

Effective MySQL Meetup – May 2012- New York, NY
South East Linux Fest 2012 – June 2012 – Charlotte, NC

MySQL Backup & Recovery Essentials

ronald — Wed, 16 May 2012 16:02:29 +0000

Download PDF Presentation

A hardware, software or human failure can occur at any time. Are you prepared?
Many organizations take a risk of serious data loss and system downtime with inadequate procedures in place to support a disaster recovery. This presentation covers the essentials of MySQL backup and recovery options, identifying the necessary tools for an effective strategy to support data resilience and business continuity for your organization. MySQL has no one single unbreakable backup solution, so it is important to understand the impact of MySQL replication, storage engines, configuration options for durability, hardware configuration and the impact on locking and uptime for the various hot/warm/cold options available.

Short Url: http://j.mp/EM-BandR
Presenter: Ronald Bradford
Schedule: RMOUG QEW – May 2012- Denver, Colorado

LAMP Performance Optimizations – Volume 1

ronald — Tue, 01 May 2012 17:24:32 +0000

Download PDF Presentation

Get a detailed introduction to the very broad topic of end-to-end performance optimization in web applications based on LAMP stack (Linux, Apache, MySQL, PHP).

Short Url: http://j.mp/EM-LAMP-opt
Presenter: Ronald Bradford
Schedule:

OTN MySQL Developer Day in May 2012 – New York.
Effective MySQL Meetup York and Web Performance Meetup. – July 2011 New York

Setting up Google Cloud SQL

ronald — Wed, 18 Apr 2012 20:00:23 +0000

You can activate Google Cloud SQL from the Google APIs Console at https://code.google.com/apis/console. NOTE: At the time of this publication this was in limited beta.

From the Google APIs console, you can create a new instance. You can then use the Web interface to run SQL statements, import and export data. There is also a Google SQL command line client that can be configured with:

# Java 6 is a dependency of the Google SQL client
$ [ -z `which java 2>/dev/null` ] && sudo apt-get install -y openjdk-6-jre-headless
$ [ -z `which unzip 2>/dev/null` ] && sudo apt-get install -y unzip
$ cd $HOME
$ mkdir cloud-sql
$ cd cloud-sql/
$ wget http://dl.google.com/cloudsql/tools/google_sql_tool.zip
$ unzip ../google_sql_tool.zip
$ ./google_sql.sh 
Please authorize Google SQL Service for your Google Account at:

http://goo.gl/XXXX

Enter Authorization Code: *************************
sql> show schemas;
+--------------------+
| Database           |
+--------------------+
| information_schema |
| mysql              |
| performance_schema |
+--------------------+
3 rows in set (0.10 sec)

NOTE: The *first time* you access your instance you need to confirm authorization by going to the provided URL.

Setting up AWS RDS

ronald — Wed, 18 Apr 2012 15:37:04 +0000

Amazon Web Services (AWS) provides a managed MySQL solution via Relational Database Service (RDS). The following instructions will enable you to configure and run RDS. Refer to Using Amazon Web Services for initial information about AWS requirements.

The following instructions are for Ubuntu.

Pre-requisites

$ [ -z `which java 2>/dev/null` ] && sudo apt-get install -y openjdk-6-jre-headless
$ [ -z `which unzip 2>/dev/null` ] && sudo apt-get install -y unzip

Installation

# See http://docs.amazonwebservices.com/AmazonRDS/latest/CommandLineReference/Welcome.html?r=8890
$ cd $HOME
$ mkdir -p aws
$ cd aws
$ wget http://s3.amazonaws.com/rds-downloads/RDSCli.zip
$ unzip RDSCli.zip
$ ln -s RDSCli-*/ rds

Configuration

You need to create the $HOME/aws/credentials file with your specific account details.

AWSAccessKeyId=XXXXXXXXXXXXXXXXX
AWSSecretKey=YYYYYYYYYYYYYYYYYYYYYYYYYYYYYYYYYYYYYYYYYY

The following should be added to a given startup profile

export JAVA_HOME=/usr/lib/jvm/java-6-openjdk/jre
export AWS_RDS_HOME=$HOME/aws/rds
export PATH=$AWS_RDS_HOME/bin:$PATH
export AWS_CREDENTIAL_FILE=$HOME/aws/credentials

A number of different MySQL versions are available.

$ rds-describe-db-engine-versions -e mysql
VERSION  mysql  5.1.45  mysql5.1  MySQL Community Edition  Mysql 5.1.45
VERSION  mysql  5.1.49  mysql5.1  MySQL Community Edition  MySQL 5.1.49-R1 with innodb plugin
VERSION  mysql  5.1.50  mysql5.1  MySQL Community Edition  MySQL 5.1.50-R3
VERSION  mysql  5.1.57  mysql5.1  MySQL Community Edition  MySQL 5.1.57-R1
VERSION  mysql  5.1.61  mysql5.1  MySQL Community Edition  MySQL 5.1.61-R1
VERSION  mysql  5.5.12  mysql5.5  MySQL Community Edition  MySQL 5.5.12-R1
VERSION  mysql  5.5.20  mysql5.5  MySQL Community Edition  MySQL 5.5.20-R1
VERSION  mysql  5.5.8   mysql5.5  MySQL Community Edition  MySQL 5.5.8.R1 GA

Verification

$ rds-describe-db-instances
$ rds-describe-db-parameter-groups
DBPARAMETERGROUP  default.mysql5.5  mysql5.5  Default parameter group for mysql5.5

It is not possible to change the default parameter group so you need to create a copy for any future configuration modifications.

$ rds-create-db-parameter-group running-mysql55 -d 'Running MySQL 5.5' -f mysql5.5

Creating a new instance

$ rds-create-db-instance book2 --db-instance-class db.m1.large --allocated-storage 20 --engine mysql --master-username dba --master-user-password passwd --db-parameter-group-name running-mysql55
DBINSTANCE  book2  db.m1.large  mysql  20  dba  creating  1  ****  n  5.5.20  general-public-license
      SECGROUP  default  active
      PARAMGRP  running-mysql55  in-sync
$  rds-describe-db-instances
DBINSTANCE  book2  db.m1.large  mysql  20  dba  creating  us-east-1a  1  ****  n  5.5.20  general-public-license
      SECGROUP  default  active
      PARAMGRP  running-mysql55  in-sync

It can take some time (e.g. 5-10 minutes for your instance to be available. When ready it will show available. In this case, the instance host is defined, however the instance is not yet accessible.

$ rds-describe-db-instances
DBINSTANCE  book2  2012-04-18T15:09:08.420Z  db.m1.large  mysql  20  dba  backing-up  book2.cqmcgpjfkies.us-east-1.rds.amazonaws.com  3306  us-east-1a  1  n  5.5.20  general-public-license
      SECGROUP  default  active
      PARAMGRP  running-mysql55  in-sync

While waiting, you can create the necessary permissions to access the RDS instance.

$ rds-describe-db-security-groups
SECGROUP  default  default
$ rds-authorize-db-security-group-ingress default --cidr-ip 10.194.163.1/21
SECGROUP  default  default
      IP-RANGE  10.194.163.1/21  authorizing
$ rds-describe-db-security-groups
SECGROUP  default  default
      IP-RANGE  10.194.163.1/21  authorized

$ rds-describe-db-instances
DBINSTANCE  book2  2012-04-18T15:09:08.420Z  db.m1.large  mysql  20  dba  available  book2.cqmcgpjfkies.us-east-1.rds.amazonaws.com  3306  us-east-1a  1  n  5.5.20  general-public-license
      SECGROUP  default  active
      PARAMGRP  running-mysql55  in-sync

The following can be used to monitor.

$ while [ : ]; do  date; rds-describe-db-instances; sleep 15; done
Wed Apr 18 19:27:14 UTC 2012
DBINSTANCE  book2  db.m1.large  mysql  20  dba  creating  1  ****  n  5.5.20  general-public-license
      SECGROUP  default  active
      PARAMGRP  running-mysql55  in-sync
...
Wed Apr 18 19:35:48 UTC 2012
DBINSTANCE  book2  2012-04-18T19:31:51.919Z  db.m1.large  mysql  20  dba  available  book2.cqmcgpjfkies.us-east-1.rds.amazonaws.com  3306  us-east-1c  1  n  5.5.20  general-public-license
      SECGROUP  default  active
      PARAMGRP  running-mysql55  in-sync

Confirmation of running MySQL Instance.

$ mysql -udba -ppasswd -hbook2.cqmcgpjfkies.us-east-1.rds.amazonaws.com -e "SELECT VERSION()"
+------------+
| VERSION()  |
+------------+
| 5.5.20-log |
+------------+

Terminating

$ rds-delete-db-instance book2 --skip-final-snapshot
    Once you begin deleting this database, it will no longer be able to accept
    connections.
    Are you sure you want to delete this database? [Ny]y
DBINSTANCE  book2  2012-04-18T14:58:54.251Z  db.m1.large  mysql  20  dba  deleting  book2.cqmcgpjfkies.us-east-1.rds.amazonaws.com  3306  us-east-1a  1  n  5.5.20  general-public-license
      SECGROUP  default  active
      PARAMGRP  default.mysql5.5  in-sync

You can pass -f to avoid the prompt.

MySQL Idiosyncrasies That Bite

ronald — Fri, 13 Apr 2012 08:49:26 +0000

Download PDF Presentation

While MySQL is a popular and widely used database product, there are some default features and settings which can be foreign in comparison with other commercial RDBMS products such as Oracle. In this discussion, Ronald Bradford will discuss some of the MySQL defaults that are not what you may expect. These include understanding the concept of storage engines, and the default non-transactional state, how silent data truncations occur which affect your data, ideal practices for date management, and the MySQL transaction isolation options. These are all critical to clearly understand and implement correctly for data integrity and consistency. He will cover in-depth topics including SQL_MODE and the recommended best practices for default settings, the ideal user permissions and privileges including not what to do, and also the best practices for character sets and collations to ensure your UTF8 is stored and retrieved correctly.

Presenter: Ronald Bradford
Schedule:
Percona Live – Santa Clara, April 2012
New York MySQL Meetup, April 2011, New York

Explaining the MySQL EXPLAIN

ronald — Thu, 12 Apr 2012 00:20:45 +0000

Download PDF Presentation

Determining the Query Execution Plan (QEP) of an SQL statement is the primary analysis tool for DBAs. Understanding how to interpret the information from the EXPLAIN command and what additional commands and tools exist to add supplementary information are essential skills that will be used daily in production operations.

The MySQL EXPLAIN QEP is significantly different from an Oracle QEP and Oracle DBAs need to understand and learn the most appropriate way to understand and navigate this information to effective performance tune a running MySQL environment.

In this presentation we will cover the following:

EXPLAIN & EXPLAIN EXTENDED Syntax
Additional commands including SHOW CREATE TABLE, SHOW INDEXES and ANALYZE TABLE
MySQL Primary Key, Unique Index, different Index Types and Index Cardinality specifics
Understand how different Storage Engines affect the QEP
The impact of multi-column indexes, partial indexes and covering indexes

Presenter: Ronald Bradford
Schedule:

Percona Live – Santa Clara, April 2012
EMEA Harmony – Helsinki, Finland May 2011
South East Linux Fest 2012 – June 2012 – Charlotte, NC

Using Amazon Web Services

ronald — Sat, 17 Mar 2012 21:07:35 +0000

After Setting up Amazon Web Services you can follow these steps to use the EC2 CLI tools to manage EC2 instances.

As per the setup instructions you require the following environment variables to use the tools. It is recommend you add these to $HOME/.bashrc or appropriate shell startup script.

$ export EC2_HOME=$HOME/aws/ec2
$ export PATH=$EC2_HOME/bin:$PATH
# For Ubuntu
$ export JAVA_HOME=/usr/lib/jvm/java-6-openjdk/
# For Mac OSX Use
# export JAVA_HOME=/System/Library/Frameworks/JavaVM.framework/Home/

Necessary Access Controls

In addition you require the various AWS access keys before running any EC2 commands.

$ cd $HOME/aws
$ mv ~/Downloads/cert-EPE36OOAUD6QZZVFJCDJTEWFAG2EPWGA.pem  cert.pem
$ mv ~/Downloads/pk-EPE36OOAUD6QZZVFJCDJTEWFAG2EPWGA.pem  pk.pem
$ export EC2_CERT=$HOME/aws/cert.pem
$ export EC2_PRIVATE_KEY=$HOME/aws/pk.pem

Two more one off tasks are needed before you can launch a new instance. These are a keypair to access the instance, and a security group to maintain firewall rules.

$ ec2-add-keypair admin | grep -v "^KEYPAIR" > admin.pem
$ chmod 600 admin.pem
$ ec2-create-group db -d "DB Servers"
$ ec2-authorize db -p 22 -s XXX.XXX.XXX.XXX/32

In this example, an SSH keypair named “admin” has been created, and a security group called “db” with SSH only access from a given IP.

You should replace XXX.XXX.XXX.XXX with your current IP address.
If you do not know your current IP Address, goto http://www.whatismyip.com/.

Launching an EC2 Image

You must start with a pre-defined image to launch, known as an Amazon Machine Image (AMI). Amazon provides a number of images as do many third parties. As this example launches a Ubuntu, we use the official AMIs listed at https://help.ubuntu.com/community/EC2StartersGuide

$ ec2-run-instances ami-baba68d3 --instance-type t1.micro --region us-east-1 --group db --key admin
RESERVATION	r-c4ee13a7	336142022409	db
INSTANCE	i-91ef87f5	ami-baba68d3			pending	admin	0		t1.micro	2012-03-16T21:40:47+0000	us-east-1c	aki-805ea7e9			monitoring-disabled					ebs		paravirtual	xen		sg-cb2ef3a3	default

You can check the start of your running instances with

$ ec2-describe-instances
RESERVATION	r-c4ee13a7	336142022409	db
INSTANCE	i-91ef87f5	ami-baba68d3	ec2-23-20-96-190.compute-1.amazonaws.com	domU-12-31-38-01-6A-F6.compute-1.internal	running	admin	0		t1.micro	2012-03-16T21:40:47+0000	us-east-1c	aki-805ea7e9	monitoring-disabled	23.20.96.190	10.253.109.8			ebs					paravirtual	xen		sg-cb2ef3a3	default
BLOCKDEVICE	/dev/sda1	vol-9bc893f7	2012-03-16T21:41:17.000Z	true

When an instance is ready it will show as “running”, and there will be an ec2-XXX-XXX-XXX-XXX.compute-1.amazonaws.com hostname to connect to.

$ ssh -i admin.pem ubuntu@ec2-23-20-96-190.compute-1.amazonaws.com
$ uname -a
$ free -m
$ df -h
$ exit

Removing an EC2 Instance

If the server you launched is not being used, this is costing you money (unless this is your only t1.micro instance on the free account). You can remove with

$ ec2-terminate-instances  i-91ef87f5
$ sleep 10
$ ec2-describe-instances
RESERVATION	r-c4ee13a7	336142022409	db
INSTANCE	i-91ef87f5	ami-a7f539ce			terminated	admin	0		t1.micro	2012-03-16T21:40:47+0000	us-east-1c	aki-805ea7e9			monitoring-disabled					ebs	paravirtual	xen		sg-cb2ef3a3	default

Conclusion

You have successfully configured and launched an EC2 AWS instance. You should now read up on the various Instance Types and also understand the use and benefits of the various regions and availability zones.

Setting up Amazon Web Services

ronald — Fri, 16 Mar 2012 18:47:00 +0000

This tutorial will help you register and get ready to use Amazon Web Service (AWS). AWS provides a free tier so it is possible to use these services at ZERO cost.

These instructions are used by the Effective MySQL: Backup and Recovery book examples.

Step 1: Registration

Goto AWS site
Register email address
Enter Login Credentials
Enter Contact Information
Enter Credit Card details (while this is required, provided you follow free guidelines you will not be charged)
Identity verification by Telephone
Activation of account

Screenshots

Step 2: Signin

Following the confirmation email that your AWS account has been activated you can signin for accounts details. While waiting you can perform Step 3 below.

Confirm access to services
Obtain Security Credentials
1. Access Key ID
2. Secret Access Key
3. X.509 Certificate (both cert and pk files)
4. AWS Account ID
5. Canonical User ID

Step 3: Install EC2 API tools

These tools provide a CLI access to AWS EC2 functionality. It is also possible to use the web-based GUI AWS Management Console.

$ mkdir -p $HOME/aws
$ cd $HOME/aws
$ curl --silent -o ec2-api-tools.zip http://s3.amazonaws.com/ec2-downloads/ec2-api-tools.zip
$ [ ! `type -p unzip` ] && sudo apt-get install -y unzip
$ unzip -q ec2-api-tools.zip
$ mkdir -p archive
$ mv ec2-api-tools.zip archive/
$ ln -s ec2-api-tools-* ec2
$ ls -l
$ export EC2_HOME=$HOME/aws/ec2
$ export PATH=$EC2_HOME/bin:$PATH
$ [ ! `type -p java` ] && sudo apt-get update && sudo apt-get install -y openjdk-6-jre-headless
$ java -version
# For Ubuntu
$ export JAVA_HOME=/usr/lib/jvm/java-6-openjdk/
# For Mac OSX Use
# export JAVA_HOME=/System/Library/Frameworks/JavaVM.framework/Home/
$ ec2ver

You should see something similar to the following.

1.5.2.5 2012-03-01

See http://docs.amazonwebservices.com/AWSEC2/latest/UserGuide/ for more information on the CLI tools.

Conclusion

You are now ready to start using Amazon Web Services.

MySQL Security Essentials

ronald — Wed, 15 Feb 2012 18:26:30 +0000

Download PDF Presentation

Default MySQL security sucks. There is no super user privilege protection, or tight filesystem security. What are the essentials for any initial MySQL installation? What is the minimum an Oracle DBA should understand and undertake for a neglected MySQL system? The MySQL privilege system provides several levels of data protection when implemented correctly, however this is rarely used. The most common user permission implementation creates several security and auditing risks? What are your MySQL user permissions, and how can developers exploit them? There are ways to secure communications within a MySQL topology, approaches to managing exposed public facing data collection via the BLACKHOLE storage engine, auditing plugin interfaces, and external authentication capabilities with PAM and LDAP for example.

This presentation provides an overview and checklist of the essentials needed to improve MySQL security and provide an understanding of managing various levels of risk.

Presenter: Ronald Bradford
Schedule: RMOUG Training Days 2012 February 2012 Denver, Colorado. Insight Out DB Showcase. October 2011 Tokyo, Japan

Better MySQL Security and Administration

ronald — Wed, 26 Oct 2011 00:12:24 +0000

Download PDF Presentation

With the recent cyber attacks and breaches with data from large organizations including Sony, is your MySQL data safe? What are the best practices for securing and administering your MySQL environment? In this presentation we will cover the essential steps for better MySQL security. We will also cover the different installation and administration tasks necessary to ensure your data is managed.

Presenter: Ronald Bradford
Schedule: Insight Out DB Showcase. October 2011 Tokyo, Japan

Successful Scalability Principles – Part 1

ronald — Sat, 08 Oct 2011 21:54:25 +0000

Download PDF
Presentation

Learn how the experts would design and architect a MySQL system to able to scale seamlessly. This presentation covers the necessary principles including:

System Architecture
Data Availability
Best Practices
Being proactive
Preparing for a disaster
Planning for success

Presenter: Ronald Bradford

You can view the video from SF MySQL Meetup – September 2010. View Meeting details and comments

Oracle Open World 2011 Presentations

ronald — Tue, 04 Oct 2011 16:50:16 +0000

MySQL Explain

Better Indexes

At Oracle Open World 2011 I gave two presentations.

You can download updated versions of Explaining the MySQL Explain and Improving Performance with Better Indexes presentations.

Want to know more, check out our Effective MySQL: Optimizing SQL Statements book that goes into great detail expanding on these presentations.

Looking for other MySQL presentations at Oracle Open World 2011. Check out

Backup and Recovery

ronald — Fri, 30 Sep 2011 17:48:27 +0000

The second book of the Effective MySQL series provides the reader with the tools, knowledge and tips necessary for a successful MySQL Backup and Recovery Schedule. Included in this book are examples of mysqldump, LVM snapshots, mylvmbackup, MySQL Enterprise Backup (MEB), Xtrabackup and mydumper. Advanced options including compression, incremental backups, partial backups and remote capabilities are discussed and examples provided with an example 5GB database.

Chapters

The Five Minute DBA – Download Sample Chapter (PDF)
Understanding Backup Options
Understanding Business Requirements
Using Replication
Understanding Recovery Options
MySQL Configuration Options
Disaster Scenarios
Optimizing Backup & Recovery
MySQL in the Cloud

All links in the book can be referenced in links.txt

Order Now

This title is available print, and ebook formats.
Kindle Version from Amazon & PDF version from McGraw-Hill.

Other Titles

See other titles in our series including:

Optimizing SQL Statements

ronald — Thu, 29 Sep 2011 17:00:42 +0000

The first book of the Effective MySQL series provides the reader with the tools, knowledge and tips necessary for optimizing SQL Statements in MySQL.

Written by Oracle ACE Director and MySQL expert Ronald Bradford, Effective MySQL: Optimizing SQL Statements is filled with detailed explanations and practical examples that can be applied immediately to improve database and application performances. Featuring a step-by-step approach to SQL optimization, this Oracle Press book helps you to analyze and tune problematic SQL statements.

Identify the essential analysis commands for gathering and diagnosing issues
Learn how different index theories are applied and represented in MySQL
Plan and execute informed SQL optimizations
Create MySQL indexes to improve query performance
much more…

Chapters

The Five Minute DBA – Code Examples – Download Sample Chapter (PDF)
The Essential Analysis Commands – Code Examples
Understanding MySQL Indexes – Code Examples
Creating Indexes – Code Examples
Creating Better Indexes – Code Examples
MySQL Configuration Options – Code Examples
The SQL Lifecycle – Code Examples
Hidden Performance Tips – Code Examples
Explaining the MySQL Explain – Code Examples

Buy Now

This title is available in print, and ebook formats from these retailers.

Get the Code

In addition to the individual chapter links provided above you can download all SQL examples via github with the following command.

$ git clone git://github.com/effectiveMySQL/OptimizingSQLStatements.git

Other Titles

See other titles in our series including:

Effective MySQL: Backup and Recovery
Effective MySQL: Advanced Replication Techniques

Next New York Meeting – Understanding Indexing

ronald — Thu, 22 Sep 2011 22:28:37 +0000

For our next meeting we have a guest speaker, Zardosht Kasheff, a frequent attendee at Effective MySQL. He will be talking about “Understanding Indexing”.

Registration Details

Event Date: Tuesday, October 11, 2011, 7:00 PM
Event Location: Hive at 55, 55 Broad Street, 13F,New York, NY 10004

We are switching to using EventBrite for registration. Please register at http://effectivemysql2011oct.eventbrite.com

The cost for event is $5 to cover the event space.

Agenda

7:00 Meet and Greet
7:15 Presentation
8:15 Q & A
8:30 Networking

Presentation Details

Indexes are used to improve query performance. As a result, good indexes are designed around queries that users find important in their application. This talk presents three simple and effective rules on how to construct indexes around queries that result in good performance.

The rules are explained using a simple model that does NOT rely on understanding B-Trees, Fractal trees, or any other data structure used to store the data on disk. They are derived from these simple properties:

point queries are slow
range queries are fast

Zardosht has been a senior member of Tokutek’s TokuDB engineering team since 2008. Leveraging Fractal Tree Indexing, TokuDB is a high performance storage engine for MySQL that is designed for write-intensive workloads

Reasons to use MySQL 5.5

ronald — Tue, 28 Jun 2011 21:04:08 +0000

Download PDF Presentation

Download Audio

There are a number of significant new features in MySQL 5.5 including semi-synchronous replication, SIGNAL and RESIGNAL, the PERFORMANCE_SCHEMA, additional STATUS variables, new partitioning options, different default storage engine, better UTF8 support and removal of deprecated functions just to list key considerations.

However some of the performance improvements are worth the investment of time. For a high concurrency InnoDB environment one new configuration alone can provide a 50% improvement in performance. Other settings can help in the reduction of downward spikes in performance due to internal InnoDB disk management. Some new configuration settings are off by default. See the actual benefits of these new features and what you should be using to maximize your database performance.

Presenter: Ronald Bradford
Schedule: Effective MySQL Meetup York. June 2011 New York

Improving Performance with Better Indexes

ronald — Mon, 30 May 2011 19:11:38 +0000

Download PDF Presentation

Learn how to use one simple advanced technique to make better MySQL indexes and improve your queries by 500% or more. Even with a highly indexed schema significant improvements in performance can be achieved by creating better indexes.

This presentation introduces the approach for correct identification and verification of problem SQL statements and then describes the means of identifying index choices for optimization. Then discussed is not only how to apply indexes to improve query performance, but how to apply better indexes and provide even greater performance gains.

This presentation includes:

6 steps to successful SQL review
Effective examples of capture SQL via application logging and TCP/IP analysis
All the commands necessary to identify why and how to create indexes
How the number of table rows and different storage engines can effect query performance
How to create an iterative verification process

Presenter: Ronald Bradford
Schedule:

May 2011 – Percona Live New Yorkin New York, NY.
February 2012 – RMOUG Training Day in Denver, CO.
July 2012 – Latin America MySQL/NoSQL/Cloud Conference in Buenos Aires, Argentina.

MySQL Best Practices for DBAs and Developers

ronald — Wed, 13 Apr 2011 13:08:16 +0000

Download PDF
Presentation Part I

Download PDF
Presentation Part 2

Learn the right techniques to maximize your investment in MySQL by knowing the best practices for DBAs and Developers. Learn what subtle differences between Oracle and MySQL are essential to understand in order to maximize the benefits of MySQL. We will be covering the ideal means for writing SQL statements, documenting your SQL, analyzing your SQL, MySQL software installation, configuration and maintenance best practices.

This new revised and expanded presentation now comes in 2 x 1 hr presentations.

Presenter: Ronald Bradford
Schedule: MySQL Users Conference 2011 – Santa Clara California.

Common MySQL Scalability Mistakes

ronald — Mon, 11 Apr 2011 14:00:49 +0000

Download PDF Presentation

The most common mistakes are easy to avoid however many startups continue to fall prey, with the impact including large re-design costs, delays in new feature releases, lower staff productivity and less then ideal ROI. All growing and successful sites need to achieve higher Availability, seamless Scalability and proven Resilience. Know the right MySQL environment to provide a suitable architecture and application design to support these essential needs.

The different types of accessible data (e.g. R/W, R, none)
What limits MySQL availability (e.g software upgrades, blocking statements, locking etc)
The three components of scalability – Read Scalability/Write Scalability/Caching
Design practices for increasing scalability and not physical resources
Disaster is inevitable. Having a tested and functional failover strategy
When other products are better (e.g. Static files, Session management via Key/Value store)
What a lack of accurate monitoring causes
What a lack of breakability testing causes
What does “No Downtime” mean to your organization
Implementing a successful “failed whale” approach with pre-emptive analysis
Identifying when MySQL is not your bottleneck

Presenter: Ronald Bradford
Schedule: IOUG Collaborate 11 – Orlando, Florida. OTN LA Tour – South America. Surge Scalability 2010 – Baltimore, Maryland.

Upcoming Conference Presentations for April 2011

ronald — Thu, 24 Mar 2011 17:12:07 +0000

Ronald Bradford will be presenting at two conferences in April, the O’Reilly MySQL Conference and the IOUG Collaborate 11 conference. His presentations include:

Monday April 11 at 3:45-4:45pm in Orlando, Florida – Common MySQL Scalability Mistakes
Wednesday April 13 at 2:00-3:00pm in Santa Clara, California – Best Practices for MySQL DBAs and Developers Part 1
Wednesday April 13 at 3:05-3:50pm in Santa Clara, California – Best Practices for MySQL DBAs and Developers Part 2
Wednesday April 13 at 7pm in Santa Clara, California – The Art of Good SQL Ignite Talk

In addition, our monthly New York Meeting will be:

Tuesday April 26th at 7pm – MySQL Idiosyncrasies That Bite. Please register at with the NY Meetup Group to attend. There will be no fee for this months presentation.

Better Indexes $ave You Money

ronald — Thu, 24 Mar 2011 16:30:49 +0000

Download PDF
Presentation

Can database performance improvements be achieved with zero code changes? Learn how to use one simple advanced technique to make better MySQL indexes and improve your queries by 500% or more. Even with a highly indexed schema as shown in our 10 table join example, significant improvements in performance can be achieved.

This presentation includes:

6 steps to successful SQL review
Basic ways via application logging and TCP/IP analysis to capture SQL
All the commands necessary to identify why and how to create indexes
How the number of table rows and different storage engines can effect query performance
How to create an iterative verification process

Adding indexes is not the only approach nor the best approach to query optimization however learning how MySQL indexes work can provide quick improvements without the need to deploy code changes.

Presenter: Ronald Bradford
Schedule: Tuesday, March 22, 2011 in New York

Effective MySQL

Understanding Tokutek Fractal Tree Indexes

New MySQL 5.6 Replication Features

MySQL 5.6 features for NoSQL, Big Data and the Cloud

Secrets of mysqlnd Presentation

Our Effective MySQL Books

Lessons learned managing large AWS Environments

Managing 500+ MySQL servers in the AWS cloud

Replication Techniques in depth

Chapters

Order Now

Other Titles

Related Presentations

MySQL Disasters, and how to avoid yours

MySQL Backup & Recovery Essentials

LAMP Performance Optimizations – Volume 1

Setting up Google Cloud SQL

Setting up AWS RDS

Pre-requisites

Installation

Configuration

Verification

Creating a new instance

Terminating

MySQL Idiosyncrasies That Bite

Explaining the MySQL EXPLAIN

Using Amazon Web Services

Necessary Access Controls

Launching an EC2 Image

Removing an EC2 Instance

Conclusion

Setting up Amazon Web Services

Step 1: Registration

Screenshots

Step 2: Signin

Step 3: Install EC2 API tools

Conclusion

MySQL Security Essentials

Better MySQL Security and Administration

Successful Scalability Principles – Part 1

Oracle Open World 2011 Presentations

Backup and Recovery

Chapters

Order Now

Related Articles

Other Titles

Related Presentations

Optimizing SQL Statements

Chapters

Buy Now

Get the Code

Other Titles

Related Presentations

Next New York Meeting – Understanding Indexing

Registration Details

Agenda

Presentation Details

Reasons to use MySQL 5.5

Improving Performance with Better Indexes

MySQL Best Practices for DBAs and Developers

Common MySQL Scalability Mistakes

Upcoming Conference Presentations for April 2011

Better Indexes $ave You Money