I have noticed a lot of queries of SproutSearch's main database table are getting slow as SproutSearch passes 8 million indexed blogs. I finally decided to do something about it after trying to add alter this table. I attempted to add a column that keeps track of the date and time of each blog's most recent post. The alter table command ran for at least 8 hours, and then MySQL either crashed or the admins killed my process. I attempted this a second time without making a new index, which also failed. I figured I would just create a new table with the extra column and write a program to slowly copy everything over. The first version of this PHP program queried 10,000 rows of data from the old table and inserted them one by one into the new table. I set up a cron job to run this every 10 minutes. Once the new table started getting big, the cron jobs were overlapping, some records were not copied, and copy processes started backing up. It dawned on me that I'd better learn something about MySQL optimization. I read some online articles and decided to try using mysqli_multi_query to copy the records. That would reduce the network overhead. The program ran several times faster but I wanted to look into other methods. I tried using prepared statements, which wasn't much better. I found this excellent article (http://www.informit.com/articles/article.asp?p=377652&seqNum=4&rl=1) which said if I use the insert format like: insert into table (column1, column2) values(val1, val2), (val1, val2)... MySQL wouldn't have to flush the index after every insert. I made my program create a giant insert statement in this format. I tried it out and it only took a few seconds when the new table was empty. I modified the program to run 10 batches of 10,000 records, which would take a few minutes. This program has been running for a few days, and all my data is finally in the new table. I am still having problems with the table being locked during lengthy select statements. It causes certain pages to hang for a long time. I am now copying all the data from a MYISAM table to a INNODB table because it has row level locking.

Convert MySQL databases to rss feeds using SQL2RSS.

SQL2RSS

In this episode, Deepthi Sigireddi of the Cloud Native Computing Foundation (CNCF) spoke with SE Radio host Nikhil Krishna about how Vitess scales MySQL. They discuss the design and architecture of the product; how Vitess impacts modern data problems;...

some useful tests and data that help to validate a lot of what we already do at craigslist

A conversation with both MySQL community managers on the latest in the community and the technology

In this conversation I talk with both MySQL community managers, David Stokes from Texas and Frédéric Descamps from Belgium.

I met both of them in Brussels in February 2020 during the preFOSDEM 2020 MySQL Days. This is where the MySQL community comes together for two days of intensive technical sessions before going to the premier European open source conference — FOSDEM (Free and Open Source Software Developers' European Meeting). Yes, there's that much content to deal with so you need a conference before the conference!

Before the pandemic, Oracle used to send many engineers from various open source projects at the company to FOSDEM to participate in the event and to engage the other 20K developers from around the world there. And the MySQL team at Oracle was always a big part of the conference. 

Now in mid 2021 tech conferences still haven't really started up again, so development and community building takes place virtually. That's where I pick up the conversation with David and Frédéric.

MySQL technology is hot these days. There is a new release out recently with many fixes and enhancements, but even before that the project released a new feature called HeatWave. That's a real-time analytics MySQL Database Service in Oracle Cloud Infrastructure (OCI). It's easily enabled and disabled on demand with no application changes and can result in performance improvements of about 400 times. And it's only found in OCI. David and Frédéric said the early customer and developer reaction to the technology has been "staggering and eye popping." But in the conversation the guys also talked about more bits in MySQL, such as high availability, clustering, the shell, and the Kubernetes operator. 

We also explored some of the dynamics going on in the MySQL community, such as the steep learning curves that all developers have to deal with these days due to the ever increasing rate of change in software development. Some of the younger developers are discovering that some of the tools and techniques that were considered "old" are coming back because, well, they just work. On the other hand, younger developers seem to tolerate better all the exclusively virtual events these days than some of the older developers. So, there are multiple simultaneous trends taking place, just as there is in any aspect of life. So Frédéric and David have a good sense of the community and hope that when live events return they can bring together the older developers with all the new developers so the community can gel again in physical experiences.

And finally, they both said that in another six months there will be some really cool technology coming out. They wouldn't say more about that. But I'd take their word on that tease, though. The last time they told me that some cool stuff was coming they released HeatWave shortly thereafter.

Video on YouTube
https://youtu.be/T3TK23THWKw 

David Stokes is a MySQL Community Manager in Texas.
https://twitter.com/stoker

Frédéric Descamps is a MySQL community Manager in Belgium.
https://twitter.com/lefred

Jim Grisanzio is a Sr. Community Manager in Oracle Developer Relations
https://twitter.com/jimgris

MySQL Community
https://dev.mysql.com/

Announcing July 2021 Releases featuring MySQL 8.0.26
https://blogs.oracle.com/mysql/announcing-july-2021-releases-featuring-mysql-8026

HeatWave
https://www.oracle.com/mysql/heatwave/

MySQL Database Service—New HeatWave Innovations
https://www.oracle.com/events/live/mysql-heatwave-innovations/

Frédéric Descamps Previews Oracle Developer Live — MySQL | October 2020
https://youtu.be/6i1WreKco9E

Dave Stokes and Frederic Descamps on Contributing to the MySQL Project | June 2020
https://youtu.be/NUU4W8O3teE

preFOSDEM 2020 MySQL Days | February 2020
https://www.youtube.com/playlist?list=PLwfImoydiSsuHfrVWcq8qJ_cz8o6vuoRo

Cheers
Jim
--
Jim Grisanzio, Sr. Community Manager, Oracle Developer Relations
https://twitter.com/jimgris

For data that is being loaded from a SAS Stored Process Server, an insertion process might fail to a MySQL database with a warning, as well as an error message that says "During insert: Incorrect datetime value…"

MySQL Lite Administrator version Beta 1 suffers from multiple cross site scripting vulnerabilities.

JSPMySQL Administrador version 1 suffers from cross site request forgery and cross site scripting vulnerabilities.

Are you using MySQL’s utf8 charset in your databases? In this write-up I’ll explain why you should switch to utf8mb4 instead, and how to do it.

#architektura #architekt #dom #design

#architektura #architekt #dom #design

oscon: High Availability in MySQL - how to pick a solution that best matches your use case http://t.co/PItdw0maTj @h_ingo #oscon #tutorial

Tiny MySQL suffers from a cross site scripting vulnerability.

MySQL G0ld is a program that issues brute force attacks against a MySQL Server using a supplied wordlist.

Stokes, David, author

See how to define a simple table using MySQL’s allowed data types and other properties and learn how to interact with the MySQL server using two different client applications.

Online Resource