1. 25 Feb, 2022 11 commits
  2. 24 Feb, 2022 4 commits
  3. 23 Feb, 2022 8 commits
    • Marko Mäkelä's avatar
      Merge 10.5 into 10.6 · 164a6aa4
      Marko Mäkelä authored
      164a6aa4
    • Marko Mäkelä's avatar
      Extend have_sanitizer with ASAN+UBSAN and MSAN · b91a123d
      Marko Mäkelä authored
      Disable some tests that are too slow or big for MSAN.
      b91a123d
    • Marko Mäkelä's avatar
      Merge 10.4 into 10.5 · 23368b76
      Marko Mäkelä authored
      23368b76
    • Julius Goryavsky's avatar
      MDEV-26377: Stricter validation of ssl-mode values · a3da3c8a
      Julius Goryavsky authored
      This commit adds validation of the values of the ssl-mode parameter
      in SSL scripts, since now only a basic check for the presence of the
      "VERIFY_" prefix is performed there to detect "VERIFY_IDENTITY" and
      "VERIFY_CA", but all other values are not checked at all.
      
      In addition, this commit removes leading and trailing spaces from
      parameter values that SST scripts read from configuration files or
      from the command line so that they do not interfere with parameter
      checks and substitutions. Parameter substitution has been made more
      robust against characters in strings that the shell might erroneously
      interpret as regexp.
      a3da3c8a
    • Marko Mäkelä's avatar
      MDEV-27798 SIGSEGV in dict_index_t::reconstruct_fields() · 46764652
      Marko Mäkelä authored
      When recovery is rolling back an incomplete instant DROP COLUMN
      operation, it may access non-existing fields. Let us avoid
      invoking std::find_if() outside the valid bounds of the array.
      
      This bug was reproduced with the Random Query Generator, using a
      combination of instant DROP, ADD...FIRST, CHANGE (renaming a column).
      Unfortunately, we were unable to create an mtr test case for
      reproducing this, despite spending considerable effort on it.
      46764652
    • Marko Mäkelä's avatar
      MDEV-27924 page_zip_copy_recs() corrupts ROW_FORMAT=COMPRESSED block descriptor · d3e06dbb
      Marko Mäkelä authored
      In commit aaef2e1d (MDEV-27058)
      we failed to introduce a special copy constructor that would
      preserve the "page_zip_des_t::fix" field that only exists there
      in order to avoid alignment loss on 64-bit systems.
      
      page_zip_copy_recs(): Invoke the special copy constructor.
      
      The block descriptor corruption causes assertion failures when
      running ./mtr --suite=innodb_zip while InnoDB has been built
      with UNIV_ZIP_COPY. Normally, calls to page_zip_copy_recs()
      occur very rarely on page splits.
      d3e06dbb
    • Marko Mäkelä's avatar
      WSREP: Fix GCC 12.0.1 -Wuninitialized · 0b849a44
      Marko Mäkelä authored
      GCC 12 complains if a reference to an uninitialized object is
      being passed to a constructor. The mysql_mutex_t, mysql_cond_t
      would be initialized in the constructor body, which is executed
      after the initializer list. There is no problem passing a pointer
      instead of a reference. The wrapper classes do not dereference
      the pointers in the constructor or destructor, so there does not
      appear to be any correctness issue.
      0b849a44
    • Marko Mäkelä's avatar
      MDEV-23888 fixup: GCC 12 -Wunused-value · 8b7abe21
      Marko Mäkelä authored
      8b7abe21
  4. 22 Feb, 2022 8 commits
    • Sergei Golubchik's avatar
      MDEV-27826 Mariabackup is linked against libsql_builtins.so dynamically · b5fe7ab8
      Sergei Golubchik authored
      build sql_builtins always statically
      b5fe7ab8
    • Marko Mäkelä's avatar
      Merge 10.5 into 10.6 · 92f79a22
      Marko Mäkelä authored
      92f79a22
    • Julius Goryavsky's avatar
      MDEV-27777: Some Galera tests fail on FreeBSD · fac9224d
      Julius Goryavsky authored
      This commit fixes problems due to bugs and quirks in bsdtar
      (the FreeBSD version of tar). Separate tests are not required,
      because without these fixes, many other tests fail when tested
      in the FreeBSD environment.
      
      Also, the grep patterns for reading utility version numbers
      has been made more robust. The notation of some options of
      the "cut" utility has been changed.
      fac9224d
    • Julius Goryavsky's avatar
      MDEV-27524: Incorrect binlogs after Galera SST using rsync and mariabackup · 17e0f522
      Julius Goryavsky authored
      This commit adds correct handling of binlogs for SST using rsync
      or mariabackup. Before this fix, binlogs were handled incorrectly -
      - only one (last) binary log file was transferred during SST, which
      then led to various failures (for example, when trying to list all
      events from the binary log). These bugs were long masked by flaws
      in the primitive binlogs handling code in the SST scripts, which
      causing binary logs files to be erased after transfer or not added
      to the binlog index on the joiner node. Now the correct transfer
      of all binary logs (not just the last of the binary log files) has
      been implemented both for the rsync (at the script level) and for
      the mariabackup (at the level of the main utility code).
      
      This commit also adds a new sst_max_binlogs=<n> parameter, which
      can be located in the [sst] section or in the [xtrabackup] section
      (historically, supported for mariabackup only, not for rsync), or
      in one of the server sections. This parameter specifies the number
      of binary log files to be sent to the joiner node during SST. This
      option is added for compatibility with old SST scripting behavior,
      which can be emulated by setting the sst_max_binlogs=1 (although
      in general this can cause problems for the reasons described above).
      In addition, setting the sst_max_binlogs=0 can be used to suppress
      the transmission of binary logs to the joiner nodes during SST
      (although sometimes a single file with the current binary log can
      still be transmitted to the joiner, even with sst_max_binlogs=0,
      because this sometimes necessary in modes that involve the use of
      GTIDs with Galera).
      
      Also, this commit ensures correct handling of paths to various
      innodb files and directories in the SST scripts, and fixes some
      problems with this that existed in mariabackup utility (which
      were associated with incorrect handling of the innodb_data_dir
      parameter in some scenarios).
      
      In addition, this commit contains the following enhancements:
      
       1) Added tests for mtr, which check the correct work with binlogs
          after SST (using rsync and mariabackup);
       2) Added correct handling of slashes at the end of all paths that
          the SST script receives as parameters;
       3) Improved parsing code for --mysqld-args parameters. Now it
          correctly processes the sequence "--" after the name of the
          one-letter option;
       4) Checking the secret signature during joiner authentication
          is made independent of presence of bash (as a unix shell)
          in the system and diff utility no longer needed to check
          certificates compliance;
       5) All directories that are necessary for the correct placement
          of various logs are automatically created by SST scripts in
          advance (before running mariabackup on the joiner node);
       6) Removal of old binary logs on joiner is done using the binlog
          index (if it exists) (not only by fixed pattern that based
          on the current binlog name, as before);
       7) Paths for placing binary logs are correctly processed if they
          are set as relative paths (to the datadir);
       8) SST scripts are made even more resistant to spaces in filenames
          (now for binlogs);
       9) In case of failure, SST scripts now always end with an exit
          code other than zero;
      10) SST script for rsync now correctly create a tar file with
          the binlogs, even if the paths to them (in the binlog index
          file) are specified as a mix of absolute and relative paths,
          and even if they do not match with the datadir path specified
          in the current configuration settings.
      17e0f522
    • Julius Goryavsky's avatar
    • Julius Goryavsky's avatar
      MDEV-27534: mariabackup: missing line in the compress_qpress.result · c753b3f6
      Julius Goryavsky authored
      This commit adds the missing line to the .result file for compress_qpress
      (in the mariabackup test suite).
      c753b3f6
    • Vlad Lesin's avatar
      Merge 10.4 into 10.5 · a112a80b
      Vlad Lesin authored
      a112a80b
    • Varun Gupta's avatar
      MDEV-15208: server crashed, when using ORDER BY with window function and UNION · 647e9523
      Varun Gupta authored
      (Edits by SergeiP: fix encryption.tempfiles_encrypted, re-word comment)
      
      Global ORDER BY clause of a UNION may not refer to 1) aggregate functions
      or 2) window functions.  setup_order() checked for #1 but not for #2.
      647e9523
  5. 21 Feb, 2022 7 commits
    • Haidong Ji's avatar
      MDEV-27394 added memset to zero out addr.un.sun_path string · 120480d1
      Haidong Ji authored
      If this char[] is not zeroed out, inaccurate log message described in
      MDEV-27394 will show up.
      120480d1
    • Varun Gupta's avatar
      MDEV-15208: server crashed, when using ORDER BY with window function and UNION · 942a9791
      Varun Gupta authored
      SELECTs inside a UNION can have window function but not the global ORDER BY clause of the UNION.
      942a9791
    • Sergei Petrunia's avatar
      MDEV-22377: Subquery in an UPDATE query uses full scan instead of range · d140d276
      Sergei Petrunia authored
      [Patch idea by Igor Babaev]
      
      Symptom: for IN (SELECT ...) subqueries using IN-to-EXISTS transformation,
      the optimizer was unable to make inferences using multiple equalities.
      
      The cause is code Item_in_subselect::inject_in_to_exists_cond() which may
      break invariants that Multiple-Equality code relies on. In particular, it
      may produce a WHERE condition with an empty Item_cond::m_cond_equal.
      
      Fixed this by making Item_cond::m_cond_equal.
      d140d276
    • Vlad Lesin's avatar
      Merge 10.3 into 10.4 · f6f055a1
      Vlad Lesin authored
      f6f055a1
    • Vlad Lesin's avatar
      MDEV-20605 Awaken transaction can miss inserted by other transaction records... · a6f258e4
      Vlad Lesin authored
      MDEV-20605 Awaken transaction can miss inserted by other transaction records due to wrong persistent cursor restoration
      
      Backported from 10.5 20e9e804 and
      5948d760.
      
      sel_restore_position_for_mysql() moves forward persistent cursor
      position after btr_pcur_restore_position() call if cursor relative position
      is BTR_PCUR_ON and the cursor points to the record with NOT the same field
      values as in a stored record(and some other not important for this case
      conditions).
      
      It was done because btr_pcur_restore_position() sets
      page_cur_mode_t mode  to PAGE_CUR_LE for cursor->rel_pos ==  BTR_PCUR_ON
      before opening cursor. So we are searching for the record less or equal
      to stored one. And if the found record is not equal to stored one, then
      it is less and we need to move cursor forward.
      
      But there can be a situation when the stored record was purged, but the
      new one with the same key but different value was inserted while
      row_search_mvcc() was suspended. In this case, when the thread is
      awaken, it will invoke sel_restore_position_for_mysql(), which, in turns,
      invoke btr_pcur_restore_position(), which will return false because found
      record don't match stored record, and
      sel_restore_position_for_mysql() will move forward cursor position.
      
      The above can lead to the case when awaken row_search_mvcc() do not see
      records inserted by other transactions while it slept. The mtr test case
      shows the example how it can be.
      
      The fix is to return special value from persistent cursor restoring
      function which would notify its caller that uniq fields of restored
      record and stored record are the same, and in this case
      sel_restore_position_for_mysql() don't move cursor forward.
      
      Delete-marked records are correctly processed in row_search_mvcc().
      Non-unique secondary indexes are "uniquified" by adding the PK, the
      index->n_uniq should then be index->n_fields. So there is no need in
      additional checks in the fix.
      
      If transaction's readview can't see the changes made in secondary index
      record, it requests clustered index record in row_search_mvcc() to check
      its transaction id and get the correspondent record version. After this
      row_search_mvcc() commits mtr to preserve clustered index latching
      order, and starts mtr. Between those mtr commit and start secondary
      index pages are unlatched, and purge has the ability to remove stored in
      the cursor record, what causes rows duplication in result set for
      non-locking reads, as cursor position is restored to the previously
      visited record.
      
      To solve this the changes are just switched off for non-locking reads,
      it's quite simple solution, besides the changes don't make sense for
      non-locking reads.
      
      The more complex and effective from performance perspective solution is
      to create mtr savepoint before clustered record requesting and rolling
      back to that savepoint after that. See MDEV-27557.
      
      One more solution is to have per-record transaction id for secondary
      indexes. See MDEV-17598.
      
      If any of those is implemented, just remove select_lock_type argument in
      sel_restore_position_for_mysql().
      a6f258e4
    • Marko Mäkelä's avatar
      MDEV-27550: Disable galera.MW-328D · b9ee26e9
      Marko Mäkelä authored
      (cherry picked from commit 66465914)
      b9ee26e9
    • Vlad Lesin's avatar
      MDEV-27025 insert-intention lock conflicts with waiting ORDINARY lock · 5f001bd7
      Vlad Lesin authored
      The code was backported from 10.5 be811386
      commit. See that commit message for details.
      5f001bd7
  6. 20 Feb, 2022 1 commit
  7. 18 Feb, 2022 1 commit
    • Marko Mäkelä's avatar
      MDEV-26645: Fix UB in Item_func_plus and Item_func_minus · b69191bb
      Marko Mäkelä authored
      An integer overflow in an expression like a+b or a-b is undefined behavior.
      The compiler is allowed to assume that no such overflow is possible,
      and optimize away some code accordingly.
      
      Item_func_plus::int_op(), Item_func_minus::int_op(): Always check
      for overflow.
      
      Depending on the compiler and the compilation options, a test might fail:
      
      CURRENT_TEST: main.func_math
      mysqltest: At line 425: query 'SELECT 9223372036854775807 + 9223372036854775807' succeeded - should have failed with errno 1690...
      
      A similar bug had been fixed earlier in
      commit 328edf85.
      b69191bb