1. 24 Jan, 2018 13 commits
    • Vicențiu Ciorbaru's avatar
      Remove xtradb "fragmentation-statistics" patches · 12c42bd2
      Vicențiu Ciorbaru authored
      The patches are implemented using server changes in THD. We are not
      interested in having special code for certain storage engines, if
      possible.
      12c42bd2
    • Vicențiu Ciorbaru's avatar
      a82bb5d3
    • Vicențiu Ciorbaru's avatar
      3699a4b5
    • Vicențiu Ciorbaru's avatar
      Remove innodb.test "keep away" comment · d69d488b
      Vicențiu Ciorbaru authored
      This was a leftover post 5.5->10.0 merge. It should've been deleted
      there.
      d69d488b
    • Vicențiu Ciorbaru's avatar
      Update Tokudb Test Results · d81e41e7
      Vicențiu Ciorbaru authored
      d81e41e7
    • Vicențiu Ciorbaru's avatar
      Make TokuDB run on 10.0 · fc3df561
      Vicențiu Ciorbaru authored
      fc3df561
    • Vicențiu Ciorbaru's avatar
      c5f333ad
    • Vicențiu Ciorbaru's avatar
      Squashed commit of connect/10.0: · 1e88e855
      Vicențiu Ciorbaru authored
      Main additions:
      
      commit 543c2006a70983c2ce75024bce3679b0c20f9ae6
      Author: Olivier Bertrand <bertrandop@gmail.com>
      Date:   Thu Jan 4 13:51:13 2018 +0100
      
          - Fix MDEV-9844, MDEV-10179, MDEV-14214
           This is done by removing the tbl table type THREAD option
           that causes a multiple of sporadic bugs.
           This may be temporary depending on whether a real fix is found.
            modified:   storage/connect/mysql-test/connect/disabled.def
            modified:   storage/connect/tabtbl.cpp
            modified:   storage/connect/tabtbl.h
      
      commit 54bc4ea024ca5fb5c137c618084d8cccfba2ee3f
      Author: Olivier Bertrand <bertrandop@gmail.com>
      Date:   Fri Nov 3 16:21:56 2017 +0100
      
          - Fix MDEV-13925: Actually this fixes SELECT queries when
            the WHERE clause have single quote.
            modified:   storage/connect/ha_connect.cc
      
          - Use Windows VirtualAlloc and VirtualFree for the Sarea workspace
            modified:   storage/connect/global.h
            modified:   storage/connect/ha_connect.cc
            modified:   storage/connect/jsonudf.cpp
            modified:   storage/connect/plgdbutl.cpp
            modified:   storage/connect/plugutil.cpp
            modified:   storage/connect/user_connect.cc
      
          - Change inihandl from c to c++.
            Because it now includes global.h that contains a bool function definition
            that make compile to fail on Linux.
            modified:   storage/connect/CMakeLists.txt
            removed:    storage/connect/inihandl.c
            added:      storage/connect/inihandl.cpp
      
          - Fix MDEV-13860 CONNECT engine does not build with JDBC without ODBC.
            By including Sergei's patch in connect_assisted_discovery.
            modified:   storage/connect/ha_connect.cc
      
      commit c07064d31a4d7ee0533fec144648d93873c0dd17
      Author: Olivier Bertrand <bertrandop@gmail.com>
      Date:   Wed Oct 18 00:11:00 2017 +0200
      
          - Update version number
            modified:   storage/connect/ha_connect.cc
      
          - Include MONGO in all Java enabled distributions
            Mongo will be enabled only for 10.2 and 10.3
            modified:   storage/connect/CMakeLists.txt
      
          - Change JDBC_SUPPORT to JAVA_SUPPORT which also replaces MONGO_SUPPORT
            MONGO_SUPPORT is now just used to enable the MONGO table type
            modified:   storage/connect/filter.cpp
            modified:   storage/connect/ha_connect.cc
            modified:   storage/connect/ha_connect.h
            modified:   storage/connect/mongo.cpp
            modified:   storage/connect/mycat.cc
            modified:   storage/connect/plgdbutl.cpp
            modified:   storage/connect/tabjson.cpp
            modified:   storage/connect/tabjson.h
      
          - Move MakeSelector function from FILTER to mongo.cpp
            modified:   storage/connect/filter.cpp
            modified:   storage/connect/filter.h
            modified:   storage/connect/cmgoconn.cpp
            modified:   storage/connect/jmgoconn.cpp
            modified:   storage/connect/mongo.cpp
      
          - Do mongo_init only on first use of the MongoDB C Driver
            This will permit to delay load the mongo lib on Windows
            modified:   storage/connect/cmgoconn.cpp
            modified:   storage/connect/cmgoconn.h
            modified:   storage/connect/ha_connect.cc
      
          - Replace NEW_VAR by a test on MYSQL_VERSION_ID
            modified:   storage/connect/ha_connect.cc
      
          - Suppress enable_mongo session variable
            modified:   storage/connect/ha_connect.cc
            modified:   storage/connect/mycat.cc
      
          - Make some function headers identical in .h and .cc file
            (replacing const char* by PCSZ)
            modified:   storage/connect/ha_connect.cc
            modified:   storage/connect/ha_connect.h
      
          - Change a parameter type from uchar* to const uchar*
            (for ScanRecord and CheckRecord)
            modified:   storage/connect/ha_connect.cc
            modified:   storage/connect/ha_connect.h
      
          - Changes on LIKE and NOT LIKE does not fix a bug yet
            modified:   storage/connect/ha_connect.cc
      
          - Suppress PIVOT_SUPPORT (PIVOT type is unconditionnal)
            modified:   storage/connect/ha_connect.cc
            modified:   storage/connect/mycat.cc
      
          - Change the strz function from inline to static
            modified:   storage/connect/ha_connect.cc
            modified:   storage/connect/ha_connect.h
      
          - export the JavaConn class and the MgoColumns and IsNum functions
            modified:   storage/connect/javaconn.h
            modified:   storage/connect/json.h
            modified:   storage/connect/mongo.h
      
          - Fix MDEV-13924
            modified:   storage/connect/jdbconn.cpp
      
          - Make a temporary fix for the compiler bug in CalculateArray
            modified:   storage/connect/jsonudf.cpp
            modified:   storage/connect/tabjson.cpp
      
          - Typo
            modified:   storage/connect/jdbccat.h
            modified:   storage/connect/reldef.h
            modified:   storage/connect/tabext.h
            modified:   storage/connect/tabjmg.cpp
            modified:   storage/connect/tabxml.h
            modified:   storage/connect/valblk.h
            modified:   storage/connect/value.h
            modified:   storage/connect/xtable.h
      
          - Fix a bug in MONGO tests by changing 'MONGO' to $TYPE
            modified:   storage/connect/mysql-test/connect/t/mongo_test.inc
      
          - Record test results to reflect all changes
            modified:   storage/connect/mysql-test/connect/r/json_java_2.result
            modified:   storage/connect/mysql-test/connect/r/json_java_3.result
            modified:   storage/connect/mysql-test/connect/r/json_mongo_c.result
            modified:   storage/connect/mysql-test/connect/r/mongo_c.result
            modified:   storage/connect/mysql-test/connect/r/mongo_java_2.result
            modified:   storage/connect/mysql-test/connect/r/mongo_java_3.result
      
      commit 3da90fd112e7d5ee6f0bd9c3fc3eeb4529b30e93
      Author: Olivier Bertrand <bertrandop@gmail.com>
      Date:   Wed Oct 11 12:21:56 2017 +0200
      
          Fix MDEV-13924 modified: storage/connect/jdbconn.cpp
      
      commit 2566e67da80f291414f02c7dd6a8ca3557161d26
      Author: Olivier Bertrand <bertrandop@gmail.com>
      Date:   Mon Sep 11 16:38:41 2017 +0200
      
          Enable MONGO for the C driver. Modified: modified:   storage/connect/CMakeLists.txt
      
      commit 27ae11db830c5d62bbf8b8b13cab976b74efe7dd
      Author: Olivier Bertrand <bertrandop@gmail.com>
      Date:   Tue Sep 5 19:52:04 2017 +0200
      
          - Update version number
            modified:   storage/connect/ha_connect.cc
      
          - Regard columns with binary charset as string (was binary)
            modified:   storage/connect/ha_connect.cc
            modified:   storage/connect/tabmysql.cpp
            modified:   storage/connect/tabutil.cpp
      
          - Support length 0 for CHAR and VARCHAR
            modified:   storage/connect/ha_connect.cc
            modified:   storage/connect/reldef.cpp
            modified:   storage/connect/value.cpp
      
          - Add ACCEPT option for void columns in discovery
            modified:   storage/connect/tabjson.cpp
      
          - Update some tests because of above change
            modified:   storage/connect/mysql-test/connect/r/json_java_2.result
            modified:   storage/connect/mysql-test/connect/r/json_java_3.result
            modified:   storage/connect/mysql-test/connect/r/json_mongo_c.result
            modified:   storage/connect/mysql-test/connect/r/mongo_c.result
            modified:   storage/connect/mysql-test/connect/r/mongo_java_2.result
            modified:   storage/connect/mysql-test/connect/r/mongo_java_3.result
            modified:   storage/connect/mysql-test/connect/r/odbc_oracle.result
            modified:   storage/connect/mysql-test/connect/r/updelx.result
            modified:   storage/connect/mysql-test/connect/t/mongo_test.inc
      
      commit f6ee6cd1d42d861fa50fea8d9a7079347b7ddfd6
      Author: Olivier Bertrand <bertrandop@gmail.com>
      Date:   Sat Sep 2 16:06:10 2017 +0200
      
          - Fix MongoDB C Driver adding for CMAKE.
            Requires MongoDB C Driver version 1.7 now available
            modified:   storage/connect/CMakeLists.txt
      
          - Add more trace to tbl_thread.test (to debug failure)
            modified:   storage/connect/mysql-test/connect/r/tbl_thread.result
            modified:   storage/connect/mysql-test/connect/t/tbl_thread.test
      1e88e855
    • Vicențiu Ciorbaru's avatar
      Fix Innodb ASAN error on init · b20f821e
      Vicențiu Ciorbaru authored
      Backport 7c03edf2 from xtradb to innodb
      b20f821e
    • Vicențiu Ciorbaru's avatar
      d833bb65
    • Oleksandr Byelkin's avatar
      typo fix · 76577e1e
      Oleksandr Byelkin authored
      76577e1e
    • Sergei Golubchik's avatar
      MDEV-13187 incorrect backslash parsing in clients · e2da680c
      Sergei Golubchik authored
      also cover USE and other built-in commands
      e2da680c
    • Ian Gilfillan's avatar
      Update sponsors · e431d900
      Ian Gilfillan authored
      e431d900
  2. 23 Jan, 2018 17 commits
    • Monty's avatar
      MDEV-14245 tokudb_alter_table.drop_add_pk_part_104 fails · d0acfa45
      Monty authored
      "tokudb_alter_table.drop_add_pk_part_104 leaves a temporary file behind"
      
      Fixed by copying 3 lines from 10.1 to 10.0 that cleaned up the temporary
      file for partitioning tables.
      d0acfa45
    • Monty's avatar
      Fixed a few compiler warnings · d5d0c624
      Monty authored
      d5d0c624
    • Monty's avatar
      Fix for MDEV-14141 Crash in print_keydup_error() · b3c7cf81
      Monty authored
      May also fix: MDEV-14970 "MariaDB crashed with signal 11 and Aria table"
      
      I am not able to reproduce a crash, however there was no protection in
      print_keydup_error() if the storage engine reported the wrong key number.
      
      This patch adds such a protection and should stop any further crashes
      in this case.
      
      Other things:
      - Added extra protection in Aria to not set errkey to more than number of
        keys. (Don't think this is cause of this crash, but better safe than
        sorry)
      - Extend test_if_equal_repl_errors() to handle different cases of
        ER_DUP_ENTRY. This is just mainly precaution for the future.
      b3c7cf81
    • Marko Mäkelä's avatar
      Add ASAN instrumentation (and more strict Valgrind) to InnoDB · 8637931f
      Marko Mäkelä authored
      mem_heap_free_heap_top(): Remove UNIV_MEM_ASSERT_W() and unpoison
      the memory region first, because part of it may have been poisoned
      by an earlier mem_heap_free_top() call.
      Poison the address range at the end.
      
      mem_heap_block_free(): Poison the address range at the end.
      
      UNIV_MEM_ASSERT_AND_ALLOC(): Replace with UNIV_MEM_ALLOC().
      We want to keep the address ranges poisoned (unaccessible) as
      long as possible.
      
      UNIV_MEM_ASSERT_AND_FREE(): Replace with UNIV_MEM_FREE().
      8637931f
    • Vicențiu Ciorbaru's avatar
      5.6.38-83.0 · f6716cef
      Vicențiu Ciorbaru authored
      f6716cef
    • Marko Mäkelä's avatar
      Silence -Wimplicit-fallthrough · 70a9b12d
      Marko Mäkelä authored
      70a9b12d
    • Vicențiu Ciorbaru's avatar
      5.6.38-83.0 · cd33250d
      Vicențiu Ciorbaru authored
      cd33250d
    • Vicențiu Ciorbaru's avatar
      5.6.39 · 3dfe1480
      Vicențiu Ciorbaru authored
      3dfe1480
    • Oleksandr Byelkin's avatar
      MDEV-14786: Server crashes in Item_cond::transform on 2nd execution of SP querying from a view · ba8d0fa7
      Oleksandr Byelkin authored
      MDEV-14957: JOIN::prepare gets unusable "conds" as argument
      
      Do not touch merged derived (it is irreversible)
      
      Fix first argument of in_optimizer for calls possible before fix_fields()
      ba8d0fa7
    • Oleksandr Byelkin's avatar
      11408a69
    • Oleksandr Byelkin's avatar
      MDEV-7533: COLUMN_JSON() doesn't escape control characters in string values · a4663af0
      Oleksandr Byelkin authored
      escape all charecters less or equal 0x1F (control symbols)
      (shorter sequence are not used to make code simple, long encoding is always legal according to the rfc4627)
      a4663af0
    • Sachin Setiya's avatar
      MDEV-14586 Assertion `0' failed in retrieve_auto_increment ... · 94da1cb4
      Sachin Setiya authored
      Problem:-
       If we create table using myisam/aria then this crashes the server.
        CREATE TABLE t1(a bit(1), b int auto_increment , index(a,b));
        insert into t1 values(1,1);
       Or this query
        CREATE TABLE t1 (b BIT(1), pk INTEGER AUTO_INCREMENT PRIMARY KEY);
        ALTER TABLE t1 ADD INDEX(b,pk);
        INSERT INTO t1 VALUES (1,b'1');
        ALTER TABLE t1 DROP PRIMARY KEY;
      
      Reason:-
       The reason for this is
       1st- find_ref_key() finds what key an auto_increment field belongs to by
        comparing key_part->offset and field->ptr. But BIT fields might have
        zero length in the record, so a key might have many key parts with the
        same offset. That is, comparing offsets cannot uniquely identify the
        correct key part.
       2nd- Since next_number_key_offset is zero it myisam/aria will think that
        auto_increment is in first part of key.
       3nd- myisam/aria will call retrieve_auto_key which will see first key_part
        field as a bit field and call assert(0)
      
      Solution:-
        Many key parts might have the same offset, but BIT fields do not
        support auto_increment. So, we can skip all key parts over BIT fields,
        and then comparing offsets will be unambiguous.
      94da1cb4
    • Daniel Black's avatar
      cc315541
    • Karim Geiger's avatar
      Fix error message typo · 701c7e77
      Karim Geiger authored
      701c7e77
    • Daniel Black's avatar
    • Daniel Black's avatar
      c98906e4
    • Eugene Kosov's avatar
      fix build for recent clang · 3532a421
      Eugene Kosov authored
      /home/kevg/work/mariadb/sql/sql_partition.cc:286:47: error: cannot initialize a parameter of type 'HA_CREATE_INFO *' (aka 'st_ha_create_information *') with an rvalue of type 'ulonglong' (aka 'unsigned long long')
                                                    (ulonglong)0, (uint)0);
                                                    ^~~~~~~~~~~~
      /home/kevg/work/mariadb/sql/partition_info.h:281:72: note: passing argument to parameter 'info' here
        bool set_up_defaults_for_partitioning(handler *file, HA_CREATE_INFO *info,
                                                                             ^
      3532a421
  3. 22 Jan, 2018 10 commits
    • Vicențiu Ciorbaru's avatar
      Fix TokuDB Not building · a04b07eb
      Vicențiu Ciorbaru authored
      We don't check for DLSYM in CMake, check for DLOPEN instead.
      a04b07eb
    • Sergei Golubchik's avatar
      MDEV-13988 connect.drop-open-error fails · ea78c574
      Sergei Golubchik authored
      PCOLRES::Length is the length in characters, not in bytes
      (because it's printed as length in "VARCHAR(N)").
      So convert it into characters using cs->mbmaxlen.
      ea78c574
    • Sergei Golubchik's avatar
      improve ASAN instrumentation: clang · 8539e4b1
      Sergei Golubchik authored
      translate clang __has_feature to gcc macros
      8539e4b1
    • Marko Mäkelä's avatar
      MDEV-12173 "Error: trying to do an operation on a dropped tablespace" · 43160723
      Marko Mäkelä authored
      InnoDB is issuing a 'noise' message that is not a sign of abnormal
      operation. The only issuers of it are the debug function
      lock_rec_block_validate() and the change buffer merge.
      While the error should ideally never occur in transactional locking,
      we happen to know that DISCARD TABLESPACE and TRUNCATE TABLE and
      possibly DROP TABLE are breaking InnoDB table locks.
      
      When it comes to the change buffer merge, the message simply is useless
      noise. We know perfectly well that a tablespace can be dropped while a
      change buffer merge is pending. And the code is prepared to handle that,
      which is demonstrated by the fact that whenever the message was issued,
      InnoDB did not crash.
      
      fil_inc_pending_ops(): Remove the parameter print_err.
      43160723
    • Vicențiu Ciorbaru's avatar
      MDEV-14715: Assertion `!table || (!table->read_set... failed in Field_num::val_decimal · b20c3dc6
      Vicențiu Ciorbaru authored
      The assertion failure was caused by an incorrectly set read_set for
      functions in the ORDER BY clause in part of a union, when we are using
      a mergeable view and the order by clause can be skipped (removed).
      
      An order by clause can be skipped if it's part of one part of the UNION as
      the result set is not meaningful when multiple SELECT queries are UNIONed. The
      server is aware of this optimization and tries to remove the order by
      clause before JOIN::prepare. The problem is that we need to throw an
      error when the ORDER BY clause contains invalid columns. To do this, we
      attempt resolving the ORDER BY expressions, then subsequently drop them
      if resolution succeeded. However, ORDER BY resolution had the side
      effect of adding the expressions to the all_fields list, which is used
      to construct temporary tables to store the result. We may be ignoring
      the ORDER BY statement, but the tmp table still tried to compute the
      values for the expressions, even if the columns are never used.
      
      The assertion only shows itself if the order by clause contains members
      which were not previously in the select list, and are part of a
      function.
      
      There is an additional question as to why this only manifests when using
      VIEWS and not when using a regular table. The difference lies with the
      "reset" of the read_set for the temporary table during
      SELECT_LEX::update_used_tables() in JOIN::optimize(). The changes
      introduced in fdf789a7 cleared the
      read_set when a mergeable view is encountered in the TABLE_LIST
      defintion.
      
      Upon initial order_list resolution, the table's read_set is updated
      correctly. JOIN::optimize() will only reset the read_set if it
      encounters a VIEW. Since we no longer have ORDER BY clause in
      JOIN::optimize() we never get to correctly update the read_set again.
      
      Other relevant commit by Timour, which first introduced the order
      resolution when we "can_skip_sort_order":
      883af99e
      
      Solution:
      Don't add the resolved ORDER BY elements to all_fields. We only resolve
      them to check if an error should be returned for the query. Ignore them
      completely otherwise.
      b20c3dc6
    • Vicențiu Ciorbaru's avatar
      6d826e3d
    • Sergei Golubchik's avatar
      03eb1593
    • Sergei Golubchik's avatar
      Finally! Make './mtr --valgrind-mysqld --gdb' to work. · d9c460b8
      Sergei Golubchik authored
      It has its limitations, e.g. it assumes that there's only one
      gdb and only one valgrind process is running. And a hard-coded
      one-second delay might be too short for slow machines.
      
      Still, it's better than "doesn't work at all"
      d9c460b8
    • Sergei Golubchik's avatar
      f2408e7e
    • Sergei Golubchik's avatar
      improve ASAN instrumentation: table->record[0] · 36eb0b7a
      Sergei Golubchik authored
      instrument table->record[0], table->record[1] and share->default_values.
      
      One should not access record image beyond share->reclength, even
      if table->record[0] has some unused space after it (functions that
      work with records, might get a copy of the record as an argument,
      and that copy - not being record[0] - might not have this buffer space
      at the end). See b80fa400 and 444587d8
      36eb0b7a