1. 22 Nov, 2019 2 commits
  2. 21 Nov, 2019 1 commit
  3. 20 Nov, 2019 10 commits
  4. 19 Nov, 2019 4 commits
  5. 18 Nov, 2019 4 commits
    • Marko Mäkelä's avatar
      Merge 10.3 into 10.4 · 589a1235
      Marko Mäkelä authored
      589a1235
    • Marko Mäkelä's avatar
      MDEV-13564 follow-up: Remove unused code · 39d8652c
      Marko Mäkelä authored
      DropIndex, CreateIndex: Remove. The file row0trunc.cc only exists
      in MariaDB Server 10.3 so that the crash recovery of TRUNCATE TABLE
      operations from older 10.2 and 10.3 servers will work. This dead code
      was being used for implementing the MySQL 5.7 WL#6501 TRUNCATE TABLE
      that was replaced with a backup-safe implementation in MDEV-13564.
      39d8652c
    • Marko Mäkelä's avatar
      Merge 10.2 into 10.3 · 613e1307
      Marko Mäkelä authored
      613e1307
    • Marko Mäkelä's avatar
      MDEV-21069 Crash on DROP TABLE if the data file is corrupted · b80df9eb
      Marko Mäkelä authored
      buf_read_ibuf_merge_pages(): Discard any page numbers that are
      outside the current bounds of the tablespace, by invoking the
      function ibuf_delete_recs() that was introduced in MDEV-20934.
      This could avoid an infinite change buffer merge loop on
      innodb_fast_shutdown=0, because normally the change buffer merge
      would only be attempted if a page was successfully loaded into
      the buffer pool.
      
      dict_drop_index_tree(): Add the parameter trx_t*.
      To prevent the DROP TABLE crash, do not invoke btr_free_if_exists()
      if the entire .ibd file will be dropped. Thus, we will avoid a crash
      if the BTR_SEG_LEAF or BTR_SEG_TOP of the index is corrupted,
      and we will also avoid unnecessarily accessing the to-be-dropped
      tablespace via the buffer pool.
      
      In MariaDB 10.2, we disable the DROP TABLE fix if innodb_safe_truncate=0,
      because the backup-unsafe MySQL 5.7 WL#6501 form of TRUNCATE TABLE
      requires that the individual pages be freed inside the tablespace.
      b80df9eb
  6. 17 Nov, 2019 1 commit
  7. 16 Nov, 2019 2 commits
  8. 15 Nov, 2019 16 commits
    • Vladislav Vaintroub's avatar
      Fix compile error on centos6. it does not like std::this_thread::sleep() · c233d406
      Vladislav Vaintroub authored
      Simplify task_group destructor.
      No tasks must be running or queued into task group is being destroyed.
      c233d406
    • Marko Mäkelä's avatar
      MDEV-16264: Minor cleanup · 15c7f684
      Marko Mäkelä authored
      Add missing static qualifiers.
      15c7f684
    • Sergei Petrunia's avatar
      MDEV-20611: MRR scan over partitioned InnoDB table produces "Out of memory" error · 86167e90
      Sergei Petrunia authored
      Fix partitioning and DS-MRR to work together
      
      - In ha_partition::index_end(): take into account that ha_innobase (and
        other engines using DS-MRR) will have inited=RND when initialized for
        DS-MRR scan.
      - In ha_partition::multi_range_read_next(): if the MRR scan is using
        HA_MRR_NO_ASSOCIATION mode, it is not guaranteed that the partition's
        handler will store anything into *range_info.
      - In DsMrr_impl::choose_mrr_impl(): ha_partition will inquire partitions
        about how much memory their MRR implementation needs by passing
        *buffer_size=0. DS-MRR code didn't know about this (actually it used
        uint for buffer size calculation and would have an under-flow).
        Returning *buffer_size=0 made ha_partition assume that partitions do
        not need MRR memory and pass the same buffer to each of them.
      
        Now, this is fixed. If DS-MRR gets *buffer_size=0, it will return
        the amount of buffer space needed, but not more than about
        @@mrr_buffer_size.
      
      * Fix ha_{innobase,maria,myisam}::clone. If ha_partition uses MRR on its
        partitions, and partition use DS-MRR, the code will call handler->clone
        with TABLE (*NOT partition*) name as an argument.
        DS-MRR has no way of knowing the partition name, so the solution was
        to have the ::clone() function for the affected storage engine to ignore
        the name argument and get it elsewhere.
      86167e90
    • Marko Mäkelä's avatar
      MDEV-16264: Remove IORequest::IGNORE_MISSING · a69cff29
      Marko Mäkelä authored
      After MDEV-11556, not even crash recovery should attempt to access
      non-existing pages. But, buf_load() is not validating its input
      and must thus be able to ignore missing pages, so that is why
      buf_read_page_background() does that.
      a69cff29
    • Marko Mäkelä's avatar
      MDEV-16264: Fix some white space · 80409986
      Marko Mäkelä authored
      80409986
    • Marko Mäkelä's avatar
      MDEV-21054 Crash on shutdown due to btr_search_latches=NULL · 37f1ab23
      Marko Mäkelä authored
      innodb_shutdown(): Invoke os_aio_free() before btr_search_sys_free().
      37f1ab23
    • Vladislav Vaintroub's avatar
      Make .clang-format work with clang-8 · a808c18b
      Vladislav Vaintroub authored
      Remove keywords that are too new.
      a808c18b
    • Vladislav Vaintroub's avatar
      4e30a57e
    • Vladislav Vaintroub's avatar
      MDEV-16264 Use threadpool for Innodb background work. · 5e62b6a5
      Vladislav Vaintroub authored
      Almost all threads have gone
      - the "ticking" threads, that sleep a while then do some work)
      (srv_monitor_thread, srv_error_monitor_thread, srv_master_thread)
      were replaced with timers. Some timers are periodic,
      e.g the "master" timer.
      
      - The btr_defragment_thread is also replaced by a timer , which
      reschedules it self when current defragment "item" needs throttling
      
      - the buf_resize_thread and buf_dump_threads are substitutes with tasks
      Ditto with page cleaner workers.
      
      - purge workers threads are not tasks as well, and purge cleaner
      coordinator is a combination of a task and timer.
      
      - All AIO is outsourced to tpool, Innodb just calls thread_pool::submit_io()
      and provides the callback.
      
      - The srv_slot_t was removed, and innodb_debug_sync used in purge
      is currently not working, and needs reimplementation.
      5e62b6a5
    • Vladislav Vaintroub's avatar
      MDEV-16264: Add threadpool library · 00ee8d85
      Vladislav Vaintroub authored
      The library is capable of
      - asynchronous execution of tasks (and optionally waiting for them)
      - asynchronous file IO
        This is implemented using libaio on Linux and completion ports on
        Windows. Elsewhere, async io is "simulated", which means worker threads
        are performing synchronous IO.
      - timers, scheduling work asynchronously in some point of the future.
        Also periodic timers are implemented.
      00ee8d85
    • Vladislav Vaintroub's avatar
      MDEV-16264 prerequisite patch, ha_preshutdown. · 7e08dd85
      Vladislav Vaintroub authored
      This is a prerequisite patch required to remove Innodb's
      thd_destructor_proxy thread.
      
      The patch implement pre-shutdown functionality for handlers.
      
      A storage engine might need to perform some work after all user
      connections are shut down, but before killing off the plugins.
      
      The reason is that an SE could still be using some of the
      server infrastructure. In case of Innodb this would be purge threads,
      that call into the server to calculate results of virtual function,
      acquire MDL locks on tables, or possibly also use the audit plugins.
      7e08dd85
    • Vladislav Vaintroub's avatar
      MDEV-16264 - prerequisite patch - true background THDs · e7549917
      Vladislav Vaintroub authored
      Create background THDs that are not counted, and do not block
      close_connections(), in other words they are just something that plugin
      can use internally.
      
      These THD will be used later by Innodb purge threads, and they need THD
      to calculate virtual functions.
      e7549917
    • Vladislav Vaintroub's avatar
      MDEV-16264 prerequisite patch, enable thr_timer in embedded · 2fb23b89
      Vladislav Vaintroub authored
      Since threadpool is using thr_timer, and it also exist in embedded version,
      initialize timer also in embedded version
      2fb23b89
    • Vladislav Vaintroub's avatar
      MDEV-16264 - prerequisite patch, periodic thr_timer · ad17c98d
      Vladislav Vaintroub authored
      Threadpool will need a functionality for periodic thr_timer
      (the threadpool maintainence task is a timer that runs periodically).
      
      Also increase the stack size for the timer thread, 8k won't be enough.
      ad17c98d
    • Vladislav Vaintroub's avatar
      Fix a couple of clang-cl warnings · 009674dc
      Vladislav Vaintroub authored
      009674dc
    • Vladislav Vaintroub's avatar
      MDEV-21062 Buildbot, Windows - sporadically missing lines from mtr's "exec" · 6df0bb7d
      Vladislav Vaintroub authored
      
      Provide own version of popen/pclose, in attempt to workaround
      sporadic erratic behavior of UCRT's one.
      6df0bb7d