• Jacob Mathew's avatar
    MDEV-14500: Support engines without rnd_pos() and · 884b83e2
    Jacob Mathew authored
                engines with inefficient rnd_pos()
    
    Some engines have not implemented rnd_pos().  There are other engines whose
    implementation of rnd_pos() is inherently inefficient.  Spider is such an
    engine, whose implementation of rnd_pos() needs to access a table on a remote
    data node to retrieve a single table row.
    
    To address these limitations, a new temporary table has been added to filesort.
    When filesort sequentially reads the table being sorted, each row is written to
    the filesort temp table in addition to being copied to the sort buffer.
    Subsequent calls to rnd_pos() will then access the table row in the filesort
    temp table instead of in the table being sorted.
    
    The following logic changes incorporate the new filesort temp table into the
    server:
    - A new handler method to determine whether a call to the engine's
      rnd_pos() is expensive.  The default return value is FALSE.  Engines without
      rnd_pos() or with an inefficient rnd_pos() should return TRUE.
    - Create the filesort temp table only if:
      - There are no add-on columns for filesort; and
      - The engine's implementation of rnd_pos() is expensive.
    - Write to the temp table each row that is read from the table being sorted.
    - Do subsequent row retrievals that use rnd_pos() on the temp table instead of
      on the table being sorted.  Upon retrieving a row from the temp table, copy
      its column values to the record of the table being sorted.
    - Upon completion of retrieval of the sorted result rows, delete the filesort
      temp table and free the memory allocated for using it.
    
    The logic changes are in the following areas:
    - Table handler.
    - Partition engine.
    - Spider engine.
    - Filesort.
    - Read record manager.
    
    Note that these changes only address the use of rnd_pos() by filesort.  They do
    not address the use of rnd_pos() in other areas such as:
    - Quick select.
    - Insert.
    - Update.
    - Window functions.
    - Multi Range Read.
    
    Author:
      Jacob Mathew.
    
    Reviewer:
      Sergei Golubchik.
    884b83e2
sql_sort.h 4.5 KB