1. 17 Oct, 2007 1 commit
    • unknown's avatar
      Checking that the very last record is fully written · 6ca17629
      unknown authored
        on the loghandler start.
      Variable definition moved because it is C programm.
      
      
      storage/maria/ma_loghandler.c:
        Checking that the very last record is fully written
          on the loghandler start.
      storage/maria/ma_recovery.c:
        Variable definition moved because it is C programm.
      6ca17629
  2. 16 Oct, 2007 2 commits
    • unknown's avatar
      Merge gbichot@bk-internal.mysql.com:/home/bk/mysql-maria · 18a4194b
      unknown authored
      into  gbichot4.local:/home/mysql_src/mysql-maria-tmp
      
      18a4194b
    • unknown's avatar
      WL#3072 Maria recovery · 8f714513
      unknown authored
      - fixes (in recovery, checkpoint, log handler) of bugs found
      during testing.
      - new option --check for maria_read_log: with --only-display (which only
      reads the header) it reads the full record, for debugging.
      
      
      storage/maria/ma_loghandler.c:
        importing patch from Sanja for bug of translog_next_LSN() found
        during recovery
      storage/maria/ma_loghandler_lsn.h:
        better types (0L is 4 bytes on some platforms, it causes problems
        when used into lsn_store(): right shift >= width of type.
      storage/maria/ma_pagecache.c:
        work around infamous "PAGECACHE_PLAIN_PAGE used for transactional
        tables in specialm case"; REDO phase disables logging and this causes
        pages to be PAGECACHE_PLAIN_PAGE, thus ignored wrongly by the
        checkpoint taken at the end of the REDO phase.
      storage/maria/ma_recovery.c:
        - a #ifdef which broke maria_read_log in non-debug builds (no output!)
        - support for maria_read_log --check
        - detect record corruption before opening the table
        - updating is_of_horizon requires writing the state
        - fix for wrong parsing of checkpoint record by recovery
      storage/maria/ma_recovery.h:
        support for maria_read_log --check
      storage/maria/maria_read_log.c:
        Option --check: --only-display only looks at the header;
        adding --check tries a translog_read_record() to see if record can
        be fully read (this is to find bugs).
      8f714513
  3. 15 Oct, 2007 1 commit
  4. 13 Oct, 2007 2 commits
  5. 12 Oct, 2007 6 commits
    • unknown's avatar
      different fix for strict-aliasing problem · 7de6b459
      unknown authored
      7de6b459
    • unknown's avatar
      bugs/warnings fixed in lf_alloc-pin.c: · 2cb4f952
      unknown authored
      1. available_stack_size() was getting the direction wrong,
         so alloca() was never used
      2. (char*) casts added to kill "break strict-aliasing rules" warnings
      3. s/node/node=0/ to kill "pointer casted to integer" warning
      4. added volatiles as appropriate to prevent gcc from moving
         assignment out of the loop
      
      
      mysys/lf_alloc-pin.c:
        bugs/warnings fixed:
        1. available_stack_size() was getting the direction wrong,
           so alloca() was never used
        2. (char*) casts added to kill "break strict-aliasing rules" warnings
        3. s/node/node=0/ to kill "pointer casted to integer" warning
        4. added volatiles as appropriate to prevent gcc from moving
           assignment out of the loop
      2cb4f952
    • unknown's avatar
      Merge bk-internal.mysql.com:/home/bk/mysql-maria · bbbc4b65
      unknown authored
      into  janus.mylan:/usr/home/serg/Abk/mysql-maria
      
      bbbc4b65
    • unknown's avatar
      make maria more pluggable · 94fb9e14
      unknown authored
      
      mysql-test/r/maria.result:
        test for maria variables
      mysql-test/t/maria.test:
        test for maria variables
      BitKeeper/etc/ignore:
        Added sql/link_sources ylwrap libmysql_r/link_sources to the ignore list
      sql/sql_delete.cc:
        fix incorrect check
      storage/maria/ha_maria.cc:
        maria status and pagecache variables
      94fb9e14
    • unknown's avatar
      int->my_bool transformation fixed (thanks Guilhem) · 432ea6b4
      unknown authored
      Mutex owner checks added.
      
      432ea6b4
    • unknown's avatar
      translog_next_LSN() changed to support pointer to the page end · 408cb46a
      unknown authored
        which can happen when you save address of horizon
      
      408cb46a
  6. 11 Oct, 2007 3 commits
    • unknown's avatar
      Merge desktop.sanja.is.com.ua:/home/bell/mysql/bk/mysql-maria · e593209e
      unknown authored
      into  desktop.sanja.is.com.ua:/home/bell/mysql/bk/work-maria-filler
      
      e593209e
    • unknown's avatar
      Compiler warnings removed. · 5521ba10
      unknown authored
      Added ability top change empty space filler of the loghandler.
      Fixed end of log reaction.
      Fixed memory corruprion bug caused by reading non-filled hage header.
      Added debug output.
      
      
      storage/maria/ma_bitmap.c:
        Compiler warnings removed.
      storage/maria/ma_blockrec.c:
        Compiler warnings removed.
      storage/maria/ma_loghandler.c:
        Added ability top change empty space filler of the loghandler.
        Fixed end of log reaction.
        Fixed memory corruprion bug caused by reading non-filled hage header.
        Added debug output.
      storage/maria/ma_loghandler_lsn.h:
        Compiler warnings removed.
      5521ba10
    • unknown's avatar
      WL#3072 Maria recovery. Bugfix (segfault of maria_read_log) · f4cdc3af
      unknown authored
      
      storage/maria/ma_recovery.c:
        bugfix ("count" is meaningul only if printing messages)
      f4cdc3af
  7. 10 Oct, 2007 1 commit
    • unknown's avatar
      WL#3072 Maria recovery. Improving the progress message (small fixes · 126bba02
      unknown authored
      plus printing a downcount of tables to flush).
      
      
      storage/maria/ma_recovery.c:
        improving the progress message of recovery; it used to assume that
        if there is a non-zero UNDO phase then there was a non-REDO phase,
        and if there are tables to flush there was an UNDO phase,
        which is not always true. We now print a downcount of tables to flush
        (4 3 2 1 0).
      126bba02
  8. 09 Oct, 2007 2 commits
    • unknown's avatar
      WL#3071 - Maria checkpoint · e7085957
      unknown authored
      * Preparation for having a background checkpoint thread:
      frequency of checkpoint taken by that thread is now configurable
      by the user: global variable maria_checkpoint_frequency, in seconds,
      default 30 (checkpoint every 30th second); 0 means no checkpoints
      (and thus no background thread, thus no background flushing, that
      will probably only be used for testing).
      * Don't take checkpoints in Recovery if it didn't do anything
      significant; thus no checkpoint after a clean shutdown/restart. The
      only checkpoint which is never skipped is the one at shutdown.
      * fix for a test failure (after-merge fix)
      
      
      include/maria.h:
        new variable
      mysql-test/suite/rpl/r/rpl_row_flsh_tbls.result:
        result update
      mysql-test/suite/rpl/t/rpl_row_flsh_tbls.test:
        position update (=after merge fix, as this position was already changed
        into 5.1 and not merged here, causing test to fail)
      storage/maria/ha_maria.cc:
        Checkpoint's frequency is now configurable by the user:
        global variable maria_checkpoint_frequency. Changing it on the fly
        requires us to shutdown/restart the background checkpoint thread,
        as the loop done in that thread assumes a constant checkpoint
        interval. Default value is 30: a checkpoint every 30 seconds (yes, I
        know, physicists will remind that it should be named "period" then).
        ha_maria now asks for a background checkpoint thread when it starts,
        but this is still overruled (disabled) in ma_checkpoint_init().
      storage/maria/ma_checkpoint.c:
        Checkpoint's frequency is now configurable by the user: background thread
        takes a checkpoint every maria_checkpoint_interval-th second.
        If that variable is 0, no checkpoints are taken.
        Note, I will enable the background thread only in a later changeset.
      storage/maria/ma_recovery.c:
        Don't take checkpoints at the end of the REDO phase and at the end of
        Recovery if Recovery didn't make anything significant (didn't open
        any tables, didn't rollback any transactions).
        With this, after a clean shutdown, Recovery shouldn't take any
        checkpoint, which makes starting faster (we save a few fsync()s of
        the log and control file).
      e7085957
    • unknown's avatar
      Merge gbichot@bk-internal.mysql.com:/home/bk/mysql-maria · 91a48a75
      unknown authored
      into  gbichot4.local:/home/mysql_src/mysql-maria-tmp
      
      
      storage/maria/ma_loghandler.c:
        Auto merged
      91a48a75
  9. 08 Oct, 2007 8 commits
    • unknown's avatar
      Merge desktop.sanja.is.com.ua:/home/bell/mysql/bk/mysql-maria · a2b44f09
      unknown authored
      into  desktop.sanja.is.com.ua:/home/bell/mysql/bk/work-maria-bug
      
      a2b44f09
    • unknown's avatar
      Merge bk-internal.mysql.com:/home/bk/mysql-maria · 8ddf0edc
      unknown authored
      into  janus.mylan:/usr/home/serg/Abk/mysql-maria1
      
      8ddf0edc
    • unknown's avatar
      Merge janus.mylan:/usr/home/serg/Abk/mysql-5.1 · f532dd11
      unknown authored
      into  janus.mylan:/usr/home/serg/Abk/mysql-maria1
      
      
      Makefile.am:
        Auto merged
      client/mysqldump.c:
        Auto merged
      configure.in:
        Auto merged
      libmysqld/Makefile.am:
        Auto merged
      mysql-test/mysql-test-run.pl:
        Auto merged
      mysql-test/r/mysqldump.result:
        Auto merged
      mysql-test/t/disabled.def:
        Auto merged
      mysql-test/t/mysqldump.test:
        Auto merged
      mysys/mf_tempfile.c:
        Auto merged
      sql/Makefile.am:
        Auto merged
      sql/ha_partition.cc:
        Auto merged
      sql/ha_partition.h:
        Auto merged
      sql/handler.cc:
        Auto merged
      sql/lock.cc:
        Auto merged
      sql/sql_parse.cc:
        Auto merged
      sql/sql_plugin.cc:
        Auto merged
      sql/sql_select.cc:
        Auto merged
      sql/sql_table.cc:
        Auto merged
      sql/table.cc:
        Auto merged
      sql/table.h:
        Auto merged
      BUILD/compile-dist:
        SCCS merged
      f532dd11
    • unknown's avatar
      sql_plugin.cc: · 6762bccc
      unknown authored
        fixed uninit memory access in SET pluginvar=DEFAULT
      innodb_mysql.test, innodb_mysql.result:
        test case for SET pluginvar=DEFAULT
      
      
      mysql-test/r/innodb_mysql.result:
        test case for SET pluginvar=DEFAULT
      mysql-test/t/innodb_mysql.test:
        test case for SET pluginvar=DEFAULT
      sql/sql_plugin.cc:
        fixed uninit memory access in SET pluginvar=DEFAULT
      6762bccc
    • unknown's avatar
      rpl_mixed_dml.inc: · 1f7faf59
      unknown authored
        use mysqltest builtins instead of --exec. Fixes a failing test too :)
      
      
      mysql-test/suite/rpl/include/rpl_mixed_dml.inc:
        use mysqltest builtins instead of --exec. Fixes a failing test too :)
      1f7faf59
    • unknown's avatar
      Makefile.am: · 07ac491c
      unknown authored
        do link_sources only once
      
      
      sql/Makefile.am:
        do link_sources only once
      libmysql_r/Makefile.am:
        do link_sources only once
      07ac491c
    • unknown's avatar
      Comments added. · 55fbc02b
      unknown authored
      moved debugging defines.
      Fixed buffer flushing (we copied last page
      content before it was actually written, now
      we abvance pointer in new buffer and unlock
      it while waiting for filling old buffer)
      
      55fbc02b
    • unknown's avatar
      WL#3072 Maria recovery · cd357588
      unknown authored
      Misc changes:
      - fix for benign Valgrind error, compiler warnings
      - fix for a segfault in execution of maria_delete_all_rows() and one
      when taking multiple checkpoints
      - fix for too paranoid assertion
      - adding ability to take checkpoints at the end of the REDO phase
      and at the end of recovery.
      - other minor changes
      
      
      storage/maria/ha_maria.cc:
        The checkpoint done after Recovery is finished, is moved to
        maria_recover().
      storage/maria/ma_bitmap.c:
        fix for Valgrind error: the "shadow debug copy" of the bitmap page
        started unitialized and so ma_print_bitmap() would use it uninitialized
      storage/maria/ma_checkpoint.c:
        * reset pointers to NULL after freeing them, or we segfault at
        next checkpoint in my_realloc().
        * fix for compiler warnings.
      storage/maria/ma_delete_all.c:
        info->trn is NULL for non-transactional tables
      storage/maria/ma_locking.c:
        correct assertion (it fired wrongly in execution of REDO_DROP_TABLE
        due to the maria_extra(HA_PREPARE_FOR_DROP)->_ma_decrement_open_count()
        ->maria_lock_database(F_UNLCK); another solution would have been to
        not call _ma_decrement_open_count() (it's ok to have a wrong open
        count in a table which we are dropping), but the same problem
        would still exist for REDO_RENAME_TABLE.
      storage/maria/ma_loghandler.c:
        fail early if UNRECOVERABLE_ERROR
      storage/maria/ma_recovery.c:
        * new argument to maria_apply_log(): should it take checkpoints
        (at end of REDO phase and at the very end) or no.
        * moving the call to translog_next_LSN() into
        parse_checkpoint_record() ("hide the details").
        * Refining an error detection for something which could happen
        if there is a checkpoint record in the log.
        * Using close_one_table() instead of maria_extra(HA_EXTRA_PREPARE_FOR_DROP|RENAME),
        as it looks safer, and also changing how close_one_table() works:
        it now limits itself to scanning all_tables[], thus having one loopp
        instead of two, which should be faster (as a result, it does not
        close tables not registered in this array, which is ok as there
        should not be any).
      storage/maria/ma_recovery.h:
        new parameter
      storage/maria/maria_read_log.c:
        update to new prototype
      cd357588
  10. 07 Oct, 2007 2 commits
    • unknown's avatar
      Comments fixed and added. · 561b6b42
      unknown authored
      561b6b42
    • unknown's avatar
      Optimisation todo for loghandler added. · fd97577f
      unknown authored
      Debug output information fixed.
      Fixed direct page referencing in write mode.
      
      
      storage/maria/ma_loghandler.c:
        TODO added.
      storage/maria/ma_pagecache.c:
        Debug output information fixed.
        Fixed direct page referencing in write mode.
      fd97577f
  11. 06 Oct, 2007 3 commits
    • unknown's avatar
      remove maria_* variables from the server, declare them in ha_maria.cc · 58532a17
      unknown authored
      note: this does *not* move pagecache* variables.
      
      
      sql/mysqld.cc:
        remove maria_* variables from the server, declare them in ha_maria.cc
      sql/set_var.cc:
        remove maria_* variables from the server, declare them in ha_maria.cc
      sql/sql_class.h:
        remove maria_* variables from the server, declare them in ha_maria.cc
      sql/sql_plugin.cc:
        bugfix: support for ENUM/SET thd local plugin variables
      storage/maria/ha_maria.cc:
        remove maria_* variables from the server, declare them in ha_maria.cc
      58532a17
    • unknown's avatar
      after-merge fixes for 64bit · ee0e324c
      unknown authored
      
      storage/maria/ma_test1.c:
        typo (?) fixed
      ee0e324c
    • unknown's avatar
      Merge bk-internal.mysql.com:/home/bk/mysql-5.1 · ba8b9742
      unknown authored
      into  janus.mylan:/usr/home/serg/Abk/mysql-5.1
      
      ba8b9742
  12. 04 Oct, 2007 7 commits
    • unknown's avatar
      Merge jamppa@bk-internal.mysql.com:/home/bk/mysql-maria · 0b3e9103
      unknown authored
      into  a88-113-38-195.elisa-laajakaista.fi:/home/my/bk/mysql-maria.prod
      
      
      BUILD/SETUP.sh:
        Auto merged
      sql/opt_range.cc:
        Auto merged
      sql/sql_insert.cc:
        Auto merged
      storage/maria/ha_maria.cc:
        Auto merged
      storage/maria/ma_check.c:
        Auto merged
      storage/maria/ma_create.c:
        Auto merged
      storage/maria/ma_delete.c:
        Auto merged
      storage/maria/ma_open.c:
        Auto merged
      storage/maria/ma_update.c:
        Auto merged
      storage/maria/ma_write.c:
        Auto merged
      storage/maria/maria_chk.c:
        Auto merged
      storage/maria/maria_def.h:
        Auto merged
      storage/maria/ma_pagecache.c:
        Manual merge with maria tree.
      storage/myisam/sort.c:
        Manual merge with maria tree.
      0b3e9103
    • unknown's avatar
      After merge fixes. Applied changes made in myisam manually to maria. · 243a5d49
      unknown authored
      
      
      storage/maria/ma_test1.c:
        After merge fixes. Applied changes made in myisam manually to maria.
        
        Fixed memory leak.
      storage/maria/ma_test2.c:
        After merge fixes. Applied changes made in myisam manually to maria.
        
        Fixed memory leak.
      243a5d49
    • unknown's avatar
      Merge trift2.:/MySQL/M50/push-5.0 · 0f769793
      unknown authored
      into  trift2.:/MySQL/M51/push-5.1
      
      
      storage/ndb/test/ndbapi/testScanFilter.cpp:
        Auto merged
      0f769793
    • unknown's avatar
      Merge trift2.:/MySQL/M50/mysql-5.0 · 711be53b
      unknown authored
      into  trift2.:/MySQL/M50/push-5.0
      
      711be53b
    • unknown's avatar
      Merge production.mysql.com:/usersnfs/jperkin/bk/build/5.0 · 3fb8f160
      unknown authored
      into  production.mysql.com:/usersnfs/jperkin/bk/build/5.1
      
      
      mysql-test/mysql-test-run.pl:
        Auto merged
      scripts/mysql_install_db.sh:
        Auto merged
      3fb8f160
    • unknown's avatar
      Merge production.mysql.com:/usersnfs/jperkin/bk/build/5.0 · 270011cb
      unknown authored
      into  production.mysql.com:/usersnfs/jperkin/bk/bug-27692/5.0
      
      270011cb
    • unknown's avatar
      Restore creation of test databases and the anonymous user which · 4d1a88e8
      unknown authored
      were accidentally removed during a previous rototill of this
      code.  Fixes bug#27692.
        
      While it can be argued we should strive to provide a 'secure by
      default' installation, this happens to be the setup currently
      documented in the manual as the default, so defer changes that
      improve security out of the box to a co-ordinated effort later
      on.
        
      For now, make a note about the test databases and anonymous user
      in mysql_install_db and recommend that mysql_secure_installation
      be ran for users wishing to remove these defaults.
      
      [..re-commit of previously lost change..]
      
      
      scripts/mysql_system_tables_data.sql:
        Add anonymous accounts.
      scripts/mysql_install_db.sh:
        Point users at the mysql_secure_installation script.
      mysql-test/mysql-test-run.pl:
        Add a comment where removing anonymous users.
      4d1a88e8
  13. 03 Oct, 2007 1 commit
    • unknown's avatar
      WL#3072 Maria recovery. · 08ced364
      unknown authored
      * Thanks to Serg's tip, we fix here the compilation issue of
      REDO_REPAIR_TABLE's execution, by defining versions of
      _ma_killed_ptr() and _ma_check_print_info|warning|error()
      in maria_read_log.c (we move those of maria_chk.c into an include
      file and include it in maria_chk.c and maria_read_log.c).
      Execution of such record looks like working from my tests (it only
      happens in maria_read_log; recovery-from-mysqld skips DDLs and
      REPAIR is considered DDL here as it bypasses logging): tested
      ALTER TABLE ENABLE KEYS and then remove table, apply log: that
      did a repair.
      * Recent changes broke maria_read_log a bit: -a became default
      and -o caused error; fixing this.
      
      
      storage/maria/Makefile.am:
        addind new file
      storage/maria/ma_recovery.c:
        enable execution of REDO_REPAIR_TABLE by maria_read_log now that
        it compiles. Now reason to keep only T_QUICK from testflag.
      storage/maria/maria_chk.c:
        moving these functions to ma_check_standalone.h for reusability
      storage/maria/maria_def.h:
        comment
      storage/maria/maria_read_log.c:
        ma_check_standalone.h needs my_progname_short.
        Fixing bug where "maria_read_log" would default to -a and
        "maria_read_log -o" would throw an error. Implemented behaviour is:
        - no options: usage()
        - -a : applys, applys UNDOs by default unless --disable-undo
        - -o : only prints
      storage/maria/ma_check_standalone.h:
        All standalone programs which need to use functions from ma_check.c
        (like maria_repair()) must define their version of _ma_killed_ptr()
        and _ma_check_print_info|warning|error(). Indeed, linking with ma_check.o
        brings in the dependencies of ma_check.o which are definitions of the above
        functions; if the program does not define them then the ones of
        ha_maria.o are used i.e. ha_maria.o is linked into the program, and this
        brings dependencies of ha_maria.o on mysqld.o into the program's linking
        which thus fails, as the program is not linked with mysqld.o.
        We put in this file the functions which maria_chk.c uses, so that
        they can be reused by maria_read_log (when it replays REDO_REPAIR_TABLE)
        as they are good enough (they just print to stdout/stderr like
        maria_read_log already does).
      08ced364
  14. 02 Oct, 2007 1 commit
    • unknown's avatar
      testScanFilter.cpp: · c47eab5e
      unknown authored
         Updated variable size arrays to use vector like Jonas did for 5.1 so that my build would not break
      
      
      ndb/test/ndbapi/testScanFilter.cpp:
         Updated variable size arrays to use vector like Jonas did for 5.1 so that my build would not break
      c47eab5e