1. 04 Jan, 2007 1 commit
    • marko's avatar
      branches/zip: Fix two bugs in the relocation of block descriptors. · ede8e7bc
      marko authored
      Improve diagnostics.
      
      buf_buddy_relocate(): Do not assume all small blocks to contain only one
      buf_page_t object.  Require an exact size match, as in the case of
      compressed pages.
      
      buf_relocate(): Relocate buf_pool->LRU_old if needed.
      Validate the LRU list in debug builds.
      
      buf_LRU_block_remove_hashed_page(): Do not overwrite FIL_PAGE_OFFSET
      or FIL_PAGE_ARCH_LOG_NO_OR_SPACE_ID.  The memory will be invalidated
      in debug builds of buf_buddy_free().
      
      buf0buddy.c: Add assertions for not holding buf_pool->zip_mutex.
      The calling thread should not be holding any block->mutex, but it might
      be too time-consuming to assert against that, even #ifdef UNIV_SYNC_DEBUG.
      ede8e7bc
  2. 03 Jan, 2007 5 commits
    • marko's avatar
      buf_flush_validate_low(): Minor cleanup. · 324df09d
      marko authored
      324df09d
    • marko's avatar
      branches/zip: Before calling buf_buddy_alloc() or buf_buddy_free(), · bb9217fa
      marko authored
      release any block mutexes but hold the buf_pool->mutex.
      bb9217fa
    • marko's avatar
      branches/zip: Use the buddy allocator for managing compressed pages. · f890ec15
      marko authored
      There is something wrong with the management of compressed-only blocks
      (BUF_BLOCK_ZIP_PAGE).  To disable the creation of such blocks, set zip=TRUE
      in buf_LRU_block_remove_hashed_page().
      
      buf_LRU_block_remove_hashed_page(): Release buf_pool->zip_mutex when
      freeing a compressed-only page and its control block, with buf_buddy_free().
      Adapt callers.
      
      buf_LRU_block_free_hashed_page(): Change the parameter type from buf_page_t*
      to buf_block_t*.
      
      buf_LRU_free_block(): Move below the definition of buf_LRU_add_block_low().
      Allocate block descriptor for compressed-only blocks.
      
      buf_LRU_block_free_non_file_page(): Replace ut_free() with buf_buddy_free().
      
      buf_zip_decompress(): New function, split from buf_page_io_complete().
      
      buf_page_init_for_read(): Do not allocate the compressed page until it is
      really needed, to avoid the overhead of the buddy allocator.  Decompress
      compressed-only blocks that are needed again.
      
      buf_page_create(): Do not allocate the compressed page until it is
      really needed, to avoid the overhead of the buddy allocator.
      
      buf_validate(): Replace some equality tests on the lengths of the LRU
      list and the flush lists with greater-or-equal tests, since the counted
      numbers do not include control blocks for compressed-only pages.
      f890ec15
    • marko's avatar
      branches/zip: Add __attribute__((const)) or __attribute__((pure)) · 0b89bb79
      marko authored
      to all fold functions.
      0b89bb79
    • marko's avatar
      branches/zip: trx_prepare_off_kernel(): Eliminate the local variable · 81334fe6
      marko authored
      must_flush_log, and remove warning about lsn being possibly uninitialized.
      81334fe6
  3. 02 Jan, 2007 2 commits
  4. 29 Dec, 2006 2 commits
    • marko's avatar
      branches/zip: Minor cleanup. · 75e35eb7
      marko authored
      buf_buddy_get(): New function in buf0buddy.c, to replace the macro
      in buf0buddy.h.
      
      buf_buddy_get_offset(): Remove.
      
      buf_buddy_get_slot(): Remove the prototype from buf0buddy.h.  This function
      is for internal use in buf0buddy.ic.
      75e35eb7
    • marko's avatar
      branches/zip: Minor cleanup. · c087a5d5
      marko authored
      buf_page_get_gen(): Cache the result of fil_space_get_zip_size().
      
      trx_commit_off_kernel(): Eliminate the flag must_flush_log.  Initialize lsn = 0
      to signify must_flush_log == FALSE.
      
      log_flush_margin(): Eliminate the flag do_flush.  Initialize lsn = 0
      to signify do_flush == FALSE.
      c087a5d5
  5. 21 Dec, 2006 1 commit
    • marko's avatar
      branches/zip: Fix two bugs in the buddy allocator. · 631da97d
      marko authored
      buf_buddy_block_free(): Remove the block from buf_pool->zip_hash.
      
      buf_buddy_alloc_clean(): Test for buf_page_in_file() before
      invoking buf_LRU_free_block().  The LRU list also contains "half-freed"
      blocks (state == BUF_BLOCK_REMOVE_HASH).
      631da97d
  6. 20 Dec, 2006 4 commits
    • marko's avatar
      branches/zip: Allow the buddy allocator to work for 16-kilobyte pages, · 9244a3a5
      marko authored
      twice the maximum block size of the buddy system.
      
      buf_page_t: Note that state may change from BUF_BLOCK_READY_FOR_USE
      to BUF_BLOCK_MEMORY without buf_page_get_mutex() protection
      [only buf_pool->mutex].
      
      buf_buddy_get_slot(): Extend the output to BUF_BUDDY_SIZES.
      
      buf_buddy_alloc(), buf_buddy_free(): Allow sizes up to UNIV_PAGE_SIZE.
      
      buf_buddy_alloc_low(), buf_buddy_free_low(), buf_buddy_alloc_clean():
      Allow i==BUF_BUDDY_SIZES.
      9244a3a5
    • marko's avatar
      branches/zip: buf_page_get_gen(): Restore the "break" statement to a · 77417e46
      marko authored
      "for (;;)" loop that was accidentally removed in r1090.
      77417e46
    • marko's avatar
      branches/zip: buf_buddy_free_low(): When trying to relocate to a block on · cf96318a
      marko authored
      the free list, remove the free block from the free list, so that the list
      item pointers will not be overwritten.
      cf96318a
    • marko's avatar
      branches/zip: Fix bugs in the buddy allocator and add assertions. · fe1e339f
      marko authored
      buf_buddy_free(), buf_buddy_free_low(): Document that the data must
      not be pointed to by the buffer pool.  Add ut_ad(!buf_pool_contains_zip())
      assertions to catch pointers to freed blocks.
      
      Validate the zip_free[] lists #ifdef UNIV_DEBUG.
      
      buf_buddy_relocate(): Ensure that the size of the compressed page
      matches.  The buddy block can be split, and the control block can be
      pointing to a smaller compressed page than the one whose relocation
      is being attempted.
      fe1e339f
  7. 19 Dec, 2006 2 commits
  8. 18 Dec, 2006 3 commits
  9. 15 Dec, 2006 2 commits
    • marko's avatar
      branches/zip: Minor improvements. · 492cd8ce
      marko authored
      buf_LRU_block_remove_hashed_page(): Return the new state of the block.
      
      Only call buf_LRU_block_free_hashed_page()
      if buf_LRU_block_remove_hashed_page() did not return BUF_BLOCK_ZIP_FREE,
      that is, the control block was not freed.
      
      buf_LRU_insert_zip_clean(): New function, for inserting a compressed-only
      block into buf_pool->zip_clean in the LRU order.
      
      buf_LRU_block_remove_hashed_page(), buf_LRU_free_block():
      Add the flag "zip" for controlling if the compressed page of an uncompressed
      page should be removed.  For now, assume zip==TRUE.
      
      buf_LRU_get_free_block(): Replace the test for UT_LIST_GET_LEN(buf_pool->free)
      with a test for the return value of buf_LRU_get_free_only().  Do not
      free zip.data, as it must already have been freed.
      
      buf_flush_insert_into_flush_list(), buf_flush_insert_sorted_into_flush_list():
      Remove compressed-only blocks from the buf_pool->zip_clean list.
      
      buf_flush_remove(): Restore compressed-only blocks to
      the buf_pool->zip_clean list.
      
      buf_page_init_for_read(): Uncompress compressed-only blocks when possible.
      Currently, there cannot be any compressed-only blocks in the buffer pool;
      they would be inserted by buf_LRU_free_block(bpage, zip=FALSE).
      492cd8ce
    • marko's avatar
      branches/zip: Minor improvements. · 0fb620f5
      marko authored
      buf_flush_remove(): New function, for removing a block from the flush list.
      Sliced from buf_flush_write_complete().
      
      buf_page_set_state(): Allow transitions between BUF_BLOCK_ZIP_PAGE
      and BUF_BLOCK_ZIP_DIRTY.
      0fb620f5
  10. 14 Dec, 2006 1 commit
  11. 13 Dec, 2006 1 commit
    • marko's avatar
      branches/zip: Make use of the previously unused state BUF_BLOCK_MEMORY. · cb530ba3
      marko authored
      buf_LRU_get_free_block(): Document that the block is in the state
      BUF_BLOCK_READY_FOR_USE.
      
      buf_block_alloc(): Change the state of the block to BUF_BLOCK_MEMORY
      and document it.
      
      Replace those invocations of buf_block_alloc() with
      buf_LRU_get_free_block() where the allocated block is used for buffer
      pool input and output.  However, temporary copies of B-tree pages
      during reorganization are not used for file I/O, and such blocks are
      still allocated with buf_block_alloc().
      cb530ba3
  12. 12 Dec, 2006 3 commits
  13. 11 Dec, 2006 5 commits
    • marko's avatar
      branches/zip: Make the code compile with all debugging enabled · 91aae178
      marko authored
      buf_buddy_relocate(): Replace ut_align_down() with ut_align_offset()
      in assertions.
      
      buf0buddy.h: Include buf0buf.h and sync0sync.h.
      91aae178
    • marko's avatar
      branches/zip: Implement the whole allocation algorithm of compressed pages. · f9a10f4c
      marko authored
      buf_LRU_free_block(): Free compressed-only pages and their
      descriptors with buf_buddy_free().
      
      buf_LRU_get_free_only(): New function for returning a block from
      buf_pool->free if one is available.  Split from buf_LRU_get_free_block().
      
      buf_buddy_alloc_zip(): Rename from buf_buddy_alloc_low() and make static.
      Remove parameter "split".  Always try to split.
      
      buf_buddy_free_block(): Rename to buf_buddy_block_free().
      
      buf_buddy_block_register(): New function for registering buf_block_t
      objects reserved by the allocator.
      
      buf_buddy_alloc_from(): New function for allocating an object from a
      bigger object, and putting the unused parts on the free list.
      
      buf_buddy_alloc_clean_zip(): New function for allocating memory by
      replacing an unmodified compressed page.
      
      buf_buddy_alloc_low(): New function for allocating memory, either from
      the free lists of compressed pages, from the global free list, or from
      unmodified pages in the buffer pool.
      f9a10f4c
    • marko's avatar
      branches/zip: buf_buddy_relocate(): Split some lines differently on · 9bf07dae
      marko authored
      popular demand.
      9bf07dae
    • marko's avatar
      branches/zip: Add buf_pool->zip_hash for keeping track on pages allocated · d387f148
      marko authored
      to the buddy system for allocating compressed pages and their descriptors.
      
      buf_buddy_free_block(): New function: Deallocate the buffer frame.
      
      buf_buddy_free(), buf_buddy_free_low(): Return void instead of a pointer
      to a freed buffer frame.
      d387f148
    • marko's avatar
      branches/zip: buf_buddy_relocate(): Relocate buf_page_t objects that represent · e2a384eb
      marko authored
      clean compressed pages (BUF_BLOCK_ZIP_PAGE).
      e2a384eb
  14. 08 Dec, 2006 2 commits
  15. 07 Dec, 2006 6 commits