mariadb

Tree: 5c95ec4035

Author	SHA1	Message	Date
marko	069514dee7	branches/zip: buf_relocate(): Copy the block. Invalidate the source block. buf_buddy_block_free(), buf_buddy_free_low(): Flag the freed bytes uninitialized. buf_page_init_for_read(), buf_buddy_relocate(): Do not refer to bpage after invoking buf_relocate(). buf_buddy_relocate(): Flag src uninitialized.	19 years ago
marko	0c19de98c0	branches/zip: buf_page_io_complete(): Change the parameter type from buf_block_t* to buf_page_t*. Handle compressed-only blocks.	19 years ago
marko	fbae0bac19	branches/zip: buf_page_init(): Improve diagnostic output in case of buf_pool->page_hash corruption.	19 years ago
marko	c801992394	branches/zip: buf_page_init_for_read(): Increment the buf_fix_count during the buf_zip_decompress() call. Otherwise, the block may end up being freed by another thread. This bug was caught by the page_zip_validate() check in buf_LRU_block_remove_hashed_page().	19 years ago
marko	785eb0c7e9	branches/zip: Remove a race condition. buf_page_init_for_read(): Protect the buf_zip_decompress() call with an X-lock on the block. page_zip_validate(): Move the page_is_comp() assertion after the page header comparison.	19 years ago
marko	8af159117e	branches/zip: buf_page_t: Introduce the field in_flush_list #ifdef UNIV_DEBUG. buf_flush_batch(): Remove the local variable "found".	19 years ago
marko	e8d77f6d5a	branches/zip: Maintain a valid checksum for compressed-only pages kept in the buffer pool. buf_LRU_free_block(): When preserving the compressed page, compute the checksum. Also assert page_zip_validate(). buf_zip_decompress(): Add parameter "check" for enabling checksum tests. Before decompressing a compressed-only page from the buffer pool, verify the compressed page checksum.	19 years ago
marko	f11423bc29	branches/zip: buf_get_latched_pages_number(): Count compressed-only blocks too.	19 years ago
marko	933d660032	branches/zip: Support compressed-only pages in buf_page_create(). buf_page_get_gen(): Note that buf_read_page() may uncompress a compressed-only page. buf_page_create(): Test buf_page_in_file() instead of BUF_BLOCK_FILE_PAGE.	19 years ago
marko	002a45ef8a	branches/zip: buf_validate(): Validate also the compressed-only blocks.	19 years ago
marko	62391d4280	branches/zip: buf_page_peek(): Return TRUE also if the page exists in the buffer pool in compressed form only. buf_page_peek_block(): Remove. mutex_enter_fast_func: Remove.	19 years ago
marko	b75e9777dd	branches/zip: buf_pool_page_hash_rebuild(): Rebuild also buf_pool->zip_hash and add compressed-only pages to buf_pool->page_hash. BUF_POOL_ZIP_FOLD(), BUF_POOL_ZIP_FOLD_PTR(), BUF_POOL_ZIP_FOLD_BPAGE(): Macros for computing buf_pool->zip_hash fold values. Make use of these in buf0buddy.c. buf0buddy.c: Replace some ptr == ut_align_down(ptr, ...) in assertions with !ut_align_offset(ptr, ...).	19 years ago
marko	14b99876d0	branches/zip: Allow dirty blocks to be relocated. Allow a transition to BUF_BLOCK_ZIP_DIRTY (discarding the uncompressed page corresponding to a modified compressed page that has not been flushed to disk). buf_page_can_relocate(): New function, modelled after buf_flush_ready_for_replace(). buf_LRU_free_block(): Allow the transition to BUF_BLOCK_ZIP_DIRTY. buf_flush_insert_into_flush_list(): Make the prototype public. buf_buddy_relocate(): Remove an unnecessary switch statement. Use buf_page_can_relocate() instead of buf_flush_ready_for_replace(). buf_page_peek(): Made UNIV_INLINE. Document UNIV_ZIP_DEBUG.	19 years ago
marko	4861c59c59	branches/zip: Fix two bugs in the relocation of block descriptors. Improve diagnostics. buf_buddy_relocate(): Do not assume all small blocks to contain only one buf_page_t object. Require an exact size match, as in the case of compressed pages. buf_relocate(): Relocate buf_pool->LRU_old if needed. Validate the LRU list in debug builds. buf_LRU_block_remove_hashed_page(): Do not overwrite FIL_PAGE_OFFSET or FIL_PAGE_ARCH_LOG_NO_OR_SPACE_ID. The memory will be invalidated in debug builds of buf_buddy_free(). buf0buddy.c: Add assertions for not holding buf_pool->zip_mutex. The calling thread should not be holding any block->mutex, but it might be too time-consuming to assert against that, even #ifdef UNIV_SYNC_DEBUG.	19 years ago
marko	4b903959da	branches/zip: Before calling buf_buddy_alloc() or buf_buddy_free(), release any block mutexes but hold the buf_pool->mutex.	19 years ago
marko	39e30c0b9b	branches/zip: Use the buddy allocator for managing compressed pages. There is something wrong with the management of compressed-only blocks (BUF_BLOCK_ZIP_PAGE). To disable the creation of such blocks, set zip=TRUE in buf_LRU_block_remove_hashed_page(). buf_LRU_block_remove_hashed_page(): Release buf_pool->zip_mutex when freeing a compressed-only page and its control block, with buf_buddy_free(). Adapt callers. buf_LRU_block_free_hashed_page(): Change the parameter type from buf_page_t* to buf_block_t*. buf_LRU_free_block(): Move below the definition of buf_LRU_add_block_low(). Allocate block descriptor for compressed-only blocks. buf_LRU_block_free_non_file_page(): Replace ut_free() with buf_buddy_free(). buf_zip_decompress(): New function, split from buf_page_io_complete(). buf_page_init_for_read(): Do not allocate the compressed page until it is really needed, to avoid the overhead of the buddy allocator. Decompress compressed-only blocks that are needed again. buf_page_create(): Do not allocate the compressed page until it is really needed, to avoid the overhead of the buddy allocator. buf_validate(): Replace some equality tests on the lengths of the LRU list and the flush lists with greater-or-equal tests, since the counted numbers do not include control blocks for compressed-only pages.	19 years ago
marko	afeec303bd	branches/zip: buf_page_get_gen(): When checking a guessed block, also check buf_page_in_file(). This error was introduced in r1082.	19 years ago
marko	7c94b19f54	branches/zip: Minor cleanup. buf_page_get_gen(): Cache the result of fil_space_get_zip_size(). trx_commit_off_kernel(): Eliminate the flag must_flush_log. Initialize lsn = 0 to signify must_flush_log == FALSE. log_flush_margin(): Eliminate the flag do_flush. Initialize lsn = 0 to signify do_flush == FALSE.	19 years ago
marko	c20a0d95af	branches/zip: buf_page_get_gen(): Restore the "break" statement to a "for (;;)" loop that was accidentally removed in r1090.	19 years ago
marko	b42f76a12b	branches/zip: Add the debug function buf_pool_contains_zip() #ifdef UNIV_DEBUG.	19 years ago
marko	a687ccdf74	branches/zip: Minor improvements. buf_LRU_block_remove_hashed_page(): Return the new state of the block. Only call buf_LRU_block_free_hashed_page() if buf_LRU_block_remove_hashed_page() did not return BUF_BLOCK_ZIP_FREE, that is, the control block was not freed. buf_LRU_insert_zip_clean(): New function, for inserting a compressed-only block into buf_pool->zip_clean in the LRU order. buf_LRU_block_remove_hashed_page(), buf_LRU_free_block(): Add the flag "zip" for controlling if the compressed page of an uncompressed page should be removed. For now, assume zip==TRUE. buf_LRU_get_free_block(): Replace the test for UT_LIST_GET_LEN(buf_pool->free) with a test for the return value of buf_LRU_get_free_only(). Do not free zip.data, as it must already have been freed. buf_flush_insert_into_flush_list(), buf_flush_insert_sorted_into_flush_list(): Remove compressed-only blocks from the buf_pool->zip_clean list. buf_flush_remove(): Restore compressed-only blocks to the buf_pool->zip_clean list. buf_page_init_for_read(): Uncompress compressed-only blocks when possible. Currently, there cannot be any compressed-only blocks in the buffer pool; they would be inserted by buf_LRU_free_block(bpage, zip=FALSE).	19 years ago
marko	255a9a878a	branches/zip: Refactor some code for relocating buffer control blocks. buf_relocate(): New function, split from buf_buddy_relocate().	19 years ago
marko	2208d25976	branches/zip: Make use of the previously unused state BUF_BLOCK_MEMORY. buf_LRU_get_free_block(): Document that the block is in the state BUF_BLOCK_READY_FOR_USE. buf_block_alloc(): Change the state of the block to BUF_BLOCK_MEMORY and document it. Replace those invocations of buf_block_alloc() with buf_LRU_get_free_block() where the allocated block is used for buffer pool input and output. However, temporary copies of B-tree pages during reorganization are not used for file I/O, and such blocks are still allocated with buf_block_alloc().	19 years ago
marko	76c69c3610	branches/zip: Add buf_pool->zip_hash for keeping track on pages allocated to the buddy system for allocating compressed pages and their descriptors. buf_buddy_free_block(): New function: Deallocate the buffer frame. buf_buddy_free(), buf_buddy_free_low(): Return void instead of a pointer to a freed buffer frame.	19 years ago
marko	e8babaee1b	branches/zip: Add the first bits of the binary buddy system for allocating compressed pages from the buffer pool. Makefile.am: Add buf0buddy.h, buf0buddy.ic. buf/Makefile.am: Add buf0buddy.c. Introduce the constants BUF_BUDDY_LOW and BUF_BUDDY_SIZES. buf_pool_t: Add zip_mutex and the lists zip_clean and zip_free[]. buf_page_get_mutex(): Return &buf_pool->zip_mutex instead of NULL. buf_buddy_get_offset(), buf_buddy_get(), buf_buddy_get_slot(), buf_buddy_alloc_free(), buf_buddy_alloc_free_low(): New functions.	19 years ago
marko	bae7010964	branches/zip: buf_page_t: Rename free_or_flush_list to list and document the possible list memberships.	19 years ago
marko	db53c1eb92	branches/zip: enum buf_page_state: Add BUF_BLOCK_ZIP_FREE, BUF_BLOCK_ZIP_DIRTY.	19 years ago
marko	cbfc6cce6e	branches/zip: Remove buf_block_t:free_list. Rename buf_page_t:flush_list to free_or_flush_list. The list node pointers can be shared, because a block can never be belong to both lists at the same time.	19 years ago
marko	4286b8286b	branches/zip: Fix compilation errors when UNIV_HOTBACKUP is defined.	19 years ago
marko	6a7be34b6b	branches/zip: Allow some functions to work on compressed-only pages (state == BUF_BLOCK_ZIP_PAGE). Make use of buf_page_in_file() and buf_page_get_mutex(). buf_block_get_newest_modification(): Rename to buf_page_get_newest_modification().	19 years ago
marko	427a413e9c	branches/zip: buf_page_peek_block(): Do not invoke buf_block_get_state() on a NULL pointer. This error was introduced in r1082.	19 years ago
marko	ac694c106a	branches/zip: Move the fields related to the least-recently-used algorithm of the buffer pool from buf_block_t to buf_page_t. Replace some buf_block_t* parameters with buf_page_t*. Add accessor functions.	19 years ago
marko	cf7b6e9153	branches/zip: Move all fields that are not needed in compression or decompression from page_zip_des_t to buf_page_t, because the fields needed in compression are modified without holding the block mutex. All writes to bit-fields sharing a machine word must be protected by the same mutex or rw-lock.	19 years ago
marko	61a48f1e14	branches/zip: Make buf_block_buf_fix_inc() a macro wrapper for buf_block_buf_fix_inc_func() to eliminate an #ifdef in every invocation.	19 years ago
marko	5e9d893508	branches/zip: Replace ib_ulonglong with ib_uint64_t, since we want exactly 64 bits. "long long" might be longer than 64 bits on some systems.	19 years ago
marko	3fe8f14c20	branches/zip: Make buf_pool->page_hash point to buf_page_t instead of buf_block_t. Move the fields "hash" and "file_page_was_freed" from buf_block_t to buf_page_t. buf_page_in_file(): New function, for checking block state in assertions.	19 years ago
marko	7d1227c32b	branches/zip: Allow the code to compile with debugging enabled. This was broken in r1066.	19 years ago
marko	da966628be	branches/zip: Enclose buf_block_t:in_LRU_list in #ifdef UNIV_DEBUG	19 years ago
marko	b239ac283b	branches/zip: Move the page flushing fields from buf_block_t to buf_page_t and page_zip_des_t.	19 years ago
marko	82dfd0f6c7	branches/zip: page_zip_des_t: Rename "size" to "ssize" and reduce the storage size from 16 to 3 bits. page_zip_get_size(), page_zip_set_size(): New functions. Replace direct references to page_zip_des_t:size with calls to buf_block_get_zip_size(), page_zip_get_size(), and page_zip_set_size().	19 years ago
marko	109570b94a	branches/zip: Introduce the unsigned 64-bit data type ib_ulonglong for log sequence numbers, to replace dulint.	19 years ago
marko	b34c10581d	branches/zip: Since r1057, page_zip_des_init() affects buf_block_get_state(). buf_block_init(), buf_page_init_for_backup_restore(): Assign block->page.zip.state after invoking page_zip_des_init(&block->page).	19 years ago
marko	3f4b80c5bd	branches/zip: Replace all references to block->space and block->offset, which should have been replaced in r1057.	19 years ago
marko	dccaa03753	branches/zip: Introduce buf_page_t, a common structure for compressed-only and uncompressed buffer pool pages. buf_block_t: Replace page_zip, space, and offset with buf_page_t page. Replace some integers with bit-fields. enum buf_block_state: Rename to buf_page_state. Add BUF_BLOCK_ZIP_PAGE. page_zip_des_t: Add the field "state". Make the integer fields bit-fields. page_zip_copy(): Document which fields are copied.	19 years ago
marko	7070b7af75	branches/zip: Remove buf_block_t:magic_n. buf_block_state_valid(): New macro for replacing the magic_n check	19 years ago
marko	0cd924d44f	branches/zip: Remove most direct references to block->state. buf_block_set_state(): New function. Also checks the state transitions. buf_block_set_file_page(): New function.	19 years ago
marko	816089073b	branches/zip: Replace most references to block->state, block->offset, and block->space with buf_block_get_state(block), buf_block_get_page_no(block), and buf_block_get_space(block). enum buf_block_state: Replaces the #define'd buf_block_t.state values. buf_block_get_state(): New function. buf_block_get_frame(): Add __attribute__((const)).	19 years ago
marko	5aea6e2a1a	branches/zip: Rebuild buf_pool->page_hash after resizing the buffer pool. buf_pool_page_hash_rebuild(): New function.	19 years ago
marko	a658b00597	branches/zip: When shrinking the buffer pool, disable and purge the adaptive hash index, because it might occupy the chunk we would like to free. TODO: In btr_search_check_free_space_in_heap(), release the block if btr_search_latch is not immediately available. buf_pool_shrink(): Split from buf_pool_resize(). btr_search_disabled: New variable, similar to srv_use_adaptive_hash_indexes that was removed earlier. btr_search_disable(): New function: disable and purge the adaptive hash index. btr_search_enable(): New function: enable the adaptive hash index. ha_clear(): New function: Empty a hash table and free the memory heaps.	19 years ago
marko	aa845361c3	branches/zip: buf_pool_resize(): When shrinking the buffer pool, do not assume that non-file pages are free. After trying to free or flush file pages, do not proceed to buf_chunk_free(), because the calls will temporarily release buf_pool->mutex. Do not flush if there are non-free blocks, because it would not achieve anything.	19 years ago

1 2 3

142 Commits (5c95ec4035dfe0a7baf901492cbf8bf058de7f5b)