{"id":279,"date":"2024-10-22T01:00:34","date_gmt":"2024-10-22T04:00:34","guid":{"rendered":"https:\/\/suspensao.blog.br\/disbelief\/?p=279"},"modified":"2024-10-30T12:23:12","modified_gmt":"2024-10-30T15:23:12","slug":"implementing-malloc-and-free-splitting-large-blocks","status":"publish","type":"post","link":"https:\/\/suspensao.blog.br\/disbelief\/implementing-malloc-and-free-splitting-large-blocks\/","title":{"rendered":"Implementing malloc() and free() \u2014 splitting large blocks"},"content":{"rendered":"\n

In the previous post of this series<\/a>, we saw how the order in which we choose memory blocks to reuse can lead to greater or lesser memory consumption, and we changed our functions to avoid this waste. But we need to solve another, even more serious, problem: sometimes, a very large memory block can occupy the space that several smaller blocks could use. Consider the case below, where we allocate a large chunk of memory, deallocate it, and then allocate two much smaller blocks:<\/p>\n\n\n\n

void *ptr1 = abmalloc(128);\nvoid *ptr2 = abmalloc(8);\nabfree(ptr1);\nvoid *ptr3 = abmalloc(8);\nvoid *ptr4 = abmalloc(8);<\/code><\/pre>\n\n\n\n
Here, we have a free 128-byte memory block, and when we allocate a block of just 8 bytes, all 128 bytes become unavailable. When we allocate another 8-byte block, the heap needs to grow again. This is not an efficient use of memory.<\/p>\n\n\n\n
There are at least two popular solutions for this case. One, more efficient, is to use bins<\/em><\/a>: lists that group blocks by size. This is a more sophisticated and efficient approach, but more complex. Another option, simpler, is to find a large block and split it into smaller blocks. We’ll follow this approach.<\/p>\n\n\n\n
But remember: simpler doesn’t exactly mean simple \ud83d\ude09<\/p>\n\n\n\n
Initial Refactoring<\/h3>\n\n\n\n
Before we begin, let’s do a small refactoring. Currently, the header_new()<\/code> function does two things: it allocates more memory for a new block and initializes its header, setting the metadata and pointers to the previous block. The part of initializing the header might be useful, so let’s extract it. We’ll create two new functions to improve readability:<\/p>\n\n\n\n
    \n
  • The header_plug()<\/code> function, which “plugs” the initialized block to the previous and next blocks.<\/li>\n\n\n\n
  • The header_init()<\/code> function, which sets the initial values of the block’s metadata (size and availability).<\/li>\n<\/ul>\n\n\n\n
    Here’s how they look:<\/p>\n\n\n\n
    void header_init(Header *header, size_t size, bool available) {\n    header->size = size;\n    header->available = available;\n}\n\nvoid header_plug(Header *header, Header *previous, Header *next) {\n    header->previous = previous;\n    if (previous != NULL) {\n        previous->next = header;\n    }\n    header->next = next;\n    if (next != NULL) {\n        next->previous = header;\n    }\n}<\/code><\/pre>\n\n\n\n
    Now, we just need to modify header_new()<\/code> to use these new functions:<\/p>\n\n\n\n
    Header *header_new(Header *previous, size_t size, bool available) {\n    Header *header = sbrk(sizeof(Header) + size);\n    header_init(header, size, available);\n    header_plug(header, previous, NULL);\n    return header;\n}<\/code><\/pre>\n\n\n\n
    (Additionally, we can remove the line last->previous->next = last;<\/code> from the abmalloc()<\/code> function, since header_plug()<\/code> now takes care of that.)<\/p>\n\n\n\n
    Splitting Blocks<\/h3>\n\n\n\n
    With these tools in hand, let’s create the header_split()<\/code> function. Given a header and a minimum required size, this function splits the memory block into two if the original block is large enough to contain<\/p>\n\n\n\n
      \n
    • the required size,<\/li>\n\n\n\n
    • a new header for the new block, and<\/li>\n\n\n\n
    • a bit of extra memory.<\/li>\n<\/ul>\n\n\n\n
      First, we check if the block is large enough:<\/p>\n\n\n\n
      Header *header_split(Header *header, size_t size) {\n    size_t original_size = header->size;\n    if (original_size >= size + sizeof(Header)) {<\/code><\/pre>\n\n\n\n
      If this condition is met, we split the block. First, we reduce the size of the current block by subtracting the size of a header and the space requested by abmalloc<\/code>:<\/p>\n\n\n\n
      header->size = original_size - size - sizeof(Header);<\/code><\/pre>\n\n\n\n
      This leaves a memory space after the current block, which we’ll use to create the new block. We calculate the pointer for this new block:<\/p>\n\n\n\n
      Header *new_header = header + sizeof(Header) + header->size;<\/code><\/pre>\n\n\n\n
      Now that we have the pointer to the new block, we initialize its header with header_init()<\/code>:<\/p>\n\n\n\n
      header_init(new_header, size, true);<\/code><\/pre>\n\n\n\n
      And we connect the new block to the previous and next blocks using header_plug()<\/code>:<\/p>\n\n\n\n
      header_plug(new_header, header, header->next);<\/code><\/pre>\n\n\n\n
      If the original block was the last one, the new block will now be the last, so we update the last<\/code> pointer:<\/p>\n\n\n\n
      if (header == last) {\n    last = new_header;\n}<\/code><\/pre>\n\n\n\n
      Finally, we return the new block:<\/p>\n\n\n\n
      return new_header;<\/code><\/pre>\n\n\n\n
      If the original block is not large enough, we simply return the original block:<\/p>\n\n\n\n
      } else {\n    return header;\n}\n}<\/code><\/pre>\n\n\n\n
      Updating abmalloc()<\/code><\/h3>\n\n\n\n
      Now, we just need to go back to the abmalloc()<\/code> function, and in the place where we find a usable block, we invoke header_split()<\/code> to try to split it:<\/p>\n\n\n\n
      if (header->available && (header->size >= size)) {\n    header = header_split(header, size);\n    header->available = false;\n    return header + 1;\n}<\/code><\/pre>\n\n\n\n
      If the block can be split, the new block will be returned. Otherwise, the original block will be kept and returned as before.<\/p>\n\n\n\n
      Note on Block Splitting<\/h3>\n\n\n\n
      Notice that we created the new block at the end of the original block. We could have created it at the beginning, but by creating the new used block at the end, the new free block stays closer to older blocks. This way, it will be found first the next time abmalloc()<\/code> is invoked.<\/p>\n\n\n\n
      Splitting large memory blocks is a step forward, but there\u2019s an opposite problem: small memory blocks can cause fragmentation, making larger requests cause the heap to grow. We’ll see how to solve this in the next post.<\/p>\n","protected":false},"excerpt":{"rendered":"
      When implementing malloc(), it is important to consider the size of the allocated blocks. For example, reusing blocks too big for smaller requests  cause memory waste. How to solve that? Let’s see on this post of our series on malloc() and free().<\/p>\n","protected":false},"author":1,"featured_media":280,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"When implementing malloc(), it is important to consider the size of the allocated blocks. For example, reusing blocks too big for smaller requests  cause memory waste. How to solve that? Let's see on this post of our series on malloc() and free().","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","enabled":false},"version":2},"jetpack_post_was_ever_published":false},"categories":[75,76],"tags":[77,82,80,78,47],"class_list":["post-279","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-c","category-linux","tag-c","tag-linux","tag-malloc","tag-memory-management","tag-software-development"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"https:\/\/i0.wp.com\/suspensao.blog.br\/disbelief\/wp-content\/uploads\/2024\/10\/Owner_of_general_store_slicing_baloney_Jarreau_Louisiana_October_1938_crop.jpg?fit=1019%2C768&ssl=1","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p9Ru6q-4v","jetpack-related-posts":[],"_links":{"self":[{"href":"https:\/\/suspensao.blog.br\/disbelief\/wp-json\/wp\/v2\/posts\/279","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/suspensao.blog.br\/disbelief\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/suspensao.blog.br\/disbelief\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/suspensao.blog.br\/disbelief\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/suspensao.blog.br\/disbelief\/wp-json\/wp\/v2\/comments?post=279"}],"version-history":[{"count":2,"href":"https:\/\/suspensao.blog.br\/disbelief\/wp-json\/wp\/v2\/posts\/279\/revisions"}],"predecessor-version":[{"id":308,"href":"https:\/\/suspensao.blog.br\/disbelief\/wp-json\/wp\/v2\/posts\/279\/revisions\/308"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/suspensao.blog.br\/disbelief\/wp-json\/wp\/v2\/media\/280"}],"wp:attachment":[{"href":"https:\/\/suspensao.blog.br\/disbelief\/wp-json\/wp\/v2\/media?parent=279"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/suspensao.blog.br\/disbelief\/wp-json\/wp\/v2\/categories?post=279"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/suspensao.blog.br\/disbelief\/wp-json\/wp\/v2\/tags?post=279"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}