Wednesday, March 23, 2011

[TECH] External R-Way Merge sorting.

http://lib-ex-sort.sourceforge.net/ is an external sorting program the following are the limitations I wish to remove before I leave in May. Most of them are engineering changes but are very useful for several algorithms based on external sorting.

  • Currently the size of each key is a constant. We need to remove this by adding a key_header for each key.
  • Use MMAP for integer sorting to avoid copy between user and kernel space.
  • Support for sorting when the data spans multiple files.

No comments: