Commits
Commit:
de557185bc5f862ef773205dd8fb0f659bb4c1c2
From:
Omar Polo <op@omarpolo.com>
Date:
Fri Aug 26 22:03:55 2022 UTC
refactor the parsing into the module change the mscan format string to siplify the parsing, and refactor the parsing code into the module for reuse. pe is an exception in that it doesn't care about the format string, it just need to decide if the current line starts a new thread or not, that's why it doesn't use the newly introduced `parse'. The new format simplifies pe too though.
Commit:
707e3f4a96c2cec1375b104d687026440e1b7abe
From:
Omar Polo <op@omarpolo.com>
Date:
Fri Aug 26 15:19:31 2022 UTC
pe: be less chatty
Commit:
054f3fd48e662b95ddb20d25898866681971de6e
From:
Omar Polo <op@omarpolo.com>
Date:
Thu Aug 25 11:26:48 2022 UTC
pledge and unveil the scripts
Commit:
27363023e413886fbe0851562fd1f02be2467d98
From:
Omar Polo <op@omarpolo.com>
Date:
Thu Aug 25 08:58:12 2022 UTC
parallelize exporting mexp is the slowest part of the pipeline. Try to speed it up by paralellizing it. this adds a `pe' scripts that sits in front on N mexp childs and dispatch threads to them, while still outputting the unchanged lines for mkindex. Unscientific testing has shown that this effectively reduces the time for a full export, even if not linearly. (4 jobs cut the time in half, 8 jobs was just barely faster)
Omar Polo