Compress Parsed DB Matrix #12
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Signed-off-by: Anjan Roy <[email protected]>
It uses the fact that the number of the significant bits in each matrix element is much lesser than 32 i.e. the bit-width of each matrix element. Meaning we can compress multiple smaller elements into single matrix element. Signed-off-by: Anjan Roy <[email protected]>
…f compression works correctly Signed-off-by: Anjan Roy <[email protected]>
Signed-off-by: Anjan Roy <[email protected]>
It is not possible to correctly compute decompressed matrix's number of columns just from compressed matrix's number of columns and compression-factor i.e. how many elements are compressed into a single one. Signed-off-by: Anjan Roy <[email protected]>
… as expected Signed-off-by: Anjan Roy <[email protected]>
… transposed database matrix Decompression is performed on the fly. This change should address the memory bandwidth bottleneck issue and open path to better performance for large databases. Signed-off-by: Anjan Roy <[email protected]>
…essed form, after it is transposed Signed-off-by: Anjan Roy <[email protected]>
Signed-off-by: Anjan Roy <[email protected]>
…-len > 16 Signed-off-by: Anjan Roy <[email protected]>
…ngle one Signed-off-by: Anjan Roy <[email protected]>
…k with new fixed compression factor of 2 Signed-off-by: Anjan Roy <[email protected]>
Signed-off-by: Anjan Roy <[email protected]>
Signed-off-by: Anjan Roy <[email protected]>
Based on whether uncompressed number of columns is even or odd, it separates codepath, which results in better performance. Signed-off-by: Anjan Roy <[email protected]>
…e `mat-elem-bit-len` as input anymore Signed-off-by: Anjan Roy <[email protected]>
Signed-off-by: Anjan Roy <[email protected]>
Signed-off-by: Anjan Roy <[email protected]>
Signed-off-by: Anjan Roy <[email protected]>
Signed-off-by: Anjan Roy <[email protected]>
…to make test run faster Signed-off-by: Anjan Roy <[email protected]>
…ve), based on cipher-text-bit-length Signed-off-by: Anjan Roy <[email protected]>
…arity 4 Signed-off-by: Anjan Roy <[email protected]>
Signed-off-by: Anjan Roy <[email protected]>
Signed-off-by: Anjan Roy <[email protected]>
Signed-off-by: Anjan Roy <[email protected]>
… work with all the compression factors Signed-off-by: Anjan Roy <[email protected]>
…t-bit-length Signed-off-by: Anjan Roy <[email protected]>
… database using binary fuse filter Signed-off-by: Anjan Roy <[email protected]>
…ed-matrix multiplication works Signed-off-by: Anjan Roy <[email protected]>
Signed-off-by: Anjan Roy <[email protected]>
Signed-off-by: Anjan Roy <[email protected]>
Signed-off-by: Anjan Roy <[email protected]>
Signed-off-by: Anjan Roy <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
- Reduce memory usage server-side
- Increase PIR throughput