Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[common] Refactor Protected Files, part 4 #1869

Merged
merged 1 commit into from
Jun 6, 2024

Conversation

dimakuv
Copy link
Contributor

@dimakuv dimakuv commented May 2, 2024

Description of the changes

This commit refactors PF code without changing functionality (part 4 in a series of commits). In particular, this commit re-orders variables, struct definitions, struct fields, typedefs, and macros for readability.

Extracted from #1841 at the request of @mkow.

Note that this PR is based on #1866.

How to test this PR?

N/A.


This change is Reviewable

@dimakuv dimakuv changed the base branch from dimakuv/protected-files-cleanup-part3 to dimakuv/protected-files-cleanup-part1 May 2, 2024 07:42
@mkow mkow force-pushed the dimakuv/protected-files-cleanup-part1 branch from 7ae2335 to 6d2ee63 Compare May 4, 2024 12:02
Base automatically changed from dimakuv/protected-files-cleanup-part1 to master May 4, 2024 16:37
@dimakuv dimakuv force-pushed the dimakuv/protected-files-cleanup-part4 branch from b840177 to 68d66ef Compare May 7, 2024 13:33
Copy link
Member

@mkow mkow left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed 3 of 4 files at r1, 1 of 1 files at r2, all commit messages.
Reviewable status: all files reviewed, 5 unresolved discussions, not enough approvals from maintainers (1 more required), not enough approvals from different teams (1 more required, approved so far: Intel) (waiting on @dimakuv)


common/src/protected_files/protected_files.h line 26 at r2 (raw file):

#define PF_MAC_SIZE 16

/*! Size of the salt used in KDF (Key Derivation Function) */

But this isn't salt, it's key ID? If something, this could be a nonce, but some parts of PF code call it "key ID" instead of nonce?


common/src/protected_files/protected_files_format.h line 41 at r2 (raw file):

// these are all defined as relative to node size, so we can decrease node size in tests
// and have deeper tree

This comment sounded useful IMO.


common/src/protected_files/protected_files_format.h line 110 at r2 (raw file):

    encrypted_node_t encrypted; // encrypted data from storage (bounce buffer)
    union {                     // decrypted data in private memory (plain buffer)

the structure itself has no control where it's located

Code quote:

in private memory (plain buffer)

common/src/protected_files/protected_files_internal.h line 25 at r2 (raw file):

    pf_key_t user_kdk_key; // KDK installed by user of PF (e.g. from Gramine manifest)

    metadata_node_t file_metadata; // plaintext and encrypted metadata from storage (bound buffer)

What does "bound buffer" mean?


common/src/protected_files/protected_files_internal.h line 28 at r2 (raw file):

root MHT node is always needed (for files bigger than 3KB)

So, not always? This comment is confusing.

Copy link
Contributor

@kailun-qin kailun-qin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed 4 of 4 files at r1, all commit messages.
Reviewable status: all files reviewed, 9 unresolved discussions, not enough approvals from maintainers (1 more required), not enough approvals from different teams (1 more required, approved so far: Intel) (waiting on @dimakuv and @mkow)


common/src/protected_files/protected_files.h line 26 at r2 (raw file):

Previously, mkow (Michał Kowalczyk) wrote…

But this isn't salt, it's key ID? If something, this could be a nonce, but some parts of PF code call it "key ID" instead of nonce?

+1, as the key derivation follows NIST SP 800-108 (as stated in the comment of kdf_input_t), the unique randomized key ID aligns more closely with the nonce in theContext field


common/src/protected_files/protected_files_format.h line 34 at r2 (raw file):

static_assert(MD_USER_DATA_SIZE == 3072, "bad struct size");

#define MAX_PAGES_IN_CACHE 48

what about just MAX_NODES_IN_CACHE?

Code quote:

#define MAX_PAGES_IN_CACHE 48

common/src/protected_files/protected_files_format.h line 116 at r2 (raw file):

} file_node_t;

// input materials for the KDF construction of NIST-SP800-108

since we mention NIST standard here, can we align all comments of fields w/ its terminologies? e.g., index -- conter

Code quote:

NIST-SP800-108

common/src/protected_files/protected_files_format.h line 120 at r2 (raw file):

    uint32_t index;             // always "1"
    char label[MAX_LABEL_SIZE]; // must be NULL terminated
    pf_keyid_t nonce;           // salt for key derivation from KDK, stored in metadata node

similar above

Code quote:

salt

common/src/protected_files/protected_files_internal.h line 30 at r2 (raw file):

    file_node_t root_mht; // root MHT node is always needed (for files bigger than 3KB)

    lruc_context_t* cache; // up to MAX_PAGES_IN_CACHE nodes are cached for each file

ditto

Code quote:

MAX_PAGES_IN_CACHE

@mkow mkow requested a review from kailun-qin May 19, 2024 17:51
Copy link
Member

@mkow mkow left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewable status: all files reviewed, 9 unresolved discussions, not enough approvals from maintainers (1 more required), not enough approvals from different teams (1 more required, approved so far: Intel) (waiting on @dimakuv and @kailun-qin)


common/src/protected_files/protected_files_format.h line 34 at r2 (raw file):

Previously, kailun-qin (Kailun Qin) wrote…

what about just MAX_NODES_IN_CACHE?

+1

Copy link
Contributor Author

@dimakuv dimakuv left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewable status: 0 of 5 files reviewed, 9 unresolved discussions, not enough approvals from maintainers (1 more required), not enough approvals from different teams (1 more required, approved so far: Intel), "fixup! " found in commit messages' one-liners (waiting on @kailun-qin and @mkow)


common/src/protected_files/protected_files.h line 26 at r2 (raw file):

Previously, kailun-qin (Kailun Qin) wrote…

+1, as the key derivation follows NIST SP 800-108 (as stated in the comment of kdf_input_t), the unique randomized key ID aligns more closely with the nonce in theContext field

Done, using "nonce" now.

"Key ID" is a wrong/unused word in the Protected Files codebase. At least I don't know what it's supposed to mean.

@kailun-qin is right, my term "salt" is also incorrect. The NIST SP 800-108 standard uses the term "nonce", so let's call everything the nonce.

@mkow Please notice that a follow up PR (not yet extracted from #1841, because I'm waiting for this PR to be finalized and merged, otherwise there will be too complex rebases) will fix the rest of the comments in the Protected Files codebase.


common/src/protected_files/protected_files_format.h line 34 at r2 (raw file):

Previously, mkow (Michał Kowalczyk) wrote…

+1

Done.


common/src/protected_files/protected_files_format.h line 41 at r2 (raw file):

Previously, mkow (Michał Kowalczyk) wrote…

This comment sounded useful IMO.

But we never changed the sizes, and we don't plan to change the sizes. I don't see a point in this comment. I think our 4KB node size is now fixed in stone (especially after we modified our Slab allocator to be compatible with 4KB-nodes).


common/src/protected_files/protected_files_format.h line 110 at r2 (raw file):

Previously, mkow (Michał Kowalczyk) wrote…

the structure itself has no control where it's located

Done, rephrased


common/src/protected_files/protected_files_format.h line 116 at r2 (raw file):

Previously, kailun-qin (Kailun Qin) wrote…

since we mention NIST standard here, can we align all comments of fields w/ its terminologies? e.g., index -- conter

Done.


common/src/protected_files/protected_files_format.h line 120 at r2 (raw file):

Previously, kailun-qin (Kailun Qin) wrote…

similar above

Done.


common/src/protected_files/protected_files_internal.h line 25 at r2 (raw file):

Previously, mkow (Michał Kowalczyk) wrote…

What does "bound buffer" mean?

Done. Typo.


common/src/protected_files/protected_files_internal.h line 28 at r2 (raw file):

Previously, mkow (Michał Kowalczyk) wrote…

root MHT node is always needed (for files bigger than 3KB)

So, not always? This comment is confusing.

Done.


common/src/protected_files/protected_files_internal.h line 30 at r2 (raw file):

Previously, kailun-qin (Kailun Qin) wrote…

ditto

Done.

Copy link
Member

@mkow mkow left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed 5 of 5 files at r3, all commit messages.
Reviewable status: all files reviewed, 4 unresolved discussions, "fixup! " found in commit messages' one-liners (waiting on @kailun-qin)


common/src/protected_files/protected_files_internal.h line 25 at r2 (raw file):

Previously, dimakuv (Dmitrii Kuvaiskii) wrote…

Done. Typo.

Ah, lol.

Copy link
Contributor

@kailun-qin kailun-qin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed 5 of 5 files at r3, all commit messages.
Reviewable status: all files reviewed, all discussions resolved, "fixup! " found in commit messages' one-liners

@dimakuv dimakuv force-pushed the dimakuv/protected-files-cleanup-part4 branch from 83bd239 to 371ad25 Compare June 4, 2024 05:41
@dimakuv
Copy link
Contributor Author

dimakuv commented Jun 4, 2024

Jenkins, test this please

@dimakuv
Copy link
Contributor Author

dimakuv commented Jun 4, 2024

Jenkins, test this please

Copy link
Member

@mkow mkow left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed all commit messages.
Reviewable status: :shipit: complete! all files reviewed, all discussions resolved

Copy link
Contributor

@kailun-qin kailun-qin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed all commit messages.
Reviewable status: :shipit: complete! all files reviewed, all discussions resolved

This commit refactors PF code without changing functionality (part 4 in
a series of commits). In particular, this commit re-orders variables,
struct definitions and fields, typedefs, and macros for readability.

Signed-off-by: Dmitrii Kuvaiskii <[email protected]>
@dimakuv dimakuv force-pushed the dimakuv/protected-files-cleanup-part4 branch from 371ad25 to 77115dd Compare June 5, 2024 16:41
Copy link
Member

@mkow mkow left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed all commit messages.
Reviewable status: :shipit: complete! all files reviewed, all discussions resolved

Copy link
Contributor

@kailun-qin kailun-qin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed all commit messages.
Reviewable status: :shipit: complete! all files reviewed, all discussions resolved

@dimakuv dimakuv merged commit 77115dd into master Jun 6, 2024
18 of 20 checks passed
@dimakuv dimakuv deleted the dimakuv/protected-files-cleanup-part4 branch June 6, 2024 07:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants