Is the source code of UNETR module using different hidden status data compared to its original publication? #8464
Y-SHI-MxLucid
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I checked and found the source code of UNETR in monai.networks.nets be like this:
and in ViT module source code:
So, I guess the hidden_states_out[3], hidden_states_out[6], hidden_states_out[9] (and together with the normalized final output of entire ViT module) which were used in UNETR is basically the output of transformer block 4, 7, and 10? However, I found in the UNETR original publication that, UNETR indeed uses the output of 3rd, 6th 9th and 12th (the output of ViT) transformer block:
I guess it might be an indexing issue, so maybe you guys in developing team can have a check when possible?
Beta Was this translation helpful? Give feedback.
All reactions