I have been trying to recreate the calculation for the RSA public key digest, but having no success...
As shown on page 9 of Developing Tamper-Resistant Designs with Ultrascale and Ultrascale+ FPGAs , Figure 2 shows the digest is obtained through calculating the SHA3-384 hash of the public key. After trying this the hash did not match the one provided from the bitgen in the .nky file. RSA Public Modulus Extension in the Authentication Certificate mentions using keccak-384 instead of SHA3-384 to reproduce the non-standard signatures used by Xilinx, which I assume is in reference to the footnote on page 8 of Developing Tamper-Resistant Designs with Ultrascale and Ultrascale+ FPGAs "RSA-2048 and SHA-3 do not currently follow a NIST standard. Contact Xilinx for details.". I have tried using keccak-384 as well, but still no success.
Can anyone point me in the right direction? Thanks