So, I went and tried all the recommended values which are 0.12, 0.16, 0.2 and 0.28 mm and it might help a bit with the higher quality ones but the top layers always seem to be missing, so I went and tried the limits which are 0.04 and 0.32 mm and I still get the issue.
I'm not sure if it's the curvature of the model because even if the model has the same curvature in a lower layer it works, the issue only seems to affect the top layers.