That's expected. For a GPO to be processed, the computer objects in scope must have at minimum read permissions to that GPO.
If the above response helps answer your question, remember to "Accept Answer" so that others in the community facing similar issues can easily find the solution. Your contribution is highly appreciated.
hth
Marcin