IMO, it can be one of two things and possibly both.
1. The sudden change we had from a wet spring to extreme heat and drought can cause the tree to abort the nuts early to conserve energy.
2. Pests, such as leaf-footed bugs and stink bugs, if they are feeding early, can penetrate the outer...