I agree with your basic idea, but think that you are reading too much into Goff's book. There is more than one version of panpsychism. His is somewhat limited, a tentative suggestion to avoid the Hard Problem. I 'm guessing that you would be more in favour of full panpsychism, more appropriately called Idealism?